| 2024-11-23
      
      § | 
    
  | 14:58 | <taavi> | removed broken records for re-created VMs in .eqiad.wmflabs zone | [admin] | 
            
  | 12:08 | <btullis@cumin1002> | END (FAIL) - Cookbook sre.hadoop.roll-restart-masters (exit_code=99) restart masters for Hadoop test cluster: Restart of jvm daemons. | [production] | 
            
  | 12:05 | <btullis@cumin1002> | START - Cookbook sre.hadoop.roll-restart-masters restart masters for Hadoop test cluster: Restart of jvm daemons. | [production] | 
            
  | 08:34 | <wmbot~bsadowski1@tools-bastion-13> | Restarted StewardBot/SULWatcher because of a connection loss | [tools.stewardbots] | 
            
  | 07:27 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-builder (T358225) | [tools] | 
            
  | 07:21 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-builder (T358225) | [tools] | 
            
  | 07:20 | <raymond-ndibe@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-builder (T358225) | [toolsbeta] | 
            
  | 07:14 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-builder (T358225) | [toolsbeta] | 
            
  | 02:15 | <urandom> | decommissioning Cassandra/restbase2023-{a,b,c} — T380236 | [production] | 
            
  | 00:41 | <AntiComposite> | CVNBot9 load ka.wikisource s:ka: (T363243) | [cvn] | 
            
  | 00:38 | <AntiComposite> | CVNBot8 load tcy.wikisource s:tcy: (T378471) | [cvn] | 
            
  | 00:37 | <AntiComposite> | CVNBot7 load tcy.wiktionary wikt:tcy: (T378463) | [cvn] | 
            
  | 00:25 | <AntiComposite> | Upgrade CVNBot29 to v4.0.4 | [cvn] | 
            
  | 00:25 | <AntiComposite> | Upgrade CVNBot28 to v4.0.4 | [cvn] | 
            
  | 00:24 | <AntiComposite> | Upgrade CVNBot27 to v4.0.4 | [cvn] | 
            
  | 00:24 | <AntiComposite> | Upgrade CVNBot26 to v4.0.4 | [cvn] | 
            
  | 00:23 | <AntiComposite> | Upgrade CVNBot25 to v4.0.4 | [cvn] | 
            
  | 00:23 | <AntiComposite> | Upgrade CVNBot24 to v4.0.4 | [cvn] | 
            
  | 00:22 | <AntiComposite> | Upgrade CVNBot23 to v4.0.4 | [cvn] | 
            
  | 00:22 | <AntiComposite> | Upgrade CVNBot22 to v4.0.4 | [cvn] | 
            
  | 00:21 | <AntiComposite> | Upgrade CVNBot19 to v4.0.4 | [cvn] | 
            
  | 00:21 | <AntiComposite> | Upgrade CVNBot17 to v4.0.4 | [cvn] | 
            
  | 00:20 | <AntiComposite> | Upgrade CVNBot16 to v4.0.4 | [cvn] | 
            
  | 00:20 | <AntiComposite> | Upgrade CVNBot10 to v4.0.4 | [cvn] | 
            
  | 00:19 | <AntiComposite> | Upgrade CVNBot9 to v4.0.4 | [cvn] | 
            
  | 00:19 | <AntiComposite> | Upgrade CVNBot8 to v4.0.4 | [cvn] | 
            
  | 00:19 | <AntiComposite> | Upgrade CVNBot7 to v4.0.4 | [cvn] | 
            
  | 00:17 | <AntiComposite> | Upgrade CVNBot6 to v4.0.4 | [cvn] | 
            
  
    | 2024-11-22
      
      § | 
    
  | 23:52 | <AntiComposite> | Upgrade CVNBot21 to v4.0.4 | [cvn] | 
            
  | 23:51 | <AntiComposite> | Upgrade CVNBot20 to v4.0.4 | [cvn] | 
            
  | 23:51 | <AntiComposite> | Upgrade CVNBot18 to v4.0.4 | [cvn] | 
            
  | 23:51 | <AntiComposite> | Upgrade CVNBot15 to v4.0.4 | [cvn] | 
            
  | 23:50 | <AntiComposite> | Upgrade CVNBot14 to v4.0.4 | [cvn] | 
            
  | 23:50 | <AntiComposite> | Upgrade CVNBot13 to v4.0.4 | [cvn] | 
            
  | 23:49 | <AntiComposite> | Upgrade CVNBot12 to v4.0.4 | [cvn] | 
            
  | 23:48 | <AntiComposite> | Upgrade CVNBot11 to v4.0.4 | [cvn] | 
            
  | 23:47 | <AntiComposite> | Upgrade CVNBot5 to v4.0.4 | [cvn] | 
            
  | 23:45 | <AntiComposite> | Upgrade CVNBot3 to v4.0.4 | [cvn] | 
            
  | 23:44 | <AntiComposite> | Upgrade CVNBot2 to v4.0.4 | [cvn] | 
            
  | 23:41 | <AntiComposite> | Upgrade CVNBot1 to v4.0.4 | [cvn] | 
            
  | 23:32 | <AntiComposite> | Upgrade CVNBot4 to v4.0.4 | [cvn] | 
            
  | 21:51 | <bking@cumin2002> | conftool action : set/pooled=false; selector: dnsdisc=wdqs-internal-scholarly,name=eqiad | [production] | 
            
  | 21:37 | <bking@cumin2002> | conftool action : set/pooled=yes; selector: name=wdqs2026.codfw.wmnet | [production] | 
            
  | 21:37 | <bking@cumin2002> | conftool action : set/pooled=yes; selector: name=wdqs2018.codfw.wmnet | [production] | 
            
  | 21:33 | <bking@cumin2002> | conftool action : set/weight=1; selector: name=wdqs2026.codfw.wmnet | [production] | 
            
  | 21:33 | <bking@cumin2002> | conftool action : set/weight=1; selector: name=wdqs2018.codfw.wmnet | [production] | 
            
  | 21:25 | <bking@cumin2002> | conftool action : set/pooled=yes:weight=1; selector: cluster=wdqs-scholarly,service=wdqs-internal-scholarly | [production] | 
            
  | 21:25 | <bking@cumin2002> | conftool action : set/pooled=yes:weight=1; selector: cluster=wdqs-main,service=wdqs-internal-main | [production] | 
            
  | 20:59 | <herron@cumin1002> | END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host aux-k8s-worker2005.codfw.wmnet | [production] |