| 2024-11-21
      
      ยง | 
    
  | 22:35 | <herron@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-etcd2003.codfw.wmnet - herron@cumin1002" | [production] | 
            
  | 22:35 | <herron@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM aux-k8s-etcd2003.codfw.wmnet - herron@cumin1002" | [production] | 
            
  | 22:32 | <herron@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 22:32 | <herron@cumin1002> | START - Cookbook sre.ganeti.makevm for new host aux-k8s-etcd2003.codfw.wmnet | [production] | 
            
  | 22:25 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1094000|Add tracking categories for {{#chart:}} usage (T369684)]] | [production] | 
            
  | 22:25 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1092334|Disable various extensions when using the shared login domain (T373737)]] (duration: 18m 16s) | [production] | 
            
  | 22:22 | <jhancock@cumin2002> | START - Cookbook sre.hosts.reimage for host es2041.codfw.wmnet with OS bookworm | [production] | 
            
  | 22:18 | <brennen@deploy2002> | tgr, brennen: Continuing with sync | [production] | 
            
  | 22:10 | <brennen@deploy2002> | tgr, brennen: Backport for [[gerrit:1092334|Disable various extensions when using the shared login domain (T373737)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:06 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1092334|Disable various extensions when using the shared login domain (T373737)]] | [production] | 
            
  | 22:05 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1094047|Revert "Reduce number of bucketsizes for MediaViewer (group0)" (T372165)]] (duration: 10m 34s) | [production] | 
            
  | 21:58 | <brennen@deploy2002> | brennen: Continuing with sync | [production] | 
            
  | 21:58 | <brennen@deploy2002> | brennen: Backport for [[gerrit:1094047|Revert "Reduce number of bucketsizes for MediaViewer (group0)" (T372165)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:54 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1094047|Revert "Reduce number of bucketsizes for MediaViewer (group0)" (T372165)]] | [production] | 
            
  | 21:51 | <brennen@deploy2002> | Sync cancelled. | [production] | 
            
  | 21:42 | <brennen@deploy2002> | brennen, tgr, simon04: Backport for [[gerrit:1079640|Reduce number of bucketsizes for MediaViewer (group0) (T372165)]], [[gerrit:1093961|Set 'remember' central session object field when recreating (T379254 T372702)]], [[gerrit:1093962|Use cookie to access central session when local session expired]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:38 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1079640|Reduce number of bucketsizes for MediaViewer (group0) (T372165)]], [[gerrit:1093961|Set 'remember' central session object field when recreating (T379254 T372702)]], [[gerrit:1093962|Use cookie to access central session when local session expired]] | [production] | 
            
  | 21:36 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1093960|Enable Skin-Codex logging (T375287)]] (duration: 15m 53s) | [production] | 
            
  | 21:29 | <brennen@deploy2002> | brennen, jdlrobson: Continuing with sync | [production] | 
            
  | 21:26 | <brennen@deploy2002> | brennen, jdlrobson: Backport for [[gerrit:1093960|Enable Skin-Codex logging (T375287)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:20 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1093960|Enable Skin-Codex logging (T375287)]] | [production] | 
            
  | 21:19 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1090968|Enable AutoModerator on afwiki (T376597)]] (duration: 13m 50s) | [production] | 
            
  | 21:12 | <brennen@deploy2002> | kgraessle, brennen: Continuing with sync | [production] | 
            
  | 21:10 | <brennen@deploy2002> | kgraessle, brennen: Backport for [[gerrit:1090968|Enable AutoModerator on afwiki (T376597)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:05 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1090968|Enable AutoModerator on afwiki (T376597)]] | [production] | 
            
  | 20:46 | <tgr|away> | T378289 running mwscript-k8s -f --comment="T378289" -- extensions/CentralAuth/maintenance/attachAccount.php --wiki=testwiki --wiki-user-list T378289-accounts-to-attach.tsv | [production] | 
            
  | 20:43 | <lucaswerkmeister> | add toolforge-standards-committee as maintainer for processing of T380537 | [tools.bullseye] | 
            
  | 20:24 | <sukhe@puppetserver1001> | conftool action : set/pooled=yes; selector: name=cp2038.codfw.wmnet [reason: DIMM replaced, T308459] | [production] | 
            
  | 20:20 | <sukhe> | force agent on cp2038 | [production] | 
            
  | 19:31 | <gmodena@deploy2002> | Finished deploy [analytics/refinery@199401a] (hadoop-test): Ad-hoc deployment TEST [analytics/refinery@199401a6] (duration: 03m 45s) | [production] | 
            
  | 19:27 | <gmodena@deploy2002> | Started deploy [analytics/refinery@199401a] (hadoop-test): Ad-hoc deployment TEST [analytics/refinery@199401a6] | [production] | 
            
  | 19:07 | <gmodena@deploy2002> | Finished deploy [analytics/refinery@199401a] (thin): Ad-hoc deployment THIN [analytics/refinery@199401a6] (duration: 05m 37s) | [production] | 
            
  | 19:01 | <gmodena@deploy2002> | Started deploy [analytics/refinery@199401a] (thin): Ad-hoc deployment THIN [analytics/refinery@199401a6] | [production] | 
            
  | 18:57 | <gmodena@deploy2002> | Finished deploy [analytics/refinery@199401a]: Ad-hoc deployment [analytics/refinery@199401a6] (duration: 14m 08s) | [production] | 
            
  | 18:56 | <cdanis@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1093983|Follow-up fix for Charts enable on commons/test2 (T379689)]] (duration: 11m 29s) | [production] | 
            
  | 18:49 | <cdanis@deploy2002> | cdanis, bvibber: Continuing with sync | [production] | 
            
  | 18:49 | <cdanis@deploy2002> | cdanis, bvibber: Backport for [[gerrit:1093983|Follow-up fix for Charts enable on commons/test2 (T379689)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 18:45 | <cdanis@deploy2002> | Started scap sync-world: Backport for [[gerrit:1093983|Follow-up fix for Charts enable on commons/test2 (T379689)]] | [production] | 
            
  | 18:43 | <gmodena@deploy2002> | Started deploy [analytics/refinery@199401a]: Ad-hoc deployment [analytics/refinery@199401a6] | [production] | 
            
  | 18:42 | <Reedy> | Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1093981 T380524 | [releng] | 
            
  | 18:21 | <cdanis@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1091328|Enabling Charts on commons+test2 (T379689)]] (duration: 14m 05s) | [production] | 
            
  | 18:16 | <jayme@cumin2002> | conftool action : set/pooled=yes; selector: name=kubestage200[34].codfw.wmnet | [production] | 
            
  | 18:15 | <jayme@cumin2002> | conftool action : set/weight=10; selector: name=kubestage200[34].codfw.wmnet | [production] | 
            
  | 18:13 | <cdanis@deploy2002> | cdanis, bvibber: Continuing with sync | [production] | 
            
  | 18:12 | <cdanis@deploy2002> | cdanis, bvibber: Backport for [[gerrit:1091328|Enabling Charts on commons+test2 (T379689)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 18:10 | <sukhe> | running puppet on A:cp to resolve failed puppet run | [production] | 
            
  | 18:10 | <sukhe> | sudo cumin -b11 'A:cp' 'run-puppet-agent | [production] | 
            
  | 18:09 | <sukhe@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on cp2038.codfw.wmnet with reason: DIMM replacement in progress | [production] | 
            
  | 18:09 | <sukhe@cumin1002> | START - Cookbook sre.hosts.downtime for 1:00:00 on cp2038.codfw.wmnet with reason: DIMM replacement in progress | [production] | 
            
  | 18:07 | <cdanis@deploy2002> | Started scap sync-world: Backport for [[gerrit:1091328|Enabling Charts on commons+test2 (T379689)]] | [production] |