| 
      
        2024-11-12
      
      ยง
     | 
  
    
  | 21:28 | 
  <ebysans@deploy2002> | 
  Finished deploy [airflow-dags/analytics@58d7b82]: (no justification provided) (duration: 03m 50s) | 
  [production] | 
            
  | 21:27 | 
  <SandraEbele_> | 
  deploying airflow as part of weekly deployment train | 
  [production] | 
            
  | 21:27 | 
  <urbanecm@deploy2002> | 
  Finished scap sync-world: Backport for [[gerrit:1088770|Fix warning about missing central account for temp users (T378289)]], [[gerrit:1088771|Check session provider when autocreating (T378289)]] (duration: 16m 11s) | 
  [production] | 
            
  | 21:25 | 
  <ebysans@deploy2002> | 
  Started deploy [airflow-dags/analytics@58d7b82]: (no justification provided) | 
  [production] | 
            
  | 21:23 | 
  <SandraEbele_> | 
  Deployed refinery using scap, then deployed onto hdfs | 
  [production] | 
            
  | 21:22 | 
  <urbanecm@deploy2002> | 
  urbanecm, tgr: Continuing with sync | 
  [production] | 
            
  | 21:22 | 
  <jhathaway@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host ms-be2082.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 21:13 | 
  <urbanecm@deploy2002> | 
  urbanecm, tgr: Backport for [[gerrit:1088770|Fix warning about missing central account for temp users (T378289)]], [[gerrit:1088771|Check session provider when autocreating (T378289)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 21:11 | 
  <urbanecm@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1088770|Fix warning about missing central account for temp users (T378289)]], [[gerrit:1088771|Check session provider when autocreating (T378289)]] | 
  [production] | 
            
  | 21:09 | 
  <urbanecm@deploy2002> | 
  Finished scap sync-world: Backport for [[gerrit:1090550|Revert^2 "[CirrusSearch] testwiki: enable offloading weighted tags via EventBus" (T378983)]] (duration: 07m 18s) | 
  [production] | 
            
  | 21:04 | 
  <ebysans@deploy2002> | 
  Finished deploy [analytics/refinery@113ea5a] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@113ea5ac] (duration: 04m 09s) | 
  [production] | 
            
  | 21:02 | 
  <urbanecm@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1090550|Revert^2 "[CirrusSearch] testwiki: enable offloading weighted tags via EventBus" (T378983)]] | 
  [production] | 
            
  | 20:59 | 
  <ebysans@deploy2002> | 
  Started deploy [analytics/refinery@113ea5a] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@113ea5ac] | 
  [production] | 
            
  | 20:59 | 
  <ebysans@deploy2002> | 
  Finished deploy [analytics/refinery@113ea5a] (thin): Regular analytics weekly train THIN [analytics/refinery@113ea5ac] (duration: 04m 54s) | 
  [production] | 
            
  | 20:54 | 
  <ebysans@deploy2002> | 
  Started deploy [analytics/refinery@113ea5a] (thin): Regular analytics weekly train THIN [analytics/refinery@113ea5ac] | 
  [production] | 
            
  | 20:53 | 
  <ebysans@deploy2002> | 
  Finished deploy [analytics/refinery@113ea5a]: Regular analytics weekly train [analytics/refinery@113ea5ac] (duration: 07m 37s) | 
  [production] | 
            
  | 20:49 | 
  <isaranto@deploy2002> | 
  helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . | 
  [production] | 
            
  | 20:46 | 
  <ebysans@deploy2002> | 
  Started deploy [analytics/refinery@113ea5a]: Regular analytics weekly train [analytics/refinery@113ea5ac] | 
  [production] | 
            
  | 19:42 | 
  <jayme@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for wikikube-ctrl1001.eqiad.wmnet | 
  [production] | 
            
  | 19:42 | 
  <jayme@cumin2002> | 
  START - Cookbook sre.hosts.remove-downtime for wikikube-ctrl1001.eqiad.wmnet | 
  [production] | 
            
  | 19:42 | 
  <jayme@cumin2002> | 
  conftool action : set/pooled=yes; selector: name=wikikube-ctrl1001.* | 
  [production] | 
            
  | 19:40 | 
  <jayme@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-ctrl1001.eqiad.wmnet with OS bookworm | 
  [production] | 
            
  | 19:16 | 
  <jayme@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-ctrl1001.eqiad.wmnet with reason: host reimage | 
  [production] | 
            
  | 19:14 | 
  <brennen@deploy2002> | 
  rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.3  refs T375662 | 
  [production] | 
            
  | 19:13 | 
  <jayme@cumin2002> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-ctrl1001.eqiad.wmnet with reason: host reimage | 
  [production] | 
            
  | 19:06 | 
  <brennen> | 
  1.44.0-wmf.3 train status (T375662): no current blockers, rolling to group0. | 
  [production] | 
            
  | 18:55 | 
  <moritzm> | 
  installing libarchive security updates | 
  [production] | 
            
  | 18:55 | 
  <jayme@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host wikikube-ctrl1001.eqiad.wmnet with OS bookworm | 
  [production] | 
            
  | 18:31 | 
  <swfrench@deploy2002> | 
  Finished scap sync-world: Backport for [[gerrit:1087604|Add title-case mapping to support migration to PHP 8.1 (T372603)]] (duration: 18m 48s) | 
  [production] | 
            
  | 18:25 | 
  <swfrench@deploy2002> | 
  swfrench: Continuing with sync | 
  [production] | 
            
  | 18:24 | 
  <swfrench-wmf> | 
  verified consistent 7.4-like title-case behavior in 7.4- and 8.1-based images, verified expected treatment of eszett in mwdebug - T372603 | 
  [production] | 
            
  | 18:19 | 
  <swfrench@deploy2002> | 
  swfrench: Backport for [[gerrit:1087604|Add title-case mapping to support migration to PHP 8.1 (T372603)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 18:12 | 
  <swfrench@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1087604|Add title-case mapping to support migration to PHP 8.1 (T372603)]] | 
  [production] | 
            
  | 18:08 | 
  <jayme@cumin2002> | 
  END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-ctrl1001.eqiad.wmnet with OS bookworm | 
  [production] | 
            
  | 18:01 | 
  <moritzm> | 
  remove ganeti1012 from active ganeti nodes T378921 | 
  [production] | 
            
  | 17:59 | 
  <swfrench@deploy2002> | 
  helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply | 
  [production] | 
            
  | 17:57 | 
  <swfrench@deploy2002> | 
  helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply | 
  [production] | 
            
  | 17:57 | 
  <swfrench@deploy2002> | 
  helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply | 
  [production] | 
            
  | 17:56 | 
  <swfrench@deploy2002> | 
  helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply | 
  [production] | 
            
  | 17:35 | 
  <swfrench@deploy2002> | 
  helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply | 
  [production] | 
            
  | 17:34 | 
  <swfrench@deploy2002> | 
  helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply | 
  [production] | 
            
  | 17:26 | 
  <brennen@deploy2002> | 
  Finished scap sync-world: testwikis to 1.44.0-wmf.3  refs T375662 (duration: 45m 29s) | 
  [production] | 
            
  | 16:55 | 
  <jgiannelos@deploy2002> | 
  helmfile [codfw] DONE helmfile.d/services/push-notifications: apply | 
  [production] | 
            
  | 16:54 | 
  <jgiannelos@deploy2002> | 
  helmfile [codfw] START helmfile.d/services/push-notifications: apply | 
  [production] | 
            
  | 16:54 | 
  <jgiannelos@deploy2002> | 
  helmfile [eqiad] DONE helmfile.d/services/push-notifications: apply | 
  [production] | 
            
  | 16:53 | 
  <jgiannelos@deploy2002> | 
  helmfile [eqiad] START helmfile.d/services/push-notifications: apply | 
  [production] | 
            
  | 16:48 | 
  <jayme@cumin2002> | 
  START - Cookbook sre.hosts.reimage for host wikikube-ctrl1001.eqiad.wmnet with OS bookworm | 
  [production] | 
            
  | 16:47 | 
  <jayme@cumin2002> | 
  END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-ctrl1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | 
  [production] | 
            
  | 16:40 | 
  <brennen@deploy2002> | 
  Started scap sync-world: testwikis to 1.44.0-wmf.3  refs T375662 | 
  [production] | 
            
  | 16:39 | 
  <jayme@cumin2002> | 
  START - Cookbook sre.hosts.provision for host wikikube-ctrl1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | 
  [production] |