| 2024-12-17
      
      ยง | 
    
  | 20:23 | <eevans@cumin1002> | END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:restbase-codfw: Upgrading to Cassandra 4.1.7 โ T380420 - eevans@cumin1002 | [production] | 
            
  | 20:20 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 20:17 | <amastilovic@deploy2002> | helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply | [production] | 
            
  | 19:37 | <James_F> | Docker: [ajv, sonar-scanner] Re-platform to Node 20 | [releng] | 
            
  | 19:29 | <dancy@deploy2002> | rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.8  refs T375667 | [production] | 
            
  | 19:25 | <James_F> | Zuul: Switch from generic-node18 to legacy-node18 jobs | [releng] | 
            
  | 19:20 | <James_F> | Zuul: Fold last two node18 templates into their users | [releng] | 
            
  | 19:09 | <swfrench@deploy2002> | Finished scap sync-world: Deployment to populate remaining migration release files - T377040 (duration: 11m 35s) | [production] | 
            
  | 18:57 | <swfrench@deploy2002> | Started scap sync-world: Deployment to populate remaining migration release files - T377040 | [production] | 
            
  | 18:42 | <swfrench@deploy2002> | helmfile [codfw] DONE helmfile.d/services/mw-web: apply | [production] | 
            
  | 18:42 | <swfrench@deploy2002> | helmfile [codfw] START helmfile.d/services/mw-web: apply | [production] | 
            
  | 18:41 | <swfrench@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/mw-web: apply | [production] | 
            
  | 18:41 | <swfrench@deploy2002> | helmfile [eqiad] START helmfile.d/services/mw-web: apply | [production] | 
            
  | 18:40 | <swfrench@deploy2002> | helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply | [production] | 
            
  | 18:40 | <swfrench@deploy2002> | helmfile [codfw] START helmfile.d/services/mw-parsoid: apply | [production] | 
            
  | 18:39 | <bd808> | Setting PHP 8.1 hiera config at the global level via Horizon (T378752) | [releng] | 
            
  | 18:39 | <swfrench@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply | [production] | 
            
  | 18:39 | <swfrench@deploy2002> | helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply | [production] | 
            
  | 18:37 | <swfrench@deploy2002> | helmfile [codfw] DONE helmfile.d/services/mw-jobrunner: apply | [production] | 
            
  | 18:37 | <swfrench@deploy2002> | helmfile [codfw] START helmfile.d/services/mw-jobrunner: apply | [production] | 
            
  | 18:36 | <swfrench@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/mw-jobrunner: apply | [production] | 
            
  | 18:36 | <swfrench@deploy2002> | helmfile [eqiad] START helmfile.d/services/mw-jobrunner: apply | [production] | 
            
  | 18:34 | <swfrench@deploy2002> | helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 18:34 | <swfrench@deploy2002> | helmfile [codfw] START helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 18:32 | <swfrench@deploy2002> | helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 18:32 | <swfrench@deploy2002> | helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply | [production] | 
            
  | 18:25 | <rzl@deploy2002> | Finished scap sync-world: https://gerrit.wikimedia.org/r/1100530, 1100531, 1100532, 1100533 (duration: 22m 25s) | [production] | 
            
  | 18:24 | <brennen> | attempting another update of development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/69 | [releng] | 
            
  | 18:20 | <rzl@deploy2002> | rzl: Continuing with sync | [production] | 
            
  | 18:20 | <rzl@deploy2002> | rzl: https://gerrit.wikimedia.org/r/1100530, 1100531, 1100532, 1100533 synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 18:11 | <eevans@cumin1002> | START - Cookbook sre.cassandra.roll-restart for nodes matching A:restbase-codfw: Upgrading to Cassandra 4.1.7 โ T380420 - eevans@cumin1002 | [production] | 
            
  | 18:04 | <rzl@deploy2002> | Started scap sync-world: https://gerrit.wikimedia.org/r/1100530, 1100531, 1100532, 1100533 | [production] | 
            
  | 17:46 | <eevans@cumin1002> | END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:restbase-eqiad: Upgrading to Cassandra 4.1.7 โ T380420 - eevans@cumin1002 | [production] | 
            
  | 17:43 | <bd808> | Doing in-place PHP 8.1 upgrade on deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud (T378752) | [releng] | 
            
  | 17:42 | <bd808> | Doing in-place PHP 8.1 upgrade on deployment-mediawiki13.deployment-prep.eqiad1.wikimedia.cloud (T378752) | [releng] | 
            
  | 17:30 | <hnowlan@deploy1003> | helmfile [codfw] DONE helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 17:30 | <hnowlan@deploy1003> | helmfile [codfw] START helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 17:30 | <hnowlan@deploy1003> | helmfile [eqiad] DONE helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 17:30 | <hnowlan@deploy1003> | helmfile [eqiad] START helmfile.d/services/mw-videoscaler: apply | [production] | 
            
  | 17:27 | <bd808> | Doing in-place PHP 8.1 upgrade on deployment-mediawiki13.deployment-prep.eqiad1.wikimedia.cloud (T378752) | [releng] | 
            
  | 17:27 | <hashar> | gerrit set-account 6691 --inactive # T382028 | [releng] | 
            
  | 17:27 | <hashar> | gerrit set-account 5579 --inactive # T382028 | [releng] | 
            
  | 17:20 | <bd808> | Doing in-place PHP 8.1 upgrade on deployment-mediawiki14.deployment-prep.eqiad1.wikimedia.cloud (T378752) | [releng] | 
            
  | 17:09 | <bd808> | Doing in-place PHP 8.1 upgrade on deployment-jobrunner05.deployment-prep.eqiad1.wikimedia.cloud (T378752) | [releng] | 
            
  | 17:02 | <jhancock@cumin2002> | END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['cloudcephosd2004-dev'] | [production] | 
            
  | 17:01 | <jhancock@cumin2002> | START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cloudcephosd2004-dev'] | [production] | 
            
  | 16:58 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudcephosd2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | [production] | 
            
  | 16:55 | <bd808> | Doing in-place PHP 8.1 upgrade on deployment-mwmaint03.deployment-prep.eqiad1.wikimedia.cloud (T378752) | [releng] | 
            
  | 16:32 | <jhancock@cumin2002> | START - Cookbook sre.hosts.provision for host cloudcephosd2004-dev.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED | [production] | 
            
  | 16:31 | <jhancock@cumin2002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] |