| 2024-10-04
      
      § | 
    
  | 11:59 | <jnuche@deploy2002> | Started deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) | [production] | 
            
  | 11:57 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway | [tools] | 
            
  | 11:52 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch | [admin] | 
            
  | 11:52 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch | [admin] | 
            
  | 11:51 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component api-gateway | [tools] | 
            
  | 11:50 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway | [toolsbeta] | 
            
  | 11:47 | <jnuche@deploy2002> | Finished deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) (duration: 00m 47s) | [production] | 
            
  | 11:46 | <jnuche@deploy2002> | Started deploy [releng/jenkins-deploy@9096f1b] (releasing): (no justification provided) | [production] | 
            
  | 11:46 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component api-gateway | [toolsbeta] | 
            
  | 11:44 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | [tools] | 
            
  | 11:39 | <aborrero@cloudcumin1001> | END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch | [admin] | 
            
  | 11:39 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch | [admin] | 
            
  | 11:38 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | [tools] | 
            
  | 11:37 | <sstefanova@cloudcumin1001> | END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api | [toolsbeta] | 
            
  | 11:35 | <aborrero@cloudcumin1001> | END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch | [admin] | 
            
  | 11:35 | <aborrero@cloudcumin1001> | START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch | [admin] | 
            
  | 11:31 | <sstefanova@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component jobs-api | [toolsbeta] | 
            
  | 10:19 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc2004.wikimedia.org | [production] | 
            
  | 10:16 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host irc2004.wikimedia.org | [production] | 
            
  | 10:13 | <jmm@cumin2002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1004.wikimedia.org | [production] | 
            
  | 10:09 | <jmm@cumin2002> | START - Cookbook sre.hosts.reboot-single for host irc1004.wikimedia.org | [production] | 
            
  | 10:07 | <moritzm> | upload ircstream 0.13.0+sse12u1 to apt.wikimedia.org bookworm/ircstream-sse component (seperate build using the experimental eventstream feature branch of ircstream) T376014 | [production] | 
            
  | 09:43 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database shnwikinews (T375432) | [production] | 
            
  | 09:35 | <moritzm> | upload ircstream 0.13.0+wmf12u1 to apt.wikimedia.org T376014 | [production] | 
            
  | 09:18 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database shnwikinews (T375432) | [production] | 
            
  | 09:17 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database kgewiki (T374814) | [production] | 
            
  | 09:17 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database kgewiki (T374814) | [production] | 
            
  | 09:17 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database gorwikiquote (T375094) | [production] | 
            
  | 09:16 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database gorwikiquote (T375094) | [production] | 
            
  | 09:16 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database madwiktionary (T375023) | [production] | 
            
  | 09:16 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database madwiktionary (T375023) | [production] | 
            
  | 09:15 | <btullis@cumin1002> | END (PASS) - Cookbook sre.wikireplicas.add-wiki (exit_code=0) for database moswiki (T375568) | [production] | 
            
  | 09:15 | <btullis@cumin1002> | START - Cookbook sre.wikireplicas.add-wiki for database moswiki (T375568) | [production] | 
            
  | 09:09 | <jelto@deploy2002> | helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply | [production] | 
            
  | 08:58 | <jelto@deploy2002> | helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply | [production] | 
            
  | 08:32 | <arturo> | cloudservice1005/1006: disable puppet and set `quiet=no` in /etc/powerdns/recursor.conf (T374830) | [admin] | 
            
  | 07:51 | <oblivian@puppetserver1001> | conftool action : set/weight=10; selector: dc=eqiad,cluster=kubernetes,name=mw1439.eqiad.wmnet | [production] | 
            
  | 07:51 | <oblivian@puppetserver1001> | conftool action : set/weight=1; selector: dc=eqiad,cluster=kubernetes,name=mw1439.eqiad.wmnet | [production] | 
            
  | 07:30 | <hashar> | upgrading Jenkins on CI Jenkins | [production] | 
            
  | 07:04 | <moritzm> | import jenkins 2.462.3 to thirdparty/ci T376449 | [production] | 
            
  | 01:45 | <ejegg> | payments-wiki upgraded from e88750e6 to ed2d78b3 | [production] | 
            
  
    | 2024-10-03
      
      § | 
    
  | 22:37 | <brennen@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] (duration: 07m 04s) | [production] | 
            
  | 22:33 | <brennen@deploy2002> | brennen: Continuing with sync | [production] | 
            
  | 22:32 | <brennen@deploy2002> | brennen: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 22:30 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] | [production] | 
            
  | 22:18 | <brennen@deploy2002> | scap failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.43.0-wmf.25 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discovery.wmnet/restricted/m | [production] | 
            
  | 22:18 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] | [production] | 
            
  | 22:15 | <brennen@deploy2002> | scap failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.43.0-wmf.25 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discovery.wmnet/restricted/m | [production] | 
            
  | 22:15 | <brennen@deploy2002> | Started scap sync-world: Backport for [[gerrit:1077802|Revert "Turn on Parsoid Selective Update metrics" (T376433)]] | [production] | 
            
  | 21:39 | <bking@cumin2002> | END (FAIL) - Cookbook sre.wdqs.categories-reload (exit_code=99) reloading categories to wdqs-categories1001.eqiad.wmnet | [production] |