| 2024-12-02
      
      ยง | 
    
  | 22:57 | <bd808> | Reverted ATS default MediaWiki backend to deployment-mediawiki14.deployment-prep.eqiad1.wikimedia.cloud via "deployment-cache-text" prefix hiera rules in Horizon (T378752) | [releng] | 
            
  | 22:42 | <bd808> | Running https://integration.wikimedia.org/ci/view/selenium-daily/job/selenium-daily-beta-MediaWiki/2382/console against thePHP 8.1 MediaWiki (T378752) | [releng] | 
            
  | 22:29 | <bd808> | https://meta.wikimedia.beta.wmflabs.org/wiki/Special:Version is showing PHP 8.1.31 (T378752) | [releng] | 
            
  | 22:27 | <bd808> | Set ATS default MediaWiki backend to deployment-mediawiki81.deployment-prep.eqiad1.wikimedia.cloud via "deployment-cache-text" prefix hiera rules in Horizon (T378752) | [releng] | 
            
  | 22:27 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:27 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:27 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:26 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:25 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:24 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:21 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:21 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:20 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:20 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:18 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:18 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:16 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:16 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:05 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 22:05 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 21:45 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 21:40 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 21:36 | <urbanecm@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1099746|testwiki: no growth experiment anymore (T380659)]], [[gerrit:1099793|fix(surfacing): don't redirect to desktop]] (duration: 13m 22s) | [production] | 
            
  | 21:35 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 21:29 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 21:29 | <urbanecm@deploy2002> | migr, urbanecm: Continuing with sync | [production] | 
            
  | 21:27 | <urbanecm@deploy2002> | migr, urbanecm: Backport for [[gerrit:1099746|testwiki: no growth experiment anymore (T380659)]], [[gerrit:1099793|fix(surfacing): don't redirect to desktop]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:22 | <urbanecm@deploy2002> | Started scap sync-world: Backport for [[gerrit:1099746|testwiki: no growth experiment anymore (T380659)]], [[gerrit:1099793|fix(surfacing): don't redirect to desktop]] | [production] | 
            
  | 21:21 | <urbanecm@deploy2002> | Finished scap sync-world: Backport for [[gerrit:1099362|Enable VisualEditor by default on Indonesian Wikiquote (T381214)]], [[gerrit:1083434|votewiki, testwiki: add securepoll-edit-poll to electionadmin (T377531)]], [[gerrit:1099750|cawiki: stop Flow being the default for some talk namespaces (T381295)]] (duration: 13m 40s) | [production] | 
            
  | 21:15 | <urbanecm@deploy2002> | kemayo, urbanecm, nmw03, sd: Continuing with sync | [production] | 
            
  | 21:14 | <vriley@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 21:12 | <urbanecm@deploy2002> | kemayo, urbanecm, nmw03, sd: Backport for [[gerrit:1099362|Enable VisualEditor by default on Indonesian Wikiquote (T381214)]], [[gerrit:1083434|votewiki, testwiki: add securepoll-edit-poll to electionadmin (T377531)]], [[gerrit:1099750|cawiki: stop Flow being the default for some talk namespaces (T381295)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | [production] | 
            
  | 21:12 | <vriley@cumin1002> | START - Cookbook sre.hosts.provision for host ms-be1083.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART | [production] | 
            
  | 21:09 | <vriley@cumin1002> | END (PASS) - Cookbook sre.dns.netbox (exit_code=0) | [production] | 
            
  | 21:09 | <vriley@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update  mgmt  ms-be1083 - vriley@cumin1002" | [production] | 
            
  | 21:09 | <vriley@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update  mgmt  ms-be1083 - vriley@cumin1002" | [production] | 
            
  | 21:08 | <urbanecm@deploy2002> | Started scap sync-world: Backport for [[gerrit:1099362|Enable VisualEditor by default on Indonesian Wikiquote (T381214)]], [[gerrit:1083434|votewiki, testwiki: add securepoll-edit-poll to electionadmin (T377531)]], [[gerrit:1099750|cawiki: stop Flow being the default for some talk namespaces (T381295)]] | [production] | 
            
  | 21:04 | <vriley@cumin1002> | START - Cookbook sre.dns.netbox | [production] | 
            
  | 20:10 | <sukhe@puppetserver1001> | conftool action : set/pooled=yes; selector: name=cp3069.esams.wmnet [reason: done: checking icinga alerts] | [production] | 
            
  | 19:55 | <sukhe@puppetserver1001> | conftool action : set/pooled=no; selector: name=cp3069.esams.wmnet [reason: checking icinga alerts] | [production] | 
            
  | 19:22 | <volans@cumin1002> | END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 19:22 | <volans@cumin1002> | START - Cookbook sre.hosts.provision for host sretest1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 19:21 | <sukhe@cumin1002> | END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs3010.esams.wmnet | [production] | 
            
  | 19:20 | <volans@cumin1002> | END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sretest1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | [production] | 
            
  | 19:15 | <dancy@deploy2002> | Installation of scap version "4.131.0" completed for 207 hosts | [production] | 
            
  | 19:14 | <sukhe@cumin1002> | START - Cookbook sre.hosts.reboot-single for host lvs3010.esams.wmnet | [production] | 
            
  | 19:13 | <sukhe> | rebooting lvs3010 to test CR 1093958 | [production] | 
            
  | 19:11 | <dancy@deploy2002> | Installing scap version "4.131.0" for 207 hosts | [production] | 
            
  | 19:07 | <sukhe> | disable puppet on A:lvs to finish rolling out CR 1093958: T358260 | [production] | 
            
  | 19:01 | <volans@cumin1002> | START - Cookbook sre.hosts.provision for host sretest1001.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL | [production] |