| 
      
        2024-12-02
      
      §
     | 
  
    
  | 09:20 | 
  <elukey@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2086.codfw.wmnet with reason: host reimage | 
  [production] | 
            
  | 09:13 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1020.eqiad.wmnet | 
  [production] | 
            
  | 09:09 | 
  <elukey@cumin1002> | 
  START - Cookbook sre.hosts.reimage for host ms-be2086.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 08:59 | 
  <elukey@cumin1002> | 
  END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be2086.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 08:52 | 
  <dcausse> | 
  restarting blazegraph on wdqs1019 (BlazegraphFreeAllocatorsDecreasingRapidly) | 
  [production] | 
            
  | 08:49 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:49 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:47 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:47 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:45 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:44 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:42 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:42 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:36 | 
  <kartik@deploy2002> | 
  Finished scap sync-world: Backport for [[gerrit:1099410|Translate: Enable message group subscription feature for some wikis (T372386)]] (duration: 23m 39s) | 
  [production] | 
            
  | 08:35 | 
  <elukey@cumin1002> | 
  START - Cookbook sre.hosts.reimage for host ms-be2086.codfw.wmnet with OS bullseye | 
  [production] | 
            
  | 08:29 | 
  <kartik@deploy2002> | 
  abi, kartik: Continuing with sync | 
  [production] | 
            
  | 08:25 | 
  <kartik@deploy2002> | 
  abi, kartik: Backport for [[gerrit:1099410|Translate: Enable message group subscription feature for some wikis (T372386)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 08:21 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:21 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:20 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:19 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:19 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:19 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply | 
  [production] | 
            
  | 08:18 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply | 
  [production] | 
            
  | 08:18 | 
  <brouberol@deploy2002> | 
  helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply | 
  [production] | 
            
  | 08:15 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1020.eqiad.wmnet | 
  [production] | 
            
  | 08:12 | 
  <kartik@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1099410|Translate: Enable message group subscription feature for some wikis (T372386)]] | 
  [production] | 
            
  | 08:11 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1020.eqiad.wmnet | 
  [production] | 
            
  | 08:09 | 
  <jmm@cumin2002> | 
  END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1009.eqiad.wmnet | 
  [production] | 
            
  | 08:07 | 
  <jmm@cumin2002> | 
  START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1009.eqiad.wmnet | 
  [production] | 
            
  | 08:00 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on pc1017.eqiad.wmnet with reason: T378068, host is not pooled | 
  [production] | 
            
  | 08:00 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on pc1017.eqiad.wmnet with reason: T378068, host is not pooled | 
  [production] | 
            
  | 08:00 | 
  <arnaudb@cumin1002> | 
  END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on pc1013.eqiad.wmnet with reason: T373037, host is not pooled | 
  [production] | 
            
  | 08:00 | 
  <arnaudb@cumin1002> | 
  START - Cookbook sre.hosts.downtime for 7 days, 0:00:00 on pc1013.eqiad.wmnet with reason: T373037, host is not pooled | 
  [production] | 
            
  | 05:20 | 
  <TimStarling> | 
  foreachwikiindblist wikidataclient extensions/Wikibase/lib/maintenance/populateSitesTable.php --force-protocol=https | 
  [production] | 
            
  | 05:14 | 
  <TimStarling> | 
  on mwmaint2002: mwscript extensions/Wikibase/lib/maintenance/populateSitesTable.php --wiki=idwikivoyage --force-protocol=https | 
  [production] | 
            
  | 04:41 | 
  <TimStarling> | 
  installed id.wikivoyage.org | 
  [production] | 
            
  | 04:39 | 
  <TimStarling> | 
  on db2123: grant alter  ON `%wik%`.* TO `wikiadmin2023`@`10.%` | 
  [production] | 
            
  | 04:26 | 
  <tstarling@deploy2002> | 
  Finished scap sync-world: Backport for [[gerrit:1098918|Create id.wikivoyage.org (T380726 T352113)]], [[gerrit:1099405|Add messages for Indonesian Wikivoyage (idwikivoyage) (T380726)]] (duration: 31m 05s) | 
  [production] | 
            
  | 04:13 | 
  <tstarling@deploy2002> | 
  tstarling: Continuing with sync | 
  [production] | 
            
  | 04:12 | 
  <tstarling@deploy2002> | 
  tstarling: Backport for [[gerrit:1098918|Create id.wikivoyage.org (T380726 T352113)]], [[gerrit:1099405|Add messages for Indonesian Wikivoyage (idwikivoyage) (T380726)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) | 
  [production] | 
            
  | 03:55 | 
  <tstarling@deploy2002> | 
  Started scap sync-world: Backport for [[gerrit:1098918|Create id.wikivoyage.org (T380726 T352113)]], [[gerrit:1099405|Add messages for Indonesian Wikivoyage (idwikivoyage) (T380726)]] | 
  [production] |