1101-1150 of 10000 results (24ms)
2025-01-15 ยง
15:40 <kamila@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw[1421-1425].eqiad.wmnet [production]
15:36 <moritzm> installing python-django security updates [production]
15:33 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
15:32 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
15:30 <jelto@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2224-2227].codfw.wmnet [production]
15:30 <jelto@cumin1002> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2224-2227].codfw.wmnet [production]
15:30 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2192 [production]
15:30 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2192 [production]
15:30 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2192.codfw.wmnet with OS bookworm [production]
15:28 <volans> uploaded spicerack_9.1.0 to apt.wikimedia.org bullseye-wikimedia [production]
15:26 <jelto> homer 'cr*codfw*' commit 'T377877' [production]
15:25 <jelto> homer 'lsw1-c6-codfw*' commit 'T377877' [production]
15:23 <jelto> homer 'lsw1-d3-codfw*' commit 'T377877' [production]
15:22 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2225.codfw.wmnet with OS bookworm [production]
15:16 <tgr|away> UTC afternoon deploys done [production]
15:15 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2226.codfw.wmnet with OS bookworm [production]
15:13 <tgr@deploy2002> Finished scap sync-world: Backport for [[gerrit:1111585|Enable SUL3 on test wikis, second attempt (T383729)]] (duration: 27m 56s) [production]
15:13 <jynus@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbprov1005.eqiad.wmnet with reason: os upgrade [production]
15:12 <jynus@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on dbprov1005.eqiad.wmnet with reason: os upgrade [production]
15:12 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2224.codfw.wmnet with OS bookworm [production]
15:09 <tgr@deploy2002> tgr: Continuing with sync [production]
15:02 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2225.codfw.wmnet with reason: host reimage [production]
14:55 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2226.codfw.wmnet with reason: host reimage [production]
14:52 <tgr@deploy2002> tgr: Backport for [[gerrit:1111585|Enable SUL3 on test wikis, second attempt (T383729)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:51 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2224.codfw.wmnet with reason: host reimage [production]
14:48 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2225.codfw.wmnet with reason: host reimage [production]
14:48 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2226.codfw.wmnet with reason: host reimage [production]
14:48 <jelto@cumin1002> START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2224.codfw.wmnet with reason: host reimage [production]
14:45 <tgr@deploy2002> Started scap sync-world: Backport for [[gerrit:1111585|Enable SUL3 on test wikis, second attempt (T383729)]] [production]
14:43 <lucaswerkmeister-wmde@deploy2002> Finished scap sync-world: Backport for [[gerrit:1111343|Yet more authentication domain overrides (T383729 T373737)]], [[gerrit:1111598|Move Beta Cluster favicons to this repository]], [[gerrit:1075211|Replace favicon.php with static.php (T374997)]] (duration: 15m 52s) [production]
14:41 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2227.codfw.wmnet with OS bookworm [production]
14:40 <aqu> Deployed refinery using scap, then deployed onto hdfs [analytics]
14:40 <aqu> Deployed refinery using scap, then deployed onto hdfs [production]
14:38 <lucaswerkmeister-wmde@deploy2002> tgr, matmarex, lucaswerkmeister-wmde: Continuing with sync [production]
14:36 <aqu@deploy2002> Finished deploy [analytics/refinery@eee2443] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@eee24435] (duration: 00m 28s) [production]
14:35 <aqu@deploy2002> Started deploy [analytics/refinery@eee2443] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@eee24435] [production]
14:35 <aqu@deploy2002> Finished deploy [analytics/refinery@eee2443] (thin): Regular analytics weekly train THIN [analytics/refinery@eee24435] (duration: 00m 33s) [production]
14:34 <lucaswerkmeister-wmde@deploy2002> tgr, matmarex, lucaswerkmeister-wmde: Backport for [[gerrit:1111343|Yet more authentication domain overrides (T383729 T373737)]], [[gerrit:1111598|Move Beta Cluster favicons to this repository]], [[gerrit:1075211|Replace favicon.php with static.php (T374997)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
14:34 <aqu@deploy2002> Started deploy [analytics/refinery@eee2443] (thin): Regular analytics weekly train THIN [analytics/refinery@eee24435] [production]
14:34 <aqu@deploy2002> Finished deploy [analytics/refinery@eee2443]: Regular analytics weekly train [analytics/refinery@eee24435] (duration: 01m 58s) [production]
14:32 <aqu@deploy2002> Started deploy [analytics/refinery@eee2443]: Regular analytics weekly train [analytics/refinery@eee24435] [production]
14:32 <aqu> Deploying analytics/refinery [production]
14:32 <aqu> Deploying analytics/refinery [analytics]
14:31 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2226 [production]
14:31 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2226 [production]
14:31 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2226.codfw.wmnet with OS bookworm [production]
14:30 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2225 [production]
14:30 <jelto@cumin1002> START - Cookbook sre.hosts.move-vlan for host wikikube-worker2225 [production]
14:30 <jelto@cumin1002> START - Cookbook sre.hosts.reimage for host wikikube-worker2225.codfw.wmnet with OS bookworm [production]
14:30 <jelto@cumin1002> END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker2224 [production]