51-100 of 10000 results (38ms)
2026-03-13 §
16:14 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1075.eqiad.wmnet}' (T419948) [admin]
16:10 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt2006-dev.codfw.wmnet}' (T419948) [admin]
16:09 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=99) on hosts matched by 'D{cloudvirt2006-dev.codfw.wmnet.eqiad.wmnet}' (T419948) [admin]
16:07 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt2006-dev.codfw.wmnet.eqiad.wmnet}' (T419948) [admin]
15:57 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1075.eqiad.wmnet}' (T419948) [admin]
15:54 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.safe_reboot (exit_code=0) on hosts matched by 'D{cloudvirt1076.eqiad.wmnet}' (T419948) [admin]
15:40 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.safe_reboot on hosts matched by 'D{cloudvirt1076.eqiad.wmnet}' (T419948) [admin]
2026-03-12 §
13:46 <filippo@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch [admin]
13:45 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
13:44 <filippo@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan+apply for main branch [admin]
13:43 <filippo@cloudcumin1001> START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch [admin]
11:44 <godog> create g4.cores8.ram32.disk20.ephem140 flavor for tools worker [admin]
2026-03-10 §
17:14 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for all services [admin]
17:10 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [admin]
2026-03-04 §
14:43 <taavi> deploying firewall rule updates: https://gerrit.wikimedia.org/r/c/operations/homer/public/+/970275 [admin]
2026-02-26 §
03:46 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment eqiad1 for all services [admin]
03:31 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for all services [admin]
03:30 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster (exit_code=0) on deployment eqiad1 [admin]
03:27 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster on deployment eqiad1 [admin]
03:26 <andrewbogott> rebuilding the rabbitmq cluster in eqiad1; many failed messages [admin]
2026-02-24 §
08:18 <godog> clean up stray wikilabels project puppet host certs [admin]
00:16 <bd808> Applied LDIF to create analytics-sre user and group (T418120) [admin]
2026-02-20 §
12:00 <dhinus> DROP DATABASE toollabs_p; (was used by updatetools.py, see T415383) [admin]
2026-02-18 §
13:29 <taavi> rebooting cloudgw1004 for T417075 fixes [admin]
2026-02-17 §
12:28 <volans> re-enabled puppet on toolforge's nfs k8s workers [admin]
10:39 <volans> temporarily disabling puppet on toolforge's nfs k8s workers to test gerrit/1239689 [admin]
2026-02-13 §
04:25 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for all services [admin]
04:21 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [admin]
04:20 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster (exit_code=0) on deployment codfw1dev [admin]
04:18 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster on deployment codfw1dev [admin]
2026-02-12 §
14:34 <andrewbogott> moritz is upgrading dnsmasq on eqiad1 cloudnets and cloudvirts [admin]
10:08 <dhinus> delete job "updatetools" in admin tool as it's no longer used (T415383) [admin]
2026-02-09 §
16:03 <andrewbogott> rebooting cloudnets in codfw1dev to make sure we've picked up the new dnsmasq version [admin]
12:50 <dcaro> removed stall cert cloudinfra-acme-chief-01.novalocal from cloudinfra-internal-puppetserver-1 [admin]
12:49 <dcaro> removed the pki* certs from the cloudinfra-cloudvps puppetserver as they are not handled there anymore but the local puppetserver [admin]
09:45 <dcaro> re-enabling nrpe2nodexp-ferm_active.service on cloudcumins after upgrade (getting stall promfile) [admin]
03:00 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment eqiad1 for all services [admin]
02:47 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for all services [admin]
02:47 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster (exit_code=0) on deployment eqiad1 [admin]
02:44 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster on deployment eqiad1 [admin]
2026-02-05 §
21:12 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for all services [admin]
21:07 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for all services [admin]
21:03 <andrew@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster (exit_code=0) on deployment codfw1dev [admin]
21:01 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster on deployment codfw1dev [admin]
20:58 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster (exit_code=99) on deployment codfw1dev [admin]
20:57 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster on deployment codfw1dev [admin]
20:56 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster (exit_code=99) on deployment codfw1dev [admin]
20:55 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster on deployment codfw1dev [admin]
20:49 <andrew@cloudcumin1001> END (FAIL) - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster (exit_code=99) on deployment codfw1dev [admin]
20:48 <andrew@cloudcumin1001> START - Cookbook wmcs.openstack.rabbitmq.rebuild_rabbit_cluster on deployment codfw1dev [admin]