1-50 of 143 results (19ms)
2025-09-10 §
08:55 <volans> force-reboot codesearch9 VM because it's unresponsive to ssh and console and the services are down T404163 [codesearch]
08:53 <volans@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [codesearch]
08:52 <volans@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [codesearch]
08:52 <volans@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.vm_console [codesearch]
08:51 <volans@cloudcumin1001> START - Cookbook wmcs.openstack.cloudvirt.vm_console [codesearch]
2025-08-09 §
08:09 <addshore> rebooted codesearch9.codesearch.eqiad1.wikimedia.cloud T401513 [codesearch]
08:09 <addshore> rebooted [codesearch]
2025-06-05 §
16:50 <mutante> resizing instance sourcebot1 from g4.cores4.ram8.disk20 to g4.cores4.ram16.disk20 [codesearch]
2025-06-04 §
23:21 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T396073) [codesearch]
23:21 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase (T396073) [codesearch]
23:20 <raymond-ndibe@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T396073) [codesearch]
23:20 <raymond-ndibe@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase (T396073) [codesearch]
2025-05-19 §
21:44 <mutante> soft rebooting instance codesearch9, web UI was down and could not get shell [codesearch]
2025-03-28 §
19:39 <Krinkle> Reboot codesearch9, web service was down and ssh not responding/timing out. Alert fired 41min ago about instance being perceiced as down. [codesearch]
2024-12-11 §
08:12 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T381911) [codesearch]
08:12 <fnegri@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase (T381911) [codesearch]
2024-10-15 §
18:10 <mutante> - re-enabled puppet on codesearch9 [codesearch]
2024-10-10 §
19:35 <mutante> stopping and restarting all hound services [codesearch]
17:24 <mutante> rebooting codesearch9 again [codesearch]
16:08 <mutante> running commands listed in commit message of gerrit:920243 [codesearch]
16:02 <mutante> adding new project member eoghan and granting member role, also granting member role to aokoth [codesearch]
2024-10-09 §
16:52 <mutante> soft rebooting instance codesearch 9 which was unreachable again [codesearch]
2024-10-03 §
17:16 <mutante> - service not reachable - cant ssh to instance codesearch9, attempting to soft reboot VM [codesearch]
2024-06-18 §
14:54 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) (T367878) [codesearch]
14:54 <taavi@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase (T367878) [codesearch]
2024-06-14 §
16:59 <mutante> createing instance codesearch9 with bookworm to replace codesearch8 (T367479) [codesearch]
2024-04-19 §
21:22 <Krinkle> Attempt to fix puppet failure since 48h `codesearch8 puppet-agent[21081]: (/Stage[main]/Codesearch/Git::Clone[labs/codesearch]/Exec[git_pull_labs/codesearch]/returns) error: insufficient permission for adding an object to repository database .git/objects` [codesearch]
2024-04-03 §
02:46 <Krinkle> Reboot host https://grafana.wmcloud.org/d/0g9N-7pVz/cloud-vps-project-board?orgId=1&var-project=codesearch&var-instance=All&from=now-3h&to=now [codesearch]
2024-03-15 §
03:53 <Krinkle> Deploying fix for T321347 [codesearch]
2024-03-01 §
11:51 <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [codesearch]
11:40 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.openstack.cloudvirt.vm_console [codesearch]
11:40 <wmbot~dcaro@urcuchillay> END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) [codesearch]
11:38 <dcaro> reboot codesearch8 as it's locked out of resources [codesearch]
11:35 <wmbot~dcaro@urcuchillay> START - Cookbook wmcs.openstack.cloudvirt.vm_console [codesearch]
2023-07-12 §
17:48 <mutante> added new member aokoth [codesearch]
2023-05-24 §
15:11 <legoktm> temporarily taking down to free up disk space (T337263) [codesearch]
2023-04-21 §
14:57 <legoktm> rebooting codesearch8 to see if that fixes networking issues (T335197) [codesearch]
2023-03-13 §
01:12 <Krinkle> Change codesearch.wmcloud.org proxy from port 3002 (Hound UI) to 3003 (new Codesearch frontend), ref T263354 [codesearch]
2023-03-12 §
22:50 <Krinkle> Create new https://codesearch-backend.wmcloud.org/ webproxy, points to the same location as codesearch-old. [codesearch]
2022-12-02 §
19:41 <Krinkle> codesearch8 instance unresponsive to http and ssh, rebooted from horizon [codesearch]
2022-11-01 §
04:35 <legoktm> temporarily stopping to fix full disk [codesearch]
2022-06-17 §
20:04 <legoktm> added Krinkle as project admin, Gerrit +2 [codesearch]
2022-05-20 §
05:16 <legoktm> restarting to pick up label changes [codesearch]
2022-04-09 §
03:55 <legoktm> restarting everything to add new "wmcs" instance [codesearch]
2022-03-15 §
02:09 <legoktm> forcing manual run of codesearch-write-config for T303641 [codesearch]
2021-11-03 §
16:06 <legoktm> manually triggered codesearch-write-config job to pick up fix for T294915 immediately [codesearch]
2021-10-24 §
22:39 <legoktm> one more restart of everything, switched hound container over to bullseye for newer git [codesearch]
22:20 <legoktm> restarted everything to add new prometheus metrics endpoint: https://codesearch.wmcloud.org/_metrics [codesearch]
2021-10-23 §
16:06 <majavah> hard reboot codesearch8 after OOM crash [codesearch]
2021-05-21 §
16:08 <legoktm> restarting everything for T283317 [codesearch]