1101-1150 of 5881 results (31ms)
2022-10-24 §
07:30 <elukey> `elukey@stat1004:~$ sudo systemctl reset-failed jupyter-ntsako-singleuser.service` [analytics]
2022-10-23 §
13:31 <elukey> clean logs with 10d+ on an-airflow1001 to free some space [analytics]
13:26 <elukey> clean logs with 15d+ on an-airflow1001 to free some space [analytics]
2022-10-22 §
08:17 <joal> rerun webrequest-load-wf-text-2022-10-22-3 oozie job with higher error threshold [analytics]
2022-10-21 §
16:55 <btullis> restarting hive-server2 service on an-coord1001 [analytics]
16:49 <btullis> restarting hue on an-tool1009 [analytics]
15:18 <joal> restart hive-server2 service [analytics]
07:32 <joal> restart failed oozie jobs [analytics]
07:28 <joal> Restart HiveServer2 on an-coord1001 (I didn't even know I could do this) [analytics]
06:53 <joal> killing old mjolnit jobs [analytics]
06:50 <joal> Kill rerun stuck oozie job [analytics]
06:37 <joal> Kill skein test jobs in arn [analytics]
2022-10-19 §
17:14 <btullis> reset the BMC on analytics1075 [analytics]
2022-10-17 §
18:17 <mforns> deleted Airflow DAGs for backfilling of Cassandra loading of unique devices [analytics]
2022-10-15 §
09:24 <joal> Rerun failed refine_eventlogging_analytics job [analytics]
09:00 <joal> Rerun pageview-hourly-wf-2022-10-14-23 [analytics]
2022-10-13 §
13:43 <mforns> cleared airflow job wikidata_dump_to_hive_weekly [analytics]
2022-10-12 §
15:26 <ottomata> remove materialized .json files from schemas/event/primary - this should be a no-op as no clients should actually be using the json files. - T315674 [analytics]
2022-10-11 §
15:44 <ottomata> remove materialized .json files from schemas/event/secondary - this should be a no-op as no clients should actually be using the json files. - T315674 [analytics]
15:04 <btullis> reset the BMC on an-worker1086 with `sudo bmc-device --cold-reset` [analytics]
06:44 <elukey> kill leftover process of jmads on stat1005 to allow user cleanup via puppet [analytics]
06:43 <elukey> kill leftover process of nokafor on stat1004 to allow user cleanup via puppet [analytics]
06:37 <elukey> kill leftover process of bmansurov on stat1007 to allow user cleanup via puppet [analytics]
06:34 <elukey> kill leftover process of bmansurov on an-airflow1002 to allow user cleanup via puppet [analytics]
2022-10-10 §
15:36 <mforns> reran geoeditors_public_monthly airflow DAG for Sept 2022, after fix [analytics]
15:34 <mforns> deployed airflow to fix geoeditors_public_monthly DAG [analytics]
15:31 <mforns> started unique devices daily back-filling in cassandra from 1st of July to end of Sept [analytics]
2022-10-08 §
11:48 <joal> rerun webrequest-load-wf-text-2022-10-7-20 [analytics]
2022-10-07 §
09:26 <elukey> delete calico pods in CrashLoop on dse (probably due to the incorrect docker settings) [analytics]
07:54 <elukey> re-initialize docker on dse-k8s-worker1004 - wrong storage type set (devicemapper instead of overlay2) [analytics]
07:49 <elukey> re-initialize docker on dse-k8s-worker100[5-8] - wrong storage type set (devicemapper instead of overlay2) [analytics]
2022-10-06 §
19:51 <SandraEbele> Started airflow projectview_hourly_dag [analytics]
19:51 <SandraEbele> Killed Oozie projectview-hourly job [analytics]
19:40 <SandraEbele> Deployed airflow to fix projectview_hourly_dag [analytics]
13:48 <btullis> decommission aqs1007 (also forgot to log aqs1006) [analytics]
12:15 <btullis> decommissioning aqs1005 [analytics]
11:23 <btullis> decommissioning aqs1004 [analytics]
2022-10-05 §
16:48 <btullis> forcibly and lazily unmounted legacy labstore hosts from an-launcher1002 and removed their /etc/fstab entries [analytics]
15:27 <SandraEbele> deployed refinery source [analytics]
14:33 <mforns> finished refinery deploy - regular weekly train [analytics]
14:05 <mforns> starting refinery deploy - regular weekly train [analytics]
13:49 <SandraEbele> Started Airflow projectview_geo job [analytics]
13:48 <SandraEbele> killed Oozie projectview-geo-coord job [analytics]
13:21 <SandraEbele> deploying fix for projective tags on airflow. [analytics]
2022-10-04 §
09:53 <btullis> deployed eventgate-logging-external to eqiad (a few minutes ago) [analytics]
09:45 <btullis> deploying new eventgate-logging-external service to codfw [analytics]
09:44 <btullis> deploying new eventgate-logging-external service to staging [analytics]
2022-10-02 §
08:13 <elukey> apt-get clean on an-airflow1001 to free some space on the root partition [analytics]
2022-09-30 §
08:41 <btullis> restarted hive-server2 and hive-metastore services on an-coord1002 (standby) server [analytics]
2022-09-29 §
12:34 <joal> Rerun failed oozie webrequest-load-wf-text-2022-9-29-9 [analytics]