|
2024-10-30
§
|
| 13:57 |
<joal> |
Scap deploy analytics airflow dags |
[analytics] |
| 13:36 |
<joal> |
Unpause webrequest_actor jobs after successful webrequest refinement |
[analytics] |
| 12:21 |
<joal> |
unpause webrequest refine airflow jobs |
[analytics] |
| 12:13 |
<joal> |
deploying refinery onto HDFS (prod + test) |
[analytics] |
| 12:10 |
<joal> |
pause webrequest_actor jobs (3) to wait for webrequest success before trying new code |
[analytics] |
| 12:06 |
<joal> |
Alter wmf.webrequest table adding new is_redirect_to_pageview field to the test cluster |
[analytics] |
| 11:56 |
<joal> |
Alter tables wmf.webrequest_actor_metrics_hourly, wmf.webrequest_actor_metrics_rollup_hourly, wmf.webrequest_actor_label_hourly adding 2 new fields - NOTE: needed to be done in 2 steps with Hive to have the field correctly inserted in the middle of the tables |
[analytics] |
| 11:53 |
<joal> |
Create new table wmf_raw.mediawiki_private_cu_log to handle newly sqooped data |
[analytics] |
| 11:51 |
<joal> |
Alter wmf.webrequest table adding new is_redirect_to_pageview field - NOTE: needed to be done in 2 steps with Hive to have the field correctly inserted in the middle of the table |
[analytics] |
| 11:33 |
<joal> |
Deploying refinery using scap |
[analytics] |
| 10:43 |
<joal> |
Pause webrequest-refinement airflow jobs (2) before starting deployment as table change needs to happen |
[analytics] |