| 2024-12-03
      
      ยง | 
    
  | 18:47 | <ryankemper@deploy2002> | Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host (duration: 00m 14s) | [production] | 
            
  | 18:47 | <ryankemper@deploy2002> | Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host | [production] | 
            
  | 18:43 | <ryankemper@deploy2002> | Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host (duration: 03m 31s) | [production] | 
            
  | 18:40 | <ryankemper@deploy2002> | Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-main host | [production] | 
            
  | 18:39 | <ryankemper@deploy2002> | Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host (duration: 00m 11s) | [production] | 
            
  | 18:39 | <ryankemper@deploy2002> | Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host | [production] | 
            
  | 18:39 | <ryankemper@deploy2002> | Finished deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host (duration: 00m 11s) | [production] | 
            
  | 18:39 | <ryankemper@deploy2002> | Started deploy [wdqs/wdqs@9927a5a]: deploy to fresh wdqs-internal-scholarly host | [production] | 
            
  | 18:35 | <jelto@cumin1002> | END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[1034-1035].eqiad.wmnet | [production] | 
            
  | 18:35 | <jelto@cumin1002> | START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[1034-1035].eqiad.wmnet | [production] | 
            
  | 18:25 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:25 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:23 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:23 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:23 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:23 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:22 | <jelto> | homer 'cr*eqiad*' commit 'T377876' | [production] | 
            
  | 18:14 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:14 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:11 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1035.eqiad.wmnet with OS bookworm | [production] | 
            
  | 18:10 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:10 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:09 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:09 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:09 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:07 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:07 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:07 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:07 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:06 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:04 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:03 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 18:01 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 18:00 | <jclark@cumin1002> | END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1091.eqiad.wmnet with OS bullseye | [production] | 
            
  | 18:00 | <jclark@cumin1002> | END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" | [production] | 
            
  | 17:59 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 17:57 | <hnowlan@deploy1003> | helmfile [codfw] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 17:57 | <hnowlan@deploy1003> | helmfile [codfw] START helmfile.d/admin 'apply'. | [production] | 
            
  | 17:57 | <hnowlan@deploy1003> | helmfile [eqiad] DONE helmfile.d/admin 'apply'. | [production] | 
            
  | 17:56 | <hnowlan@deploy1003> | helmfile [eqiad] START helmfile.d/admin 'apply'. | [production] | 
            
  | 17:52 | <jelto@cumin1002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1035.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:50 | <bking@cumin2002> | END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on wdqs2026.codfw.wmnet with reason: T376150 | [production] | 
            
  | 17:50 | <bking@cumin2002> | START - Cookbook sre.hosts.downtime for 4:00:00 on wdqs2026.codfw.wmnet with reason: T376150 | [production] | 
            
  | 17:48 | <jelto@cumin1002> | START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1035.eqiad.wmnet with reason: host reimage | [production] | 
            
  | 17:47 | <brett@puppetserver1001> | conftool action : set/pooled=yes; selector: dc=magru,service=cdn,name=cp7001.magru.wmnet | [production] | 
            
  | 17:46 | <brett> | Removing RSA certificate support from haproxy/cp (T370837) | [production] | 
            
  | 17:38 | <raymond-ndibe@cloudcumin1001> | END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api | [toolsbeta] | 
            
  | 17:38 | <jclark@cumin1002> | START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1002" | [production] | 
            
  | 17:37 | <raymond-ndibe@cloudcumin1001> | START - Cookbook wmcs.toolforge.component.deploy for component builds-api | [toolsbeta] | 
            
  | 17:32 | <jelto@cumin1002> | START - Cookbook sre.hosts.reimage for host wikikube-worker1035.eqiad.wmnet with OS bookworm | [production] |