Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.7 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 845 2428344 2321672 2026-06-17T21:01:01Z BKing (WMF) 29017 Add link to cirrussearch deployment details 2428344 wikitext text/x-wiki 42271lalfno6krp0agnc54lo48z9lhw 2428349 2428344 2026-06-17T21:06:22Z BKing (WMF) 29017 Call out that `deployment-elasticsearch` has been replaced by `deployment-cirrussearch` 2428349 wikitext text/x-wiki pq6j5kgmbeuf313p7nur65922kn1265 12 1568 2428313 2372869 2026-06-17T19:06:42Z Tejinderk.2004 56571 added reference link to a new page for more context 2428313 wikitext text/x-wiki p5tm0lpvw7arelgyuoktoxsoit48og1 2428314 2428313 2026-06-17T19:07:31Z Tejinderk.2004 56571 added spacing to distinguish reference context 2428314 wikitext text/x-wiki 4c90355isivbuigpg60lhjzil0tegfw 2428317 2428314 2026-06-17T19:11:31Z Tejinderk.2004 56571 added an extra resource for reference 2428317 wikitext text/x-wiki ko1vop1t0t2cjvq0g5u963lkj2mekrm 2 1625 2428276 1824985 2026-06-17T16:49:11Z Hashar 32 Rant Driven Development 2428276 wikitext text/x-wiki p07nk9rpk2z6lh19b6dk69c4oma1eh6 0 3214 2428175 2420163 2026-06-17T13:57:38Z BJensen-WMF 48942 /* Servers */ Add context around shard names 2428175 wikitext text/x-wiki th299p0bihqtcfppyzpch9z4ea2ks5w 2428182 2428175 2026-06-17T14:05:00Z Effie Mouzeli (WMF) 12880 /* Servers */ 2428182 wikitext text/x-wiki gw7nmp9ua5yox6fk0tnnq3p2k6u5n0p 2428476 2428182 2026-06-18T10:03:22Z BJensen-WMF 48942 /* Infrastructure */ Add a note that the gutter pool shouldn't usually receive traffic. 2428476 wikitext text/x-wiki 0x1bctsgc1ltepwyg360oym86474cuj 0 4108 2428140 2427961 2026-06-17T13:17:51Z ScheduleDeploymentBot 37566 Add [[gerrit:1302956]] to Thursday, June 18 UTC late backport window 2428140 wikitext text/x-wiki 91vagtg66stlfg70vskz7ej8ozxun62 2428170 2428140 2026-06-17T13:52:21Z ScheduleDeploymentBot 37566 Add [[gerrit:1303436]] to Wednesday, June 17 UTC afternoon backport window 2428170 wikitext text/x-wiki jt2o0nceqgzfx018k3gxu4fo94gnj48 2428217 2428170 2026-06-17T14:37:52Z ScheduleDeploymentBot 37566 Add [[gerrit:1303012]] to Wednesday, June 17 UTC late backport window 2428217 wikitext text/x-wiki d5llv9jvzqdmxrqstoa2d9d99kk8mp2 2428234 2428217 2026-06-17T15:10:45Z ScheduleDeploymentBot 37566 Add [[gerrit:1303004]] to Wednesday, June 17 UTC late backport window 2428234 wikitext text/x-wiki 3rrb3gzd595st8gt61amxlqe6vi92c6 2428244 2428234 2026-06-17T15:51:24Z ADancy (WMF) 17694 /* {{Deployment_day|date=2026-06-18}} */ Add change 1276813 to next puppet deployment window 2428244 wikitext text/x-wiki ct61d78pvcjvcwbevmpctbtp3601nj6 2428298 2428244 2026-06-17T18:21:33Z ScheduleDeploymentBot 37566 Add [[gerrit:1302923]] to Thursday, June 18 UTC afternoon backport window 2428298 wikitext text/x-wiki sckts815ndcn87dwcyp4xvq3y4xq4c5 2428335 2428298 2026-06-17T20:27:36Z ScheduleDeploymentBot 37566 Add [[gerrit:1300892]] to Thursday, June 18 UTC afternoon backport window 2428335 wikitext text/x-wiki jpq42ngdmoyggijxtcq9n9gtt7n199f 2428433 2428335 2026-06-18T06:36:35Z ScheduleDeploymentBot 37566 Add [[gerrit:1303895]] to Thursday, June 18 UTC late backport window 2428433 wikitext text/x-wiki 24icxx09nvflb67yg31lqherog44vmc 2428436 2428433 2026-06-18T06:53:20Z DCausse (WMF) 5604 /* {{Deployment_day|date=2026-06-18}} */ 2428436 wikitext text/x-wiki i89nszzr4n8asdpo1e5b806a7m7wrlf 12 6310 2428321 2344224 2026-06-17T19:22:46Z Tejinderk.2004 56571 redirected the entire documentation section to a separate page for more clarity . 2428321 wikitext text/x-wiki i78voxji0xns7morup0e8cvbktz3h43 2428369 2428321 2026-06-17T22:06:52Z APaskulin (WMF) 14880 /* Troubleshooting permissions errors */ Formatting 2428369 wikitext text/x-wiki kwz196cozpk1vkh69vucxs68nk4f17v 0 7919 2428046 2428045 2026-06-17T12:00:04Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es1045.eqiad.wmnet with reason: host reimage 2428046 wikitext text/x-wiki s4vj8e7r26tsbknprwojhc8umbd4cuv 2428047 2428046 2026-06-17T12:00:50Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2428047 wikitext text/x-wiki 6rxa1vcq7koyhnvop1eh4v9ympxfxcp 2428048 2428047 2026-06-17T12:01:54Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2428048 wikitext text/x-wiki jx7540wjjac8cm1z71nn0usg4gravkn 2428049 2428048 2026-06-17T12:02:24Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.reimage for host dse-k8s-wdqs2002.codfw.wmnet with OS bookworm 2428049 wikitext text/x-wiki jl9nnq9box702qn2eq51f7pdjs6vdy3 2428050 2428049 2026-06-17T12:02:26Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.reimage for host dse-k8s-wdqs2001.codfw.wmnet with OS bookworm 2428050 wikitext text/x-wiki go3788lqx3knww3s6edcntyu822r5pg 2428051 2428050 2026-06-17T12:03:19Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es2044: repool after maintenance es2044 2428051 wikitext text/x-wiki 24ik6blribpmuur83354anvf25hfvbv 2428052 2428051 2026-06-17T12:03:26Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host cloudvirt1078.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2428052 wikitext text/x-wiki 6yby7ll8em2r9vl5ch39es3in4rczgj 2428053 2428052 2026-06-17T12:03:30Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2428053 wikitext text/x-wiki augl7d6s5xdp7ftz7phtqoulcxepmgo 2428054 2428053 2026-06-17T12:03:32Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2428054 wikitext text/x-wiki djk1ocbpfd5hik394y6g99r0jghmdy4 2428055 2428054 2026-06-17T12:04:34Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es1045.eqiad.wmnet with reason: host reimage 2428055 wikitext text/x-wiki jp29e6ix08f6m6c1pmz2933mvv106om 2428056 2428055 2026-06-17T12:05:02Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-wdqs2002.codfw.wmnet with reason: host reimage 2428056 wikitext text/x-wiki 7slxf59f12wcrkqqg1fdg9h7pttrsgz 2428057 2428056 2026-06-17T12:07:39Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2428057 wikitext text/x-wiki 8lxgw86a7aofc0vuofrbo6m7h2fx7mv 2428058 2428057 2026-06-17T12:07:44Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2428058 wikitext text/x-wiki 8318z9oo6tin9cunnlwxqbcqai2rwdl 2428059 2428058 2026-06-17T12:07:46Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2428059 wikitext text/x-wiki 0xzktqcjh9c2utu1o5mnksg3tkpylu7 2428060 2428059 2026-06-17T12:07:48Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2428060 wikitext text/x-wiki c56x743sqljh56s2t8pz0fxown2ek26 2428061 2428060 2026-06-17T12:07:50Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2428061 wikitext text/x-wiki 96a6chkag25uecdfo92f2agkepz029p 2428062 2428061 2026-06-17T12:07:52Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2428062 wikitext text/x-wiki 57wtdnauguospw51kmx4i1w92zbjuei 2428063 2428062 2026-06-17T12:08:54Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2428063 wikitext text/x-wiki gs4pmm7uhlbaun907bbms5rpbzwbocp 2428064 2428063 2026-06-17T12:09:10Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-wdqs2002.codfw.wmnet with reason: host reimage 2428064 wikitext text/x-wiki 9pmwhpdpjp5s4za7y7nc8q46jevtj9i 2428065 2428064 2026-06-17T12:13:07Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudvirt1078.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2428065 wikitext text/x-wiki 1ui35ky87vh40xivif53nlk5olhyiw5 2428066 2428065 2026-06-17T12:15:08Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-wdqs2001.codfw.wmnet with reason: host reimage 2428066 wikitext text/x-wiki fo79z4t4ijr1b07nddlj8sh2hb9ihqh 2428067 2428066 2026-06-17T12:16:36Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.reimage for host dse-k8s-wdqs2003.codfw.wmnet with OS bookworm 2428067 wikitext text/x-wiki 7i9x033axit7w8mah4zlj45lblkl0f8 2428068 2428067 2026-06-17T12:16:43Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.reimage for host dse-k8s-wdqs2004.codfw.wmnet with OS bookworm 2428068 wikitext text/x-wiki qobsldqsojeaasbis424qa6t0wdn72a 2428069 2428068 2026-06-17T12:19:08Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" 2428069 wikitext text/x-wiki 213wklblhyar08ofzk3gasi56a1882p 2428071 2428069 2026-06-17T12:19:50Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-wdqs2001.codfw.wmnet with reason: host reimage 2428071 wikitext text/x-wiki re79q3wzwn3dn9x7nekletogwntqo61 2428072 2428071 2026-06-17T12:21:34Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es1045.eqiad.wmnet with OS trixie 2428072 wikitext text/x-wiki pgud4ud4dgj61r3g0caj6lxyx9wwz8m 2428073 2428072 2026-06-17T12:22:58Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) 2428073 wikitext text/x-wiki h4fowf33k9tlkef757cycnia0y4gdgj 2428074 2428073 2026-06-17T12:23:48Z Stashbot 7414 klausman@cumin1003: START - Cookbook sre.cassandra.roll-restart for nodes matching A:ml-cache-eqiad: Security updates (T426585) - klausman@cumin1003 2428074 wikitext text/x-wiki rdskgi3x1lqsq52jkxzblpt2ajgc2na 2428075 2428074 2026-06-17T12:23:55Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es1045: repool after upgrade 2428075 wikitext text/x-wiki f2qrfxrpzdwldd97zo3jlrx8me6io8m 2428076 2428075 2026-06-17T12:24:17Z Stashbot 7414 klausman@cumin1003: START - Cookbook sre.cassandra.roll-restart for nodes matching A:ml-cache-codfw: Security updates (T426585) - klausman@cumin1003 2428076 wikitext text/x-wiki m45dz2rjrk8ziieclam7in2aa7xyv93 2428077 2428076 2026-06-17T12:28:36Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-wdqs2003.codfw.wmnet with reason: host reimage 2428077 wikitext text/x-wiki f7aujyj4y6916pftwgf39wbmwc5u4oc 2428079 2428077 2026-06-17T12:29:04Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-wdqs2004.codfw.wmnet with reason: host reimage 2428079 wikitext text/x-wiki 3015nz58ygzsts6f4jfznjvnc2iokg2 2428080 2428079 2026-06-17T12:32:12Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/mw-mcrouter: apply 2428080 wikitext text/x-wiki svh382fds173cf84alsqi580vy0lbb9 2428081 2428080 2026-06-17T12:32:28Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-mcrouter: apply 2428081 wikitext text/x-wiki o7tgjvfieezzbiethieuf1b2t98ofv6 2428082 2428081 2026-06-17T12:32:41Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-mcrouter: apply 2428082 wikitext text/x-wiki 1qwp0y84m88lsub7sbt5k59yj0fknuq 2428083 2428082 2026-06-17T12:32:49Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-mcrouter: apply 2428083 wikitext text/x-wiki 30u6lu6xpt5xku65q60e9hoihycnhd7 2428084 2428083 2026-06-17T12:33:46Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" 2428084 wikitext text/x-wiki srigzf92a8v8oeuul5fl3rganck5f8d 2428085 2428084 2026-06-17T12:33:48Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-wdqs2002.codfw.wmnet with OS bookworm 2428085 wikitext text/x-wiki 5of7edkarszyo237cer8fjtqhnnwa7m 2428087 2428085 2026-06-17T12:35:08Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-wdqs2003.codfw.wmnet with reason: host reimage 2428087 wikitext text/x-wiki ldygq4vpog5krr8b2xnwpm4avla887r 2428088 2428087 2026-06-17T12:36:39Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1163: Migration of db1163.eqiad.wmnet completed 2428088 wikitext text/x-wiki 2p7ism5jwxda7nq6q12hbwtvot9ukbr 2428089 2428088 2026-06-17T12:36:42Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2428089 wikitext text/x-wiki m2hnb89fem3lnymxd4kcx9m1z73j8e8 2428090 2428089 2026-06-17T12:37:53Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" 2428090 wikitext text/x-wiki ghbzkglelg4s4hgixdwrxypo3mz021n 2428091 2428090 2026-06-17T12:39:56Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-wdqs2004.codfw.wmnet with reason: host reimage 2428091 wikitext text/x-wiki dfsa8qkmhpit8f1xxx6ddv27b3l8eei 2428092 2428091 2026-06-17T12:40:36Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.reimage for host mc-gp1005.eqiad.wmnet with OS trixie 2428092 wikitext text/x-wiki 2vcrwnsbkx8zpv0d6ek911s3mfo4aq1 2428094 2428092 2026-06-17T12:41:04Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.move-vlan for host mc-gp1005 2428094 wikitext text/x-wiki 50nr90hl6aby0nhje2x72qalns8czw4 2428095 2428094 2026-06-17T12:41:29Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.reimage for host mc-gp1006.eqiad.wmnet with OS trixie 2428095 wikitext text/x-wiki azinh5sujx6gtui9pj879wgjnksguw9 2428096 2428095 2026-06-17T12:41:42Z Stashbot 7414 klausman@cumin1003: END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:ml-cache-eqiad: Security updates (T426585) - klausman@cumin1003 2428096 wikitext text/x-wiki rvad9z50s15yq8caltmmuzvzksgxl9d 2428097 2428096 2026-06-17T12:41:51Z Stashbot 7414 klausman@cumin1003: END (PASS) - Cookbook sre.cassandra.roll-restart (exit_code=0) for nodes matching A:ml-cache-codfw: Security updates (T426585) - klausman@cumin1003 2428097 wikitext text/x-wiki f1frwm0fxhyt8va15hhibchr0n6ew3m 2428098 2428097 2026-06-17T12:41:56Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" 2428098 wikitext text/x-wiki cc1p5tudx1urnjx3bljzajxvu1mhymp 2428099 2428098 2026-06-17T12:41:57Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-wdqs2001.codfw.wmnet with OS bookworm 2428099 wikitext text/x-wiki rp4swjdnrh422q97rwmdeqwot9ubt3b 2428100 2428099 2026-06-17T12:41:59Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.move-vlan for host mc-gp1006 2428100 wikitext text/x-wiki 3kn7i0v2s6w4j6n0hhsa1hbfahc3gss 2428101 2428100 2026-06-17T12:43:21Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.dns.netbox 2428101 wikitext text/x-wiki 8t09mut8l6yfo8dzt4vs6vrz1aaa5k1 2428102 2428101 2026-06-17T12:45:30Z Stashbot 7414 klausman@cumin1003: START - Cookbook sre.cassandra.roll-reboot rolling reboot on A:ml-cache-eqiad 2428102 wikitext text/x-wiki d9fk77ea89lh81prwwk4eobdk7o1wd5 2428103 2428102 2026-06-17T12:45:42Z Stashbot 7414 klausman@cumin1003: START - Cookbook sre.cassandra.roll-reboot rolling reboot on A:ml-cache-codfw 2428103 wikitext text/x-wiki 3s0yv5kki25wwys4ac7nqgusi5504h3 2428105 2428103 2026-06-17T12:48:55Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.dns.netbox 2428105 wikitext text/x-wiki mxe3wwm8zutyd2g9nsg4bqybz8igh2b 2428106 2428105 2026-06-17T12:49:23Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host mc-gp1005 - blake@cumin1003" 2428106 wikitext text/x-wiki oigluoz6qq07l01uvdws6klvo4f0iqi 2428107 2428106 2026-06-17T12:49:28Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host mc-gp1005 - blake@cumin1003" 2428107 wikitext text/x-wiki 5d4cumuia347zogyn3geodzds7t9u6p 2428108 2428107 2026-06-17T12:49:30Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2428108 wikitext text/x-wiki fhucewnp1g0ncb9swvj1fke42xzni7u 2428109 2428108 2026-06-17T12:49:32Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.dns.wipe-cache mc-gp1005.eqiad.wmnet 126.32.64.10.in-addr.arpa 6.2.1.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2428109 wikitext text/x-wiki myuw5f29re7h39zt5bycbqds7umyyjb 2428110 2428109 2026-06-17T12:49:34Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) mc-gp1005.eqiad.wmnet 126.32.64.10.in-addr.arpa 6.2.1.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2428110 wikitext text/x-wiki bu3wi5r72ylhmm0x918uc0xvco0nx2h 2428111 2428110 2026-06-17T12:49:37Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host mc-gp1005 2428111 wikitext text/x-wiki 3hy8poa9tv4iqzxsho4fnxtcfxcm9d9 2428112 2428111 2026-06-17T12:51:02Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-gp1005 2428112 wikitext text/x-wiki 9557f4h2ob90n6torhsapw6zb961i7j 2428113 2428112 2026-06-17T12:51:04Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host mc-gp1005 2428113 wikitext text/x-wiki oa37642tm1xfwxv8r3hhix0k6ochcxx 2428114 2428113 2026-06-17T12:51:50Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2428114 wikitext text/x-wiki f6kcyyb9zyv1kfm450qtoqemjwl4tl5 2428115 2428114 2026-06-17T12:51:53Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.dns.wipe-cache mc-gp1006.eqiad.wmnet 182.48.64.10.in-addr.arpa 2.8.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2428115 wikitext text/x-wiki c5sxuwsy077c0u3l68qj2knexu9ldm2 2428116 2428115 2026-06-17T12:51:54Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) mc-gp1006.eqiad.wmnet 182.48.64.10.in-addr.arpa 2.8.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2428116 wikitext text/x-wiki jn6x2rjghy6lzitobgm08ws9uxrcxn5 2428117 2428116 2026-06-17T12:51:56Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host mc-gp1006 2428117 wikitext text/x-wiki n7awy9nt5mwuy3t78zjdcoxts900qmy 2428118 2428117 2026-06-17T12:52:21Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc-gp1006 2428118 wikitext text/x-wiki 2br9nd6gnv0mna5plbw0lqsii7hvi2o 2428119 2428118 2026-06-17T12:52:23Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host mc-gp1006 2428119 wikitext text/x-wiki ss4grmwhq8f3wbdm0wjq0e493wzrw1b 2428122 2428119 2026-06-17T12:53:32Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" 2428122 wikitext text/x-wiki 90f5kz9ch73e86nm06c3ihw548elvnd 2428127 2428122 2026-06-17T13:00:12Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" 2428127 wikitext text/x-wiki sq9gi1p0htuemjurigv91jhpqpg5m21 2428129 2428127 2026-06-17T13:06:39Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc-gp1005.eqiad.wmnet with reason: host reimage 2428129 wikitext text/x-wiki knbvhzokvwlh1yzibiae121c8inrbbc 2428130 2428129 2026-06-17T13:06:50Z Stashbot 7414 dani@deploy1003: Started scap sync-world: Backport for [[gerrit:1302998|Add English Wikipedia Mobile App Survey (T428876)]] 2428130 wikitext text/x-wiki 9cchgkmf9iq4catn83hy71bd7uy0ccy 2428131 2428130 2026-06-17T13:07:47Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc-gp1006.eqiad.wmnet with reason: host reimage 2428131 wikitext text/x-wiki nvyjywpqkll0lvfflmuq7m0s0fwzi6m 2428132 2428131 2026-06-17T13:08:49Z Stashbot 7414 dani@deploy1003: dani: Backport for [[gerrit:1302998|Add English Wikipedia Mobile App Survey (T428876)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428132 wikitext text/x-wiki 868v7hkntf6c7qtzcoyqpbpehnzi08r 2428133 2428132 2026-06-17T13:09:19Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es1045: repool after upgrade 2428133 wikitext text/x-wiki l0drg4sl8y6rmxbvyxjq0x9c9wr3rnp 2428134 2428133 2026-06-17T13:10:17Z Stashbot 7414 dani@deploy1003: dani: Continuing with deployment 2428134 wikitext text/x-wiki 7y3wgcmuaauh1ndbrm9hu86ytf21bqh 2428135 2428134 2026-06-17T13:10:31Z Stashbot 7414 klausman@cumin1003: END (PASS) - Cookbook sre.cassandra.roll-reboot (exit_code=0) rolling reboot on A:ml-cache-eqiad 2428135 wikitext text/x-wiki mkpp00195bn6t0xtp4d9uux0b45alxc 2428136 2428135 2026-06-17T13:10:38Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc-gp1005.eqiad.wmnet with reason: host reimage 2428136 wikitext text/x-wiki ggjlglssz7uh0jc1mhkyqm8gh7dyu72 2428137 2428136 2026-06-17T13:11:09Z Stashbot 7414 klausman@cumin1003: END (PASS) - Cookbook sre.cassandra.roll-reboot (exit_code=0) rolling reboot on A:ml-cache-codfw 2428137 wikitext text/x-wiki momecyz9a21aorkw0xndywvg6w3riw2 2428138 2428137 2026-06-17T13:14:37Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc-gp1006.eqiad.wmnet with reason: host reimage 2428138 wikitext text/x-wiki 6jsdt9vdymc2kwk06md4lu7ftj4q5to 2428139 2428138 2026-06-17T13:14:44Z Stashbot 7414 dani@deploy1003: Finished scap sync-world: Backport for [[gerrit:1302998|Add English Wikipedia Mobile App Survey (T428876)]] (duration: 07m 53s) 2428139 wikitext text/x-wiki r7m1d3o4jam60dz0b3tg2bld64mle1x 2428141 2428139 2026-06-17T13:23:45Z Stashbot 7414 jmm@deploy1003: helmfile [staging-eqiad] START helmfile.d/admin 'sync'. 2428141 wikitext text/x-wiki hzfa7uwd8opwqpux7ygm093qvwoltw1 2428142 2428141 2026-06-17T13:24:07Z Stashbot 7414 jmm@deploy1003: helmfile [staging-eqiad] DONE helmfile.d/admin 'sync'. 2428142 wikitext text/x-wiki tlikkcuern2w25xk1phnz7qr14sstdg 2428143 2428142 2026-06-17T13:25:01Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1298293|Add Wikidata configuration for WikiProject links (T422935)]], [[gerrit:1299943|Add instance-of WikiProject links for paintings and elections (T422936)]] 2428143 wikitext text/x-wiki 99b7v13nfnmw90jdgch1sympnldvf6j 2428144 2428143 2026-06-17T13:27:01Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: sadiyamohammed13, lucaswerkmeister-wmde: Backport for [[gerrit:1298293|Add Wikidata configuration for WikiProject links (T422935)]], [[gerrit:1299943|Add instance-of WikiProject links for paintings and elections (T422936)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428144 wikitext text/x-wiki sf0qmzt8l2q1z9yydbhkfpw0rm63nuk 2428145 2428144 2026-06-17T13:28:43Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc-gp1005.eqiad.wmnet with OS trixie 2428145 wikitext text/x-wiki lxihfa4y7o64hwils96hct7kfqd72l8 2428147 2428145 2026-06-17T13:30:44Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.cloud-host for host cloudvirt1068 2428147 wikitext text/x-wiki j54gs34xj7ll5us6s2g0ugpmosxjv32 2428148 2428147 2026-06-17T13:30:46Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.cloud-host (exit_code=0) for host cloudvirt1068 2428148 wikitext text/x-wiki e7j2jzung2fx0m475sc98zu6vtb4756 2428149 2428148 2026-06-17T13:31:04Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.cloud-host for host cloudvirt1069 2428149 wikitext text/x-wiki ixlz32n6qpsbgbtqh0y1xtfc88yzvep 2428150 2428149 2026-06-17T13:31:06Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: sadiyamohammed13, lucaswerkmeister-wmde: Rolling back deployment 2428150 wikitext text/x-wiki 8vi8qbfmlyuwojjfvxxa7ycfbxqdlni 2428151 2428150 2026-06-17T13:31:08Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.cloud-host (exit_code=0) for host cloudvirt1069 2428151 wikitext text/x-wiki cbwxqt3hhnsjfvivubanbwr3539snci 2428152 2428151 2026-06-17T13:31:31Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.cloud-host for host cloudvirt1061 2428152 wikitext text/x-wiki bl4fwoa45vi1y6crhgpzsdwjbglyp03 2428153 2428152 2026-06-17T13:31:33Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.cloud-host (exit_code=0) for host cloudvirt1061 2428153 wikitext text/x-wiki mldhrn52bzdsjrui391oaqptcv7ulc7 2428154 2428153 2026-06-17T13:31:57Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.cloud-host for host cloudcephosd1016 2428154 wikitext text/x-wiki bajrani2a56a1wrt1p7kxpchz5xs43s 2428155 2428154 2026-06-17T13:31:59Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.cloud-host (exit_code=0) for host cloudcephosd1016 2428155 wikitext text/x-wiki gcsbvpulzkacwx2yrdn251i66rr5h10 2428156 2428155 2026-06-17T13:32:49Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc-gp1006.eqiad.wmnet with OS trixie 2428156 wikitext text/x-wiki 3rl8c38x3zwijn5dnjdc4hly6a4msmf 2428157 2428156 2026-06-17T13:33:15Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1298293|Add Wikidata configuration for WikiProject links (T422935)]], [[gerrit:1299943|Add instance-of WikiProject links for paintings and elections (T422936)]] (duration: 08m 14s) 2428157 wikitext text/x-wiki 66qiruxcc42f64tp9g2xf54f1rlu4ty 2428160 2428157 2026-06-17T13:42:10Z Stashbot 7414 jmm@deploy1003: helmfile [staging-codfw] START helmfile.d/admin 'sync'. 2428160 wikitext text/x-wiki 3xfb5e6z3828s6t1ghisgktcymnvz3d 2428161 2428160 2026-06-17T13:42:53Z Stashbot 7414 jmm@deploy1003: helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. 2428161 wikitext text/x-wiki oyyd8gm2y4nzgcnbksx3gvgoz47uqf2 2428162 2428161 2026-06-17T13:45:56Z Stashbot 7414 pt1979@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mr1-codfw with reason: switch refresh 2428162 wikitext text/x-wiki chhf8ipm5lvg321t89bmuhtfvo39oq4 2428163 2428162 2026-06-17T13:46:49Z Stashbot 7414 pt1979@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mr1-codfw with reason: mgmt interface change 2428163 wikitext text/x-wiki jokc081ym0cn7pzrcfyf1s2uraqbon7 2428164 2428163 2026-06-17T13:47:08Z Stashbot 7414 papaul: mgmt interface change on mr-codfw 2428164 wikitext text/x-wiki 20vl0ie76f9vnakizc8lwh611fu7lj0 2428166 2428164 2026-06-17T13:50:26Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.bmc-user-mgmt for host sretest[2001,2003-2004,2006,2009-2010].codfw.wmnet,sretest1005.eqiad.wmnet 2428166 wikitext text/x-wiki kfqe76wayflkdcidkf2em4w7iivs80c 2428167 2428166 2026-06-17T13:51:35Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.bmc-user-mgmt (exit_code=0) for host sretest[2001,2003-2004,2006,2009-2010].codfw.wmnet,sretest1005.eqiad.wmnet 2428167 wikitext text/x-wiki bwd36ihfph1siplcbp0v1rnwonuc9yq 2428168 2428167 2026-06-17T13:51:40Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] START helmfile.d/admin 'sync'. 2428168 wikitext text/x-wiki 1nml45nvsbr5sv166mo5fqzsqebrpc7 2428169 2428168 2026-06-17T13:52:15Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'sync'. 2428169 wikitext text/x-wiki clwx19rolfihma5d9j6tb98g64elxxw 2428171 2428169 2026-06-17T13:53:20Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1302739|ULS rewrite: Lock body scroll when open on mobile]], [[gerrit:1302743|ULS rewrite: Fix settings dialog width and field sizing (T416512)]], [[gerrit:1303010|ULS rewrite: Show variants even when no languages are available (T426532)]], [[gerrit:1303009|ULS rewrite: Capture trigger element before async module load (T429145)]], [[gerri 2428171 wikitext text/x-wiki m0s9q5z3x318f5vwf979takfmwrdzv5 2428172 2428171 2026-06-17T13:55:23Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, abi: Backport for [[gerrit:1302739|ULS rewrite: Lock body scroll when open on mobile]], [[gerrit:1302743|ULS rewrite: Fix settings dialog width and field sizing (T416512)]], [[gerrit:1303010|ULS rewrite: Show variants even when no languages are available (T426532)]], [[gerrit:1303009|ULS rewrite: Capture trigger element before async module load (T429145)]], [[ge 2428172 wikitext text/x-wiki 49vne2u1t2yq5423zh4xaf7s8qq98pp 2428176 2428172 2026-06-17T13:58:14Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" 2428176 wikitext text/x-wiki 5sq4fybr46amiv3yej0jshd00t2c5j6 2428177 2428176 2026-06-17T13:58:16Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-wdqs2004.codfw.wmnet with OS bookworm 2428177 wikitext text/x-wiki qqhgqzqrgivbxacttiplwlzjsn8rl6x 2428178 2428177 2026-06-17T13:58:19Z Stashbot 7414 btullis@cumin1003: END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1003" 2428178 wikitext text/x-wiki n6tng2i5lt84va69fsxcphgb5oxqora 2428179 2428178 2026-06-17T13:58:22Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-wdqs2003.codfw.wmnet with OS bookworm 2428179 wikitext text/x-wiki h7d0dx6y0t4wnxes0gymx9grdv8c3ni 2428180 2428179 2026-06-17T14:00:57Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] START helmfile.d/admin 'sync'. 2428180 wikitext text/x-wiki 33mda1yox2erz2mbz9zugrrg31ev17y 2428181 2428180 2026-06-17T14:01:14Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'sync'. 2428181 wikitext text/x-wiki rznukvizhpzn6scinpsz4s8vth4tzef 2428183 2428181 2026-06-17T14:06:12Z Stashbot 7414 ecarg@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2428183 wikitext text/x-wiki t4cq2p30kinumesc5z61dnmabfuyslt 2428184 2428183 2026-06-17T14:08:43Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, abi: Continuing with deployment 2428184 wikitext text/x-wiki 4joo1qtmsy1tzd8n0mlyneslkzmwkds 2428186 2428184 2026-06-17T14:11:39Z Stashbot 7414 btullis@puppetserver1001: conftool action : set/weight=10; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-wdqs*.eqiad.wmnet 2428186 wikitext text/x-wiki n6w7zxs38k56bsi5nbnl5yxz55v8705 2428187 2428186 2026-06-17T14:12:00Z Stashbot 7414 btullis@puppetserver1001: conftool action : set/weight=10; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-wdqs1001.eqiad.wmnet 2428187 wikitext text/x-wiki 6jkn6qgg5v1azbuyplr7snetbymq9py 2428188 2428187 2026-06-17T14:12:04Z Stashbot 7414 btullis@puppetserver1001: conftool action : set/weight=10; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-wdqs1002.eqiad.wmnet 2428188 wikitext text/x-wiki aml6ltnrzo3t0txgypjnrz9x3w4bjrg 2428189 2428188 2026-06-17T14:12:08Z Stashbot 7414 btullis@puppetserver1001: conftool action : set/weight=10; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-wdqs1003.eqiad.wmnet 2428189 wikitext text/x-wiki q8zdjxicp0jkar4xw6x1k2asteqi8zl 2428190 2428189 2026-06-17T14:12:14Z Stashbot 7414 btullis@puppetserver1001: conftool action : set/weight=10; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-wdqs-test1001.eqiad.wmnet 2428190 wikitext text/x-wiki kfg1vcg5vl371c5suqqddd4n3zi8tdd 2428191 2428190 2026-06-17T14:12:27Z Stashbot 7414 btullis@puppetserver1001: conftool action : set/pooled=yes; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-wdqs1001.eqiad.wmnet 2428191 wikitext text/x-wiki 8m6tsb9eu4sh0wkpbeyokmgm2vh6qq5 2428192 2428191 2026-06-17T14:12:31Z Stashbot 7414 btullis@puppetserver1001: conftool action : set/pooled=yes; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-wdqs1002.eqiad.wmnet 2428192 wikitext text/x-wiki 2rqxt9jnvuv23ete8qz1nnr4jy7awhl 2428193 2428192 2026-06-17T14:12:35Z Stashbot 7414 btullis@puppetserver1001: conftool action : set/pooled=yes; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-wdqs1003.eqiad.wmnet 2428193 wikitext text/x-wiki 94e18a9seh4jv08tsrkl5gqf4pqn57k 2428194 2428193 2026-06-17T14:12:44Z Stashbot 7414 btullis@puppetserver1001: conftool action : set/pooled=yes; selector: service=kubesvc,cluster=dse-k8s,dc=eqiad,name=dse-k8s-wdqs-test1001.eqiad.wmnet 2428194 wikitext text/x-wiki ptwj4zu1l4y67yo4hnbyzg4doxrrv17 2428195 2428194 2026-06-17T14:13:04Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1302739|ULS rewrite: Lock body scroll when open on mobile]], [[gerrit:1302743|ULS rewrite: Fix settings dialog width and field sizing (T416512)]], [[gerrit:1303010|ULS rewrite: Show variants even when no languages are available (T426532)]], [[gerrit:1303009|ULS rewrite: Capture trigger element before async module load (T429145)]], [[gerr 2428195 wikitext text/x-wiki l1c9piktq9yi85fj6q1czqui6p2n6ja 2428196 2428195 2026-06-17T14:13:11Z Stashbot 7414 Lucas_WMDE: UTC afternoon backport+config window done 2428196 wikitext text/x-wiki mxybalkxr75u0fzl41nk3w1zg539dum 2428197 2428196 2026-06-17T14:13:36Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2428197 wikitext text/x-wiki jc93qqscda04q78u4vftq60oaz4ftfp 2428198 2428197 2026-06-17T14:13:57Z Stashbot 7414 elukey: add basic Kafka ACLs for anonymous to logging-eqiad - T425528 2428198 wikitext text/x-wiki 46bncn9so0un8tvt7v1pq75gt0uxclg 2428199 2428198 2026-06-17T14:14:00Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es2048: Upgrading es2048.codfw.wmnet 2428199 wikitext text/x-wiki cm2dk7ljcvoshyq91f2x7zzpfag2nrw 2428200 2428199 2026-06-17T14:14:40Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2048: Upgrading es2048.codfw.wmnet 2428200 wikitext text/x-wiki 6qp2ab3kdrmx5lk5skv39urk195wwmj 2428201 2428200 2026-06-17T14:16:35Z Stashbot 7414 ecarg@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2428201 wikitext text/x-wiki qx0lu5fr2bqeg77zl77we36y14rmc60 2428202 2428201 2026-06-17T14:16:57Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/mw-mcrouter: apply 2428202 wikitext text/x-wiki mwau2j2dwrvs12vtht6ovtopipurrkf 2428203 2428202 2026-06-17T14:17:08Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-mcrouter: apply 2428203 wikitext text/x-wiki oxqlnu1qcjioedt78ctge44kvapujyo 2428204 2428203 2026-06-17T14:17:15Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-mcrouter: apply 2428204 wikitext text/x-wiki hcakbqmrvjmt4j0m6d0586esgpihj8z 2428205 2428204 2026-06-17T14:17:20Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-mcrouter: apply 2428205 wikitext text/x-wiki fvns1mon7qxh94uhwv1d0h572wnfdge 2428206 2428205 2026-06-17T14:17:26Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es2048.codfw.wmnet with OS trixie 2428206 wikitext text/x-wiki r9ue3w7w2wgjhjzf7wbf97uv73vvb6f 2428207 2428206 2026-06-17T14:18:53Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1303436|Add Wikidata configuration for WikiProject links (T422935 T422936)]] 2428207 wikitext text/x-wiki 0ho9v0j72dxu5qqt3ej68rgzq85siha 2428208 2428207 2026-06-17T14:19:03Z Stashbot 7414 cdobbins@cumin1003: conftool action : set/pooled=no; selector: name=dns7002.* 2428208 wikitext text/x-wiki 924mwdroyfkhllksql3omepij0m4cr5 2428209 2428208 2026-06-17T14:19:48Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.reimage for host mc-gp1004.eqiad.wmnet with OS trixie 2428209 wikitext text/x-wiki 2m2f9pvib1656cxrj831njfeolmjfqz 2428210 2428209 2026-06-17T14:20:51Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: audreypenven, lucaswerkmeister-wmde: Backport for [[gerrit:1303436|Add Wikidata configuration for WikiProject links (T422935 T422936)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428210 wikitext text/x-wiki 7kw42q74ejwzl2b486q9d5ehk9f4edn 2428211 2428210 2026-06-17T14:21:04Z Stashbot 7414 cjd91: depooling dns7002 to attempt reimage to trixie 2428211 wikitext text/x-wiki 6gmdwkzsjpr4jbbxjjo40aboomfism3 2428212 2428211 2026-06-17T14:22:20Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: audreypenven, lucaswerkmeister-wmde: Continuing with deployment 2428212 wikitext text/x-wiki pu26iavjgqlm3evjd44ipd5te4cq0kg 2428213 2428212 2026-06-17T14:26:42Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303436|Add Wikidata configuration for WikiProject links (T422935 T422936)]] (duration: 07m 49s) 2428213 wikitext text/x-wiki diym1dpczqjpdpugc6s0bwb7p0won0k 2428214 2428213 2026-06-17T14:28:08Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.reimage for host dns7002.wikimedia.org with OS trixie 2428214 wikitext text/x-wiki pm38hsmejoeh3a371gsd0ns454cuxvu 2428215 2428214 2026-06-17T14:33:10Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es2048.codfw.wmnet with reason: host reimage 2428215 wikitext text/x-wiki lfg1s7ndkhf6iqwe9fb2f1fxr0xhcvd 2428216 2428215 2026-06-17T14:35:59Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc-gp1004.eqiad.wmnet with reason: host reimage 2428216 wikitext text/x-wiki 9akaol0u28pcqfnlhnenl5p2ze0mm30 2428218 2428216 2026-06-17T14:40:17Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2048.codfw.wmnet with reason: host reimage 2428218 wikitext text/x-wiki ni10e3se8sx0vwwz8zb7rcg2lrroyg3 2428220 2428218 2026-06-17T14:44:40Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc-gp1004.eqiad.wmnet with reason: host reimage 2428220 wikitext text/x-wiki b8yfs65zhofk094cmaatj1jrq703vib 2428224 2428220 2026-06-17T14:56:39Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on dns7002.wikimedia.org with reason: host reimage 2428224 wikitext text/x-wiki 3ekl5wl1gv5kzi63mx9q38z4aisd787 2428225 2428224 2026-06-17T14:57:18Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2048.codfw.wmnet with OS trixie 2428225 wikitext text/x-wiki dk3u8k2iwtif2z8to1ppzrymr67nriw 2428226 2428225 2026-06-17T14:59:51Z Stashbot 7414 cdobbins@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns7002.wikimedia.org with reason: host reimage 2428226 wikitext text/x-wiki pwi39ibixr7ebk6ben2g4aqcdcqj728 2428227 2428226 2026-06-17T15:00:58Z Stashbot 7414 aokoth@deploy1003: Started deploy [phabricator/deployment@a640ed9]: deploy phab 2428227 wikitext text/x-wiki n1hgkb7jsyxkrnllqvhabw4bj19owhe 2428228 2428227 2026-06-17T15:02:22Z Stashbot 7414 aokoth@deploy1003: Finished deploy [phabricator/deployment@a640ed9]: deploy phab (duration: 01m 24s) 2428228 wikitext text/x-wiki jg6p6xbm4algq0l17j3in6fsu38l9ks 2428229 2428228 2026-06-17T15:03:15Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc-gp1004.eqiad.wmnet with OS trixie 2428229 wikitext text/x-wiki rxmh32ffcasep0f2uwxl5p9ln21zxm2 2428231 2428229 2026-06-17T15:05:29Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply 2428231 wikitext text/x-wiki d82br2wqgmg1osqjr8lk5dp2v207y4h 2428232 2428231 2026-06-17T15:05:58Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply 2428232 wikitext text/x-wiki cwvb9yr46vsy6h73eqb774ytw5n3aqt 2428233 2428232 2026-06-17T15:08:44Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es2048: Migration of es2048.codfw.wmnet completed 2428233 wikitext text/x-wiki 0on9info7hys7g0n8yiqm6l7pqgmgni 2428237 2428233 2026-06-17T15:26:12Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.reimage for host kafka-logging1007.eqiad.wmnet with OS trixie 2428237 wikitext text/x-wiki 00s6e65jzrjgjdpk3tfpmbkb3aq6gtz 2428238 2428237 2026-06-17T15:27:46Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2428238 wikitext text/x-wiki 8e19q32tbewfgqepunktmvjldorsgnn 2428239 2428238 2026-06-17T15:30:45Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2428239 wikitext text/x-wiki mlot2dijgy5st4yexx616i5qn8r5xmr 2428241 2428239 2026-06-17T15:42:49Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.reimage for host cloudvirt1078.eqiad.wmnet with OS trixie 2428241 wikitext text/x-wiki m9giu4s9kuxxzp4mks99j2rjr0wmoj6 2428242 2428241 2026-06-17T15:46:26Z Stashbot 7414 moritzm: installing python-ldap security updates 2428242 wikitext text/x-wiki 55sf5752hz3md1avgafun6kshlatb7n 2428243 2428242 2026-06-17T15:47:25Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-logging1007.eqiad.wmnet with reason: host reimage 2428243 wikitext text/x-wiki r4eb11frg4wdo4a09mflpa8damjtzqa 2428245 2428243 2026-06-17T15:53:41Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1078.eqiad.wmnet with reason: host reimage 2428245 wikitext text/x-wiki dqxb25pbhjpu8sj3s7mgqnmnafk8emr 2428246 2428245 2026-06-17T15:54:14Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es2048: Migration of es2048.codfw.wmnet completed 2428246 wikitext text/x-wiki kue07y4lokflglbjrgyz2wnjbwq3k0u 2428247 2428246 2026-06-17T15:54:16Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2428247 wikitext text/x-wiki iqb40zqnmm3pvdx5j9jsolp60k5smrn 2428248 2428247 2026-06-17T15:54:40Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-logging1007.eqiad.wmnet with reason: host reimage 2428248 wikitext text/x-wiki 01jchdp98avbhdxitc3wyd77b8b52xx 2428249 2428248 2026-06-17T15:58:45Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1078.eqiad.wmnet with reason: host reimage 2428249 wikitext text/x-wiki d2lmptobfbruhxcdbkhfwdxvgguc5rl 2428250 2428249 2026-06-17T16:00:16Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.cdn.roll-restart-purged rolling restart_daemons on A:cp and not P{cp7001.magru.wmnet} and A:cp 2428250 wikitext text/x-wiki enld2r4sdwzymiatzwvsrxuty0fw4os 2428251 2428250 2026-06-17T16:02:29Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.loadbalancer.admin depooling P{lvs5005.eqsin.wmnet} and A:liberica 2428251 wikitext text/x-wiki j5uc3cfs8xrkd9swvog85xwiraziqby 2428252 2428251 2026-06-17T16:03:00Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) depooling P{lvs5005.eqsin.wmnet} and A:liberica 2428252 wikitext text/x-wiki 8e7su6jzhph5scxiurxtmgwmtgi8n7m 2428253 2428252 2026-06-17T16:11:50Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1003" 2428253 wikitext text/x-wiki 59kp6n50t2a1hm1viveg8w1tymdwd24 2428254 2428253 2026-06-17T16:15:40Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1003" 2428254 wikitext text/x-wiki tsjb3895wczjhe64h3t2gtknl14womh 2428255 2428254 2026-06-17T16:15:42Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-logging1007.eqiad.wmnet with OS trixie 2428255 wikitext text/x-wiki g2ma1g87aa2wz00aul76xazu94ppnqo 2428256 2428255 2026-06-17T16:15:45Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.reimage for host lvs5005.eqsin.wmnet with OS bookworm 2428256 wikitext text/x-wiki 057kbk0jt0i9v8fdzpkktqh6laxjpo1 2428257 2428256 2026-06-17T16:16:05Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1003" 2428257 wikitext text/x-wiki 0n9bxz0adyw9ouboigpp96ntj6q51vs 2428258 2428257 2026-06-17T16:16:23Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.move-vlan for host lvs5005 2428258 wikitext text/x-wiki gxl9ue492870lemue20prccz807i71c 2428259 2428258 2026-06-17T16:16:25Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1003" 2428259 wikitext text/x-wiki 9x3ymt2bwtyi7u194zlp7ph2zlsyzee 2428260 2428259 2026-06-17T16:16:27Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1078.eqiad.wmnet with OS trixie 2428260 wikitext text/x-wiki ta8hceydsgc3t77wlu4wt0grmse4qa6 2428261 2428260 2026-06-17T16:39:56Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.dns.netbox 2428261 wikitext text/x-wiki tkfz70nxffxolezfkd3yo72cgcnt6o5 2428262 2428261 2026-06-17T16:45:13Z Stashbot 7414 dcausse@deploy1003: helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply 2428262 wikitext text/x-wiki mkihqpfpdjm0tbq7bucx1i7uhf4uuwi 2428263 2428262 2026-06-17T16:45:26Z Stashbot 7414 dcausse@deploy1003: helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply 2428263 wikitext text/x-wiki srs54wndhqrls2m650dpo1qe7ksyh17 2428264 2428263 2026-06-17T16:45:45Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host lvs5005 - brett@cumin2002" 2428264 wikitext text/x-wiki jrgl0dolrvmzgg7uql31jdusgj2ms0i 2428265 2428264 2026-06-17T16:45:50Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host lvs5005 - brett@cumin2002" 2428265 wikitext text/x-wiki kbu825njw4x1v4i6vvj8t6ir7idphzs 2428266 2428265 2026-06-17T16:45:52Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2428266 wikitext text/x-wiki jztqyg7eqwd5310sr3rjacl8bmb3zth 2428267 2428266 2026-06-17T16:45:55Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.dns.wipe-cache lvs5005.eqsin.wmnet 6.0.132.10.in-addr.arpa 6.0.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors 2428267 wikitext text/x-wiki n0xozlxrxsn1752ahhwmhi7z8dq96dx 2428268 2428267 2026-06-17T16:45:57Z Stashbot 7414 brett@cumin2002: END (FAIL) - Cookbook sre.dns.wipe-cache (exit_code=99) lvs5005.eqsin.wmnet 6.0.132.10.in-addr.arpa 6.0.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors 2428268 wikitext text/x-wiki fhaofduyyz026qdzagwuodxpiiardwu 2428269 2428268 2026-06-17T16:47:17Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.dns.wipe-cache lvs5005.eqsin.wmnet 6.0.132.10.in-addr.arpa 6.0.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors 2428269 wikitext text/x-wiki ba47zr2ijvah9btf69t5rhtrzdeiaiu 2428270 2428269 2026-06-17T16:47:20Z Stashbot 7414 brett@cumin2002: END (FAIL) - Cookbook sre.dns.wipe-cache (exit_code=99) lvs5005.eqsin.wmnet 6.0.132.10.in-addr.arpa 6.0.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors 2428270 wikitext text/x-wiki bz3lw6klqtkwd2272oa3hogtr7lj27n 2428271 2428270 2026-06-17T16:47:42Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host lvs5005 2428271 wikitext text/x-wiki 15703jle6wahnwkcmw34fxg03hc31pp 2428272 2428271 2026-06-17T16:47:51Z Stashbot 7414 dcausse@deploy1003: helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply 2428272 wikitext text/x-wiki s9n71stcu41i5qpnciog4n0x0wvscvq 2428273 2428272 2026-06-17T16:48:05Z Stashbot 7414 dcausse@deploy1003: helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply 2428273 wikitext text/x-wiki jxwf8d41m68qnwjun7b6nai5ovtljqd 2428274 2428273 2026-06-17T16:48:30Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host lvs5005 2428274 wikitext text/x-wiki or2w8qgo793ct1b8yysdsptl8aarz6r 2428275 2428274 2026-06-17T16:48:31Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host lvs5005 2428275 wikitext text/x-wiki 1jw6k95gimbq5vt5vk1oqfy1hrr6t4d 2428277 2428275 2026-06-17T16:49:39Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.cdn.roll-restart-ats rolling restart_daemons on A:cp 2428277 wikitext text/x-wiki 03nz4ezbwsr32a88n21rmio61h0b2h5 2428278 2428277 2026-06-17T16:51:01Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2428278 wikitext text/x-wiki izusip4bwjjosi83x8ncmdfsqqhkc5f 2428279 2428278 2026-06-17T16:51:14Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2428279 wikitext text/x-wiki 5a7kycci9pen3puivhwfiuctstmo1bv 2428281 2428279 2026-06-17T17:03:04Z Stashbot 7414 mutante: contint1003 - re-enabling puppet - checking it does NOT start jenkins - also see gerrit:1297236 and gerrit:1301416 - T418521 2428281 wikitext text/x-wiki ohz8ro586mogi7yra355b67v83qzf3n 2428282 2428281 2026-06-17T17:06:09Z Stashbot 7414 mutante: contint1003 - even with gerrit:1301416 jenkins was STILL restarted :/ - stopping it manually and puppet - debugging - T418521 2428282 wikitext text/x-wiki lrji6ps4k2r3ik2z16o9ay36pq3odg2 2428283 2428282 2026-06-17T17:16:58Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on lvs5005.eqsin.wmnet with reason: host reimage 2428283 wikitext text/x-wiki nqo6j40gf0shj66897duo9javx9ynd8 2428284 2428283 2026-06-17T17:20:40Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs5005.eqsin.wmnet with reason: host reimage 2428284 wikitext text/x-wiki e37lwkkxid06pnwgquf26vdnol1tmh8 2428288 2428284 2026-06-17T17:41:56Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs5005.eqsin.wmnet with OS bookworm 2428288 wikitext text/x-wiki 6i3oet8381v7bk0kc0jaouih1dwd9eh 2428289 2428288 2026-06-17T18:07:03Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=no; selector: name=cp6011.* 2428289 wikitext text/x-wiki 9da8k8jf9w0u8wbio3hmivdi595pzr4 2428290 2428289 2026-06-17T18:07:26Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.reboot-single for host cp6011.drmrs.wmnet 2428290 wikitext text/x-wiki kaiyl8agpkm7iddq2jn5ob4ydrog8vm 2428294 2428290 2026-06-17T18:16:46Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp6011.drmrs.wmnet 2428294 wikitext text/x-wiki mijj8shm57o5eei4re4wn2rq3qmfk1q 2428295 2428294 2026-06-17T18:17:08Z Stashbot 7414 brett: commit new lvs5005 IP address to cr2-eqsin.wikimedia.org,cr3-eqsin.wikimedia.org 2428295 wikitext text/x-wiki eiago7wu9te68l4akbpe9x84a7wwaac 2428297 2428295 2026-06-17T18:19:44Z Stashbot 7414 brett@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on cp6011.drmrs.wmnet with reason: ats restart, continuing from failed cookbook run 2428297 wikitext text/x-wiki n3s5cvmypwe8fobqeal982gbp2txoep 2428299 2428297 2026-06-17T18:24:06Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.remove-downtime for cp6011.drmrs.wmnet 2428299 wikitext text/x-wiki kkldoneix4tqan01dwmr8tdlpzk8qyb 2428300 2428299 2026-06-17T18:24:08Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp6011.drmrs.wmnet 2428300 wikitext text/x-wiki oxn0i73i38kg2f8olaiy9zwicz67kn7 2428301 2428300 2026-06-17T18:24:15Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp6011.* 2428301 wikitext text/x-wiki 018iwkkkgeyjmkhz5yisr37ualr8ouy 2428303 2428301 2026-06-17T18:46:33Z Stashbot 7414 andrew@cumin2002: START - Cookbook sre.hosts.decommission for hosts cloudcontrol1008-dev.eqiad.wmnet 2428303 wikitext text/x-wiki ej0avpvrdtdt5opasmdpuc2fg0t1fq5 2428306 2428303 2026-06-17T18:52:17Z Stashbot 7414 andrew@cumin2002: START - Cookbook sre.dns.netbox 2428306 wikitext text/x-wiki sjmbkwbxztndy5x8q59h9smcy8m3ogz 2428308 2428306 2026-06-17T18:59:29Z Stashbot 7414 andrew@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudcontrol1008-dev.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin2002" 2428308 wikitext text/x-wiki aoin1ff1po9jv3b884ybbmnzsqs21kp 2428309 2428308 2026-06-17T19:00:03Z Stashbot 7414 andrew@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cloudcontrol1008-dev.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - andrew@cumin2002" 2428309 wikitext text/x-wiki p80daqldcsgyyzc1v87hbygychc9b8q 2428310 2428309 2026-06-17T19:00:06Z Stashbot 7414 andrew@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2428310 wikitext text/x-wiki nh8lxsl6xrua29mwvropbvc7v9exel9 2428311 2428310 2026-06-17T19:00:07Z Stashbot 7414 andrew@cumin2002: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cloudcontrol1008-dev.eqiad.wmnet 2428311 wikitext text/x-wiki csty3gabc07u7wyr1xh93m0164qj7d1 2428312 2428311 2026-06-17T19:01:58Z Stashbot 7414 jhuneidi@deploy1003: Started scap sync-world: Attempt to roll wmf.7 to group 1 2428312 wikitext text/x-wiki sw6e8zf7bv5z0svswf5gbs1rmnlf5ya 2428315 2428312 2026-06-17T19:08:49Z Stashbot 7414 jhuneidi@deploy1003: Finished scap sync-world: Attempt to roll wmf.7 to group 1 (duration: 07m 24s) 2428315 wikitext text/x-wiki nylxc6wfo0l4ukf9nzhh2b00kddx3v5 2428316 2428315 2026-06-17T19:10:01Z Stashbot 7414 jhuneidi@deploy1003: Started scap sync-world: wmf.7 to group 1 (Take 2) 2428316 wikitext text/x-wiki apxu09ztnzhfw587u0taprnvblhb8f3 2428318 2428316 2026-06-17T19:16:05Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.cdn.roll-restart-purged (exit_code=0) rolling restart_daemons on A:cp and not P{cp7001.magru.wmnet} and A:cp 2428318 wikitext text/x-wiki a02gu08avjrxg97o0xpgr9i1g96w9q3 2428319 2428318 2026-06-17T19:16:32Z Stashbot 7414 jhuneidi@deploy1003: Finished scap sync-world: wmf.7 to group 1 (Take 2) (duration: 07m 01s) 2428319 wikitext text/x-wiki 9tgndoj26k5p1641r4f1lbm8k63xt16 2428324 2428319 2026-06-17T19:30:56Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.loadbalancer.admin config_reloading P{lvs5005*} and A:liberica (T428229) 2428324 wikitext text/x-wiki q6fz5j2mqtwk1xw9fuamr7wkbkte5av 2428325 2428324 2026-06-17T19:31:21Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) config_reloading P{lvs5005*} and A:liberica (T428229) 2428325 wikitext text/x-wiki h877qwiip4jgv76n4ls1l1b3wqaq9w0 2428327 2428325 2026-06-17T19:42:45Z Stashbot 7414 jgreen@dns1005: START - running authdns-update 2428327 wikitext text/x-wiki 1d1fbxh7l5ysxhha62oek6drz58bk48 2428328 2428327 2026-06-17T19:44:36Z Stashbot 7414 jgreen@dns1005: END - running authdns-update 2428328 wikitext text/x-wiki 1rmvobp98vgz22nzkxswl04njp2jp9b 2428329 2428328 2026-06-17T20:11:01Z Stashbot 7414 sgimeno@deploy1003: Started scap sync-world: Backport for [[gerrit:1303365|migrateMentorStatusAway: Return SIMULATED for all dry-run executions (T409170)]], [[gerrit:1303364|migrateMentorStatusAway: Return SIMULATED for all dry-run executions (T409170)]] 2428329 wikitext text/x-wiki 00lciledih9ijkfcksotyeg9hmf3njh 2428330 2428329 2026-06-17T20:12:59Z Stashbot 7414 sgimeno@deploy1003: sgimeno: Backport for [[gerrit:1303365|migrateMentorStatusAway: Return SIMULATED for all dry-run executions (T409170)]], [[gerrit:1303364|migrateMentorStatusAway: Return SIMULATED for all dry-run executions (T409170)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428330 wikitext text/x-wiki o8y88txd3guoah8tjxak4d22f32lkb2 2428331 2428330 2026-06-17T20:13:36Z Stashbot 7414 sgimeno@deploy1003: sgimeno: Continuing with deployment 2428331 wikitext text/x-wiki 0rdf705b4ie4trdeefe0di7xsiau7ya 2428332 2428331 2026-06-17T20:17:56Z Stashbot 7414 sgimeno@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303365|migrateMentorStatusAway: Return SIMULATED for all dry-run executions (T409170)]], [[gerrit:1303364|migrateMentorStatusAway: Return SIMULATED for all dry-run executions (T409170)]] (duration: 06m 55s) 2428332 wikitext text/x-wiki o3oovv24ogm3xqm68msvusf1z5075md 2428336 2428332 2026-06-17T20:27:45Z Stashbot 7414 sbisson@deploy1003: Started scap sync-world: Backport for [[gerrit:1303012|Enable ULS v2 on group1 wikis]] 2428336 wikitext text/x-wiki 0vfko5if7hx06dt2ewleyf5w83njw2p 2428337 2428336 2026-06-17T20:29:45Z Stashbot 7414 sbisson@deploy1003: sbisson, abi: Backport for [[gerrit:1303012|Enable ULS v2 on group1 wikis]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428337 wikitext text/x-wiki hlo7qypku3geagvr173f4jiewy75c8h 2428338 2428337 2026-06-17T20:31:54Z Stashbot 7414 sbisson@deploy1003: sbisson, abi: Continuing with deployment 2428338 wikitext text/x-wiki rp0weesxlvqkyr3cjm6yhtgljp2zvp4 2428339 2428338 2026-06-17T20:36:11Z Stashbot 7414 sbisson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303012|Enable ULS v2 on group1 wikis]] (duration: 08m 26s) 2428339 wikitext text/x-wiki mjxrfokditi16isy63j4dier1zq8c2v 2428340 2428339 2026-06-17T20:41:13Z Stashbot 7414 cdobbins@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dns7002.wikimedia.org with OS trixie 2428340 wikitext text/x-wiki lny19eakfxtwci6qomuqqrleb00wkf3 2428341 2428340 2026-06-17T20:41:45Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.cdn.roll-restart-ats (exit_code=0) rolling restart_daemons on A:cp 2428341 wikitext text/x-wiki 3osb6oaojurw8z4y34jbd2w7yr0enbe 2428342 2428341 2026-06-17T20:45:13Z Stashbot 7414 cdobbins@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dns7002.wikimedia.org with reason: bird.service keeps failing 2428342 wikitext text/x-wiki 6c9mpjw0xeauvy0lzmgdrgynug8zhst 2428345 2428342 2026-06-17T21:02:02Z Stashbot 7414 zabe@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-experimental: apply 2428345 wikitext text/x-wiki idu07d6qjemnqmz731nzzy900kqbu2p 2428346 2428345 2026-06-17T21:02:36Z Stashbot 7414 zabe@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply 2428346 wikitext text/x-wiki se89tm7a02asfcov46m6y1wmumhm4b0 2428347 2428346 2026-06-17T21:05:20Z Stashbot 7414 ecarg@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2428347 wikitext text/x-wiki 77h6n3zs37tqys8ra83g1ris2ogt0tv 2428348 2428347 2026-06-17T21:06:10Z Stashbot 7414 ecarg@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2428348 wikitext text/x-wiki teqag1etp2wo3rd3ye3uysqtrve0dgm 2428350 2428348 2026-06-17T21:09:37Z Stashbot 7414 ecarg@deploy1003: helmfile [codfw] START helmfile.d/services/wikifunctions: apply 2428350 wikitext text/x-wiki gmgun15eolpz3n9zxfprirqwzfcwurg 2428351 2428350 2026-06-17T21:12:11Z Stashbot 7414 ecarg@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply 2428351 wikitext text/x-wiki 43a5yve8x4h5ys3rnnxipdkp55s642a 2428352 2428351 2026-06-17T21:12:22Z Stashbot 7414 ecarg@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2428352 wikitext text/x-wiki otc3vr9qbelw16zl40i4tme9q3bieio 2428353 2428352 2026-06-17T21:15:26Z Stashbot 7414 ecarg@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2428353 wikitext text/x-wiki 92izv2xlwh64kkopu7axej6g85709v8 2428354 2428353 2026-06-17T21:20:24Z Stashbot 7414 ecarg@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2428354 wikitext text/x-wiki j6ieg78pux0dq0s45zuzjppkfu2ns5b 2428355 2428354 2026-06-17T21:20:48Z Stashbot 7414 ecarg@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2428355 wikitext text/x-wiki e3lc67aujbq8wefrphkuy9fwz6ofs3f 2428356 2428355 2026-06-17T21:21:19Z Stashbot 7414 ecarg@deploy1003: helmfile [codfw] START helmfile.d/services/wikifunctions: apply 2428356 wikitext text/x-wiki suykgm5zbzva6rqz1pmvey8idkqn475 2428357 2428356 2026-06-17T21:22:10Z Stashbot 7414 ecarg@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply 2428357 wikitext text/x-wiki s1klkprne75i0t8zgcxre370tzhco5s 2428358 2428357 2026-06-17T21:22:18Z Stashbot 7414 ecarg@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2428358 wikitext text/x-wiki d4zq7amqzgbk70y805vustnld61kdgk 2428359 2428358 2026-06-17T21:23:07Z Stashbot 7414 ecarg@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2428359 wikitext text/x-wiki g9vq24gupuqazjqykve3bobuwfl3jmt 2428360 2428359 2026-06-17T21:27:19Z Stashbot 7414 ecarg@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2428360 wikitext text/x-wiki 9dv4n1qzboo1yr9r9rqbu1k92nirekp 2428361 2428360 2026-06-17T21:27:52Z Stashbot 7414 ecarg@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2428361 wikitext text/x-wiki 72jfz5ilmf2wgxlbid4aeimlootpwm0 2428362 2428361 2026-06-17T21:28:23Z Stashbot 7414 ecarg@deploy1003: helmfile [codfw] START helmfile.d/services/wikifunctions: apply 2428362 wikitext text/x-wiki fq4k5u3dt53bs0iwejsb22p0qo6oyj9 2428363 2428362 2026-06-17T21:29:10Z Stashbot 7414 ecarg@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply 2428363 wikitext text/x-wiki p7l05n0o3p5readjpbd0o2wqdohep59 2428364 2428363 2026-06-17T21:29:29Z Stashbot 7414 ecarg@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2428364 wikitext text/x-wiki pxgo5brfi575zhe0s4r9ztbnwa83tsh 2428365 2428364 2026-06-17T21:30:00Z Stashbot 7414 ecarg@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2428365 wikitext text/x-wiki 4il4qs2atvh1yitph7ksg6s5qtbfdwf 2428366 2428365 2026-06-17T21:52:05Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2428366 wikitext text/x-wiki mv6lr30pdz7d659l3m02aej3uiykiyp 2428367 2428366 2026-06-17T21:52:34Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2428367 wikitext text/x-wiki qbk58mjz0je2xpdwcgjpigz3mtcd3ze 2428371 2428367 2026-06-17T22:14:10Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1303517|Donor Delight Badge: Add accessible label and hide popover from AT (T427313)]] 2428371 wikitext text/x-wiki iejodpc4fbmpkhksr90vxiuwrmq6wfg 2428375 2428371 2026-06-17T22:31:53Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1303517|Donor Delight Badge: Add accessible label and hide popover from AT (T427313)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428375 wikitext text/x-wiki 34jbttzc9f87cqxsyee9dulrkqyokic 2428376 2428375 2026-06-17T22:32:48Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2428376 wikitext text/x-wiki r8fcz4dlx0e44o2vi33k7afk5x0sd2f 2428377 2428376 2026-06-17T22:45:12Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303517|Donor Delight Badge: Add accessible label and hide popover from AT (T427313)]] (duration: 31m 01s) 2428377 wikitext text/x-wiki 7m2iy8ysvz6pa12ezysl7cl343rg68z 2428380 2428377 2026-06-17T22:52:09Z Stashbot 7414 egardner@deploy1003: Started scap sync-world: Backport for [[gerrit:1303571|Image Browsing: fix transparent images in carousel (T429047)]], [[gerrit:1303572|MMV Beta Viewer: Make in-flight image downloads abortable (T429193)]], [[gerrit:1303573|MMV Beta Viewer: Delay the loading indicator on quick navigation (T429193)]] 2428380 wikitext text/x-wiki d7iabwuaq4fivtvb1yuzkgekcyecjbc 2428381 2428380 2026-06-17T22:56:16Z Stashbot 7414 egardner@deploy1003: egardner: Backport for [[gerrit:1303571|Image Browsing: fix transparent images in carousel (T429047)]], [[gerrit:1303572|MMV Beta Viewer: Make in-flight image downloads abortable (T429193)]], [[gerrit:1303573|MMV Beta Viewer: Delay the loading indicator on quick navigation (T429193)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428381 wikitext text/x-wiki l14e6rp9810s3jwyr79igko88ikb6do 2428382 2428381 2026-06-17T22:57:59Z Stashbot 7414 egardner@deploy1003: egardner: Continuing with deployment 2428382 wikitext text/x-wiki 6kgo7s7bepmlr8kpnqr5kiif7cz0ms4 2428384 2428382 2026-06-17T23:04:41Z Stashbot 7414 egardner@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303571|Image Browsing: fix transparent images in carousel (T429047)]], [[gerrit:1303572|MMV Beta Viewer: Make in-flight image downloads abortable (T429193)]], [[gerrit:1303573|MMV Beta Viewer: Delay the loading indicator on quick navigation (T429193)]] (duration: 12m 31s) 2428384 wikitext text/x-wiki dxf2iawol5ytgz1c7wmg7nlhe041b60 2428385 2428384 2026-06-17T23:10:09Z Stashbot 7414 egardner@deploy1003: Started scap sync-world: Backport for [[gerrit:1303552|Image Browsing: fix transparent images in carousel (T429047)]], [[gerrit:1303553|MMV Beta Viewer: Make in-flight image downloads abortable (T429193)]], [[gerrit:1303554|MMV Beta Viewer: Delay the loading indicator on quick navigation (T429193)]] 2428385 wikitext text/x-wiki spkpexse1hfjrm17rqh0c9a3co3nhe3 2428386 2428385 2026-06-17T23:12:05Z Stashbot 7414 egardner@deploy1003: egardner: Backport for [[gerrit:1303552|Image Browsing: fix transparent images in carousel (T429047)]], [[gerrit:1303553|MMV Beta Viewer: Make in-flight image downloads abortable (T429193)]], [[gerrit:1303554|MMV Beta Viewer: Delay the loading indicator on quick navigation (T429193)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428386 wikitext text/x-wiki ffq78n04v1jhgfyiknb1v54fgx2xtry 2428387 2428386 2026-06-17T23:12:39Z Stashbot 7414 egardner@deploy1003: egardner: Continuing with deployment 2428387 wikitext text/x-wiki 92l5b8ci4ubsa5yy53avb5rzwl3iwio 2428388 2428387 2026-06-17T23:14:14Z Stashbot 7414 mutante: gerrit2002 - unlink /srv/gerrit/site_path/review_site/logs/logs (T425667) 2428388 wikitext text/x-wiki 6v8dexfk9l1ednimmqi90pm1doo8v6u 2428390 2428388 2026-06-17T23:17:05Z Stashbot 7414 egardner@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303552|Image Browsing: fix transparent images in carousel (T429047)]], [[gerrit:1303553|MMV Beta Viewer: Make in-flight image downloads abortable (T429193)]], [[gerrit:1303554|MMV Beta Viewer: Delay the loading indicator on quick navigation (T429193)]] (duration: 06m 55s) 2428390 wikitext text/x-wiki eauxb699dhf21uvstvdde9i67c9oo3k 2428391 2428390 2026-06-17T23:19:51Z Stashbot 7414 egardner@deploy1003: Started scap sync-world: Backport for [[gerrit:1303504|Enable beta mobile MMV on Wikipedias (T426775)]] 2428391 wikitext text/x-wiki 5ek721gdgb4do25jp6ou7b17d5b8va8 2428392 2428391 2026-06-17T23:21:48Z Stashbot 7414 egardner@deploy1003: egardner: Backport for [[gerrit:1303504|Enable beta mobile MMV on Wikipedias (T426775)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428392 wikitext text/x-wiki g883qt1vepkpk8ktbqboge0emwj2mtr 2428393 2428392 2026-06-17T23:22:20Z Stashbot 7414 egardner@deploy1003: egardner: Continuing with deployment 2428393 wikitext text/x-wiki oeeb37ow1mums41a9a32tncakx00vqh 2428394 2428393 2026-06-17T23:26:37Z Stashbot 7414 egardner@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303504|Enable beta mobile MMV on Wikipedias (T426775)]] (duration: 06m 46s) 2428394 wikitext text/x-wiki 9qzs1g7mn5ri6cmxnq4g6yqgjdjpy01 2428396 2428394 2026-06-18T00:26:24Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1303594|Init magwiki (T428266)]] 2428396 wikitext text/x-wiki n6rcehl4vsju21exvrrye7zlq1oeits 2428397 2428396 2026-06-18T00:28:24Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Backport for [[gerrit:1303594|Init magwiki (T428266)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428397 wikitext text/x-wiki d6kf1tq3ei17m8cxlqp73wumj2upaz2 2428398 2428397 2026-06-18T00:29:16Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Continuing with deployment 2428398 wikitext text/x-wiki 5638tj2nmwhvopme8tccsxb2au2jjpl 2428399 2428398 2026-06-18T00:33:38Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303594|Init magwiki (T428266)]] (duration: 07m 14s) 2428399 wikitext text/x-wiki h1szw8dpckdk35f4sathw57r6gatjtm 2428400 2428399 2026-06-18T00:40:42Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1303596|Activate magwiki (T428266)]] 2428400 wikitext text/x-wiki c0pmnhx50ricli578vcgu752smsme4l 2428402 2428400 2026-06-18T00:42:43Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Backport for [[gerrit:1303596|Activate magwiki (T428266)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428402 wikitext text/x-wiki kn24zrsbwp7r088k1zgr8i9kfnis48w 2428403 2428402 2026-06-18T00:43:53Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Continuing with deployment 2428403 wikitext text/x-wiki 1y21sc9cg61ol1l00tex0vw04d6yaun 2428404 2428403 2026-06-18T00:48:07Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303596|Activate magwiki (T428266)]] (duration: 07m 25s) 2428404 wikitext text/x-wiki 4pvardc65ikiy0uga3cva1co1p8w06h 2428405 2428404 2026-06-18T01:12:32Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1303600|Update interwiki map (T428266)]] 2428405 wikitext text/x-wiki t6gsdqd9dxvzozai2lolsdkd1xbnwyi 2428406 2428405 2026-06-18T01:14:31Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Backport for [[gerrit:1303600|Update interwiki map (T428266)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428406 wikitext text/x-wiki 0e6yqu92yvlkt0lre006y9zwwk2gxbo 2428407 2428406 2026-06-18T01:15:07Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Continuing with deployment 2428407 wikitext text/x-wiki m9w9qoo65g8itqu7v4ydiwzxkjek49n 2428408 2428407 2026-06-18T01:19:27Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303600|Update interwiki map (T428266)]] (duration: 06m 55s) 2428408 wikitext text/x-wiki cywi8cdegb3lj35rfnkpgsrreyiksop 2428409 2428408 2026-06-18T02:00:47Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2428409 wikitext text/x-wiki 7jtaoz423imj1bsctppa682yxdqp8w0 2428410 2428409 2026-06-18T02:07:32Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 06m 45s) 2428410 wikitext text/x-wiki szh87gxvfuti74sxcf0rvjaj6c09he7 2428413 2428410 2026-06-18T05:12:41Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2428413 wikitext text/x-wiki o9g6wvi6uhl5xnpxdua6k45zpg23z4l 2428414 2428413 2026-06-18T05:12:45Z Stashbot 7414 marostegui@cumin1003: dbmaint on es7@codfw T429463 2428414 wikitext text/x-wiki j4c18ed3rzfkog7po7cojejksporler 2428415 2428414 2026-06-18T05:13:03Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es2040: Upgrading es2040.codfw.wmnet 2428415 wikitext text/x-wiki mptw6jwqlfrlqs8oj3l0e7328vf48em 2428416 2428415 2026-06-18T05:13:24Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2040: Upgrading es2040.codfw.wmnet 2428416 wikitext text/x-wiki 2uw2elv6n5urtm8cqxecmgytub3gu2e 2428417 2428416 2026-06-18T05:14:37Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es2040.codfw.wmnet with OS trixie 2428417 wikitext text/x-wiki o4ctpedb701geam0ixvkkcv572b0g2l 2428419 2428417 2026-06-18T05:27:40Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Remove db1224 from dbctl T429561', diff saved to https://phabricator.wikimedia.org/P94269 and previous config saved to /var/cache/conftool/dbconfig/20260618-052737-marostegui.json 2428419 wikitext text/x-wiki dq1nsbqzj4set1f4571vnianpcu6f7y 2428420 2428419 2026-06-18T05:30:54Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.decommission 2428420 wikitext text/x-wiki j6dqjovb2395e7j7d3kcbfeegqvbnjs 2428421 2428420 2026-06-18T05:31:05Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.decommission for hosts db1224.eqiad.wmnet 2428421 wikitext text/x-wiki ehvxy1edpz3757zgi7qbecunc82b1bx 2428422 2428421 2026-06-18T05:31:18Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es2040.codfw.wmnet with reason: host reimage 2428422 wikitext text/x-wiki pb3d7fjji2q4faht4i2knofx7d2b9w9 2428423 2428422 2026-06-18T05:35:35Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2040.codfw.wmnet with reason: host reimage 2428423 wikitext text/x-wiki kcqnsr8h1mhuhaej2uvq0siisjlasfs 2428424 2428423 2026-06-18T05:36:23Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.dns.netbox 2428424 wikitext text/x-wiki 75t1w26rq1uloui6stk03fq3jha9x0x 2428425 2428424 2026-06-18T05:40:48Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db1224.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1003" 2428425 wikitext text/x-wiki lqh6hwjbhqql9v7l7zmrmvnrhuxqclk 2428426 2428425 2026-06-18T05:41:04Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db1224.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1003" 2428426 wikitext text/x-wiki testi6l5cslfxjksomoqtwqahx1eyw3 2428427 2428426 2026-06-18T05:41:07Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2428427 wikitext text/x-wiki d8fqg18ws7at5d0z8392eb4agkqbv54 2428428 2428427 2026-06-18T05:41:09Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db1224.eqiad.wmnet 2428428 wikitext text/x-wiki jdxrlwiseosp2iyuldlfo8yi7cww6x9 2428429 2428428 2026-06-18T05:41:24Z Stashbot 7414 marostegui@cumin1003: Removing db1224 from zarcillo T429561 2428429 wikitext text/x-wiki 80lihup4v8txtvz6lfysz57rsgwxhue 2428430 2428429 2026-06-18T05:41:26Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.decommission (exit_code=99) 2428430 wikitext text/x-wiki ftzec9hbj2nd1cnj9zcf58dtp92g6yk 2428431 2428430 2026-06-18T05:52:21Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2040.codfw.wmnet with OS trixie 2428431 wikitext text/x-wiki 42n04g6z00iyamwect0xhzseuwjgq54 2428432 2428431 2026-06-18T06:04:37Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es2040: Migration of es2040.codfw.wmnet completed 2428432 wikitext text/x-wiki p98k5gy5durqzz8zfklxrnglke1bu6r 2428434 2428432 2026-06-18T06:50:09Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es2040: Migration of es2040.codfw.wmnet completed 2428434 wikitext text/x-wiki 691lzu37s3srs0r6t33fo63owuzvvz1 2428435 2428434 2026-06-18T06:50:11Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2428435 wikitext text/x-wiki madc6ifibyoghz48j169imk6scz2cgc 2428440 2428435 2026-06-18T08:01:20Z Stashbot 7414 moritzm: regenerate pbuilder environments on build2002 to use deb.debian.org T416707 2428440 wikitext text/x-wiki 1whovk8sut1uqftbuqe9dqf4jo8thte 2428441 2428440 2026-06-18T08:02:56Z Stashbot 7414 moritzm: uploaded wmf-laptop 1.0.6 to component/wmf-laptop on apt.wikimedia.org 2428441 wikitext text/x-wiki pn6e6f5c2timr5rcbpd6j7xma10q0h9 2428442 2428441 2026-06-18T08:05:21Z Stashbot 7414 moritzm: regenerate pbuilder environments on build2001 to use deb.debian.org T416707 2428442 wikitext text/x-wiki g2cpcuuye8yzkdgjqio8t4jozpi2ple 2428443 2428442 2026-06-18T08:19:57Z Stashbot 7414 urbanecm@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-experimental: apply 2428443 wikitext text/x-wiki 22xejitqd032lht04h8iag9nvkrtgy1 2428444 2428443 2026-06-18T08:20:26Z Stashbot 7414 urbanecm@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply 2428444 wikitext text/x-wiki ged84933t1f2c1mauz2yzf0gvo0t8wk 2428445 2428444 2026-06-18T08:21:04Z Stashbot 7414 jelto@deploy1003: helmfile [staging] START helmfile.d/services/miscweb: apply 2428445 wikitext text/x-wiki git7ovhwt33wei09dqqs8zca07uxts7 2428446 2428445 2026-06-18T08:22:09Z Stashbot 7414 jelto@deploy1003: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2428446 wikitext text/x-wiki f9jx4uji1fkw65fz2r8ghc2jok8feil 2428447 2428446 2026-06-18T08:33:18Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2428447 wikitext text/x-wiki 1yrniq10zixu6r8uddf44ebrnyirn8d 2428448 2428447 2026-06-18T08:33:50Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2428448 wikitext text/x-wiki 5ek3mhsisszxyrstqs4coarjkm44a50 2428449 2428448 2026-06-18T08:34:18Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2428449 wikitext text/x-wiki 2bgrz67f0a1p1k5m17j5vbvduf9gjl0 2428450 2428449 2026-06-18T08:35:11Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2428450 wikitext text/x-wiki to0d2nawojvdmvkiaoqmthjsznd4u5h 2428451 2428450 2026-06-18T08:51:01Z Stashbot 7414 jelto@deploy1003: helmfile [staging] START helmfile.d/services/miscweb: apply 2428451 wikitext text/x-wiki e3i5fq9vfpuc7i3d48790mbai3s8lvt 2428452 2428451 2026-06-18T08:51:08Z Stashbot 7414 jelto@deploy1003: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2428452 wikitext text/x-wiki 7e7ia1oso0rukb0ncjjz5sbx6ym9qzp 2428453 2428452 2026-06-18T08:51:18Z Stashbot 7414 jelto@deploy1003: helmfile [codfw] START helmfile.d/services/miscweb: apply 2428453 wikitext text/x-wiki 9u6c6m05zl4hyrx1t0v05ytlbkh7nky 2428454 2428453 2026-06-18T08:53:16Z Stashbot 7414 jelto@deploy1003: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2428454 wikitext text/x-wiki g5ttkcbuhloke0dne2hyn6a387bs8k7 2428455 2428454 2026-06-18T08:53:43Z Stashbot 7414 jelto@deploy1003: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2428455 wikitext text/x-wiki n5imu5mguy6xwt43wxfc67hdbrtader 2428456 2428455 2026-06-18T08:55:44Z Stashbot 7414 jelto@deploy1003: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2428456 wikitext text/x-wiki enrhxabmi9ms8vkjbfxnfi76i41h0zj 2428459 2428456 2026-06-18T09:11:38Z Stashbot 7414 moritzm: installing apache2 security updates 2428459 wikitext text/x-wiki pxylskw3g59s7vdunuirzesjq56fsza 2428461 2428459 2026-06-18T09:32:56Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-mcrouter: apply 2428461 wikitext text/x-wiki 5nic1ffmkqa4yaw6748knfd6tbwbu0h 2428462 2428461 2026-06-18T09:33:07Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-mcrouter: apply 2428462 wikitext text/x-wiki 5l41h7tt4e3n6gzmpeodf2p1l1w3qz0 2428463 2428462 2026-06-18T09:33:13Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/mw-mcrouter: apply 2428463 wikitext text/x-wiki fytze255shwsfptavo94o7as970scft 2428464 2428463 2026-06-18T09:33:20Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-mcrouter: apply 2428464 wikitext text/x-wiki 0qrjgoam1seh5iat7tiryo6z15bpttm 2428467 2428464 2026-06-18T09:51:49Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1303983|CaptchaScoreHooks: Log risk score for every non-exempt edit (T429481)]], [[gerrit:1303982|CaptchaScoreHooks: Log risk score for every non-exempt edit (T429481)]] 2428467 wikitext text/x-wiki 6etzklny8r4oq4cg5s6yptbthnqaew1 2428468 2428467 2026-06-18T09:54:02Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1303983|CaptchaScoreHooks: Log risk score for every non-exempt edit (T429481)]], [[gerrit:1303982|CaptchaScoreHooks: Log risk score for every non-exempt edit (T429481)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428468 wikitext text/x-wiki bihrfuobghuai1in4mrtf4hsecmdoz8 2428469 2428468 2026-06-18T09:55:33Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2428469 wikitext text/x-wiki q1lnr79t875mctf18658gvzzekwllcy 2428471 2428469 2026-06-18T09:59:59Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303983|CaptchaScoreHooks: Log risk score for every non-exempt edit (T429481)]], [[gerrit:1303982|CaptchaScoreHooks: Log risk score for every non-exempt edit (T429481)]] (duration: 08m 10s) 2428471 wikitext text/x-wiki p73qdq3zdxnnzg44hzjn164b6zlo5tq 2428472 2428471 2026-06-18T10:00:04Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Change provenance var context - fabfur@cumin1003 - T427068" 2428472 wikitext text/x-wiki dwjyd4ulah22c89wedejwyjego008ew 2428473 2428472 2026-06-18T10:00:09Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Change provenance var context - fabfur@cumin1003 - T427068 2428473 wikitext text/x-wiki d7j3sq0gbt3kossae4jmwz2g0i349py 2428474 2428473 2026-06-18T10:01:02Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Change provenance var context - fabfur@cumin1003 - T427068 2428474 wikitext text/x-wiki 84sgp21uo51yx09ysdstw0cf8zygvay 2428475 2428474 2026-06-18T10:01:06Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "Change provenance var context - fabfur@cumin1003 - T427068" 2428475 wikitext text/x-wiki ekmbwp0ku97oysgclbauwq5m22kdzug 2428477 2428475 2026-06-18T10:05:01Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply 2428477 wikitext text/x-wiki hb4k1u7tsjb5mrgtau527d5gdhxlluy 2428478 2428477 2026-06-18T10:05:07Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply 2428478 wikitext text/x-wiki kzm4po0bu3k887h9tz53d1c1nl5f3q4 2428480 2428478 2026-06-18T10:12:00Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1303986|hCaptcha: Recompute blocked-edit risk score block IDs server-side (T428394)]] 2428480 wikitext text/x-wiki gs84mihg4w517oo35w0ixqa6yea2ptt 2428481 2428480 2026-06-18T10:14:04Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1303986|hCaptcha: Recompute blocked-edit risk score block IDs server-side (T428394)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2428481 wikitext text/x-wiki 0k2i83c50vv3ye31s9qwdoh6j8awrvf 2428482 2428481 2026-06-18T10:19:57Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2428482 wikitext text/x-wiki 5wsccrtfx3dujb3akv1pbolytsu2kzj 2428484 2428482 2026-06-18T10:24:14Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1303986|hCaptcha: Recompute blocked-edit risk score block IDs server-side (T428394)]] (duration: 12m 13s) 2428484 wikitext text/x-wiki i2u3mqtmuaipc3rj7izrf8p2oemxlpn 2428487 2428484 2026-06-18T10:37:17Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.puppet.disable-merges 2428487 wikitext text/x-wiki 6qe85oi3mjw7019snpwepytcg8bidx8 2428488 2428487 2026-06-18T10:37:30Z Stashbot 7414 jmm@cumin2002: END (FAIL) - Cookbook sre.puppet.disable-merges (exit_code=99) 2428488 wikitext text/x-wiki ijisi4k374slagu2nglo1wyx6ufdn0x 2428492 2428488 2026-06-18T11:10:09Z Stashbot 7414 atsukoito: atsuko updated charlie to 0.0.19 https://w.wiki/RPKN 2428492 wikitext text/x-wiki cyk9wk8hnlu4ldhjehmr5nwll1isyyk 498 9925 2428223 2408665 2026-06-17T14:56:21Z Stashbot 7414 inflatador: mwscript /srv/mediawiki-staging/php-master/extensions/CirrusSearch/maintenance/ForceSearchIndex.php --wiki=enwikibooks 2428223 wikitext text/x-wiki pym2vnb8ush03o50aqxkbd8ioi43h63 2428439 2428223 2026-06-18T07:23:07Z Stashbot 7414 dcausse: reindexing all wikis to opensearch2 (T425585, T427196) 2428439 wikitext text/x-wiki bizfuhrw84kuzpoxvsyksqugddhhoso 0 17290 2428222 2427597 2026-06-17T14:56:20Z Stashbot 7414 inflatador: mwscript /srv/mediawiki-staging/php-master/extensions/CirrusSearch/maintenance/ForceSearchIndex.php --wiki=enwikibooks 2428222 wikitext text/x-wiki 9q03lq6vgf6di7q280qdz9irbjy55t4 2428302 2428222 2026-06-17T18:45:07Z Stashbot 7414 dduvall: restarting jenkins due to stuck zuul queues 2428302 wikitext text/x-wiki 56jbm6zqwkg0xlq6fda8v3xgqqzp6py 2428304 2428302 2026-06-17T18:51:31Z Stashbot 7414 dduvall: performed stop/start of jenkins service on contint1002 following failed safeRestart 2428304 wikitext text/x-wiki s5ykdc1aguyhwq2ckmzaowti56tyoan 2428383 2428304 2026-06-17T23:03:33Z Stashbot 7414 mutante: re-enabled puppet on contint1003 - triple checked puppet does NOT start jenkins anymore. BOTH masked AND stopped while running untouched on contint1002. after: gerrit:1303578 | (T418521) (T428791) 2428383 wikitext text/x-wiki 4i6vbi5y8o6zfchjku4jfspvws7fs25 2428389 2428383 2026-06-17T23:16:40Z Stashbot 7414 dduvall: restarted zuul to clear up 5 hrs of stuck queues 2428389 wikitext text/x-wiki j9rwanaajgs337cz39qsm0brh2tmoco 2428438 2428389 2026-06-18T07:23:03Z Stashbot 7414 dcausse: reindexing all wikis to opensearch2 (T425585, T427196) 2428438 wikitext text/x-wiki 7ri0a46hmk4j3u7uqnq4h8jq1bxp4s1 12 18684 2428322 2380468 2026-06-17T19:25:46Z Tejinderk.2004 56571 summarised content and redirected the user to a page with complete information 2428322 wikitext text/x-wiki 7qzdq8gx7b84b4cmtgis59rv64oveey 2428323 2428322 2026-06-17T19:26:47Z Tejinderk.2004 56571 fixed a minor typo 2428323 wikitext text/x-wiki lp9i2bzvja1uodazgwj10hqar5etjrz 2428370 2428323 2026-06-17T22:07:26Z APaskulin (WMF) 14880 /* Sharing files via shared storage */ Formatting 2428370 wikitext text/x-wiki k95v1g2d8sqve06xqaopqagxwk81ufz 2428374 2428370 2026-06-17T22:23:05Z APaskulin (WMF) 14880 /* Sharing files via shared storage */ Formatting 2428374 wikitext text/x-wiki hxddrms98pzt7grc8wv9mbd2h3usjre 0 21478 2428457 2400500 2026-06-18T09:05:06Z FNegri-WMF 32595 /* List of components */ fix broken link 2428457 wikitext text/x-wiki 891ikbi4gz7wd2cl1f4kpn59urckhmp 498 30942 2428174 2427643 2026-06-17T13:57:16Z Stashbot 7414 dhinus: updated wikireplicas-utils from 0.1.0 to 0.2.0 on clouddb* 2428174 wikitext text/x-wiki p094g3o7j3d4m6a46t1pz67297e4afh 10 54864 2428372 2396613 2026-06-17T22:21:21Z APaskulin (WMF) 14880 Add link to [[Help:Toolforge/Managing and sharing files]] 2428372 wikitext text/x-wiki fmclxufbr2t7use2ajdifhbenyu36ru 0 442952 2428493 2427510 2026-06-18T11:13:23Z RCoccioli (WMF) 7416 Add my skills 2428493 wikitext text/x-wiki 8vnj4v1njsyk9h5a9ffznjnifo8qh5i 0 444130 2428411 2401072 2026-06-18T03:09:32Z RLazarus (WMF) 15215 /* Rolling back in an emergency */ root is not required 2428411 wikitext text/x-wiki i96c9q069gvn6d60puae2zdf0gye3n9 2428412 2428411 2026-06-18T03:17:11Z RLazarus (WMF) 15215 /* Advanced use cases: using helm */ root is not required 2428412 wikitext text/x-wiki 9xnb59jt5i77cjauoy5xcw45sg5t6ks 12 444255 2428320 2311985 2026-06-17T19:19:50Z Tejinderk.2004 56571 redirected the entire documentation section to a separate page for more clarity . 2428320 wikitext text/x-wiki 1q0q30rina02sijzr6ctfd6tsshqnno 2428368 2428320 2026-06-17T22:05:23Z APaskulin (WMF) 14880 /* Manage files in Toolforge */ Formatting 2428368 wikitext text/x-wiki a8blu0z43hmqvh31efl9r25zpgzgffk 0 445676 2428219 2401088 2026-06-17T14:40:43Z SLyngshede-WMF 31501 MFA guide, using Webauthn/FIDO2 2428219 wikitext text/x-wiki 6wwvaggqz3du09f9qeuq8tivi48cs1l 2428230 2428219 2026-06-17T15:04:16Z SLyngshede-WMF 31501 /* Setting up MFA as a user (staff member) */ 2428230 wikitext text/x-wiki dh053j0bh1aauu7mk1w5a1c0wqc8cga 2428458 2428230 2026-06-18T09:08:47Z MMuhlenhoff (WMF) 5268 /* Configuring and using WebAuthn / FIDO2 multifactor authentication */ typo 2428458 wikitext text/x-wiki ntdwsm5za8sz91t9v23p0qcai110efj 2428465 2428458 2026-06-18T09:48:43Z MMuhlenhoff (WMF) 5268 /* Setting up MFA as a user (staff member) */ typo 2428465 wikitext text/x-wiki 4ta2l64ef7walckpcueqim2t6mkoa1f 2428466 2428465 2026-06-18T09:50:18Z MMuhlenhoff (WMF) 5268 /* Setting up MFA as a user (staff member) */ 2428466 wikitext text/x-wiki 84r7tnxufzjw2kg6ih6ho1cq591tdrv 0 445719 2428158 2366383 2026-06-17T13:39:16Z SLyngshede-WMF 31501 /* Generating encryption and signing keys */ Generating 512 bit keys for A256CBC-HS512 2428158 wikitext text/x-wiki ba0zmxkcz69kv8oz0anc5f1callst7g 2428159 2428158 2026-06-17T13:39:29Z SLyngshede-WMF 31501 /* Adding new key */ 2428159 wikitext text/x-wiki 6ob9w0soigl2jifg21s83j4richgho8 0 446084 2428126 1867927 2026-06-17T12:58:01Z Effie Mouzeli (WMF) 12880 Redirected page to [[mw:Wikimedia Production/Service Catalog/Ownership Roles and Responsibilities]] 2428126 wikitext text/x-wiki 2vg8tc2wopl9vfuorzcq2vurxs8mel5 3 446778 2428173 2403873 2026-06-17T13:56:26Z DCaro (WMF) 18271 /* Webservice on Toolforge */ Reply 2428173 wikitext text/x-wiki pbpwqc8vh3yp1x8gebwjffb4d65yup5 0 449160 2428395 2427939 2026-06-18T00:02:30Z Dexbot 30554 Bot: Updating the report 2428395 wikitext text/x-wiki p9vxq6jh5sioylalxz870lj9j8xgvk8 2428418 2428395 2026-06-18T05:15:13Z Dexbot 30554 Bot: Updating the report 2428418 wikitext text/x-wiki cmglim1bjbo7z51s5iutuje7jkuhfnd 498 451340 2428120 2379964 2026-06-17T12:52:31Z Valerio Bozzolan 10109 2428120 wikitext text/x-wiki t4dhjfh69gx8jx6fwx5aa5x4ebj1nue 2428121 2428120 2026-06-17T12:52:50Z Valerio Bozzolan 10109 starting line 2428121 wikitext text/x-wiki 7uhgtf0icba2hzi28xd3rsc4yr2cm68 2428125 2428121 2026-06-17T12:55:32Z Valerio Bozzolan 10109 2428125 wikitext text/x-wiki r9fuqqprt03tn8t7a0h065u2naeh5pf 498 451572 2428086 2428005 2026-06-17T12:34:58Z Stashbot 7414 volans@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.delete_project (exit_code=0) for project netops-clab in eqiad1 (T429447) 2428086 wikitext text/x-wiki e29z0u6j2a4x4ev2upc8nm2qfs43b8c 0 452153 2428460 2421078 2026-06-18T09:15:30Z FNegri-WMF 32595 Add new lines to cover all services that are listed in https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin but were missing from this page. 2428460 wikitext text/x-wiki ow7kq2etk4yyv63zjjltj7ihjxkjmql 0 453279 2428470 2388860 2026-06-18T09:59:21Z FNegri-WMF 32595 clarify the scope of the other linked tutorial 2428470 wikitext text/x-wiki 2xpps1tdvzcha930xtyj5718f650i6j 2428479 2428470 2026-06-18T10:05:56Z FNegri-WMF 32595 Group notes and move to the top of the page 2428479 wikitext text/x-wiki doe91anj02y8q5zck293wa0ddtks9qk 0 453976 2428078 2355832 2026-06-17T12:28:46Z FCeratto-WMF 39104 Clarify 2 methods 2428078 wikitext text/x-wiki hj08o175x5x8l25et74o5jjjpus9e9i 2428093 2428078 2026-06-17T12:40:48Z FCeratto-WMF 39104 Fix indentation 2428093 wikitext text/x-wiki n3ueo7bfu4z2ktz08efkf9e7bfzlqmc 2428104 2428093 2026-06-17T12:46:16Z FCeratto-WMF 39104 Add steps 2428104 wikitext text/x-wiki noe1roxj6c2spjrz4z9p1no2yapzgka 2428123 2428104 2026-06-17T12:53:38Z FCeratto-WMF 39104 Minor fix 2428123 wikitext text/x-wiki eim2w8gnh3sd8r2zoha51qtkqtaax2y 2428124 2428123 2026-06-17T12:55:05Z FCeratto-WMF 39104 Method 1: clarify branches 2428124 wikitext text/x-wiki d75q9ca91wx18ctfa5t2kmz71ddnf4r 2428128 2428124 2026-06-17T13:02:08Z FNegri-WMF 32595 Fix indentation of headers 2428128 wikitext text/x-wiki o8g2mac84q1wieljv7dhr89rdk7tvfw 2428286 2428128 2026-06-17T17:40:37Z FNegri-WMF 32595 /* Method 1: One commit for each distro release */ Remove reference to multiple MR and branches, as the workflow below suggests to use the same branch. 2428286 wikitext text/x-wiki 95bp1mhp7gewlu706gq07lyueqw6sri 2428287 2428286 2026-06-17T17:41:36Z FNegri-WMF 32595 /* Method 2: One commit for all Debian versions */ Both method 1 and method 2 use the "main" branch, the difference is the number of commits. 2428287 wikitext text/x-wiki m5doq527c0uqfygxtw9z39kyf5ybv8t 2428291 2428287 2026-06-17T18:10:31Z FNegri-WMF 32595 /* A typical workflow */ Fix the inconsistencies in the example (to the best of my knowledge) 2428291 wikitext text/x-wiki f0ro1uafrzlhtnzc5za2q9r2dwed7i4 2428292 2428291 2026-06-17T18:11:15Z FNegri-WMF 32595 /* Bullseye */ Remove redundant comment 2428292 wikitext text/x-wiki g9afnmwp9611zq3yo3bppi062ao3npn 2428293 2428292 2026-06-17T18:11:40Z FNegri-WMF 32595 /* Bullseye */ s/line/section/ 2428293 wikitext text/x-wiki ovglmup4t68qc4fbsvtx1xgjtpur1lo 2428296 2428293 2026-06-17T18:17:53Z FNegri-WMF 32595 /* Semi-automated upload to apt.wikimedia.org */ Add link to web interface for apt-staging, clarify import process. 2428296 wikitext text/x-wiki o0o3hxlrvjoatsmrz9c9ty2lld6gmx2 2428489 2428296 2026-06-18T10:40:57Z FCeratto-WMF 39104 Fixed process 2428489 wikitext text/x-wiki 5ay8cenlqab1udu2ql8w7ehk71jvoci 2428490 2428489 2026-06-18T10:42:43Z FCeratto-WMF 39104 Minor fix 2428490 wikitext text/x-wiki nc1nn9z52638jsmh9glbz21bcpgbub6 2428491 2428490 2026-06-18T10:52:16Z FCeratto-WMF 39104 Cleanup 2428491 wikitext text/x-wiki 87uhlztam4al8zbw6vmm892dnwn0ovr 2428494 2428491 2026-06-18T11:17:50Z FCeratto-WMF 39104 Reorder build 2428494 wikitext text/x-wiki pmibg40egb9109xl8l5yyylir3431zc 2428495 2428494 2026-06-18T11:41:11Z MVernon (WMF) 25893 /* Method 2: One commit for all Debian versions */ use ~ for backport version numbers 2428495 wikitext text/x-wiki gioj6t4u3koxy4vowoo6un0k73yz84n 0 456381 2428486 2385103 2026-06-18T10:32:41Z FFurnari-WMF 36523 /* Adding fields for webrequest */ 2428486 wikitext text/x-wiki 9892mscbhuhfbhh474aeyzfwaqhes46 0 458558 2428285 2347628 2026-06-17T17:34:52Z BBearnes (WMF) 13780 SpiderPig now also controls the train. 2428285 wikitext text/x-wiki bq7904v6bs7ukbaek6ccg6nhrlw4krv 0 459044 2428280 2427687 2026-06-17T17:00:45Z BKing (WMF) 29017 2428280 wikitext text/x-wiki fzlkgbzhw7tin7bbft0icnyt7x5ni9n 0 459290 2428070 2427032 2026-06-17T12:19:26Z JAllemandou (WMF) 37709 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ Add a refinery item 2428070 wikitext text/x-wiki 272v07c5pww5ldqahrvv17hhls9suf5 2428236 2428070 2026-06-17T15:24:33Z JAllemandou (WMF) 37709 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ Added a patch to a refinery line 2428236 wikitext text/x-wiki iotrly957np4i38f5m2w90cnl02jpce 0 459699 2428401 2427811 2026-06-18T00:42:26Z Stashbot 7414 eileen: civicrm upgraded from 646d893e to 602742db 2428401 wikitext text/x-wiki sdtfl4gjgh43aei2tnidl35ol4jorra 0 460161 2428378 2427427 2026-06-17T22:45:52Z ArielGlenn 11 /* Architecture */ fix couple typos 2428378 wikitext text/x-wiki 8a68j7pfmey5r46wizzj0xri0f8kd0w 0 460194 2428485 2427723 2026-06-18T10:28:12Z Effie Mouzeli (WMF) 12880 scrollbot update 2428485 wikitext text/x-wiki g4ok9cf7z8cgz3p1bn2s8lzqysirsl3 0 460232 2428185 2424478 2026-06-17T14:10:18Z MPopov (WMF) 5891 Section on stopping an experiment 2428185 wikitext text/x-wiki e9g7fygdm23m9l21ld5kyzst2p490w4 0 460280 2428333 2423281 2026-06-17T20:24:51Z SSapaty (WMF) 28955 2428333 wikitext text/x-wiki qsribvnoxe36qrdr5ojmxfzvu2pp0ql 2428334 2428333 2026-06-17T20:25:27Z SSapaty (WMF) 28955 remove draft 2428334 wikitext text/x-wiki 3vm9m8r87sn98evt6xo5l4eac9x808a 2 460340 2428221 2427560 2026-06-17T14:52:23Z Phuedx (WMF) 47850 Snapshot. Reworking the Overview section 2428221 wikitext text/x-wiki fl7yse9tilvws3raglth2mpco6pmc4h 2428483 2428221 2026-06-18T10:24:02Z Phuedx (WMF) 47850 Snapshot. Started reworking the lifecycle section 2428483 wikitext text/x-wiki axm2ly57vz0y480g2zlji6nwav9h1vg 12 460342 2428305 2427916 2026-06-17T18:51:46Z Tejinderk.2004 56571 added common mistakes , references and best practices sections to complete the overall documentation content 2428305 wikitext text/x-wiki salomesil07zlr7azyes21kfdhfqexk 2428307 2428305 2026-06-17T18:54:01Z Tejinderk.2004 56571 corrected a minor typo made during the creation of a code block 2428307 wikitext text/x-wiki jmchpitgaom22gvn3bzjg0zgfxv76rp 2428373 2428307 2026-06-17T22:21:54Z APaskulin (WMF) 14880 Add Toolforge navigation 2428373 wikitext text/x-wiki ifsfqkx24d6khc36n91s6u9olhvn0uv 2428379 2428373 2026-06-17T22:50:47Z APaskulin (WMF) 14880 Formatting and style 2428379 wikitext text/x-wiki eke4wd7gy6ugos9zxhwuyhc5ntgns9z 0 460351 2428146 2026-06-17T13:30:20Z BKing (WMF) 29017 Created page with "Placeholder" 2428146 wikitext text/x-wiki rp6ekfc3smhpzk3bym7bz0jugu65jzc 2428165 2428146 2026-06-17T13:48:55Z BKing (WMF) 29017 2428165 wikitext text/x-wiki epxb4t5loa4owz67lebc6snid0lfehq 2428240 2428165 2026-06-17T15:31:21Z BKing (WMF) 29017 2428240 wikitext text/x-wiki pf3rf2lykcl9q0dpn6skqe8s3hheyp2 2428343 2428240 2026-06-17T20:57:31Z BKing (WMF) 29017 2428343 wikitext text/x-wiki 1wuf5mfiswx4pil7e55k1v5079sxd1w 3 460352 2428235 2026-06-17T15:19:59Z StrikerBot 8475 Welcome to Toolforge! 2428235 wikitext text/x-wiki 5kd0g4fipltl6954pgtl0qq3xmiw2jn 1 460353 2428326 2026-06-17T19:37:46Z BCornwall-WMF 31521 /* Archive? */ new section 2428326 wikitext text/x-wiki bb402xiidc9928we5f0d31kparfir0e 12 460354 2428437 2026-06-18T07:08:40Z SSapaty (WMF) 28955 Initial draft 2428437 wikitext text/x-wiki 3cy0n5y5janzzraphb88ylwy5qrrznh