Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.2 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk MediaWiki:Common.css 8 215 2412749 2236933 2026-05-12T13:47:44Z Taavi 13997 [[Wikitech:Village_pump#c-Codename_Noreste-20260509030700-Main_page_change_requests]] 2412749 css text/css olyxlazqoib0attaealrw4x79yk92qm Nova Resource:Tools/SAL 498 3086 2413028 2412225 2026-05-12T21:58:02Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer 2413028 wikitext text/x-wiki 05iezbqk0lr3rqlvtr6cfzdbdl3f6nh 2413033 2413028 2026-05-12T22:15:55Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer 2413033 wikitext text/x-wiki cvg6m6wwcvvwv6cijhr1tgsvyjhfq52 2413043 2413033 2026-05-12T22:47:22Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2413043 wikitext text/x-wiki b67505p4ljpugrx63x56dab5lc1datw 2413046 2413043 2026-05-12T22:55:19Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2413046 wikitext text/x-wiki op1mj0n6sajj7wv97cool7vf7hig2f8 2413051 2413046 2026-05-12T23:07:18Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component api-gateway 2413051 wikitext text/x-wiki m9hxp1dejt8f1x27as5xxccfrm3m5ch 2413052 2413051 2026-05-12T23:11:19Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway 2413052 wikitext text/x-wiki nzgaxtj5h8704dvrq5s7u2e4dd47k8e 2413068 2413052 2026-05-13T00:25:05Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2413068 wikitext text/x-wiki ere42wj2wb46vogamngdnhzx0em9smm 2413069 2413068 2026-05-13T00:30:30Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2413069 wikitext text/x-wiki 76fmucz9g4eg86b9mkeenqg9k9omi51 2413207 2413069 2026-05-13T08:35:24Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component webservice-cli 2413207 wikitext text/x-wiki mn0ztjzb8q8qgnevj9qpg58iwwowx5f 2413210 2413207 2026-05-13T08:36:49Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component webservice-cli 2413210 wikitext text/x-wiki fiagg9gbgzp83xu21atyzf70u9zp46h 2413218 2413210 2026-05-13T08:46:41Z Stashbot 7414 godog: restart sample webservices with new memory requests https://phabricator.wikimedia.org/P92497 - T420565 2413218 wikitext text/x-wiki rkm5419lma9vb1l6sc95myonme0rslx Deployments 0 4108 2412714 2412650 2026-05-12T12:03:24Z ScheduleDeploymentBot 37566 Add [[gerrit:1285913]] to Thursday, May 14 UTC afternoon backport window 2412714 wikitext text/x-wiki n9c7mqjmci496e99gev2qbhc72khxdm 2412717 2412714 2026-05-12T12:09:14Z ScheduleDeploymentBot 37566 Add [[gerrit:1286327]] to Thursday, May 14 UTC afternoon backport window 2412717 wikitext text/x-wiki oicuunab7mcm4y7qhy2dnoaei21rtjz 2412727 2412717 2026-05-12T12:27:51Z ScheduleDeploymentBot 37566 Add [[gerrit:1286334]] to Tuesday, May 12 UTC afternoon backport window 2412727 wikitext text/x-wiki j0ipgsjpld74nr08d10uh095v1h9y62 2412728 2412727 2026-05-12T12:28:08Z ScheduleDeploymentBot 37566 Add [[gerrit:1286336]] to Tuesday, May 12 UTC afternoon backport window 2412728 wikitext text/x-wiki cq4t8i87kckx23k0ypvue4z0bsjh580 2412731 2412728 2026-05-12T12:44:03Z ScheduleDeploymentBot 37566 Add [[gerrit:1286341]] to Tuesday, May 12 UTC afternoon backport window 2412731 wikitext text/x-wiki 9p4aazflg8f1boqygffng66qc8qfofh 2412737 2412731 2026-05-12T13:10:20Z ScheduleDeploymentBot 37566 Add [[gerrit:1283711]] to Tuesday, May 12 UTC afternoon backport window 2412737 wikitext text/x-wiki 2iw3fteyyejjyqu71nob37khjj1c1qn 2412744 2412737 2026-05-12T13:29:38Z ScheduleDeploymentBot 37566 Add [[gerrit:1285930]] to Tuesday, May 12 UTC late backport window 2412744 wikitext text/x-wiki q2exs6765jyxz0amkyxmunr6gg3n76d 2412746 2412744 2026-05-12T13:38:21Z ScheduleDeploymentBot 37566 Add [[gerrit:1286359]] to Wednesday, May 13 UTC afternoon backport window 2412746 wikitext text/x-wiki ee4fb3xatvg9whadr19gdk84t90x41j 2412799 2412746 2026-05-12T14:15:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1285482]] to Tuesday, May 12 UTC late backport window 2412799 wikitext text/x-wiki g053b8q87o6tnzdhq5ict881zk4gx6d 2412831 2412799 2026-05-12T14:34:20Z ScheduleDeploymentBot 37566 Add [[gerrit:1283048]] to Tuesday, May 12 UTC late backport window 2412831 wikitext text/x-wiki soqc10eb3piozgsr1cf4l2jezc6z5l4 2412847 2412831 2026-05-12T15:01:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1286390]] to Tuesday, May 12 UTC late backport window 2412847 wikitext text/x-wiki o5tcxbft1jcar0c9eslywve2efte1ls 2412848 2412847 2026-05-12T15:03:30Z ScheduleDeploymentBot 37566 Add [[gerrit:1286371]] to Wednesday, May 13 UTC morning backport window 2412848 wikitext text/x-wiki tnywkvkj17iifm30xd2p8ntt3o9q1np 2412855 2412848 2026-05-12T15:23:35Z ScheduleDeploymentBot 37566 Add [[gerrit:1286400]] to Wednesday, May 13 UTC morning backport window 2412855 wikitext text/x-wiki 7sc4ima3mzpoc04tj60rhzvpd8gr999 2412944 2412855 2026-05-12T19:34:06Z ScheduleDeploymentBot 37566 Add [[gerrit:1286469]] to Tuesday, May 12 UTC late backport window 2412944 wikitext text/x-wiki pl7a5yicozj6nidp7pcjts14t1r5ouy 2412958 2412944 2026-05-12T20:06:45Z ScheduleDeploymentBot 37566 Add [[gerrit:1286485]] to Tuesday, May 12 UTC late backport window 2412958 wikitext text/x-wiki 3tvtbcxgp43q3xvonp7wlucgf4wkixb 2412961 2412958 2026-05-12T20:10:34Z Cscott 41391 /* {{Deployment_day|date=2026-05-12}} */ Add vendor patch 2412961 wikitext text/x-wiki 5go91gc6p1a1kweo7n4scehvg8zwev1 2412965 2412961 2026-05-12T20:17:44Z ScheduleDeploymentBot 37566 Add [[gerrit:1286488]] to Tuesday, May 12 UTC late backport window 2412965 wikitext text/x-wiki d9cee0d511ecevv3t2i7b14bff4kqat 2412966 2412965 2026-05-12T20:17:54Z ScheduleDeploymentBot 37566 Add [[gerrit:1286489]] to Tuesday, May 12 UTC late backport window 2412966 wikitext text/x-wiki inrs95koa2rt7faltixdy037se8xawt 2413150 2412966 2026-05-13T04:05:49Z ScheduleDeploymentBot 37566 Add [[gerrit:1216721]] to Thursday, May 14 UTC afternoon backport window 2413150 wikitext text/x-wiki 3ix0w6ltu3q21mzifr1u19lra8l9egl 2413154 2413150 2026-05-13T05:28:45Z ScheduleDeploymentBot 37566 Add [[gerrit:1284900]] to Wednesday, May 13 UTC afternoon backport window 2413154 wikitext text/x-wiki aavyzsal5gwlqzegcpzw79q8zm5htp7 2413168 2413154 2026-05-13T06:19:30Z ScheduleDeploymentBot 37566 Add [[gerrit:1286277]] to Wednesday, May 13 UTC morning backport window 2413168 wikitext text/x-wiki mifkrb3iukngagh7sla59jvh225u7l2 2413242 2413168 2026-05-13T09:38:00Z ScheduleDeploymentBot 37566 Add [[gerrit:1286518]] to Wednesday, May 13 UTC afternoon backport window 2413242 wikitext text/x-wiki j0wnnyf00slauav8admagfvrd4anjry 2413245 2413242 2026-05-13T09:40:58Z ScheduleDeploymentBot 37566 Add [[gerrit:1286838]] to Wednesday, May 13 UTC afternoon backport window 2413245 wikitext text/x-wiki chop94pce49wwszymvdhz326zvjykxv 2413262 2413245 2026-05-13T09:59:33Z ScheduleDeploymentBot 37566 Add [[gerrit:1286839]] to Wednesday, May 13 UTC afternoon backport window 2413262 wikitext text/x-wiki ca9k96c6vyta5u0za2o60ayw68hx598 2413264 2413262 2026-05-13T10:00:04Z ScheduleDeploymentBot 37566 Add [[gerrit:1286844]] to Wednesday, May 13 UTC afternoon backport window 2413264 wikitext text/x-wiki d5sprungu14e2nhsx0c6t4b3995a5dm 2413270 2413264 2026-05-13T10:03:14Z ScheduleDeploymentBot 37566 Add [[gerrit:1286846]] to Wednesday, May 13 UTC afternoon backport window 2413270 wikitext text/x-wiki tdmytw0zgg85odi03xzvhyuvqf4gysq 2413272 2413270 2026-05-13T10:04:23Z ScheduleDeploymentBot 37566 Add [[gerrit:1286847]] to Wednesday, May 13 UTC afternoon backport window 2413272 wikitext text/x-wiki tm58zti1vpa5tuhluve07xi94zcxjtc Incident status 0 4218 2412720 2352429 2026-05-12T12:16:38Z Novem Linguae 23682 {{Notice|This page is being used less frequently, in favor of Google Docs and Phabricator tasks created by [[Corto]], some of which are not public. See [https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/message/GUGCSE7JKQNSXWKCFHPCXEL7BLAVRTD6/ wikitech-l mailing list discussion].}} 2412720 wikitext text/x-wiki l2f4svlxab7q0zqptp9fo1xzya1l4eo Nova Resource:Toolsbeta/SAL 498 6726 2413035 2412705 2026-05-12T22:20:15Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2413035 wikitext text/x-wiki oiptq2bvypm4r27yv9jq9qtbqcqh8lg 2413038 2413035 2026-05-12T22:28:17Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2413038 wikitext text/x-wiki 17kjsa1wwn96h4jilghp7d658xcbaxs 2413048 2413038 2026-05-12T23:02:39Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component api-gateway 2413048 wikitext text/x-wiki 4vq239fbj3azhyflwruvem1u56fdbwk 2413050 2413048 2026-05-12T23:06:45Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway 2413050 wikitext text/x-wiki 11zx14ss3fflxms7hy6ffqcssw6cu73 2413066 2413050 2026-05-13T00:19:55Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2413066 wikitext text/x-wiki odaxfnuta37ktiajgvo5dbzvieep9nv 2413067 2413066 2026-05-13T00:24:47Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2413067 wikitext text/x-wiki nt030ma0vw41mbtggh72sk9xlouhqei 2413198 2413067 2026-05-13T08:18:46Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component webservice-cli 2413198 wikitext text/x-wiki oup6opt4sn7si33cgmm19rkilkut5x8 2413199 2413198 2026-05-13T08:19:57Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component webservice-cli 2413199 wikitext text/x-wiki kawahfw5ar03yui2yihiogi7u4iuiyw Server Admin Log 0 7919 2412713 2412701 2026-05-12T12:02:37Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1286309|Special:UserLogin: Instrument no-JS form submissions (T425631)]] 2412713 wikitext text/x-wiki kh90vpj4ww0njl392eojarrixmxggrq 2412715 2412713 2026-05-12T12:04:30Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1286309|Special:UserLogin: Instrument no-JS form submissions (T425631)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412715 wikitext text/x-wiki r0cqrwqfm9r79luoj5ewhhecribax9l 2412716 2412715 2026-05-12T12:06:05Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2412716 wikitext text/x-wiki mik5e3mseowuu1ozahb9k3g3jj5umlg 2412718 2412716 2026-05-12T12:10:21Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286309|Special:UserLogin: Instrument no-JS form submissions (T425631)]] (duration: 07m 45s) 2412718 wikitext text/x-wiki kvdd49ry6qjlb3it5o3rayirvalhjyy 2412719 2412718 2026-05-12T12:15:57Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1286328|Make DiscussionTools not show hCaptcha initially unless configured (T425955)]], [[gerrit:1286324|Show CAPTCHA if required for all edits before first edit attempt (T425955)]], [[gerrit:1286322|hCaptcha: Enable for DiscussionTools on testwiki (T426039)]], [[gerrit:1286318|hCaptcha: Enable for VisualEditor and MobileFrontend mediawikiwiki (T425 2412719 wikitext text/x-wiki 7zdzfiqq7jkgwc69g13eoecip0uhcxb 2412721 2412719 2026-05-12T12:17:48Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1286328|Make DiscussionTools not show hCaptcha initially unless configured (T425955)]], [[gerrit:1286324|Show CAPTCHA if required for all edits before first edit attempt (T425955)]], [[gerrit:1286322|hCaptcha: Enable for DiscussionTools on testwiki (T426039)]], [[gerrit:1286318|hCaptcha: Enable for VisualEditor and MobileFrontend mediawikiwiki (T425940)]] synced 2412721 wikitext text/x-wiki 59ukh00pz3bk9a51z6tpjg75xt6gl84 2412723 2412721 2026-05-12T12:20:57Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2412723 wikitext text/x-wiki hqwup0xvqypje8rhzewspxa87tmslx8 2412724 2412723 2026-05-12T12:25:09Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286328|Make DiscussionTools not show hCaptcha initially unless configured (T425955)]], [[gerrit:1286324|Show CAPTCHA if required for all edits before first edit attempt (T425955)]], [[gerrit:1286322|hCaptcha: Enable for DiscussionTools on testwiki (T426039)]], [[gerrit:1286318|hCaptcha: Enable for VisualEditor and MobileFrontend mediawikiwiki (T42 2412724 wikitext text/x-wiki mpl9mtjaaoqu938jhexypr87pcvuojq 2412725 2412724 2026-05-12T12:26:45Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] START helmfile.d/services/mw-mcrouter: apply 2412725 wikitext text/x-wiki s10rdsfmjesimj9jw710t04el8gkd67 2412726 2412725 2026-05-12T12:26:55Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-mcrouter: apply 2412726 wikitext text/x-wiki kxdr5qmy2563zutcy5jij44k0h77au4 2412729 2412726 2026-05-12T12:38:19Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-mcrouter: apply 2412729 wikitext text/x-wiki kpdu8iq2clpv5kimt3aph3w6dqw1lth 2412730 2412729 2026-05-12T12:40:50Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-mcrouter: apply 2412730 wikitext text/x-wiki smt48rsxv8sz2vh4zqx6j2zpn41g9my 2412734 2412730 2026-05-12T13:06:57Z Stashbot 7414 sbisson@deploy1003: Started scap sync-world: Backport for [[gerrit:1286334|ArticleGuidance: set sparql endpoint (T425389)]] 2412734 wikitext text/x-wiki 7ybp0sjmkf7r5kbrnw7nvmw3j1sd2rh 2412735 2412734 2026-05-12T13:08:49Z Stashbot 7414 sbisson@deploy1003: sbisson: Backport for [[gerrit:1286334|ArticleGuidance: set sparql endpoint (T425389)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412735 wikitext text/x-wiki lmlx5wgbknr1ztj8hrgl0rzzgv44ueg 2412736 2412735 2026-05-12T13:09:55Z Stashbot 7414 sbisson@deploy1003: sbisson: Continuing with deployment 2412736 wikitext text/x-wiki n5kkv5x2c2lzo209u0cdyf3bpuc957b 2412739 2412736 2026-05-12T13:14:10Z Stashbot 7414 sbisson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286334|ArticleGuidance: set sparql endpoint (T425389)]] (duration: 07m 13s) 2412739 wikitext text/x-wiki sk3rv2fu8jxc84iuc7azhjjgwjln3ym 2412740 2412739 2026-05-12T13:17:59Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on dbproxy2006.codfw.wmnet with reason: Reboot 2412740 wikitext text/x-wiki 5ejie0wvh4a5x6c3og55qxymiq0dasc 2412741 2412740 2026-05-12T13:20:01Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2233.codfw.wmnet with reason: Reboot 2412741 wikitext text/x-wiki 5bkfxttr2zzt5d9s9ri3934n6utgxq4 2412742 2412741 2026-05-12T13:27:36Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1286336|Keep all long, non-wrapping values inside parent element (T425176)]], [[gerrit:1286341|page_change - add revision.revert info]] 2412742 wikitext text/x-wiki q12so33n201kvv8t0b6i8r8bqylc8x5 2412743 2412742 2026-05-12T13:29:29Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: audreypenven, lucaswerkmeister-wmde, otto: Backport for [[gerrit:1286336|Keep all long, non-wrapping values inside parent element (T425176)]], [[gerrit:1286341|page_change - add revision.revert info]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412743 wikitext text/x-wiki ogq6liv92di5s5slnv5xhbeq8y9u7tq 2412745 2412743 2026-05-12T13:32:00Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.hosts.reimage for host lvs1017.eqiad.wmnet with OS bullseye 2412745 wikitext text/x-wiki m8d9v0wc1qsolzq4py6knqy76w5tgd5 2412750 2412745 2026-05-12T13:48:27Z Stashbot 7414 ottomata: roll restart eventgate main to pick up mediawiki/page/change/1.4.0 schema version for T423583 2412750 wikitext text/x-wiki jboo0dlnd8dxxnt4upawryq910fdno7 2412751 2412750 2026-05-12T13:48:56Z Stashbot 7414 otto@deploy1003: helmfile [staging] START helmfile.d/services/eventgate-main: sync 2412751 wikitext text/x-wiki irjo28yfo4qk7tqrmdy1ukatuquxncv 2412752 2412751 2026-05-12T13:49:04Z Stashbot 7414 otto@deploy1003: helmfile [staging] DONE helmfile.d/services/eventgate-main: sync 2412752 wikitext text/x-wiki abqwhf2vqyubifhvek46w956qrce9qk 2412754 2412752 2026-05-12T13:49:19Z Stashbot 7414 otto@deploy1003: helmfile [codfw] START helmfile.d/services/eventgate-main: sync 2412754 wikitext text/x-wiki q3seib92z9qlw2ivnet6m1fi4lyh0vq 2412755 2412754 2026-05-12T13:49:42Z Stashbot 7414 otto@deploy1003: helmfile [codfw] DONE helmfile.d/services/eventgate-main: sync 2412755 wikitext text/x-wiki o10kyt0dnf01gcxjyjkr9r738tveqvs 2412756 2412755 2026-05-12T13:49:53Z Stashbot 7414 sukhe@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host lvs1017.eqiad.wmnet with OS bullseye 2412756 wikitext text/x-wiki 057vsj37vuz5dxv6wx4uyfu1jxidmwh 2412757 2412756 2026-05-12T13:50:10Z Stashbot 7414 otto@deploy1003: helmfile [eqiad] START helmfile.d/services/eventgate-main: sync 2412757 wikitext text/x-wiki mtw05qn9pf8sedga46fh8v55xuz5tln 2412758 2412757 2026-05-12T13:50:26Z Stashbot 7414 otto@deploy1003: helmfile [eqiad] DONE helmfile.d/services/eventgate-main: sync 2412758 wikitext text/x-wiki 7u54exlnur1seqdiyg5loiklz5hzs8f 2412759 2412758 2026-05-12T13:51:33Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1270.eqiad.wmnet with OS bookworm 2412759 wikitext text/x-wiki nq15ygh419rxobxn0ynla2413a64rgs 2412760 2412759 2026-05-12T13:51:53Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2412760 wikitext text/x-wiki mdeh42yf8p8qdufazh2psmnelj32r35 2412761 2412760 2026-05-12T13:54:13Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2412761 wikitext text/x-wiki byluav60xf2rg3nq6hhn754ci08repj 2412763 2412761 2026-05-12T13:54:44Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2412763 wikitext text/x-wiki 5kotpyd5eysp8jzplg7bfwjonwdvlz2 2412764 2412763 2026-05-12T13:57:12Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2412764 wikitext text/x-wiki 465sabe9oo0clx5zkmz042gzsukzqki 2412765 2412764 2026-05-12T13:57:39Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2412765 wikitext text/x-wiki 2kpgiyiiioxmovpmys57neeauaeu70s 2412766 2412765 2026-05-12T14:02:24Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1272] - vriley@cumin1003" 2412766 wikitext text/x-wiki qrf6qg8rrh54tydirb4ihp7z2wjlqra 2412767 2412766 2026-05-12T14:02:41Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1272] - vriley@cumin1003" 2412767 wikitext text/x-wiki 1y1zafhdwry5zgp21xjdx3hoqzwnzz3 2412768 2412767 2026-05-12T14:02:42Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2412768 wikitext text/x-wiki b0r59qyllldq1kf0b05zq9xum5auyp5 2412769 2412768 2026-05-12T14:02:43Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2412769 wikitext text/x-wiki imxzerr96bdfrddrpok1snbuna2ze9c 2412770 2412769 2026-05-12T14:03:03Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host db1272 2412770 wikitext text/x-wiki r1wn0vzatrc0r5za8cwabv7nkz3j4qj 2412771 2412770 2026-05-12T14:04:17Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host db1272 2412771 wikitext text/x-wiki aw5jppqlwefdmhv7vwdrkyobzlccwjt 2412772 2412771 2026-05-12T14:04:58Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1272.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412772 wikitext text/x-wiki 0h37r1dbp6lqpclrrikk7y3x7yg5mlo 2412773 2412772 2026-05-12T14:05:14Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2412773 wikitext text/x-wiki 6axhe05x8e7u6dcby1k30gqqmtrkxjm 2412774 2412773 2026-05-12T14:05:26Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: audreypenven, lucaswerkmeister-wmde, otto: Rolling back deployment 2412774 wikitext text/x-wiki i8crvlfrphj6lv2atnho5jpy13hvwg5 2412775 2412774 2026-05-12T14:05:32Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2412775 wikitext text/x-wiki 2so89o84yzt995jgeaus7p93mpqdvuk 2412776 2412775 2026-05-12T14:05:59Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host db1271 2412776 wikitext text/x-wiki 9gilxpjhkhqk10yomsqwvu2215sqwuk 2412777 2412776 2026-05-12T14:06:05Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2412777 wikitext text/x-wiki msn1f2a1rbwltmw8oqzarw6jktffyue 2412778 2412777 2026-05-12T14:07:12Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286336|Keep all long, non-wrapping values inside parent element (T425176)]], [[gerrit:1286341|page_change - add revision.revert info]] (duration: 39m 36s) 2412778 wikitext text/x-wiki 40in4ta0gv7gpaxc17kop9re5830ips 2412779 2412778 2026-05-12T14:07:22Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2412779 wikitext text/x-wiki d8c61aaz2bx2mpb7jo3sct012pg39be 2412780 2412779 2026-05-12T14:07:31Z Stashbot 7414 eevans@deploy1003: helmfile [staging] START helmfile.d/services/sessionstore: apply 2412780 wikitext text/x-wiki s8knmzwtzgcd4m5gasgb0q7mf1wc4um 2412781 2412780 2026-05-12T14:07:36Z Stashbot 7414 eevans@deploy1003: helmfile [staging] DONE helmfile.d/services/sessionstore: apply 2412781 wikitext text/x-wiki 53s36h86n7kqjqpxe4rryuh7z0bcp7c 2412782 2412781 2026-05-12T14:07:38Z Stashbot 7414 eevans@deploy1003: helmfile [staging] START helmfile.d/services/sessionstore: apply 2412782 wikitext text/x-wiki 5z61uakmsesekgbxaslzinkrsh3dp7e 2412783 2412782 2026-05-12T14:07:41Z Stashbot 7414 eevans@deploy1003: helmfile [staging] DONE helmfile.d/services/sessionstore: apply 2412783 wikitext text/x-wiki 905qayo6gq9ljbtyclqfnx1ca2s9zl1 2412784 2412783 2026-05-12T14:07:53Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2412784 wikitext text/x-wiki jpc9ra49476kgo9bepqtqkl3t5ko610 2412785 2412784 2026-05-12T14:07:54Z Stashbot 7414 root@cumin1003: START - Cookbook sre.hosts.reimage for host mc1056.eqiad.wmnet with OS bullseye 2412785 wikitext text/x-wiki 7cbqp8urbmhqxr7x7b4so2742789sgw 2412786 2412785 2026-05-12T14:07:57Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1057.eqiad.wmnet with OS bullseye 2412786 wikitext text/x-wiki 3bry1qes8rk3aqxdu0c2xcpk4kn6p60 2412787 2412786 2026-05-12T14:07:59Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1058.eqiad.wmnet with OS bullseye 2412787 wikitext text/x-wiki 2e1cohownvlxjcyaebq4pa9hrquyyds 2412788 2412787 2026-05-12T14:08:01Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1059.eqiad.wmnet with OS bullseye 2412788 wikitext text/x-wiki 0np3hbitmvkv82fj35x6vburl6xaqwc 2412789 2412788 2026-05-12T14:08:10Z Stashbot 7414 eevans@deploy1003: helmfile [codfw] START helmfile.d/services/sessionstore: apply 2412789 wikitext text/x-wiki icj7w2zbi4nkfjy9a6xmy7ea7wz7w1q 2412790 2412789 2026-05-12T14:08:29Z Stashbot 7414 eevans@deploy1003: helmfile [codfw] DONE helmfile.d/services/sessionstore: apply 2412790 wikitext text/x-wiki 5ra9aeqooqrh7hbs5zv8h0vocpatlbz 2412791 2412790 2026-05-12T14:08:31Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1286336|Keep all long, non-wrapping values inside parent element (T425176)]], [[gerrit:1286372|Revert "page_change - add revision.revert info"]] 2412791 wikitext text/x-wiki 72m62gltj1tb9y1pixlqspmqddax67j 2412792 2412791 2026-05-12T14:09:12Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db1272.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412792 wikitext text/x-wiki kixnqkj6nrmduib447cajgmavppyqx1 2412793 2412792 2026-05-12T14:10:00Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host db1271 2412793 wikitext text/x-wiki eu2y5y7mb0mrrenvlu7t8ztsf0vr2xx 2412794 2412793 2026-05-12T14:10:26Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: audreypenven, lucaswerkmeister-wmde: Backport for [[gerrit:1286336|Keep all long, non-wrapping values inside parent element (T425176)]], [[gerrit:1286372|Revert "page_change - add revision.revert info"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412794 wikitext text/x-wiki 3z0jlsol1lh99q6lbt522txg6bc0tp1 2412795 2412794 2026-05-12T14:10:32Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1271.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412795 wikitext text/x-wiki rq7q73io94rn9bs3a694tom05by2dmq 2412796 2412795 2026-05-12T14:11:10Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: audreypenven, lucaswerkmeister-wmde: Continuing with deployment 2412796 wikitext text/x-wiki p33i9f7nlrj9ndwymi2mydtoeyu96md 2412797 2412796 2026-05-12T14:15:34Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286336|Keep all long, non-wrapping values inside parent element (T425176)]], [[gerrit:1286372|Revert "page_change - add revision.revert info"]] (duration: 07m 02s) 2412797 wikitext text/x-wiki 4eqpz7ce66i0sugxtye51fqny2j3sqz 2412798 2412797 2026-05-12T14:15:41Z Stashbot 7414 Lucas_WMDE: UTC afternoon backport+config window done 2412798 wikitext text/x-wiki 2y33i37wjubnttvofeclzk302gauwf6 2412800 2412798 2026-05-12T14:17:08Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] START helmfile.d/services/sessionstore: apply 2412800 wikitext text/x-wiki oqwvlow2h0vya2t1wu69dap8w16u69p 2412801 2412800 2026-05-12T14:17:24Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/sessionstore: apply 2412801 wikitext text/x-wiki ttnsfry4e714r2if97wxihmq9nnvuqg 2412803 2412801 2026-05-12T14:19:59Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1058.eqiad.wmnet with reason: host reimage 2412803 wikitext text/x-wiki 3kvsj6dlx4zf4gil5lry1gif00w1wxw 2412804 2412803 2026-05-12T14:20:05Z Stashbot 7414 root@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1056.eqiad.wmnet with reason: host reimage 2412804 wikitext text/x-wiki ec2rpffsap15n91m7ppxp3c175bo9ab 2412805 2412804 2026-05-12T14:20:06Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1057.eqiad.wmnet with reason: host reimage 2412805 wikitext text/x-wiki rvfib5eyzaai14p9c25b75z5ca4vkrh 2412806 2412805 2026-05-12T14:20:31Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1059.eqiad.wmnet with reason: host reimage 2412806 wikitext text/x-wiki k1degbvujavw0a3r83nhdi40t0rs1gw 2412807 2412806 2026-05-12T14:21:05Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.rename from wdqs1028 to dse-k8s-wdqs-test1001 2412807 wikitext text/x-wiki 8ftql78jpl8p4j3o0cc2pbjp65rdvtt 2412808 2412807 2026-05-12T14:22:13Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1271.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412808 wikitext text/x-wiki r72p9purgwz7g1bgz50daodvunos48w 2412809 2412808 2026-05-12T14:22:29Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.dns.netbox 2412809 wikitext text/x-wiki 1jodvzy8smd3krx5nk1b8gk5uq6mfvh 2412810 2412809 2026-05-12T14:24:21Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1058.eqiad.wmnet with reason: host reimage 2412810 wikitext text/x-wiki qbgelj5ba44bh4evf0dnjmfzzl29m9s 2412811 2412810 2026-05-12T14:26:31Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming wdqs1028 to dse-k8s-wdqs-test1001 - btullis@cumin1003" 2412811 wikitext text/x-wiki 7jvn4ouj62ny0petb2han56buhwexe7 2412812 2412811 2026-05-12T14:26:32Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.rename from wdqs2009 to dse-k8s-wdqs-test2001 2412812 wikitext text/x-wiki 8oohzzw4ox3qshqrldc8nmreg9rar2b 2412813 2412812 2026-05-12T14:26:48Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming wdqs1028 to dse-k8s-wdqs-test1001 - btullis@cumin1003" 2412813 wikitext text/x-wiki 1r5olxjnufwpmns9lypk3xy7dkdxtb4 2412814 2412813 2026-05-12T14:26:49Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2412814 wikitext text/x-wiki fqyeatbjex4q1qa8710gh1dfacew86p 2412815 2412814 2026-05-12T14:26:50Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.dns.wipe-cache dse-k8s-wdqs-test1001 on all recursors 2412815 wikitext text/x-wiki qujr4gvfsfi276oclfkp7ntfifw8aw0 2412816 2412815 2026-05-12T14:26:51Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.dns.netbox 2412816 wikitext text/x-wiki tidpw3vlbzz0bt6258r0ianfgc3s3sz 2412817 2412816 2026-05-12T14:26:52Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-wdqs-test1001 on all recursors 2412817 wikitext text/x-wiki dt8ke0fc6karobumv1d0gr0hw6v0yiq 2412818 2412817 2026-05-12T14:26:53Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-wdqs-test1001 2412818 wikitext text/x-wiki fx17ljcvt5iyc7435aegnkt5mmug7nk 2412819 2412818 2026-05-12T14:27:54Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-wdqs-test1001 2412819 wikitext text/x-wiki 4je3puiad75z6gj139iqzh9mm5z0v46 2412820 2412819 2026-05-12T14:28:14Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1059.eqiad.wmnet with reason: host reimage 2412820 wikitext text/x-wiki lzdu1w71g1nl5gu6pe37azy0dnitnxo 2412821 2412820 2026-05-12T14:28:30Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from wdqs1028 to dse-k8s-wdqs-test1001 2412821 wikitext text/x-wiki mieri0vii6rvom7q2vu0h756iarmhg3 2412822 2412821 2026-05-12T14:31:52Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming wdqs2009 to dse-k8s-wdqs-test2001 - btullis@cumin1003" 2412822 wikitext text/x-wiki mgq2sn0kb0y4jei9ne88p0l3ktuwq9d 2412823 2412822 2026-05-12T14:32:43Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1056.eqiad.wmnet with reason: host reimage 2412823 wikitext text/x-wiki hyzuicvjhuixxebkt6rvjimul58sppk 2412824 2412823 2026-05-12T14:33:41Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.reimage for host dse-k8s-wdqs-test1001.eqiad.wmnet with OS bookworm 2412824 wikitext text/x-wiki 81fenp6gmk9nip0lr9vah3yej5wwqcd 2412825 2412824 2026-05-12T14:33:48Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming wdqs2009 to dse-k8s-wdqs-test2001 - btullis@cumin1003" 2412825 wikitext text/x-wiki 8yyzgv2qqypm5cuuawbkh78aeteibtm 2412826 2412825 2026-05-12T14:33:49Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2412826 wikitext text/x-wiki qlw3e99y1tukku185kl7ur3omf6yerd 2412827 2412826 2026-05-12T14:33:50Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.dns.wipe-cache dse-k8s-wdqs-test2001 on all recursors 2412827 wikitext text/x-wiki kzkth10whcj6zjo6nzqi6xjxtni6xvq 2412828 2412827 2026-05-12T14:33:52Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-wdqs-test2001 on all recursors 2412828 wikitext text/x-wiki g61d29iyifb533dyqud89vbwjlbzkiw 2412829 2412828 2026-05-12T14:33:54Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-wdqs-test2001 2412829 wikitext text/x-wiki og58qe7ydv8kas20ybt8v6vi1sjxrct 2412830 2412829 2026-05-12T14:34:11Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-wdqs-test2001 2412830 wikitext text/x-wiki avtp0h6dxj7twhk41bq8y60a6l0aiym 2412832 2412830 2026-05-12T14:34:46Z Stashbot 7414 btullis@cumin1003: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from wdqs2009 to dse-k8s-wdqs-test2001 2412832 wikitext text/x-wiki 2i2uh3rs3obho0mzpilzrv3i9tlu1xk 2412833 2412832 2026-05-12T14:36:07Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1057.eqiad.wmnet with reason: host reimage 2412833 wikitext text/x-wiki t76uqaxdncauhj9lv2m83blj9t4f5x1 2412834 2412833 2026-05-12T14:39:41Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1058.eqiad.wmnet with OS bullseye 2412834 wikitext text/x-wiki 624qxjlw1alm5gmpej0v4lsm6jxjahg 2412835 2412834 2026-05-12T14:43:13Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1059.eqiad.wmnet with OS bullseye 2412835 wikitext text/x-wiki hgma2rzh88738pnzexy2kg7jmevmnid 2412836 2412835 2026-05-12T14:44:52Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-toolhub-test: apply 2412836 wikitext text/x-wiki d5j4kgz29sicawaju2rk8yl3qmqobzn 2412837 2412836 2026-05-12T14:45:04Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-toolhub-test: apply 2412837 wikitext text/x-wiki noejj3hkmab3mt9lax960tlhdnxlnnt 2412838 2412837 2026-05-12T14:45:20Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.reimage for host dse-k8s-wdqs-test2001.codfw.wmnet with OS bookworm 2412838 wikitext text/x-wiki quvxqx842o8swhlb96db7de1wm799ef 2412839 2412838 2026-05-12T14:47:51Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1056.eqiad.wmnet with OS bullseye 2412839 wikitext text/x-wiki hcbpn1bzti9egdxthqn8vsh9rp2pt4c 2412840 2412839 2026-05-12T14:50:29Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1057.eqiad.wmnet with OS bullseye 2412840 wikitext text/x-wiki 99uxwt73u90jurctcl6o6h0a296c6q2 2412841 2412840 2026-05-12T14:53:39Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412841 wikitext text/x-wiki ak8shsx5zohgfn7k0p3nr0uex59ztex 2412842 2412841 2026-05-12T14:54:19Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412842 wikitext text/x-wiki 4z3asecnbl7s1djbu4hq1o03hnn6tp8 2412843 2412842 2026-05-12T14:54:40Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2412843 wikitext text/x-wiki bj7gctnhnvpx9hbkssn7rdxj42dghhp 2412844 2412843 2026-05-12T14:55:05Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2412844 wikitext text/x-wiki h8yklyx5w9k1vz15nobpqj5b3dr30ha 2412845 2412844 2026-05-12T14:57:09Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2220.codfw.wmnet with reason: Maintenance 2412845 wikitext text/x-wiki 3rsy14ehycijw73ed36960xh8b16of9 2412849 2412845 2026-05-12T15:11:47Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host db1270.eqiad.wmnet with OS bookworm 2412849 wikitext text/x-wiki ht1lbporhmzepj4k8uzzqux97olp7w7 2412850 2412849 2026-05-12T15:12:10Z Stashbot 7414 eevans@deploy1003: helmfile [staging] START helmfile.d/services/linked-artifacts: apply 2412850 wikitext text/x-wiki a9zn5pea5tte1lvu6pgl8vtvk95va9g 2412851 2412850 2026-05-12T15:12:24Z Stashbot 7414 eevans@deploy1003: helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply 2412851 wikitext text/x-wiki 3vk8bx11hsk1g4qbq56gysz1uut1w1j 2412852 2412851 2026-05-12T15:17:22Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.264.0" for 163 host(s) 2412852 wikitext text/x-wiki 6muka2epcp8d0ox9x8r7x0brzvm086b 2412853 2412852 2026-05-12T15:22:10Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.264.0" for 1 host(s) 2412853 wikitext text/x-wiki g888hpyqx8p8b307dwy00x567voll3p 2412854 2412853 2026-05-12T15:23:02Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.264.0" completed for 1 hosts 2412854 wikitext text/x-wiki gmg0w7tlwqtudgoi7htrimemu43uyh0 2412856 2412854 2026-05-12T15:23:56Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.264.0" for 1 host(s) 2412856 wikitext text/x-wiki evoa54rzwpyn7xmc3kr3ghzdsgegms3 2412857 2412856 2026-05-12T15:24:47Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.264.0" completed for 1 hosts 2412857 wikitext text/x-wiki q0j0xyfnf9w7fw4s756619bpzjbafbi 2412858 2412857 2026-05-12T15:25:21Z Stashbot 7414 jelto@deploy1003: helmfile [staging] START helmfile.d/services/miscweb: apply 2412858 wikitext text/x-wiki b5kqv6ds5g7jkg0d2sbwsfpnvmegi4a 2412859 2412858 2026-05-12T15:25:52Z Stashbot 7414 jelto@deploy1003: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2412859 wikitext text/x-wiki fhzf1plu44m2crhupt9rf8clene748r 2412860 2412859 2026-05-12T15:26:06Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1270.eqiad.wmnet with OS bookworm 2412860 wikitext text/x-wiki c6cmqkd922d8fzz2sfoyrqkpebpnml3 2412861 2412860 2026-05-12T15:26:49Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1272.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412861 wikitext text/x-wiki 7mla38wwu5kx3lwdh4es383sc8eaudz 2412862 2412861 2026-05-12T15:28:38Z Stashbot 7414 jelto@deploy1003: helmfile [staging] START helmfile.d/services/miscweb: apply 2412862 wikitext text/x-wiki ri4bkejhx7vt4qasac9vccx5n3yj72d 2412863 2412862 2026-05-12T15:29:40Z Stashbot 7414 jelto@deploy1003: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2412863 wikitext text/x-wiki e9usv9ad1zaos96oos7smqwf07pnjsz 2412864 2412863 2026-05-12T15:30:30Z Stashbot 7414 jelto@deploy1003: helmfile [codfw] START helmfile.d/services/miscweb: apply 2412864 wikitext text/x-wiki hixvxh3sz9od8txlzinwyvr95dcs6ss 2412865 2412864 2026-05-12T15:30:45Z Stashbot 7414 jelto@deploy1003: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2412865 wikitext text/x-wiki ksbq3m46bjfj71ah97xnc9iy4ravxpk 2412866 2412865 2026-05-12T15:31:14Z Stashbot 7414 jelto@deploy1003: helmfile [codfw] START helmfile.d/services/miscweb: apply 2412866 wikitext text/x-wiki 6y0x3g0cotwxrga4ucd79llbo4jttnt 2412867 2412866 2026-05-12T15:33:46Z Stashbot 7414 jelto@deploy1003: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2412867 wikitext text/x-wiki ejgseqnxdc1yrdnkvg7x13uvsvt32zu 2412868 2412867 2026-05-12T15:34:52Z Stashbot 7414 jelto: helm uninstall -n miscweb design-strategy - T329991 2412868 wikitext text/x-wiki t1w8t0ujdwke40fwcmuupze31pgfzb2 2412869 2412868 2026-05-12T15:35:01Z Stashbot 7414 jelto@deploy1003: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2412869 wikitext text/x-wiki 9qtlmg15074px7bqzgnivkrn09ax5oi 2412870 2412869 2026-05-12T15:37:03Z Stashbot 7414 jelto@deploy1003: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2412870 wikitext text/x-wiki i8d1p4x0z9dp46wdl16bgbx72zv5un5 2412871 2412870 2026-05-12T15:42:03Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1272.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412871 wikitext text/x-wiki qndi0y273y80qd2wkvbsn3pz25irk8j 2412872 2412871 2026-05-12T15:45:18Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1286384|wikinews: Remove unnecessary settings (T421796)]] 2412872 wikitext text/x-wiki 21cbgwz5dfoqt7jil2kevikuc40u8z0 2412873 2412872 2026-05-12T15:47:19Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup, neriah: Backport for [[gerrit:1286384|wikinews: Remove unnecessary settings (T421796)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412873 wikitext text/x-wiki 4q1ahsnnie0zstm5vtvzkrqzfr48ed6 2412874 2412873 2026-05-12T15:48:29Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup, neriah: Continuing with deployment 2412874 wikitext text/x-wiki f3uthjq31t9nqvhqrfgg5huxtwqxr58 2412875 2412874 2026-05-12T15:52:31Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2412875 wikitext text/x-wiki 0ksfbkxpg304jyo0om7ve7yp8y9b77n 2412876 2412875 2026-05-12T15:52:39Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2412876 wikitext text/x-wiki sm44xjq7dxnsu1u11qqt0lfifoqi2n3 2412877 2412876 2026-05-12T15:52:42Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286384|wikinews: Remove unnecessary settings (T421796)]] (duration: 07m 22s) 2412877 wikitext text/x-wiki 295yw75bvvcczgeskhv79bv3sbr6hwx 2412880 2412877 2026-05-12T15:57:50Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2412880 wikitext text/x-wiki osww6giziitzwwxf48xguv7bz8uyum2 2412881 2412880 2026-05-12T16:00:24Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2412881 wikitext text/x-wiki 9nxfutg8obeijuw220xvg6ld90l7zqo 2412883 2412881 2026-05-12T16:25:25Z Stashbot 7414 moritzm: installing Exim security updates on lists/vrts hosts 2412883 wikitext text/x-wiki 15r60n8gtx30497a2sugnt4tunevvob 2412884 2412883 2026-05-12T16:46:23Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host db1270.eqiad.wmnet with OS bookworm 2412884 wikitext text/x-wiki cplb8ijhpa4lt71w01fmv7uo2rdw7at 2412885 2412884 2026-05-12T17:35:37Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-toolhub: apply 2412885 wikitext text/x-wiki mktkn6szinz82askp1asgy0jhmu05y6 2412886 2412885 2026-05-12T17:36:04Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-toolhub: apply 2412886 wikitext text/x-wiki 4ab422v7i3gz5lgs033o5c7tcc2cd28 2412887 2412886 2026-05-12T17:36:32Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2412887 wikitext text/x-wiki 4dte47y7vgvcj2qcxfv5cd085hedkiq 2412888 2412887 2026-05-12T17:37:21Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2412888 wikitext text/x-wiki jtxhx5z2ye5k9aq3zxe2vzxt0ihvj3f 2412889 2412888 2026-05-12T17:37:22Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2412889 wikitext text/x-wiki m4c4hjumqbad4u87lxnsfqmfppled9s 2412890 2412889 2026-05-12T17:37:39Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.provision for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2412890 wikitext text/x-wiki 1zki5ur4fz52ryzyg7xd3gwi38f40rl 2412891 2412890 2026-05-12T17:38:13Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2412891 wikitext text/x-wiki f09ry3bxoxkcz7j1xcgc8u6871xd3da 2412892 2412891 2026-05-12T17:38:50Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2412892 wikitext text/x-wiki rlsqnstbas4xlks6y86ms31whjm5kft 2412893 2412892 2026-05-12T17:38:52Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2412893 wikitext text/x-wiki ojdvoot9cunzzxx4ya5yhfxdqojxva8 2412894 2412893 2026-05-12T17:38:54Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2412894 wikitext text/x-wiki 0bqdr8n58uzxj8ittdpb1gpv3w3q2xb 2412895 2412894 2026-05-12T17:38:57Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2412895 wikitext text/x-wiki 78yixgdmtsrtsdtbabl0x71n532uetx 2412896 2412895 2026-05-12T17:39:52Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2412896 wikitext text/x-wiki eu1sd1g89fvyea4n6m0mgo5efz1te9b 2412897 2412896 2026-05-12T17:39:55Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2412897 wikitext text/x-wiki 8suqyimil5ikhjsots48yhclnq7grxy 2412898 2412897 2026-05-12T17:39:56Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2412898 wikitext text/x-wiki bdou8cpear6zalskybllos7w186izz0 2412899 2412898 2026-05-12T17:39:59Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2412899 wikitext text/x-wiki nmsvpe5ivrym79n30eenoaca80z7svg 2412900 2412899 2026-05-12T17:40:38Z Stashbot 7414 otto@deploy1003: Started scap sync-world: Backport for [[gerrit:1286434|EventStreamConfig - ingest mediawiki.user_change into the Data Lake (T423952)]] 2412900 wikitext text/x-wiki ihb8k6hebycihp4d6q1l7m8jt9nkf3u 2412901 2412900 2026-05-12T17:42:33Z Stashbot 7414 otto@deploy1003: otto: Backport for [[gerrit:1286434|EventStreamConfig - ingest mediawiki.user_change into the Data Lake (T423952)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412901 wikitext text/x-wiki 2hgq68czcadtfmq6vz6xbgrs9r2y3f1 2412902 2412901 2026-05-12T17:45:40Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2412902 wikitext text/x-wiki c4kl9w9tdc3d1dp2rmsrdl09ku46bhm 2412903 2412902 2026-05-12T17:46:04Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2412903 wikitext text/x-wiki 1h7buk8a4nxzw642b09mlzopoc5d41o 2412904 2412903 2026-05-12T17:46:06Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2412904 wikitext text/x-wiki he8azb4nvpjxrhhm7rt0zswcvx5dome 2412905 2412904 2026-05-12T17:46:34Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2412905 wikitext text/x-wiki r7n7et5apffwcaglkqj8komew60g08s 2412906 2412905 2026-05-12T17:48:31Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2412906 wikitext text/x-wiki pnsn6qm3phookewqy1feunjfwit06gf 2412907 2412906 2026-05-12T17:48:33Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2412907 wikitext text/x-wiki 9t89ev6r6l3xsham12zafzdvdx03f79 2412908 2412907 2026-05-12T17:48:34Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2412908 wikitext text/x-wiki s60p66td1kdwdie6lt34lqtkl0sm5qq 2412909 2412908 2026-05-12T17:48:38Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2412909 wikitext text/x-wiki spe0h6nkfy5xmcpe2oxu8qvu0klxuvl 2412910 2412909 2026-05-12T17:50:41Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2412910 wikitext text/x-wiki 3q0hm07wrimml349325y06fqgpow3hp 2412911 2412910 2026-05-12T17:50:44Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2412911 wikitext text/x-wiki 43lpkmm0wq38vd0eun5ikoh2wfo0lax 2412912 2412911 2026-05-12T17:50:45Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2412912 wikitext text/x-wiki po05tpv1tw9wd1y42gsg4bswkrqjymz 2412913 2412912 2026-05-12T17:50:48Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2412913 wikitext text/x-wiki dak1zxth97nl8tdabwts5p61kkvm6ez 2412914 2412913 2026-05-12T17:51:57Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2412914 wikitext text/x-wiki 10ggowxyvq8eejsb1kyfr9n6neu4je8 2412915 2412914 2026-05-12T17:51:59Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2412915 wikitext text/x-wiki sj05ruyt7e735i0sqqipikzik7ayuwf 2412916 2412915 2026-05-12T17:52:00Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2412916 wikitext text/x-wiki jamro18vor1f7sk26u9ezlekuo1wsi6 2412917 2412916 2026-05-12T17:52:04Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2412917 wikitext text/x-wiki ns7ihj8rfzz8p79kguk9s300bqfn725 2412918 2412917 2026-05-12T17:52:31Z Stashbot 7414 otto@deploy1003: otto: Continuing with deployment 2412918 wikitext text/x-wiki soallu7l1mwbrr65r4kwz5un3gvf2ob 2412919 2412918 2026-05-12T17:53:38Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2412919 wikitext text/x-wiki agr3ze2haxfgt7pvxayfkyo8d7ynupq 2412920 2412919 2026-05-12T17:53:42Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2412920 wikitext text/x-wiki nc2q22d9kg5m2wa2rrpjc1fmwsd2d6t 2412921 2412920 2026-05-12T17:53:43Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2412921 wikitext text/x-wiki 73vwydgcoz0jejjev4utxozr85995jh 2412922 2412921 2026-05-12T17:53:48Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2412922 wikitext text/x-wiki crlm9z119aqjfpq7tfh5ndaniv18ua6 2412923 2412922 2026-05-12T17:56:24Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2412923 wikitext text/x-wiki 4gmmnjmffzd89tmne0nbws1yxb3d3j0 2412924 2412923 2026-05-12T17:56:46Z Stashbot 7414 otto@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286434|EventStreamConfig - ingest mediawiki.user_change into the Data Lake (T423952)]] (duration: 16m 08s) 2412924 wikitext text/x-wiki mifp4eeq7uyt3lncsz0vbnlxvi6ojdv 2412925 2412924 2026-05-12T17:56:47Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.reimage for host lvs1017.eqiad.wmnet with OS bullseye 2412925 wikitext text/x-wiki 7ufxyb5thuh4g7ie86e6geido1uzabo 2412928 2412925 2026-05-12T18:08:35Z Stashbot 7414 brett@cumin2002: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host lvs1017.eqiad.wmnet with OS bullseye 2412928 wikitext text/x-wiki ovjndjusrdw2sp7w8adqxh48rwrc2kh 2412929 2412928 2026-05-12T18:08:52Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.provision for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2412929 wikitext text/x-wiki 7nye1xnus9w4xtgnf9ufequ81n5r4ez 2412930 2412929 2026-05-12T18:24:42Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2412930 wikitext text/x-wiki pnueoozl4ktqkb42914ryme7qub9ucu 2412931 2412930 2026-05-12T18:25:14Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.reimage for host lvs1017.eqiad.wmnet with OS bullseye 2412931 wikitext text/x-wiki ldyic1yag5xmke3ffp8z7snrtd5s96j 2412932 2412931 2026-05-12T18:35:19Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.provision for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2412932 wikitext text/x-wiki de8fn4l1equn7k7ydkl0ur6wbyvldrb 2412933 2412932 2026-05-12T18:42:12Z Stashbot 7414 brett@cumin2002: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2412933 wikitext text/x-wiki 95xvh7l8im1bmk4fg1r4y9jijdl73lf 2412934 2412933 2026-05-12T19:05:40Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.provision for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2412934 wikitext text/x-wiki b6tv3fdn0ttgau04hju064r1dygacye 2412935 2412934 2026-05-12T19:06:23Z Stashbot 7414 topranks: migrate link from cr1-magru to asw1-b3-magru to L2 trunk on the switch side T424611 2412935 wikitext text/x-wiki qplqob1rlhmf8ln5jyyc5sws97p04z1 2412936 2412935 2026-05-12T19:06:46Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host lvs1017.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2412936 wikitext text/x-wiki i1cufq5xaxyorw85dhhw0cgqlwn13xt 2412937 2412936 2026-05-12T19:14:38Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.reimage for host lvs1017.eqiad.wmnet with OS bullseye 2412937 wikitext text/x-wiki 1z0xq3jrfflt0n9w7of3wcrkm3vz85h 2412939 2412937 2026-05-12T19:26:00Z Stashbot 7414 topranks: migrate link from cr2-magru to asw1-b3-magru to L2 trunk on the switch side T424611 2412939 wikitext text/x-wiki eo7v874bgzooxestwyq8ekxwlusv8q5 2412940 2412939 2026-05-12T19:27:43Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: Backport for [[gerrit:1286464|Fix MediaHandler caching to not preserve language (T425988 T425740 T425782)]] 2412940 wikitext text/x-wiki 7ad4m4jhmkb5px664lci9pwtd7i7ag8 2412941 2412940 2026-05-12T19:30:09Z Stashbot 7414 dancy@deploy1003: jforrester, dancy: Backport for [[gerrit:1286464|Fix MediaHandler caching to not preserve language (T425988 T425740 T425782)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412941 wikitext text/x-wiki s3p2zscbct3jf45a2dy3qi5l4yofuws 2412942 2412941 2026-05-12T19:30:31Z Stashbot 7414 dancy@deploy1003: jforrester, dancy: Continuing with deployment 2412942 wikitext text/x-wiki djsege2yetb4p9ui0yp38dbczncopcl 2412943 2412942 2026-05-12T19:30:33Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on lvs1017.eqiad.wmnet with reason: host reimage 2412943 wikitext text/x-wiki ompebmn208qvw4rtyq7mli8t84a0rfx 2412945 2412943 2026-05-12T19:34:50Z Stashbot 7414 dancy@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286464|Fix MediaHandler caching to not preserve language (T425988 T425740 T425782)]] (duration: 07m 07s) 2412945 wikitext text/x-wiki pda0p99zvsqg8uefq3hm149c6adw0jv 2412946 2412945 2026-05-12T19:35:03Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs1017.eqiad.wmnet with reason: host reimage 2412946 wikitext text/x-wiki pjhuz94m3rv420njkyt6pd2qpun1wba 2412947 2412946 2026-05-12T19:43:22Z Stashbot 7414 topranks: migrate link from cr1-magru to asw1-b4-magru to L2 trunk on the switch side T424611 2412947 wikitext text/x-wiki 7aai1fo73t8u9r8prq1ivl31efvq3aq 2412948 2412947 2026-05-12T19:51:15Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs1017.eqiad.wmnet with OS bullseye 2412948 wikitext text/x-wiki 4r2in18iprjkkvy9anwnw1s6w859iv5 2412949 2412948 2026-05-12T19:52:34Z Stashbot 7414 topranks: migrate link from cr2-magru to asw1-b4-magru to L2 trunk on the switch side T424611 2412949 wikitext text/x-wiki m61v6qsmyeb0r6xn6cezqmc2wqyy8xc 2412950 2412949 2026-05-12T19:54:17Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2412950 wikitext text/x-wiki dw3dvb2nav5ib840wjjlymjgfwv9vyw 2412951 2412950 2026-05-12T19:56:31Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1270.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412951 wikitext text/x-wiki qbfuoqeebqu8902230h48ww6m1i8bwm 2412952 2412951 2026-05-12T19:58:41Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host db1270.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412952 wikitext text/x-wiki rc1vxr2lz87rf6hlyj4xyihpzbj4ekv 2412953 2412952 2026-05-12T19:59:30Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1270.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412953 wikitext text/x-wiki awenq4b28ualnvhr2h7y7h98hvn7usi 2412954 2412953 2026-05-12T20:00:12Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2412954 wikitext text/x-wiki 11udn62oc2l48sg8aanffqn1q9d1mo5 2412955 2412954 2026-05-12T20:03:39Z Stashbot 7414 alexsanford@deploy1003: Started scap sync-world: Backport for [[gerrit:1285905|Enforce 2FA requirements for phase 2 groups (T423119)]], [[gerrit:1286469|Prepare $wgOATH2FARequiredGroupRemovalPages for phases 2 and 3 (T423119 T423120)]] 2412955 wikitext text/x-wiki 8qlo57ukb7ryi9g74ulng2azwa1kw2s 2412956 2412955 2026-05-12T20:05:21Z Stashbot 7414 topranks: migrate link from cr1-esams to asw1-bw27-esams to L2 trunk on the switch side T424611 2412956 wikitext text/x-wiki 5ntoes6vmesp35u6o0twcx3im1ie0pu 2412957 2412956 2026-05-12T20:05:39Z Stashbot 7414 alexsanford@deploy1003: alexsanford: Backport for [[gerrit:1285905|Enforce 2FA requirements for phase 2 groups (T423119)]], [[gerrit:1286469|Prepare $wgOATH2FARequiredGroupRemovalPages for phases 2 and 3 (T423119 T423120)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412957 wikitext text/x-wiki 8718xyl2ov0c31c8t4p40ut3vsxo7bz 2412959 2412957 2026-05-12T20:09:15Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1270.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412959 wikitext text/x-wiki 1dx55zpxdh0fsm1pflizmomjxsnl8m7 2412960 2412959 2026-05-12T20:10:23Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1270.eqiad.wmnet with OS bookworm 2412960 wikitext text/x-wiki hzj6bamvdfexcscyhhb9kg55q0ici5s 2412962 2412960 2026-05-12T20:11:10Z Stashbot 7414 alexsanford@deploy1003: alexsanford: Continuing with deployment 2412962 wikitext text/x-wiki 2pkfohegpfndnlbbw9yzefv25xxticm 2412963 2412962 2026-05-12T20:15:26Z Stashbot 7414 alexsanford@deploy1003: Finished scap sync-world: Backport for [[gerrit:1285905|Enforce 2FA requirements for phase 2 groups (T423119)]], [[gerrit:1286469|Prepare $wgOATH2FARequiredGroupRemovalPages for phases 2 and 3 (T423119 T423120)]] (duration: 11m 47s) 2412963 wikitext text/x-wiki hps2qx6gpksg6i45d2c2ssx3tkgnoap 2412964 2412963 2026-05-12T20:16:22Z Stashbot 7414 topranks: migrate link from cr2-esams to asw1-bw27-esams to L2 trunk on the switch side T424611 2412964 wikitext text/x-wiki fnuunyg44t4qch36zk205b6g0x777zl 2412967 2412964 2026-05-12T20:18:20Z Stashbot 7414 dbrant@deploy1003: Started scap sync-world: Backport for [[gerrit:1285930|docroot: Add "get_login_creds" permission to Android app. (T426010)]] 2412967 wikitext text/x-wiki g3edqybny28h0smdxrloqibtks2kurw 2412968 2412967 2026-05-12T20:20:17Z Stashbot 7414 dbrant@deploy1003: dbrant: Backport for [[gerrit:1285930|docroot: Add "get_login_creds" permission to Android app. (T426010)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412968 wikitext text/x-wiki 9041xsnl4ak23pnx2r6bh60tn40ac3q 2412969 2412968 2026-05-12T20:20:55Z Stashbot 7414 dbrant@deploy1003: dbrant: Continuing with deployment 2412969 wikitext text/x-wiki 8ktq4nte2ktwx9nubjexg4ysqaffv1n 2412970 2412969 2026-05-12T20:23:27Z Stashbot 7414 topranks: migrate link from cr1-esams to asw1-by27-esams to L2 trunk on the switch side T424611 2412970 wikitext text/x-wiki qb7683xmj75x9rxlroxbytkjbqkya5c 2412971 2412970 2026-05-12T20:25:49Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1271.eqiad.wmnet with OS bookworm 2412971 wikitext text/x-wiki tllkzmetc287qgucn1h4xvzerslgirt 2412972 2412971 2026-05-12T20:26:47Z Stashbot 7414 dbrant@deploy1003: Finished scap sync-world: Backport for [[gerrit:1285930|docroot: Add "get_login_creds" permission to Android app. (T426010)]] (duration: 08m 27s) 2412972 wikitext text/x-wiki 1nskqubho1q904imj5w7oush52d88mh 2412973 2412972 2026-05-12T20:35:28Z Stashbot 7414 topranks: migrate link from cr2-esams to asw1-by27-esams to L2 trunk on the switch side T424611 2412973 wikitext text/x-wiki r2llz9nmx1b2kiniq3jzk2futrd4qi5 2412974 2412973 2026-05-12T20:41:13Z Stashbot 7414 samtar@deploy1003: Started scap sync-world: Backport for [[gerrit:1285482|Allow svwiki bureaucrats to remove sysop rights (T425806)]] 2412974 wikitext text/x-wiki idrjo3xagisrz41by82nse4whdn1juj 2412975 2412974 2026-05-12T20:41:26Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1271.eqiad.wmnet with reason: host reimage 2412975 wikitext text/x-wiki lcghu6pn1uq7z84xbbps4zrb5vmgmy6 2412976 2412975 2026-05-12T20:41:29Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on db1271.eqiad.wmnet with reason: host reimage 2412976 wikitext text/x-wiki 3edga83ug0u4cdagckr5i5uqkdlnako 2412977 2412976 2026-05-12T20:41:31Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2412977 wikitext text/x-wiki o8pjucdqp7ik2czps4mne5om6rckzzc 2412978 2412977 2026-05-12T20:42:05Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1270.eqiad.wmnet with reason: host reimage 2412978 wikitext text/x-wiki khfqy1gkh77arqyqtmgiyunoqs7qunb 2412979 2412978 2026-05-12T20:43:12Z Stashbot 7414 samtar@deploy1003: samtar, dreamrimmer: Backport for [[gerrit:1285482|Allow svwiki bureaucrats to remove sysop rights (T425806)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412979 wikitext text/x-wiki a6k0wnmiit1v3dyj81mfeo88ud8v5ao 2412980 2412979 2026-05-12T20:44:50Z Stashbot 7414 topranks: migrate link from cr1-drmrs to asw1-b12-drmrs to L2 trunk on the switch side T424611 2412980 wikitext text/x-wiki 4kufqeanntxbkj0hguwvv8q26ktaufs 2412981 2412980 2026-05-12T20:46:06Z Stashbot 7414 samtar@deploy1003: samtar, dreamrimmer: Continuing with deployment 2412981 wikitext text/x-wiki mczv4gzgilnqw1jfd5w3jsbv7lznkg0 2412982 2412981 2026-05-12T20:46:50Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new link networks - cmooney@cumin1003" 2412982 wikitext text/x-wiki hossq7m2wajljownenmjkzp4iyyvjyc 2412983 2412982 2026-05-12T20:48:40Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1270.eqiad.wmnet with reason: host reimage 2412983 wikitext text/x-wiki oz8891a5fcip660qld86xlkpe0tsk87 2412984 2412983 2026-05-12T20:50:16Z Stashbot 7414 samtar@deploy1003: Finished scap sync-world: Backport for [[gerrit:1285482|Allow svwiki bureaucrats to remove sysop rights (T425806)]] (duration: 09m 03s) 2412984 wikitext text/x-wiki 2tqn6kjcdmoultnc9liybu56fgggmhl 2412985 2412984 2026-05-12T20:51:59Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host db1271.eqiad.wmnet with OS bookworm 2412985 wikitext text/x-wiki qf7uranqtwvbatu3jp2qngx5ufeydvo 2412986 2412985 2026-05-12T20:54:30Z Stashbot 7414 topranks: migrate link from cr2-drmrs to asw1-b12-drmrs to L2 trunk on the switch side T424611 2412986 wikitext text/x-wiki 8r76naitjbqj2p0dq457wyuo7euecyv 2412988 2412986 2026-05-12T21:01:35Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new link networks - cmooney@cumin1003" 2412988 wikitext text/x-wiki mlyr6crr7t0ph19c3c9nw7y8jv72f5a 2412989 2412988 2026-05-12T21:01:37Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2412989 wikitext text/x-wiki a9awneuz8xvry0pphwshxzpf2rr0don 2412990 2412989 2026-05-12T21:01:47Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2412990 wikitext text/x-wiki 448wvgtmy32zas4gipsxd2dd55qbjyk 2412991 2412990 2026-05-12T21:03:50Z Stashbot 7414 topranks: migrate link from cr1-drmrs to asw1-b13-drmrs to L2 trunk on the switch side T424611 2412991 wikitext text/x-wiki ndqwvt7v3amru8rp2gucwnv9fhlx43z 2412992 2412991 2026-05-12T21:05:07Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1286484|Bump wikimedia/parsoid to 0.24.0-a3 (T409751 T420336 T425981)]], [[gerrit:1286485|Bump wikimedia/parsoid to 0.24.0-a3 (T425981)]], [[gerrit:1286488|Disable unit tests that fail with new vendor release]], [[gerrit:1286489|Skip ContentHolderTest that fails with new vendor release]] 2412992 wikitext text/x-wiki srbgjr9mmykvizcit1c48c8k9ii77fj 2412993 2412992 2026-05-12T21:05:10Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new link networks - cmooney@cumin1003" 2412993 wikitext text/x-wiki qej72os1f9t4bfrh65gl3m97qbyv9cd 2412994 2412993 2026-05-12T21:05:26Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new link networks - cmooney@cumin1003" 2412994 wikitext text/x-wiki d9tgkko7nzepf3ituu4yiqbvjyds9we 2412995 2412994 2026-05-12T21:05:27Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2412995 wikitext text/x-wiki h46id3e1wfoayfnrc8g67fg591jcg7q 2412996 2412995 2026-05-12T21:05:29Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2412996 wikitext text/x-wiki 4rw4sa8d2w8n4uea97lq5zh51qlejay 2412997 2412996 2026-05-12T21:05:48Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2412997 wikitext text/x-wiki fjj3cviivmvk231mdfjdyjwgxujtbo7 2412998 2412997 2026-05-12T21:05:49Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1270.eqiad.wmnet with OS bookworm 2412998 wikitext text/x-wiki 0rbz9weptmrquhthjuvha5kxx6usx4y 2412999 2412998 2026-05-12T21:06:27Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1271.eqiad.wmnet with OS bookworm 2412999 wikitext text/x-wiki 9uz2pmmi0dl6po9eurtwbm3xajkqvbu 2413000 2412999 2026-05-12T21:07:02Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1286484|Bump wikimedia/parsoid to 0.24.0-a3 (T409751 T420336 T425981)]], [[gerrit:1286485|Bump wikimedia/parsoid to 0.24.0-a3 (T425981)]], [[gerrit:1286488|Disable unit tests that fail with new vendor release]], [[gerrit:1286489|Skip ContentHolderTest that fails with new vendor release]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Change 2413000 wikitext text/x-wiki bx6ghzm7bdyzxnbmzhbk1g58xkcdgkz 2413001 2413000 2026-05-12T21:15:36Z Stashbot 7414 topranks: migrate link from cr1-drmrs to asw1-b13-drmrs to L2 trunk on the switch side T424611 2413001 wikitext text/x-wiki bbq9j56meid9m1jp0yqh2hkht1aglw8 2413002 2413001 2026-05-12T21:15:45Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2413002 wikitext text/x-wiki ed7oo58dsh5aspr0iayrvcfljnrp57b 2413003 2413002 2026-05-12T21:19:58Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286484|Bump wikimedia/parsoid to 0.24.0-a3 (T409751 T420336 T425981)]], [[gerrit:1286485|Bump wikimedia/parsoid to 0.24.0-a3 (T425981)]], [[gerrit:1286488|Disable unit tests that fail with new vendor release]], [[gerrit:1286489|Skip ContentHolderTest that fails with new vendor release]] (duration: 14m 51s) 2413003 wikitext text/x-wiki mn6oyrlenguwhpyjncu2oukppmkksr6 2413004 2413003 2026-05-12T21:23:11Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1271.eqiad.wmnet with reason: host reimage 2413004 wikitext text/x-wiki ezhhsusx90vw2hfxvltjen6n0wvs5ra 2413005 2413004 2026-05-12T21:23:39Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2413005 wikitext text/x-wiki ku39x8domyhkd4zqu21l4jirfzcjfab 2413006 2413005 2026-05-12T21:26:57Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1283048|Enabling RSS extension for cowikimedia chapter (T425440)]], [[gerrit:1286390|Set $wgSignatureAllowedLintErrors to an empty array on Spanish Wiktionary (T425332)]] 2413006 wikitext text/x-wiki c92j4b29tq6pwb4aino8avzu09kaoj2 2413007 2413006 2026-05-12T21:27:47Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new link networks - cmooney@cumin1003" 2413007 wikitext text/x-wiki acxqbenj4ij75u6ypp9msr7wxdrcwe0 2413008 2413007 2026-05-12T21:28:08Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new link networks - cmooney@cumin1003" 2413008 wikitext text/x-wiki cs3ronwey84nh6ujxn9qldmymmkqq9s 2413009 2413008 2026-05-12T21:28:09Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413009 wikitext text/x-wiki hs9vk98l5l3g65bwhi2kgbjto4rdu5b 2413010 2413009 2026-05-12T21:29:07Z Stashbot 7414 cscott@deploy1003: danielyepezgarces, cscott, vadymts1: Backport for [[gerrit:1283048|Enabling RSS extension for cowikimedia chapter (T425440)]], [[gerrit:1286390|Set $wgSignatureAllowedLintErrors to an empty array on Spanish Wiktionary (T425332)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2413010 wikitext text/x-wiki g29ho03bbyfnvlh00d4729h8pzj3ktd 2413011 2413010 2026-05-12T21:29:53Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1271.eqiad.wmnet with reason: host reimage 2413011 wikitext text/x-wiki o1yjaxvzlubmx4aun5vk3j5ogbhlzva 2413012 2413011 2026-05-12T21:31:13Z Stashbot 7414 cscott@deploy1003: danielyepezgarces, cscott, vadymts1: Continuing with deployment 2413012 wikitext text/x-wiki i6t6eub6ohve3g3zmb6omidfd3tlp31 2413013 2413012 2026-05-12T21:32:52Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2413013 wikitext text/x-wiki 2i9kracc18pblfgp70wdyhmje5p07sh 2413014 2413013 2026-05-12T21:38:42Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1273] - vriley@cumin1003" 2413014 wikitext text/x-wiki dh1jlqj0rl70c8hq6liuc8veu0uqftw 2413015 2413014 2026-05-12T21:38:47Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1273] - vriley@cumin1003" 2413015 wikitext text/x-wiki p7c85jmf0wk6msyypta5tp7qv0wa3q8 2413016 2413015 2026-05-12T21:38:48Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413016 wikitext text/x-wiki 7eqtbwyx22ybqar1kqu8ona2xm1dl0b 2413017 2413016 2026-05-12T21:38:53Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1283048|Enabling RSS extension for cowikimedia chapter (T425440)]], [[gerrit:1286390|Set $wgSignatureAllowedLintErrors to an empty array on Spanish Wiktionary (T425332)]] (duration: 11m 56s) 2413017 wikitext text/x-wiki j1261womawnntp1o3k25dmkzx515fhb 2413018 2413017 2026-05-12T21:39:19Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host db1273 2413018 wikitext text/x-wiki ao1sfb1f95n4k68njxkam9jy8m8437d 2413019 2413018 2026-05-12T21:40:40Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1272.eqiad.wmnet with OS bookworm 2413019 wikitext text/x-wiki 7zeky6s3sw70zqqzm9aj63bgob6rbqa 2413021 2413019 2026-05-12T21:41:57Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host db1273 2413021 wikitext text/x-wiki 182ej93goi7b7evm8vpi14yfqgi9fye 2413022 2413021 2026-05-12T21:42:32Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1273.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413022 wikitext text/x-wiki eln0apf3yxrtof0zynjmuv1b1et4u8f 2413023 2413022 2026-05-12T21:44:00Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1286456|Disable interactions until load is complete (T422968 T424787)]] 2413023 wikitext text/x-wiki r0dm9t6nabzx4wrca2fm4lzehux3r8i 2413024 2413023 2026-05-12T21:46:52Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413024 wikitext text/x-wiki 7emzoysjvpnn9erpcdqo05ywfg0872a 2413025 2413024 2026-05-12T21:50:49Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413025 wikitext text/x-wiki sey56r9szk915yr7m389oeudiyrbwz7 2413026 2413025 2026-05-12T21:50:50Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1271.eqiad.wmnet with OS bookworm 2413026 wikitext text/x-wiki dkhz3nqmjxijdnuofy4d9hemmg7knuf 2413027 2413026 2026-05-12T21:57:30Z Stashbot 7414 dwisehaupt@dns1004: START - running authdns-update 2413027 wikitext text/x-wiki srofo3bowkfg64e8o0teeyb56qhmkvh 2413029 2413027 2026-05-12T21:59:06Z Stashbot 7414 dwisehaupt@dns1004: END - running authdns-update 2413029 wikitext text/x-wiki frpi1rlhthsgdqpx34qviw24fnuzwm2 2413030 2413029 2026-05-12T22:01:38Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1286456|Disable interactions until load is complete (T422968 T424787)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2413030 wikitext text/x-wiki aqh6pryar2lc0myz638erfealm9707x 2413031 2413030 2026-05-12T22:03:58Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1273.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413031 wikitext text/x-wiki kmviyvuag023hnyc4wilqcnnssbcn2l 2413032 2413031 2026-05-12T22:05:20Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2413032 wikitext text/x-wiki sweuccpgr21n6d57nc2os3aysxirqsd 2413034 2413032 2026-05-12T22:18:01Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286456|Disable interactions until load is complete (T422968 T424787)]] (duration: 34m 01s) 2413034 wikitext text/x-wiki b1z3dx9sum5hq4xq7dd4o7ne95khp4w 2413036 2413034 2026-05-12T22:21:24Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1272.eqiad.wmnet with reason: host reimage 2413036 wikitext text/x-wiki q2fqgpqop66lj06xkwuws6bbd7yyptw 2413037 2413036 2026-05-12T22:21:48Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on db1272.eqiad.wmnet with reason: host reimage 2413037 wikitext text/x-wiki 1ab7v4fgav7ixc5uf7mjmy4rhzvt5f0 2413039 2413037 2026-05-12T22:32:04Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1286514|Also merge views overflow into array-items (T426115)]], [[gerrit:1286513|Also merge views overflow into array-items (T426115)]], [[gerrit:1286421|Special:Preferences: Display three options for thumbsizes (T424910)]] 2413039 wikitext text/x-wiki 78ng08cfs8h0purnmodkj0s44cab39u 2413040 2413039 2026-05-12T22:40:11Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413040 wikitext text/x-wiki ga8939t3c7gsa51sy4379gi5npl1qha 2413041 2413040 2026-05-12T22:40:30Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413041 wikitext text/x-wiki o4d6zocektjl9n4msbjpmclwoufa18u 2413042 2413041 2026-05-12T22:40:31Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1272.eqiad.wmnet with OS bookworm 2413042 wikitext text/x-wiki gk0tdnp8bf7ggvrqo2mem4eoe41efp2 2413044 2413042 2026-05-12T22:49:41Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1286514|Also merge views overflow into array-items (T426115)]], [[gerrit:1286513|Also merge views overflow into array-items (T426115)]], [[gerrit:1286421|Special:Preferences: Display three options for thumbsizes (T424910)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2413044 wikitext text/x-wiki 25e62rl7t0uijywu1puaivmijm2e53s 2413045 2413044 2026-05-12T22:53:40Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2413045 wikitext text/x-wiki pkr51lu035cm45xjvgu8r4kir9lqzft 2413047 2413045 2026-05-12T23:01:37Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1273.eqiad.wmnet with OS bookworm 2413047 wikitext text/x-wiki tjafxkoh1xv9t2g7tpk9wq42ghoyn7v 2413049 2413047 2026-05-12T23:05:32Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286514|Also merge views overflow into array-items (T426115)]], [[gerrit:1286513|Also merge views overflow into array-items (T426115)]], [[gerrit:1286421|Special:Preferences: Display three options for thumbsizes (T424910)]] (duration: 33m 28s) 2413049 wikitext text/x-wiki jry4hd67l5n24iic8zusac5re475s9u 2413053 2413049 2026-05-12T23:33:38Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1286506|Re-enable unit tests with updated output]], [[gerrit:1286516|Re-enable ContentHolderTest with updated output]], [[gerrit:1286515|Revert "Remove File::getHandler language fallback" (T425988)]] 2413053 wikitext text/x-wiki ew0pl7vwmqod7p66cijvbrcpsi3pb32 2413055 2413053 2026-05-12T23:39:17Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1286506|Re-enable unit tests with updated output]], [[gerrit:1286516|Re-enable ContentHolderTest with updated output]], [[gerrit:1286515|Revert "Remove File::getHandler language fallback" (T425988)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2413055 wikitext text/x-wiki spsaj44lsaazgz78nky9d811g0a2sps 2413056 2413055 2026-05-12T23:40:09Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2413056 wikitext text/x-wiki nq26azi82tkqgy49mp8issnfyqmjx34 2413061 2413056 2026-05-12T23:46:24Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286506|Re-enable unit tests with updated output]], [[gerrit:1286516|Re-enable ContentHolderTest with updated output]], [[gerrit:1286515|Revert "Remove File::getHandler language fallback" (T425988)]] (duration: 12m 45s) 2413061 wikitext text/x-wiki dagtem1wuow3hvuz31eerc6quq9dz99 2413062 2413061 2026-05-12T23:48:14Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1273.eqiad.wmnet with reason: host reimage 2413062 wikitext text/x-wiki j5ri9yqt2w99u0yjr1logzpf0xcv5gg 2413063 2413062 2026-05-12T23:54:29Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1273.eqiad.wmnet with reason: host reimage 2413063 wikitext text/x-wiki isp7zaafugbbaxos2yzsi9fkf6qty76 2413065 2413063 2026-05-13T00:11:51Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413065 wikitext text/x-wiki g85ocgazafwxk05t98niz2z76z17wbd 2413070 2413065 2026-05-13T00:50:10Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413070 wikitext text/x-wiki j1wmw635flc0pqqdwlesf9400nc5ewu 2413071 2413070 2026-05-13T00:50:12Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1273.eqiad.wmnet with OS bookworm 2413071 wikitext text/x-wiki 4q4t14o9uyxnxk8ap8pydnrgzdi57gm 2413072 2413071 2026-05-13T00:52:36Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2413072 wikitext text/x-wiki p35fx4arb3ln5u47n70xpw0hjrt52ur 2413073 2413072 2026-05-13T00:56:26Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1274] - vriley@cumin1003" 2413073 wikitext text/x-wiki o7y8rpr38f5x18oo0llizqyv8ghpm0x 2413074 2413073 2026-05-13T00:56:32Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1274] - vriley@cumin1003" 2413074 wikitext text/x-wiki luww8j0wz3hccolbhdhcoographfjhp 2413075 2413074 2026-05-13T00:56:33Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413075 wikitext text/x-wiki bx3vayl6g2pmtj88ek1pezsnz8bwl9z 2413076 2413075 2026-05-13T00:57:39Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host db1274 2413076 wikitext text/x-wiki 4c178drc8gqdp1wcoix77yqgmfszav9 2413077 2413076 2026-05-13T00:58:55Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host db1274 2413077 wikitext text/x-wiki t82j21cq6bg5txp16eprgrcb2b282n7 2413078 2413077 2026-05-13T00:59:40Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1274.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413078 wikitext text/x-wiki azguue6t1pyqrsnr5awo4ktnim4k5um 2413079 2413078 2026-05-13T01:08:17Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2413079 wikitext text/x-wiki q98koq4u5t3oe0jsblbrlhm4hduhlko 2413080 2413079 2026-05-13T01:12:02Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1275] - vriley@cumin1003" 2413080 wikitext text/x-wiki j8pctw9layhcewjsq69d1sknbr3brcl 2413081 2413080 2026-05-13T01:12:09Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1275] - vriley@cumin1003" 2413081 wikitext text/x-wiki ic452d4fusrb460nvlb985n26h3vkf5 2413082 2413081 2026-05-13T01:12:10Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413082 wikitext text/x-wiki rjtqef84iqzgbddromlkykb52e7dswa 2413083 2413082 2026-05-13T01:12:31Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host db1275 2413083 wikitext text/x-wiki 4ltjuz42t610027mg2ry8s3jgxvuqrq 2413084 2413083 2026-05-13T01:12:59Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1274.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413084 wikitext text/x-wiki 1h8cf9pkwzwxy2vefxiq4qb99bb09hg 2413087 2413084 2026-05-13T01:14:19Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host db1275 2413087 wikitext text/x-wiki ale88orq4ox6vu2yza8a84lokuaftbx 2413089 2413087 2026-05-13T01:18:27Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1275.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413089 wikitext text/x-wiki 5qpcfzrwb4zwm96slvxqk8y5sny46bn 2413090 2413089 2026-05-13T01:26:01Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1286532|Start reading from new tables everywhere except commons (2nd try) (T416548)]] 2413090 wikitext text/x-wiki gjjklr22xlww4w1rqkvfcdqcwoqq1zl 2413091 2413090 2026-05-13T01:27:14Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1274.eqiad.wmnet with OS bookworm 2413091 wikitext text/x-wiki igmwjl9rwz7irmcirft1h6x1r5l4k6v 2413093 2413091 2026-05-13T01:27:58Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1286532|Start reading from new tables everywhere except commons (2nd try) (T416548)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2413093 wikitext text/x-wiki gmnecr3dyqxlldyerub2xkk3zjk1j55 2413094 2413093 2026-05-13T01:28:26Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with deployment 2413094 wikitext text/x-wiki er7rcjcbcqwdxe5vsql24mar0m83kx5 2413095 2413094 2026-05-13T01:32:36Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286532|Start reading from new tables everywhere except commons (2nd try) (T416548)]] (duration: 06m 35s) 2413095 wikitext text/x-wiki 3maz1xefm07afu0vvfmofnb1l4sgqbe 2413097 2413095 2026-05-13T01:37:10Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1275.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413097 wikitext text/x-wiki biry3mds5t9ssts6h8yl1o80xwbq1b0 2413099 2413097 2026-05-13T01:58:04Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1275.eqiad.wmnet with OS bookworm 2413099 wikitext text/x-wiki 6y34z51qfzlj3a2ingv0cz6qwmxdyrq 2413100 2413099 2026-05-13T02:00:47Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2413100 wikitext text/x-wiki tf4ozxbce5mcdy191pkfl5ryn4ye8n5 2413103 2413100 2026-05-13T02:07:03Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2413103 wikitext text/x-wiki crw5jj0l3axqoa20rn6otoen20s7zrn 2413104 2413103 2026-05-13T02:07:32Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 06m 44s) 2413104 wikitext text/x-wiki 2x0qc6nliykn46afhz9vqzmsm68ijcw 2413105 2413104 2026-05-13T02:10:48Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1276] - vriley@cumin1003" 2413105 wikitext text/x-wiki dlijcwk61er4oodmbidbvf8un230z1g 2413106 2413105 2026-05-13T02:10:54Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1276] - vriley@cumin1003" 2413106 wikitext text/x-wiki etyf2hb40qfn4ahzej7g4eatzrilgoy 2413107 2413106 2026-05-13T02:10:55Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413107 wikitext text/x-wiki kulh211tc0b92dk1oy96gwod67k982l 2413108 2413107 2026-05-13T02:11:44Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host db1276 2413108 wikitext text/x-wiki 85sx1p6ztlxgpgy36aw6q78ztq8gnow 2413109 2413108 2026-05-13T02:13:45Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1275.eqiad.wmnet with reason: host reimage 2413109 wikitext text/x-wiki pgge5qoda2n75kuhuteqna46fntbuhs 2413110 2413109 2026-05-13T02:15:03Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host db1276 2413110 wikitext text/x-wiki pm0nw022i7b7pr6n47hvd7wmnijc13r 2413111 2413110 2026-05-13T02:16:06Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1276.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413111 wikitext text/x-wiki dtc5kuvg5jumufgd2ckagwqw3vqg254 2413112 2413111 2026-05-13T02:18:34Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1275.eqiad.wmnet with reason: host reimage 2413112 wikitext text/x-wiki f40lslcyal14djc8r61uu3n238satve 2413113 2413112 2026-05-13T02:19:47Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host db1274.eqiad.wmnet with OS bookworm 2413113 wikitext text/x-wiki 5c9iit9rtimrny8nvk0bdgv33667n90 2413114 2413113 2026-05-13T02:21:25Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2413114 wikitext text/x-wiki 2v1mr3wbkj8fi8t66xi0iog7buc4cjl 2413115 2413114 2026-05-13T02:25:25Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1277] - vriley@cumin1003" 2413115 wikitext text/x-wiki i0wgaef7caeezy7dr97mn0dgzc55ypg 2413116 2413115 2026-05-13T02:25:30Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1277] - vriley@cumin1003" 2413116 wikitext text/x-wiki cydu0ovf0h27y6kxz4hodwk58crnpvr 2413117 2413116 2026-05-13T02:25:32Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413117 wikitext text/x-wiki 5kdjrsrurw8c51cnrq3c7layetqvkvm 2413118 2413117 2026-05-13T02:26:19Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host db1277 2413118 wikitext text/x-wiki 8cu7eex4qo5nawfemznrlv99n9xfcyk 2413119 2413118 2026-05-13T02:28:00Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host db1277 2413119 wikitext text/x-wiki 3ve627ub4pp5w9zjxwma7lisuk9q4b6 2413120 2413119 2026-05-13T02:28:52Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1277.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413120 wikitext text/x-wiki gjjc9zo0axxu63t71ff01ay1mjukest 2413121 2413120 2026-05-13T02:34:25Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1276.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413121 wikitext text/x-wiki fimogj0a1pbuqtk4s2aplkxiwhxgcl9 2413122 2413121 2026-05-13T02:35:41Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413122 wikitext text/x-wiki foc2h2ry1jncdrydbw75gpt3ar7o1xg 2413123 2413122 2026-05-13T02:37:37Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413123 wikitext text/x-wiki omqpflo637aniyaho99rff4ll254cmm 2413124 2413123 2026-05-13T02:37:39Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1275.eqiad.wmnet with OS bookworm 2413124 wikitext text/x-wiki 0l78fr2c5m3mwps3hmzjfihb9quyonl 2413125 2413124 2026-05-13T02:49:07Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1276.eqiad.wmnet with OS bookworm 2413125 wikitext text/x-wiki hfswmik5w9y8h6wlpe03dpb1dosodte 2413126 2413125 2026-05-13T02:50:13Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1277.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413126 wikitext text/x-wiki 1ac0v2k5m8wxmk9jzzminkea8woc25g 2413127 2413126 2026-05-13T03:02:12Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1277.eqiad.wmnet with OS bookworm 2413127 wikitext text/x-wiki d7ru0gqi51parzddx92n5g09c4hmk2o 2413128 2413127 2026-05-13T03:03:55Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2413128 wikitext text/x-wiki tw272am9muubthlisdoz82oxk3fmirc 2413129 2413128 2026-05-13T03:04:46Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1276.eqiad.wmnet with reason: host reimage 2413129 wikitext text/x-wiki 45s8t2id6c8qekoiveb0ma7pertgqbv 2413130 2413129 2026-05-13T03:07:49Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1278] - vriley@cumin1003" 2413130 wikitext text/x-wiki ct3nigx8js9lnhvucej11rkvqau68gz 2413131 2413130 2026-05-13T03:07:55Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [db1278] - vriley@cumin1003" 2413131 wikitext text/x-wiki sq7xmj6ly7m1lxss17r6sjq3xxisopr 2413132 2413131 2026-05-13T03:07:56Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413132 wikitext text/x-wiki m2qq042hl30ef0mf59begdne752fhcg 2413133 2413132 2026-05-13T03:08:09Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host db1278 2413133 wikitext text/x-wiki 4rdso2gx0wp2sq1jtsl76siu40qz9qw 2413134 2413133 2026-05-13T03:09:04Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1276.eqiad.wmnet with reason: host reimage 2413134 wikitext text/x-wiki 1o6roa9dwza8au1v6oovrxpt41vz3bt 2413135 2413134 2026-05-13T03:09:26Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host db1278 2413135 wikitext text/x-wiki aw8hkknksiwr8jupbsxg6v8mplg6vhf 2413136 2413135 2026-05-13T03:10:23Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host db1278.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413136 wikitext text/x-wiki lx7td3dxpx3q85to02p3obcw1ttcoac 2413137 2413136 2026-05-13T03:17:56Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1277.eqiad.wmnet with reason: host reimage 2413137 wikitext text/x-wiki jercnsfhamo5rm6skdlobfg2witjor8 2413138 2413137 2026-05-13T03:24:10Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1277.eqiad.wmnet with reason: host reimage 2413138 wikitext text/x-wiki o5gsd1u3k21itd5zej91fbzfb1busej 2413139 2413138 2026-05-13T03:25:24Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413139 wikitext text/x-wiki 36s9r0x2p2lbznacwp1cy3p6pyj5i5k 2413140 2413139 2026-05-13T03:25:49Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413140 wikitext text/x-wiki a2r5hcsiwe55sfop1b7x9xhoo0e8qmn 2413141 2413140 2026-05-13T03:25:50Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1276.eqiad.wmnet with OS bookworm 2413141 wikitext text/x-wiki cd3al5xn22ypyaeoxzzilwqt2hipgtk 2413143 2413141 2026-05-13T03:28:20Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host db1278.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2413143 wikitext text/x-wiki tdeu2s2mgmvgiyacdbve5w1y6cp821s 2413144 2413143 2026-05-13T03:41:34Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host db1278.eqiad.wmnet with OS bookworm 2413144 wikitext text/x-wiki bhmx9bgbest9ya2pxuatth6j2rhxoby 2413145 2413144 2026-05-13T03:42:21Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413145 wikitext text/x-wiki 2x50pwgfmkc8bzb42udvjzv1bon3hlh 2413146 2413145 2026-05-13T03:42:41Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413146 wikitext text/x-wiki j7hyaa6fhcldddmjet69xzcy0rj8zel 2413147 2413146 2026-05-13T03:42:42Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1277.eqiad.wmnet with OS bookworm 2413147 wikitext text/x-wiki p7egcpgz2c3xnne8psw2dxpts4zrhev 2413148 2413147 2026-05-13T03:57:33Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1278.eqiad.wmnet with reason: host reimage 2413148 wikitext text/x-wiki qr7c0ut24mryyheezl8aq4sazu95fgq 2413149 2413148 2026-05-13T04:03:20Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1278.eqiad.wmnet with reason: host reimage 2413149 wikitext text/x-wiki 0667e4oe1wouvd0b508ekrc0jn06uiz 2413151 2413149 2026-05-13T04:20:32Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413151 wikitext text/x-wiki aybkin930n8u4bcxgpz2maqaz3tzn9d 2413152 2413151 2026-05-13T04:20:53Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2413152 wikitext text/x-wiki hbhssorqxg1vtviqo4xkzjaxt714yww 2413153 2413152 2026-05-13T04:20:55Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1278.eqiad.wmnet with OS bookworm 2413153 wikitext text/x-wiki cahisivafr2khw5v730gh3kypt7fimu 2413156 2413153 2026-05-13T05:35:26Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2218.codfw.wmnet with reason: Reimage to Trixie 2413156 wikitext text/x-wiki 1i6wsrofx725niqiqxrt7nara5o778o 2413157 2413156 2026-05-13T05:35:31Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db2218: Reimage to Trixie 2413157 wikitext text/x-wiki 45ffxu83z54q7v6bqonen1daqces6j3 2413158 2413157 2026-05-13T05:35:40Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db1253.eqiad.wmnet with reason: Reimage to Trixie 2413158 wikitext text/x-wiki 2vpgfepzwcv9zjsfr8i18hlsuyh28l0 2413159 2413158 2026-05-13T05:35:45Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db1253: Reimage to Trixie 2413159 wikitext text/x-wiki 6m2vca8p1qnku8yr1bpv80chvbvtgww 2413160 2413159 2026-05-13T05:36:00Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2218: Reimage to Trixie 2413160 wikitext text/x-wiki pbq3pbqz6pq9qoth0g964162lthxb1q 2413161 2413160 2026-05-13T05:36:34Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1253: Reimage to Trixie 2413161 wikitext text/x-wiki dlnhhod1nsek6wymfvoac4h523bp5ps 2413162 2413161 2026-05-13T05:37:39Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host db2218.codfw.wmnet with OS trixie 2413162 wikitext text/x-wiki t8gnpxe5ah6dvctqgluskcn5mwq5goq 2413163 2413162 2026-05-13T05:37:59Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host db1253.eqiad.wmnet with OS trixie 2413163 wikitext text/x-wiki h9mkdkkys4te3of87erbluxv8ja0ci1 2413164 2413163 2026-05-13T05:54:45Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1253.eqiad.wmnet with reason: host reimage 2413164 wikitext text/x-wiki d6bj8bi3tvuzkwqn759yfcwnw6nxa7i 2413165 2413164 2026-05-13T05:57:34Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2218.codfw.wmnet with reason: host reimage 2413165 wikitext text/x-wiki sfqgocpdbzcijiycpnh44rzuut31h04 2413166 2413165 2026-05-13T05:59:56Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1253.eqiad.wmnet with reason: host reimage 2413166 wikitext text/x-wiki tl2epiz2zxxpf5ahkti0rprzz7adz6z 2413167 2413166 2026-05-13T06:03:58Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2218.codfw.wmnet with reason: host reimage 2413167 wikitext text/x-wiki s4yylm7t3x7d61k25kl8p3l6we5fjri 2413169 2413167 2026-05-13T06:22:36Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1253.eqiad.wmnet with OS trixie 2413169 wikitext text/x-wiki dfmzvtxhebu39s4msd1ryk471qp0820 2413170 2413169 2026-05-13T06:26:04Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1253: after reimage to trixie 2413170 wikitext text/x-wiki orpl4dx60u07lv695q16av1ekwids4r 2413171 2413170 2026-05-13T06:27:13Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2218.codfw.wmnet with OS trixie 2413171 wikitext text/x-wiki ngi2davcy4je93ei8k2njej1aaizefw 2413172 2413171 2026-05-13T06:30:35Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db2218: after reimage to trixie 2413172 wikitext text/x-wiki 1ovshen710y9ucsv9oq64syhhfuvjwy 2413173 2413172 2026-05-13T06:39:53Z Stashbot 7414 moritzm: installing Exim security updates on the hosts where Exim is used as a local mail relay 2413173 wikitext text/x-wiki qn4otnrqm5l2kl6ul1qcqxfa4wtmzzq 2413174 2413173 2026-05-13T07:11:29Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1253: after reimage to trixie 2413174 wikitext text/x-wiki cmaxy0cwfd6qkhafa1z7arsmitmr7ci 2413175 2413174 2026-05-13T07:16:00Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2218: after reimage to trixie 2413175 wikitext text/x-wiki lvdycqzo9qt6w99qx6udg4bya9ufvdb 2413176 2413175 2026-05-13T07:17:48Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] START helmfile.d/services/mw-mcrouter: apply 2413176 wikitext text/x-wiki mjv3227uy4ksuxhyc9vcwh5fmr3okur 2413177 2413176 2026-05-13T07:17:56Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-mcrouter: apply 2413177 wikitext text/x-wiki axdj2jujbefgn4ewdly53jz7jub2vcl 2413178 2413177 2026-05-13T07:18:38Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-mcrouter: apply 2413178 wikitext text/x-wiki hxlqzpgq2s0vl7sr9dimbb3kkax9jao 2413179 2413178 2026-05-13T07:18:47Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-mcrouter: apply 2413179 wikitext text/x-wiki 8uhwu9qu4cxd1c6rnpfttjw5ighy3kq 2413180 2413179 2026-05-13T07:25:06Z Stashbot 7414 dcausse@deploy1003: Started scap sync-world: Backport for [[gerrit:1286400|testwiki: Disable sub-ref's synthetic list defined refs on test wikis (T425967)]], [[gerrit:1286277|Revert^2 "cirrus: use a keywork tokenizer for the plain field for autocomplete"]] 2413180 wikitext text/x-wiki mvm2lygz6y4sl996zyhxj0lklch1vpo 2413181 2413180 2026-05-13T07:27:19Z Stashbot 7414 dcausse@deploy1003: dcausse, wmde-fisch: Backport for [[gerrit:1286400|testwiki: Disable sub-ref's synthetic list defined refs on test wikis (T425967)]], [[gerrit:1286277|Revert^2 "cirrus: use a keywork tokenizer for the plain field for autocomplete"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2413181 wikitext text/x-wiki 4aekqxrzmgqj5ndcgdxce155fgzlqvh 2413182 2413181 2026-05-13T07:30:26Z Stashbot 7414 dcausse@deploy1003: dcausse, wmde-fisch: Continuing with deployment 2413182 wikitext text/x-wiki 4lgkw9mbvigc34l24ec5wo0l4vq9ql3 2413183 2413182 2026-05-13T07:34:38Z Stashbot 7414 dcausse@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286400|testwiki: Disable sub-ref's synthetic list defined refs on test wikis (T425967)]], [[gerrit:1286277|Revert^2 "cirrus: use a keywork tokenizer for the plain field for autocomplete"]] (duration: 09m 32s) 2413183 wikitext text/x-wiki 9lpln7cabk1qcpw80zjyfw6opkf7mn1 2413184 2413183 2026-05-13T07:37:17Z Stashbot 7414 gkyziridis@deploy1003: helmfile [eqiad] START helmfile.d/services/changeprop: sync 2413184 wikitext text/x-wiki g726co58a8fo1ob79vvsmxy11jbdpu3 2413185 2413184 2026-05-13T07:37:44Z Stashbot 7414 gkyziridis@deploy1003: helmfile [eqiad] DONE helmfile.d/services/changeprop: sync 2413185 wikitext text/x-wiki ly0h1e749dgx4zb2dze9cqtnlrsfhic 2413186 2413185 2026-05-13T07:38:07Z Stashbot 7414 dcausse@deploy1003: Started scap sync-world: Backport for [[gerrit:1286371|translate: add opensearch-ttmserver-test (T425377)]] 2413186 wikitext text/x-wiki nwrjo4yk72gp36bd4r4dokcnchg5p2e 2413187 2413186 2026-05-13T07:39:11Z Stashbot 7414 gkyziridis@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop: sync 2413187 wikitext text/x-wiki q1neciv6j4n9g706luo5ohq88s21lp8 2413188 2413187 2026-05-13T07:39:35Z Stashbot 7414 gkyziridis@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop: sync 2413188 wikitext text/x-wiki 17v5ty2nev7nfi9l6i6nx500yficz2w 2413189 2413188 2026-05-13T07:40:07Z Stashbot 7414 dcausse@deploy1003: atsuko, dcausse: Backport for [[gerrit:1286371|translate: add opensearch-ttmserver-test (T425377)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2413189 wikitext text/x-wiki 0y3gspsds1eo1ucjwkrp9lp9c5n9v16 2413190 2413189 2026-05-13T07:43:09Z Stashbot 7414 dcausse@deploy1003: atsuko, dcausse: Continuing with deployment 2413190 wikitext text/x-wiki ah36odrrcinblr2s33b4cdaas5dijfi 2413191 2413190 2026-05-13T07:47:16Z Stashbot 7414 dcausse@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286371|translate: add opensearch-ttmserver-test (T425377)]] (duration: 09m 09s) 2413191 wikitext text/x-wiki 0bne6sa5p98wqueqxec9bhyvsy2uwb8 2413192 2413191 2026-05-13T07:56:47Z Stashbot 7414 moritzm: imported dnsmasq 2.92-1~wmf12u2 to bookworm-wikimedia/main (backport of latest dnsmasq security fixes to our internal build) 2413192 wikitext text/x-wiki 4y337vxjwog4f44ry56fznbi66ngjn3 2413193 2413192 2026-05-13T08:08:45Z Stashbot 7414 topranks: reconfigure link from cr4-ulsfo to asw1-22-ulsfo as 802.1q tagged T424611 2413193 wikitext text/x-wiki 7a7gm6ekm12ev0vk5g0a19n890km1mw 2413195 2413193 2026-05-13T08:11:05Z Stashbot 7414 moritzm: imported dnsmasq 2.92-1~wmf13u2 to trixie-wikimedia/main (backport of latest dnsmasq security fixes to our internal build) 2413195 wikitext text/x-wiki fhgz1dwqc0q4ky8twr4rrqc89gjmbxh 2413196 2413195 2026-05-13T08:14:53Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1286805|WikimediaEvents: Enable Special:UserLogin instrumentation (T425631)]] 2413196 wikitext text/x-wiki e9mo1jyhgsrtebm6tjsvztekee71z42 2413197 2413196 2026-05-13T08:16:46Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1286805|WikimediaEvents: Enable Special:UserLogin instrumentation (T425631)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2413197 wikitext text/x-wiki bfpwgoq80k1l4nvyft1f4wbujlu0aoc 2413200 2413197 2026-05-13T08:20:01Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2413200 wikitext text/x-wiki c53d7mk3pse7jlkl10sadg79xibyx18 2413201 2413200 2026-05-13T08:24:09Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1286805|WikimediaEvents: Enable Special:UserLogin instrumentation (T425631)]] (duration: 09m 18s) 2413201 wikitext text/x-wiki pu87o0mgqvffc046z25l739s2jnp897 2413202 2413201 2026-05-13T08:25:13Z Stashbot 7414 jmm@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2413202 wikitext text/x-wiki qqiikhzrixyb8naygg6i9jjwf26ty94 2413203 2413202 2026-05-13T08:25:31Z Stashbot 7414 jmm@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2413203 wikitext text/x-wiki 8yku54q22ncvuykhlys57w6twx9sl0t 2413204 2413203 2026-05-13T08:28:55Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2413204 wikitext text/x-wiki t7c1l0tikvmv8a51virjfp6gn9e1wam 2413205 2413204 2026-05-13T08:32:28Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2413205 wikitext text/x-wiki cwcqsb8xbkym1r9h0g9bho0cxtkk4uc 2413206 2413205 2026-05-13T08:32:31Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add include for 2620:0:863:fe0a::/64 - cmooney@cumin1003" 2413206 wikitext text/x-wiki scheounpxwtavugwos4e8upymbed6be 2413208 2413206 2026-05-13T08:35:51Z Stashbot 7414 aklapper@deploy1003: rebuilt and synchronized wikiversions files: group1 to 1.47.0-wmf.2 refs T423911 2413208 wikitext text/x-wiki s65hdw401fzf0g0eijtveehb6d3kk4p 2413209 2413208 2026-05-13T08:36:03Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2413209 wikitext text/x-wiki 2wml3zmnp6in30zur951a1r2ci5rygs 2413211 2413209 2026-05-13T08:37:10Z Stashbot 7414 cmooney@dns2005: START - running authdns-update 2413211 wikitext text/x-wiki mlhr8pth98a85j178ej7or6931lq993 2413212 2413211 2026-05-13T08:38:24Z Stashbot 7414 cmooney@dns2005: END - running authdns-update 2413212 wikitext text/x-wiki a1imzncdzt0shur83105bhtkm6xcqr8 2413213 2413212 2026-05-13T08:38:33Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2413213 wikitext text/x-wiki s9in7mfg0rqim2i2pz3xplnvwfwgwmp 2413214 2413213 2026-05-13T08:38:50Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add include for 2620:0:863:fe0a::/64 - cmooney@cumin1003" 2413214 wikitext text/x-wiki 3wunzrchqfcdb7jlvba9zyseyadrx9k 2413215 2413214 2026-05-13T08:38:51Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413215 wikitext text/x-wiki 7zbxtqre3d1wdekg4iqgvkcxehq6r00 2413216 2413215 2026-05-13T08:40:54Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2413216 wikitext text/x-wiki 93pnm64w565c6xyspyt2jdrf0m564f6 2413217 2413216 2026-05-13T08:45:59Z Stashbot 7414 moritzm: installing dnsmasq security updates 2413217 wikitext text/x-wiki q7w51q6k5dql538sgothks51ckrctqg 2413219 2413217 2026-05-13T09:07:42Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2413219 wikitext text/x-wiki 5t4ta9oq0hlzb4to7dulkv6v54isfku 2413220 2413219 2026-05-13T09:10:53Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add records for 2620:0:863:fe09::/64 - cmooney@cumin1003" 2413220 wikitext text/x-wiki o7npwq9jr1f2bxhspr8bxlxrfbzd4fu 2413221 2413220 2026-05-13T09:14:15Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add records for 2620:0:863:fe09::/64 - cmooney@cumin1003" 2413221 wikitext text/x-wiki 854yt40nxlvhiearpeksb1vrdybbo1k 2413222 2413221 2026-05-13T09:14:16Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413222 wikitext text/x-wiki 1xvk2c5yswebfomwlw1062j5k3keuon 2413223 2413222 2026-05-13T09:14:51Z Stashbot 7414 elukey@puppetserver1001: conftool action : set/pooled=false; selector: dnsdisc=pki,name=codfw 2413223 wikitext text/x-wiki 52yyrvu1w9pmconteqkacrywilvrp6d 2413224 2413223 2026-05-13T09:17:31Z Stashbot 7414 root@cumin1003: START - Cookbook sre.hosts.reimage for host mc1060.eqiad.wmnet with OS bullseye 2413224 wikitext text/x-wiki 8te9guq857ta5fx0gab6y8ectdio3to 2413225 2413224 2026-05-13T09:17:40Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1061.eqiad.wmnet with OS bullseye 2413225 wikitext text/x-wiki ifp5kbj25w25jjmllq85cmfvr2rvqzc 2413226 2413225 2026-05-13T09:17:42Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1062.eqiad.wmnet with OS bullseye 2413226 wikitext text/x-wiki t9u87w31pnvdkglokgnd673pq9wmb1y 2413227 2413226 2026-05-13T09:17:44Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1064.eqiad.wmnet with OS bullseye 2413227 wikitext text/x-wiki 8i7uix6te8p7v6dm5w2ysetk6l426q3 2413228 2413227 2026-05-13T09:17:56Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host pki2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2413228 wikitext text/x-wiki dopgnox32mpksnc1qrxcxoma4hvbj1a 2413229 2413228 2026-05-13T09:21:25Z Stashbot 7414 logmsgbot: dreamyjazz Deployed security patch for T423840 2413229 wikitext text/x-wiki 7diwxjk40nip7cne4t1demu2w2efii6 2413230 2413229 2026-05-13T09:22:52Z Stashbot 7414 elukey@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pki2002.codfw.wmnet with reason: reimage 2413230 wikitext text/x-wiki 5o829quqtcld0ir9cr8r84lscri41xw 2413231 2413230 2026-05-13T09:24:30Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host pki2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2413231 wikitext text/x-wiki 48poltfrp8j19zb8kdhiswbisma7mz2 2413232 2413231 2026-05-13T09:25:06Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts pki2002.codfw.wmnet 2413232 wikitext text/x-wiki 0786sp71rn61gc7uo499maa9zyii6pr 2413233 2413232 2026-05-13T09:27:23Z Stashbot 7414 logmsgbot: dreamyjazz Deployed security patch for T423840 2413233 wikitext text/x-wiki 6nwmcc97jedmww5f5r33f4pxfafznrv 2413234 2413233 2026-05-13T09:27:25Z Stashbot 7414 cmooney@dns2005: START - running authdns-update 2413234 wikitext text/x-wiki 3mdjfgnpmsh5o4cxi1g0qs4vm1hexs5 2413235 2413234 2026-05-13T09:28:39Z Stashbot 7414 cmooney@dns2005: END - running authdns-update 2413235 wikitext text/x-wiki bk7vtqtspgt4p6b7b6f5rf0vau1ave7 2413236 2413235 2026-05-13T09:29:49Z Stashbot 7414 root@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1060.eqiad.wmnet with reason: host reimage 2413236 wikitext text/x-wiki f6ty1gj12remxbld0bwuaf70so5ifki 2413237 2413236 2026-05-13T09:29:58Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1061.eqiad.wmnet with reason: host reimage 2413237 wikitext text/x-wiki c2amhdwem42hv8s81d4wvj7gsfeucof 2413238 2413237 2026-05-13T09:30:04Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1062.eqiad.wmnet with reason: host reimage 2413238 wikitext text/x-wiki tcdly1o9l865dyahpy19a705fkv5b0g 2413239 2413238 2026-05-13T09:30:06Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1064.eqiad.wmnet with reason: host reimage 2413239 wikitext text/x-wiki dfb9xljwe8vi4f8nm0gchcw2ih4ei85 2413240 2413239 2026-05-13T09:34:34Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1060.eqiad.wmnet with reason: host reimage 2413240 wikitext text/x-wiki mb2useiwl6u2y6ww62voo9m1spge6nr 2413241 2413240 2026-05-13T09:36:34Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1284633|EventStreamConfig: Register special_user_login event stream (T425631)]] 2413241 wikitext text/x-wiki t6bz02odc6071nlc7iyoqkry3tnyobk 2413243 2413241 2026-05-13T09:38:30Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1284633|EventStreamConfig: Register special_user_login event stream (T425631)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2413243 wikitext text/x-wiki b7bmruwxaorgedtnqbzjj48jc7aumwy 2413244 2413243 2026-05-13T09:38:32Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1061.eqiad.wmnet with reason: host reimage 2413244 wikitext text/x-wiki j9hf88mjaglc80z0br6eg3l48hktzw7 2413246 2413244 2026-05-13T09:41:26Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2413246 wikitext text/x-wiki dkhvp7t460vpqjlfiszupmlrfiwq59i 2413247 2413246 2026-05-13T09:42:11Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1062.eqiad.wmnet with reason: host reimage 2413247 wikitext text/x-wiki jv7fn6y6bgkvdd4svo6or6fu3sm4s8a 2413248 2413247 2026-05-13T09:45:35Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1284633|EventStreamConfig: Register special_user_login event stream (T425631)]] (duration: 09m 01s) 2413248 wikitext text/x-wiki 2ccae1yyuv1phaug7e4ewjjjkij2b97 2413249 2413248 2026-05-13T09:50:06Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1064.eqiad.wmnet with reason: host reimage 2413249 wikitext text/x-wiki imtezxr6hgj055or0vrlupaxmknss0o 2413250 2413249 2026-05-13T09:50:12Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1060.eqiad.wmnet with OS bullseye 2413250 wikitext text/x-wiki 00oedctrdm2tfu9s6hgwx9v5hzl5q6v 2413251 2413250 2026-05-13T09:51:08Z Stashbot 7414 moritzm: installing ca-certificates update from Bookworm point release 2413251 wikitext text/x-wiki 72p1qs6sk1weeduwg5nb3kbq3tdl64r 2413252 2413251 2026-05-13T09:53:43Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Set db2218 with weight 0 T426142', diff saved to https://phabricator.wikimedia.org/P92498 and previous config saved to /var/cache/conftool/dbconfig/20260513-095337-marostegui.json 2413252 wikitext text/x-wiki 1mu4w0by2rz5a7c2fn0tl1irjngvujz 2413253 2413252 2026-05-13T09:53:54Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1061.eqiad.wmnet with OS bullseye 2413253 wikitext text/x-wiki py7p2wdppx3atgyp8w2whl2q515wkur 2413254 2413253 2026-05-13T09:54:00Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 28 hosts with reason: Primary switchover s7 T426142 2413254 wikitext text/x-wiki dcom3qgmc1isd5lg0l9o7q5qoith2w4 2413255 2413254 2026-05-13T09:54:37Z Stashbot 7414 marostegui: Starting s7 codfw failover from db2220 to db2218 - T426142 2413255 wikitext text/x-wiki 3qz4mcotqqx9ao184498lbfo5tru3z3 2413257 2413255 2026-05-13T09:56:29Z Stashbot 7414 moritzm: installing distro-info-data updates from Bookworm point release 2413257 wikitext text/x-wiki gco9yf9nn0te8oho4sl3j842ce8megt 2413258 2413257 2026-05-13T09:57:51Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1062.eqiad.wmnet with OS bullseye 2413258 wikitext text/x-wiki t4dcnuhea1q1q9vapny2xhzd3ggpknt 2413259 2413258 2026-05-13T09:58:11Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2413259 wikitext text/x-wiki 1exoh7bj1voracymmouc838b49h3a9p 2413260 2413259 2026-05-13T09:58:15Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2413260 wikitext text/x-wiki sonygo06ati4w8cpd5ct9fmzhyz6xqq 2413261 2413260 2026-05-13T09:58:17Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Promote db2218 to s7 primary T426142', diff saved to https://phabricator.wikimedia.org/P92499 and previous config saved to /var/cache/conftool/dbconfig/20260513-095814-marostegui.json 2413261 wikitext text/x-wiki tt4fm4q9j7j2tlegjise9ikb34cj2wc 2413263 2413261 2026-05-13T09:59:37Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Depool db2220 T426142', diff saved to https://phabricator.wikimedia.org/P92500 and previous config saved to /var/cache/conftool/dbconfig/20260513-095934-marostegui.json 2413263 wikitext text/x-wiki ejygr2e8414ry600pue9yu8ra7pfp1e 2413265 2413263 2026-05-13T10:01:33Z Stashbot 7414 jmm@deploy1003: helmfile [staging] START helmfile.d/services/proton: apply 2413265 wikitext text/x-wiki ljfor5coujjqjjfr8lkqc18uxfaim8t 2413266 2413265 2026-05-13T10:02:15Z Stashbot 7414 jmm@deploy1003: helmfile [staging] DONE helmfile.d/services/proton: apply 2413266 wikitext text/x-wiki l4yygh64fk711vgsnu5v2t6zt7zsyd3 2413267 2413266 2026-05-13T10:02:49Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2220.codfw.wmnet with reason: Reimage to Trixie 2413267 wikitext text/x-wiki oteve5hj5sbd9ozc5xhlnz15337urgw 2413268 2413267 2026-05-13T10:02:55Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db2220: Reimage to Trixie 2413268 wikitext text/x-wiki 3jcchbh4nxnpp2sg8ah38oswq1ppg8b 2413269 2413268 2026-05-13T10:03:02Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2220: Reimage to Trixie 2413269 wikitext text/x-wiki mct1iijt1on0mdw2lg4zh00tqe4ox6p 2413271 2413269 2026-05-13T10:04:24Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] START helmfile.d/services/proton: apply 2413271 wikitext text/x-wiki pafvny3lp7nvb9ko1qerwpkv831z4xn 2413273 2413271 2026-05-13T10:05:14Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1064.eqiad.wmnet with OS bullseye 2413273 wikitext text/x-wiki 42k22qw2ki7wvaavd82sv10hr9bqol6 2413274 2413273 2026-05-13T10:05:37Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] DONE helmfile.d/services/proton: apply 2413274 wikitext text/x-wiki 52obwlqbkebp58pmte90iq6gjbrf8kv 2413275 2413274 2026-05-13T10:06:03Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host db2220.codfw.wmnet with OS trixie 2413275 wikitext text/x-wiki qn4qkc7ypjshrctm8tvrcdnpgzi66as 2413276 2413275 2026-05-13T10:09:06Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2413276 wikitext text/x-wiki cdndgwkknaopeb1fli7wtehpddg0j9p 2413277 2413276 2026-05-13T10:09:09Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2413277 wikitext text/x-wiki a29a41o42b0uqfogq9gmgqw7e0m6q2v 2413278 2413277 2026-05-13T10:10:43Z Stashbot 7414 moritzm: installing Apache security updates on Bullseye 2413278 wikitext text/x-wiki qm7f7os6kbqtszkmvj0d4bz5ckdpmdf 2413279 2413278 2026-05-13T10:12:22Z Stashbot 7414 jayme@deploy1003: helmfile [staging] START helmfile.d/services/ratelimit: apply 2413279 wikitext text/x-wiki mijqqid7rff4f7n9j6yc35nbr833zlr 2413280 2413279 2026-05-13T10:12:37Z Stashbot 7414 jayme@deploy1003: helmfile [staging] DONE helmfile.d/services/ratelimit: apply 2413280 wikitext text/x-wiki oitqwz4tsnf5pb8aooy46mqzrbyydlr 2413281 2413280 2026-05-13T10:14:37Z Stashbot 7414 jayme@deploy1003: helmfile [staging] START helmfile.d/services/ratelimit: apply 2413281 wikitext text/x-wiki ri5uxu90cp1ybx4ajpqwlo6y33hyye7 2413282 2413281 2026-05-13T10:14:47Z Stashbot 7414 jayme@deploy1003: helmfile [staging] DONE helmfile.d/services/ratelimit: apply 2413282 wikitext text/x-wiki lsro4jelfrwv3ddr8cuoyasz0u0be8v 2413283 2413282 2026-05-13T10:15:29Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] START helmfile.d/services/ratelimit: apply 2413283 wikitext text/x-wiki gtjumupfd1pgay2axodoebeeg6fyjni 2413284 2413283 2026-05-13T10:15:31Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] START helmfile.d/services/proton: apply 2413284 wikitext text/x-wiki 11gfu47b1u48vph36jhv6v2a99i9jhe 2413285 2413284 2026-05-13T10:16:13Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] DONE helmfile.d/services/ratelimit: apply 2413285 wikitext text/x-wiki qdr8ix0m1zfwxgf3f8q8dn39dplqm65 2413286 2413285 2026-05-13T10:16:19Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] START helmfile.d/services/ratelimit: apply 2413286 wikitext text/x-wiki nk5muhtw2fkwp4ndox4q2rqi6czw1qo 2413287 2413286 2026-05-13T10:16:46Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] DONE helmfile.d/services/proton: apply 2413287 wikitext text/x-wiki c1bso9y1dl8xeyv27fg1n5412c04xtr 2413288 2413287 2026-05-13T10:17:01Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] DONE helmfile.d/services/ratelimit: apply 2413288 wikitext text/x-wiki tk9rmuv2rntbfth9i8q8eecckxvuie4 2413289 2413288 2026-05-13T10:21:16Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts pki2002.codfw.wmnet 2413289 wikitext text/x-wiki befenjk79tyb5k8o9cbwvsxpc8kmyhi 2413290 2413289 2026-05-13T10:22:04Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host pki2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2413290 wikitext text/x-wiki lzycxvlpubdkznhk44wp44nr0qmquqa 2413291 2413290 2026-05-13T10:24:01Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host pki2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2413291 wikitext text/x-wiki me2cuddotr0jp4e0engvdvaehmai3uj 2413292 2413291 2026-05-13T10:25:16Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.reimage for host pki2002.codfw.wmnet with OS trixie 2413292 wikitext text/x-wiki 3zlqcthj34bhty8aftf33h3mgg9eeuj 2413293 2413292 2026-05-13T10:26:46Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2220.codfw.wmnet with reason: host reimage 2413293 wikitext text/x-wiki clt5uolohzm8t4pss8dvc7xxnw41pvn 2413294 2413293 2026-05-13T10:33:18Z Stashbot 7414 topranks: switch eqsin core router ibgp path to route via switches T424611 2413294 wikitext text/x-wiki 1ewbe0ygtrgrwnprogsh1vo2uhguin5 2413295 2413294 2026-05-13T10:35:09Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2220.codfw.wmnet with reason: host reimage 2413295 wikitext text/x-wiki t5uitldcqgrej0uw1yukofc454x510j 2413296 2413295 2026-05-13T10:39:30Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] START helmfile.d/services/mw-mcrouter: apply 2413296 wikitext text/x-wiki 4r97sijitqjh61bth3909gdq0tgzbfx 2413297 2413296 2026-05-13T10:39:39Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-mcrouter: apply 2413297 wikitext text/x-wiki 9ea2sdsh2ghxgappvbpr3hijaeqa74r 2413298 2413297 2026-05-13T10:39:51Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-mcrouter: apply 2413298 wikitext text/x-wiki jif1ovqarl8w7kp5ckhx5hm4nhg5xg9 2413299 2413298 2026-05-13T10:40:08Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-mcrouter: apply 2413299 wikitext text/x-wiki gw6xswtwor4rmlidix3kc0e1tn8j2n2 2413300 2413299 2026-05-13T10:42:06Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on pki2002.codfw.wmnet with reason: host reimage 2413300 wikitext text/x-wiki r65b39rh4t54bh67090g51lncjqcy7l 2413302 2413300 2026-05-13T10:48:39Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host install6003.wikimedia.org 2413302 wikitext text/x-wiki 6hfgxnh6dyuq9eq5mgzrhp7wh12af17 2413303 2413302 2026-05-13T10:49:41Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pki2002.codfw.wmnet with reason: host reimage 2413303 wikitext text/x-wiki grijcngnbt2b464ivfod8slb17qcyxa 2413305 2413303 2026-05-13T10:52:21Z Stashbot 7414 moritzm: installing Linux 5.10.251-4 on all Bullseye hosts 2413305 wikitext text/x-wiki s2h2623a8bkuh2fz6zgtxa2nevccykm 2413306 2413305 2026-05-13T10:55:19Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host install6003.wikimedia.org 2413306 wikitext text/x-wiki 7e2v221ey352sjyq4jjtiqmzxhkar4c 2413307 2413306 2026-05-13T10:55:25Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] START helmfile.d/services/ratelimit: apply 2413307 wikitext text/x-wiki hv19ivu9myzzlho9e0mrsusw40hv42t 2413308 2413307 2026-05-13T10:55:52Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] DONE helmfile.d/services/ratelimit: apply 2413308 wikitext text/x-wiki lj2zb8usdnm533i5cm9dimzkugitjik 2413309 2413308 2026-05-13T10:58:06Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2220.codfw.wmnet with OS trixie 2413309 wikitext text/x-wiki 236f2y0ha99qnlnez8zc8suxrz3pnht 2413310 2413309 2026-05-13T11:03:11Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.major-upgrade 2413310 wikitext text/x-wiki 21vtsgd0fd60o9fdi4907lcpli59ykl 2413311 2413310 2026-05-13T11:03:33Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.depool depool db1236: Upgrading db1236.eqiad.wmnet 2413311 wikitext text/x-wiki g44r6yacbuj6v9jq4v523j0fowdq2w4 2413312 2413311 2026-05-13T11:04:02Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1236: Upgrading db1236.eqiad.wmnet 2413312 wikitext text/x-wiki jbpdg7kqhswpbbipl5yeqopyc1p516i 2413313 2413312 2026-05-13T11:06:43Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.hosts.reimage for host db1236.eqiad.wmnet with OS trixie 2413313 wikitext text/x-wiki f15lulbhe7nz7kf5cofoaetc732adbt 2413314 2413313 2026-05-13T11:10:05Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db2220: after reimage to trixie 2413314 wikitext text/x-wiki 9zsbgqf484zyhm7dymofhj8idvg7qd5 2413315 2413314 2026-05-13T11:12:42Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pki2002.codfw.wmnet with OS trixie 2413315 wikitext text/x-wiki qaanzyjfxki03l96qx70cq264mcnvur 2413317 2413315 2026-05-13T11:19:46Z Stashbot 7414 moritzm: installing Linux 6.1.170-3 on all Bookworm hosts 2413317 wikitext text/x-wiki 1mwaiopu5tgascikkb7ttysm15f4v09 2413318 2413317 2026-05-13T11:21:45Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1236.eqiad.wmnet with reason: host reimage 2413318 wikitext text/x-wiki 8s3p80hxykzhilw73rhfk81o1l5c15v 2413319 2413318 2026-05-13T11:24:12Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] START helmfile.d/services/ratelimit: apply 2413319 wikitext text/x-wiki pvhfcl1lvydw3x1nedwyw75kuni1bom 2413320 2413319 2026-05-13T11:24:37Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] DONE helmfile.d/services/ratelimit: apply 2413320 wikitext text/x-wiki c28clykw2ry2xr3mh30mleopm9lew2b 2413321 2413320 2026-05-13T11:25:45Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1236.eqiad.wmnet with reason: host reimage 2413321 wikitext text/x-wiki 4x5t16t887cbnql1bam15a9v2v4nea7 2413322 2413321 2026-05-13T11:27:34Z Stashbot 7414 topranks: add ibgp peering between cr1-drms and cr2-drmrs over loopback IPs T424611 2413322 wikitext text/x-wiki jhzps0sucxn9ksu29re5s535amkj22b 2413323 2413322 2026-05-13T11:30:23Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2413323 wikitext text/x-wiki 5gszlgs2m9l9oyv3dpzuo7q65rkkysq 2413324 2413323 2026-05-13T11:30:48Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2413324 wikitext text/x-wiki 7y6v629jpx5re4juup0x5euqrorzg8l 2413325 2413324 2026-05-13T11:33:32Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2413325 wikitext text/x-wiki 5zvjpmsn6frt22fmt08ttst4cgiycnx 2413326 2413325 2026-05-13T11:33:55Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2413326 wikitext text/x-wiki dx7zsz6cgfbolvupyyih0w20frca044 2413327 2413326 2026-05-13T11:40:30Z Stashbot 7414 topranks: delete old direct ibgp peering between cr1-drms and cr2-drmrs T424611 2413327 wikitext text/x-wiki 2ur877vhade3ueovkcgrzewuvr94v0x 2413328 2413327 2026-05-13T11:43:20Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1236.eqiad.wmnet with OS trixie 2413328 wikitext text/x-wiki 7rjmr8pjli6xeep8rlduiikfi5ibli6 2413329 2413328 2026-05-13T11:43:55Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] START helmfile.d/admin 'sync'. 2413329 wikitext text/x-wiki 2dz2emvkc9b5idcebhwjfc4x5e4tblj 2413330 2413329 2026-05-13T11:44:28Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'sync'. 2413330 wikitext text/x-wiki he45ill6x91ahshz1qfrpvmsxoxyf1p 2413332 2413330 2026-05-13T11:51:52Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.pool pool db1236: Migration of db1236.eqiad.wmnet completed 2413332 wikitext text/x-wiki qb8n0sf66mttetjd7k4eqwems1z1tgu 2413333 2413332 2026-05-13T11:52:00Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2413333 wikitext text/x-wiki i130r10ig6xv73aux9tqvvoycqq4ihz 2413334 2413333 2026-05-13T11:55:30Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2220: after reimage to trixie 2413334 wikitext text/x-wiki l28newfyxrsqiz09st9bvq50th66q99 2413335 2413334 2026-05-13T11:57:23Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update records for drmrs ibgp link - cmooney@cumin1003" 2413335 wikitext text/x-wiki 8ww9dluctaq2prkmrsbskq5de441h84 2413336 2413335 2026-05-13T11:57:29Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update records for drmrs ibgp link - cmooney@cumin1003" 2413336 wikitext text/x-wiki s68ldponqfii9epmpgqewrobo23uaz2 2413337 2413336 2026-05-13T11:57:31Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2413337 wikitext text/x-wiki k7siv0s4n02uu6ra26tfo8bmwoidtp6 Release Engineering/SAL 0 17290 2412733 2412711 2026-05-12T13:04:14Z Stashbot 7414 atsukoito: PrivateSettings: credentials for opensearch-on-k8s ttmserver-test 2412733 wikitext text/x-wiki 6ok49nz149iggeqsayh7bsy9qknhond 2412802 2412733 2026-05-12T14:18:34Z Stashbot 7414 atsukoito: PrivateSettings: empty $wgOpensearchCredentials for opensearch-on-k8s synced to deploy04 by Reedy 2412802 wikitext text/x-wiki 6vmjj7d7w36dlytb6vank55mfs0ivw9 2412927 2412802 2026-05-12T18:08:01Z Stashbot 7414 James_F: Zuul: [mediawiki/extensions/WikiLambda] Add AF and SB deps for T423180 2412927 wikitext text/x-wiki aegdk06u27mbl2m3cpw7s3hro17e0ww 2412987 2412927 2026-05-12T20:57:36Z Stashbot 7414 brennen: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/104 (T424774) 2412987 wikitext text/x-wiki k9f03w0luk8sdi91m31srqvy72oyzo4 Etcd 0 23934 2412938 2309720 2026-05-12T19:23:09Z BCornwall-WMF 31521 /* Example "hello world" query listing keys */ let's not keep having to update the cumin hostname, shall we? 2412938 wikitext text/x-wiki 9mhbtrlp2eokbc7vi655vi9qznclp4u SRE/LDAP/Groups 0 33280 2413155 2401071 2026-05-13T05:33:34Z Novem Linguae 23682 /* See also */ requestctl 2413155 wikitext text/x-wiki 4j8i42i48ccip427o7lnz7jbwyx05wr 2413316 2413155 2026-05-13T11:13:16Z Taavi 13997 Undid revision [[Special:Diff/2413155|2413155]] by [[Special:Contributions/Novem Linguae|Novem Linguae]] ([[User talk:Novem Linguae|talk]]) not true 2413316 wikitext text/x-wiki d8c1ix90707lwhrxebggke4wanrbt8f Global traffic routing 0 76447 2413054 2401060 2026-05-12T23:37:44Z BCornwall-WMF 31521 /* Management */ Add section for re-enabling a site 2413054 wikitext text/x-wiki 7dz6ocprrxry23fq7cbeyqzahqw0zea 2413057 2413054 2026-05-12T23:40:28Z BCornwall-WMF 31521 /* Disabling a Site */ Unordered list the section 2413057 wikitext text/x-wiki gbigjng12a7txhtbp5t4w7ii02xat28 2413058 2413057 2026-05-12T23:41:12Z BCornwall-WMF 31521 /* Management */ switch disable/renable sites from unordered lists to numbered 2413058 wikitext text/x-wiki 95ox93uraooal39n3liiez06qyvph5g 2413059 2413058 2026-05-12T23:41:49Z BCornwall-WMF 31521 /* Re-enabling a site */ clarify intro question 2413059 wikitext text/x-wiki tvwgmhan60d5oc7pfnem727y3jx87hl 2413060 2413059 2026-05-12T23:45:43Z BCornwall-WMF 31521 /* Disabling a Site */ see template 2413060 wikitext text/x-wiki rwwisbtoiux7q619bi2ao16zvd7rtxy Nova Resource:Tools.cluebotng/SAL 498 443628 2413101 2412698 2026-05-13T02:05:01Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25773616046 (https://github.com/cluebotng/component-configs/commits/0fd601991775a24b437113d09438e74b996c991b) 2413101 wikitext text/x-wiki nbsb6c59q19g97n1ipvsu1iamzr4evq MariaDB/Upgrading a section 0 447862 2412738 2412712 2026-05-12T13:13:26Z FCeratto-WMF 39104 /* Misc masters */ 2412738 wikitext text/x-wiki 0jtl63hn7bucmfjicutunqovjuuqyr9 Map of database maintenance 0 449160 2413064 2412668 2026-05-13T00:00:37Z Dexbot 30554 Bot: Updating the report 2413064 wikitext text/x-wiki 1m18o2asrygg062tpczggfwkrimzgnp 2413256 2413064 2026-05-13T09:55:48Z Dexbot 30554 Bot: Updating the report 2413256 wikitext text/x-wiki n54kughcd6qrizvpgvxedmfkg9dd6kx Machine Learning/LiftWing/Streams 0 452452 2413194 2408333 2026-05-13T08:10:31Z ISarantopoulos-WMF 34784 Remove "ask an SRE to deploy changeprop" since MLEs also have permissions 2413194 wikitext text/x-wiki sc4vb91rj9zdu3ykei23i9u1gf000od Nova Resource:Tools.cluebotng-review/SAL 498 452890 2413102 2412699 2026-05-13T02:06:43Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25773616037 (https://github.com/cluebotng/component-configs/commits/0fd601991775a24b437113d09438e74b996c991b) 2413102 wikitext text/x-wiki mu3yoocpzro3tke4kpuwy773zpvrfmu Tool:Gitlab-account-approval/Log 116 453906 2412926 2412661 2026-05-12T18:06:24Z Gitlabaccountapprovalbot 37332 @psubhashish was approved. 2412926 wikitext text/x-wiki 8vfvjxmh3kr5jpdrcee6cghk2xz5n6e 2413304 2412926 2026-05-13T10:51:13Z Gitlabaccountapprovalbot 37332 ssssaaaa was rejected. 2413304 wikitext text/x-wiki 7k94gxqq0ffl4a20uilpw87ywolfd44 Wikitech:Village pump 4 458615 2412762 2412183 2026-05-12T13:54:43Z Taavi 13997 /* Main page change requests */ Reply 2412762 wikitext text/x-wiki mu5zbqbe0ey2cj2v7emmx4l8jps9jkk Nova Resource:Tools.cluebotng-monitoring/SAL 498 459243 2412722 2412707 2026-05-12T12:19:01Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25733759682 (https://github.com/cluebotng/component-configs/commits/d71f9d5a70137a2c686d661ffd2e3ea4ce69115b) 2412722 wikitext text/x-wiki k7amflypwuqudoo40aqwud3ih1e01dc 2412732 2412722 2026-05-12T12:54:54Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25735536230 (https://github.com/cluebotng/component-configs/commits/245e38970666704881e64dbcdbf137cd7cf4769b) 2412732 wikitext text/x-wiki fyh7ep8r3f4n6gff4ebk9dn6mb23617 2413085 2412732 2026-05-13T01:14:05Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25771823348 (https://github.com/cluebotng/component-configs/commits/d3130e631e8e51f86a65880414bcb85c6e35b979) 2413085 wikitext text/x-wiki sbsc9qg65z52tmlhtratbjj7xyskuz9 2413088 2413085 2026-05-13T01:17:25Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25771924892 (https://github.com/cluebotng/component-configs/commits/a8bb5b7a82d6f9fbfe284e624bd8ec03b24b5e0e) 2413088 wikitext text/x-wiki m89o8rdzpjvusgt6lhl1euyxt7h97j9 2413092 2413088 2026-05-13T01:27:51Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25772343768 (https://github.com/cluebotng/component-configs/commits/6b6570012dd25ddae243b54aa3376d2fb9485ec1) 2413092 wikitext text/x-wiki ahwi2dtn9hadnqy9y65yzhtbxvz9l0y 2413096 2413092 2026-05-13T01:33:46Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25772564857 (https://github.com/cluebotng/component-configs/commits/a1494790dc79d0332e0f7d6bdc8d2cf36635de8a) 2413096 wikitext text/x-wiki d1jtnhasluqe7cl58p9ypc1b79eyyo4 2413098 2413096 2026-05-13T01:57:49Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25773326566 (https://github.com/cluebotng/component-configs/commits/7112f7cc4f34aa90e0c7d7db1ee89c2104da8c46) 2413098 wikitext text/x-wiki 3w5er7tnw6uzpunw7rnz3pg7ihq3682 Nova Resource:Tools.cluebotng-trainer/SAL 498 459244 2413086 2412706 2026-05-13T01:14:06Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25771881181 (https://github.com/cluebotng/component-configs/commits/d180b98d98a8b5c89115a2080375145455ab4730) 2413086 wikitext text/x-wiki 2nwa1djzjh026qm72nrkkpebbc0s1eb Data Platform Engineering/Ops week/Analytics weekly train 0 459290 2413020 2412366 2026-05-12T21:41:19Z XCollazo-WMF 31846 /* NEXT TRAIN */ 2413020 wikitext text/x-wiki oqqzbsyjqoevln02z6ggzlqtqy3yezm Fundraising/SAL 0 459699 2412882 2411056 2026-05-12T16:07:03Z Stashbot 7414 ejegg: fundraising civicrm upgraded from 24ac90e7 to 60dcc28f 2412882 wikitext text/x-wiki jultj0k6cpcuyyxpknvqzmchu65p4up Talk:MediaWiki Content File Exports 1 459889 2413301 2394857 2026-05-13T10:43:31Z Jberkel 5719 /* Index files */ new section 2413301 wikitext text/x-wiki ols8h3hn95e429hvlwey44fs523eqeh External-services 0 459920 2413331 2401574 2026-05-13T11:47:38Z Effie Mouzeli (WMF) 12880 2413331 wikitext text/x-wiki 6v3a031r8nqyars7ctkkfx296cu81lb Traffic/Runbooks/CPHostDepooled 0 460127 2412878 2408435 2026-05-12T15:53:57Z CDobbins-WMF 37390 2412878 wikitext text/x-wiki qcwideexzxtie1q8yvw49c5ve5c3p7p Annual Toolforge Survey/Ops 0 460159 2412846 2412241 2026-05-12T14:59:25Z SSapaty (WMF) 28955 2412846 wikitext text/x-wiki n2lu6q9zcsjl0m151fyisp0pv8z01h2 MediaWiki:Mainpage-title 8 460164 2412747 2026-05-12T13:47:25Z Taavi 13997 [[Wikitech:Village_pump#c-Codename_Noreste-20260509030700-Main_page_change_requests]] 2412747 wikitext text/x-wiki phoiac9h4m842xq45sp7s6u21eteeq1 MediaWiki:Mainpage-title-loggedin 8 460165 2412748 2026-05-12T13:47:30Z Taavi 13997 [[Wikitech:Village_pump#c-Codename_Noreste-20260509030700-Main_page_change_requests]] 2412748 wikitext text/x-wiki phoiac9h4m842xq45sp7s6u21eteeq1 MediaWiki:Wikimedia-styles-exclude 8 460166 2412753 2026-05-12T13:49:13Z Taavi 13997 [[Wikitech:Village_pump#c-Codename_Noreste-20260509030700-Main_page_change_requests]] 2412753 wikitext text/x-wiki 6vfu5zw1534lz97z2tvqajgqeo5el9z Wikimedia Cloud Services team/Skill matrix 0 460167 2412879 2026-05-12T15:55:48Z BryanDavis 1604 improve discoverability 2412879 wikitext text/x-wiki 8h8lrj9o8gtuo0skjbdci4enxk979ni User talk:Taratarussia 3 460168 2413142 2026-05-13T03:27:09Z StrikerBot 8475 Welcome to Toolforge! 2413142 wikitext text/x-wiki rkyvm3kavg3g9sjqwc2wv12kljcxf1f