Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.6 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 1516 2426657 2426642 2026-06-14T19:16:49Z Stashbot 7414 Krinkle: AntiComposite is now CVN senior staff 2426657 wikitext text/x-wiki 9yvehhlzttctxv9zk0zvntygwc02yvp 2426658 2426657 2026-06-14T19:17:45Z Stashbot 7414 Krinkle: Remove Matanya, rxy, and Wikitanvir as staff per myself and Barras. 2426658 wikitext text/x-wiki jym4597g7e2f9stp0w1mzqwjvzrv5c5 498 3086 2426793 2426262 2026-06-15T09:52:21Z Stashbot 7414 godog: delete tools-checker-5 - T313030 2426793 wikitext text/x-wiki rpprvkp43ly4g4xpybss181wc3w8bs1 2426794 2426793 2026-06-15T09:53:56Z Stashbot 7414 godog: delete tools-checker puppet prefix - T313030 2426794 wikitext text/x-wiki iwrniq7ncrkc67ry04dtduz7qrtebhn 2426820 2426794 2026-06-15T11:00:40Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.prepare_upgrade for cluster tools upgrade to 1.32.13 (T427919) 2426820 wikitext text/x-wiki jttgll7xkd6506hdb5yljtryuvcp7jz 2426824 2426820 2026-06-15T11:20:05Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.prepare_upgrade (exit_code=0) for cluster tools upgrade to 1.32.13 (T427919) 2426824 wikitext text/x-wiki 4yzc5thlgsavjbi8wdnomowxhk4kyvj 2426825 2426824 2026-06-15T11:20:47Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-control-7 from 1.31.14 to 1.32.13 (T427919) 2426825 wikitext text/x-wiki gger3e3tgyljz7rk90t2wgwwbp1nnrf 2426827 2426825 2026-06-15T11:27:51Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-control-7 from 1.31.14 to 1.32.13 (T427919) 2426827 wikitext text/x-wiki 4u905apqt3tyys0datraw5rmfozh4k4 2426828 2426827 2026-06-15T11:27:58Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-control-8 from 1.31.14 to 1.32.13 (T427919) 2426828 wikitext text/x-wiki oftm27t1ed7da1csn7ftj6d7nuw1hvm 2426829 2426828 2026-06-15T11:30:23Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=99) for node tools-k8s-control-8 from 1.31.14 to 1.32.13 (T427919) 2426829 wikitext text/x-wiki 6y3xw1tnj46vw2fec5n8ftirqt4aksh 2426830 2426829 2026-06-15T11:33:22Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-control-9 from 1.31.14 to 1.32.13 (T427919) 2426830 wikitext text/x-wiki 0up39gd1qkqe72ytlodk9x7mt6aonzx 2426832 2426830 2026-06-15T11:39:05Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-control-9 from 1.31.14 to 1.32.13 (T427919) 2426832 wikitext text/x-wiki 3t09d9640ue9e4zrpdtb2jw5gdccpjz 2426833 2426832 2026-06-15T11:40:17Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade_workers for tools-k8s-worker-102, tools-k8s-worker-103, tools-k8s-worker-105, tools-k8s-worker-106, tools-k8s-worker-107, tools-k8s-worker-108, tools-k8s-worker-109, tools-k8s-worker-110, tools-k8s-worker-111, tools-k8s-worker-112, tools-k8s-worker-113 (T427919) 2426833 wikitext text/x-wiki orn5xvujzoy2t7berlouba4zrpt7r5y 2426834 2426833 2026-06-15T11:40:52Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade_workers for tools-k8s-worker-nfs-1, tools-k8s-worker-nfs-10, tools-k8s-worker-nfs-11, tools-k8s-worker-nfs-12, tools-k8s-worker-nfs-13, tools-k8s-worker-nfs-14, tools-k8s-worker-nfs-16, tools-k8s-worker-nfs-17, tools-k8s-worker-nfs-19, tools-k8s-worker-nfs-2, tools-k8s-worker-nfs-21, tools-k8s-worker-nfs-22, tools-k8s-worker-nfs-23, tools-k 2426834 wikitext text/x-wiki l3k72ubeyhmnqc35ks76hvwbzll8amo 2426835 2426834 2026-06-15T11:41:08Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade_workers for tools-k8s-worker-nfs-1, tools-k8s-worker-nfs-10, tools-k8s-worker-nfs-11, tools-k8s-worker-nfs-12, tools-k8s-worker-nfs-13, tools-k8s-worker-nfs-14, tools-k8s-worker-nfs-16, tools-k8s-worker-nfs-17, tools-k8s-worker-nfs-19, tools-k8s-worker-nfs-2, tools-k8s-worker-nfs-21, tools-k8s-worker-nfs-22, tools-k8s-worker-nfs-23, tools-k 2426835 wikitext text/x-wiki 2ma3edkow0sa0505b4arrwe03ythgkn 2426837 2426835 2026-06-15T11:42:18Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade_workers for tools-k8s-worker-nfs-1, tools-k8s-worker-nfs-10, tools-k8s-worker-nfs-11, tools-k8s-worker-nfs-12, tools-k8s-worker-nfs-13, tools-k8s-worker-nfs-14, tools-k8s-worker-nfs-16, tools-k8s-worker-nfs-17, tools-k8s-worker-nfs-19, tools-k8s-worker-nfs-2, tools-k8s-worker-nfs-21, tools-k8s-worker-nfs-22, tools-k8s-worker-nfs-23, tools-k 2426837 wikitext text/x-wiki 6ykupo8t1nwg1bbjzqnfu3kf97iim3e 2426843 2426837 2026-06-15T11:45:50Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.k8s.worker.upgrade_workers (exit_code=99) for tools-k8s-worker-nfs-1, tools-k8s-worker-nfs-10, tools-k8s-worker-nfs-11, tools-k8s-worker-nfs-12, tools-k8s-worker-nfs-13, tools-k8s-worker-nfs-14, tools-k8s-worker-nfs-16, tools-k8s-worker-nfs-17, tools-k8s-worker-nfs-19, tools-k8s-worker-nfs-2, tools-k8s-worker-nfs-21, tools-k8s-worker-nfs-22, tools-k8s-wo 2426843 wikitext text/x-wiki roxns64q3sei06tz5v4xpwljvpz5czo 2426847 2426843 2026-06-15T11:48:13Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade_workers for tools-k8s-worker-nfs-1, tools-k8s-worker-nfs-10, tools-k8s-worker-nfs-11, tools-k8s-worker-nfs-12, tools-k8s-worker-nfs-13, tools-k8s-worker-nfs-14, tools-k8s-worker-nfs-16, tools-k8s-worker-nfs-17, tools-k8s-worker-nfs-19, tools-k8s-worker-nfs-2, tools-k8s-worker-nfs-21, tools-k8s-worker-nfs-22, tools-k8s-worker-nfs-23, tools-k 2426847 wikitext text/x-wiki 9vt2jyvtad57ld36t91bqhdkqmm6ztr 2426851 2426847 2026-06-15T11:53:05Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade_workers (exit_code=0) for tools-k8s-worker-102, tools-k8s-worker-103, tools-k8s-worker-105, tools-k8s-worker-106, tools-k8s-worker-107, tools-k8s-worker-108, tools-k8s-worker-109, tools-k8s-worker-110, tools-k8s-worker-111, tools-k8s-worker-112, tools-k8s-worker-113 (T427919) 2426851 wikitext text/x-wiki 2dik3st2lrks7qmut1jyvz83p1ofhsa 2426855 2426851 2026-06-15T11:54:42Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-gateway-1 from 1.31.14 to 1.32.13 (T427919) 2426855 wikitext text/x-wiki 7bbeuzthm1dyuet9epqq6b91gu4pd09 2426856 2426855 2026-06-15T11:55:37Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-gateway-1 from 1.31.14 to 1.32.13 (T427919) 2426856 wikitext text/x-wiki h4cnyqrfqtlpxtz4gdf3v3jy00xj8bj 2426858 2426856 2026-06-15T11:56:26Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-gateway-2 from 1.31.14 to 1.32.13 (T427919) 2426858 wikitext text/x-wiki ka5uzmvgph50uu5rdl251mqf7afvff1 2426860 2426858 2026-06-15T11:57:20Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.worker.upgrade (exit_code=0) for node tools-k8s-gateway-2 from 1.31.14 to 1.32.13 (T427919) 2426860 wikitext text/x-wiki 8ebk9fjtbblr3eqdz1hix5abph7zp7e 2426861 2426860 2026-06-15T11:58:18Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.worker.upgrade for node tools-k8s-gateway-3 from 1.31.14 to 1.32.13 (T427919) 2426861 wikitext text/x-wiki i3xu5ifcbcplu654bz1ga2i2kr4w43h 0 3801 2426792 2408456 2026-06-15T09:50:44Z WBrown (WMF) 37696 update for recent changes 2426792 wikitext text/x-wiki 04zag66dx38abfop8x763nq1zvnp45v 0 4108 2426685 2426604 2026-06-15T06:04:02Z ScheduleDeploymentBot 37566 Add [[gerrit:1301675]] to Monday, June 15 UTC morning backport window 2426685 wikitext text/x-wiki qgeaztyws1v9kqywzwqrg4zfapwokwt 2426786 2426685 2026-06-15T09:43:27Z ScheduleDeploymentBot 37566 Add [[gerrit:1302100]] to Monday, June 15 UTC afternoon backport window 2426786 wikitext text/x-wiki evarkrul5oxg6uwgovn2olds0kvoc3a 2426787 2426786 2026-06-15T09:43:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1300835]] to Monday, June 15 UTC afternoon backport window 2426787 wikitext text/x-wiki 9qzte3yziptllya7vcabztvwsfthjs1 0 7919 2426667 2426653 2026-06-15T02:01:08Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2426667 wikitext text/x-wiki h7o4kxi7iqpib32j63l0dbwbhzh7sf9 2426668 2426667 2026-06-15T02:08:07Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 06m 58s) 2426668 wikitext text/x-wiki gnwh0bedygl0rc0pvd76skfmiu0ma9z 2426669 2426668 2026-06-15T02:18:02Z Stashbot 7414 Amir1: making Dexbot a bot in cywiki (T428927) 2426669 wikitext text/x-wiki r7sk3uxbsi5vodhqawi2caz0xlgic6o 2426671 2426669 2026-06-15T05:30:43Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Depool es2046', diff saved to https://phabricator.wikimedia.org/P94104 and previous config saved to /var/cache/conftool/dbconfig/20260615-053041-marostegui.json 2426671 wikitext text/x-wiki leicmpnp3oho9oi10opb04jzbmw4muo 2426672 2426671 2026-06-15T05:31:18Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on es2045.codfw.wmnet with reason: crash 2426672 wikitext text/x-wiki 3wtjx8nhnkw292vaegq2r9iy0t0nyfi 2426673 2426672 2026-06-15T05:31:53Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on es2046.codfw.wmnet with reason: cloning 2426673 wikitext text/x-wiki gxfzkh8ijrf5dpevgxynjqc0x75v3zb 2426674 2426673 2026-06-15T05:34:05Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Repool es2046', diff saved to https://phabricator.wikimedia.org/P94105 and previous config saved to /var/cache/conftool/dbconfig/20260615-053403-marostegui.json 2426674 wikitext text/x-wiki moc8ogoiladl0x21qfl2815j2pyym6x 2426675 2426674 2026-06-15T05:48:46Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool pc1021: Migration to 10.11.18 T428861 2426675 wikitext text/x-wiki nj8zffu98n4o6tpz2cr96zqeh6fm45z 2426676 2426675 2026-06-15T05:48:50Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1021: Migration to 10.11.18 T428861 2426676 wikitext text/x-wiki j88o7wfj9c3k6ljghh4rxg86ha531o6 2426677 2426676 2026-06-15T05:49:34Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool pc2021: Migration to 10.11.18 T428861 2426677 wikitext text/x-wiki ksywn0bdvocdl99k7m2xcqi1i8wellr 2426678 2426677 2026-06-15T05:49:38Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc2021: Migration to 10.11.18 T428861 2426678 wikitext text/x-wiki 44guvtury9tku00fxdnxuceytazrnzo 2426679 2426678 2026-06-15T05:56:43Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool pc2021: Migration to 10.11.18 T428861 2426679 wikitext text/x-wiki gbasywsjw50233p62wqqhbx4hoowub0 2426680 2426679 2026-06-15T05:56:46Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.parsercache 2426680 wikitext text/x-wiki jn3c4tn7mgkpty3uxbjssfupphkvso6 2426681 2426680 2026-06-15T05:56:50Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) 2426681 wikitext text/x-wiki no676swecal0k7cu0swekm0gqukjifp 2426682 2426681 2026-06-15T05:56:54Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc2021: Migration to 10.11.18 T428861 2426682 wikitext text/x-wiki d6y7vnrz8iztnhdz489acsq1ane43vd 2426683 2426682 2026-06-15T05:57:33Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on pc2021.codfw.wmnet,pc1021.eqiad.wmnet with reason: upgrading 2426683 wikitext text/x-wiki 45suvostwm1nrwbybhgekcoxdy51c3b 2426684 2426683 2026-06-15T05:59:05Z Stashbot 7414 marostegui: install mariadb 10.11.18 on pc1 T428861 2426684 wikitext text/x-wiki ptrmze5zf3seegivquxjvjqw0il88eu 2426686 2426684 2026-06-15T06:09:53Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool pc2021: Migration to 10.11.18 T428861 2426686 wikitext text/x-wiki 9rzalkxm98ymk1hlzb0xdk7qbt14rry 2426687 2426686 2026-06-15T06:09:55Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.parsercache 2426687 wikitext text/x-wiki 5po28kkxjscg0zm1ay3r7ucd4ptts1o 2426688 2426687 2026-06-15T06:10:04Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) 2426688 wikitext text/x-wiki 2cqltubi19cxetzrfkx26p8ia9hi1eo 2426689 2426688 2026-06-15T06:10:08Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool pc2021: Migration to 10.11.18 T428861 2426689 wikitext text/x-wiki 5smm84esxdkvdqeug74mubmm0l0u3gt 2426691 2426689 2026-06-15T06:27:26Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426691 wikitext text/x-wiki g7b4lnlvl3ttd02wkvx0yfnz5g8kcr9 2426692 2426691 2026-06-15T06:27:48Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es2047: Upgrading es2047.codfw.wmnet 2426692 wikitext text/x-wiki b4kheambu6ftd9a68qoinh10wima7me 2426693 2426692 2026-06-15T06:28:10Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2047: Upgrading es2047.codfw.wmnet 2426693 wikitext text/x-wiki hv6cjpxaw2es77yj549y0aim0wq52ru 2426694 2426693 2026-06-15T06:31:46Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es2047.codfw.wmnet with OS trixie 2426694 wikitext text/x-wiki n1iupm8wcgmuvwk9qn8zdeqlrs4b0kf 2426695 2426694 2026-06-15T06:47:59Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es2047.codfw.wmnet with reason: host reimage 2426695 wikitext text/x-wiki s0bx3l9w42avlpkw5lonptka9aql19h 2426696 2426695 2026-06-15T06:53:19Z Stashbot 7414 moritzm: imported zookeeper 3.4.13-6+wmf12u1 to component/zookeeper34 for bookworm-wikimedia T428495 2426696 wikitext text/x-wiki 8j9osv5qms4cnpa379q5ecq3eoq7why 2426697 2426696 2026-06-15T06:55:05Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2047.codfw.wmnet with reason: host reimage 2426697 wikitext text/x-wiki mhpjht76eacbvzj1zyw4stxa4nt8bsq 2426698 2426697 2026-06-15T07:10:11Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426698 wikitext text/x-wiki kvecwt2c4om0e2ah7eee1zwa11h74jt 2426699 2426698 2026-06-15T07:11:34Z Stashbot 7414 dcausse@deploy1003: Started scap sync-world: Backport for [[gerrit:1301675|Switch wmgUseCalendar to false for dewikivoyage (T429095)]], [[gerrit:1300301|Add alias namespace for cswiki (T428619)]] 2426699 wikitext text/x-wiki a8crwjyebmuiszd48kb3i8595lp8q7g 2426700 2426699 2026-06-15T07:11:38Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2047.codfw.wmnet with OS trixie 2426700 wikitext text/x-wiki a19n7l7e5bvxjwzo8w7s6sr5g8i4io8 2426701 2426700 2026-06-15T07:11:47Z Stashbot 7414 elukey@cumin2002: START - Cookbook sre.hosts.provision for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426701 wikitext text/x-wiki 5gvqdn1m29krqmy8utnxcynv0ml5mc0 2426702 2426701 2026-06-15T07:20:31Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426702 wikitext text/x-wiki kn80mgtayb5ob294jtu5nwcocid8x9z 2426703 2426702 2026-06-15T07:21:04Z Stashbot 7414 elukey@cumin2002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudvirt1077.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426703 wikitext text/x-wiki b4q6cabqzq2u758736hjqzhqttwdb7y 2426704 2426703 2026-06-15T07:21:06Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426704 wikitext text/x-wiki lsknmy5ogar6bv30rlunjgsxuxeie4s 2426705 2426704 2026-06-15T07:23:07Z Stashbot 7414 arnaudb@dns1005: START - running authdns-update 2426705 wikitext text/x-wiki 7lav28w4es0gog3g1lov8xp8dt1locv 2426706 2426705 2026-06-15T07:23:10Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es2047: Migration of es2047.codfw.wmnet completed 2426706 wikitext text/x-wiki pfzjzqpyi0hsiifb78la0la2du03ds1 2426707 2426706 2026-06-15T07:23:15Z Stashbot 7414 elukey@cumin2002: START - Cookbook sre.hosts.provision for host cloudvirt1078.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426707 wikitext text/x-wiki tq4jlm9e694fnz3jidwq5h4d6npp0a9 2426708 2426707 2026-06-15T07:23:20Z Stashbot 7414 elukey@cumin2002: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudvirt1078.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426708 wikitext text/x-wiki cfr8ty0v2vcki6kya5o9te59kfnp9g1 2426709 2426708 2026-06-15T07:24:13Z Stashbot 7414 elukey@cumin2002: START - Cookbook sre.hosts.provision for host cloudvirt1079.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426709 wikitext text/x-wiki l3w0jjnojhcmikcu3286yhda2ypyzge 2426710 2426709 2026-06-15T07:24:40Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1163.eqiad.wmnet with reason: Maintenance 2426710 wikitext text/x-wiki ivjnsjheogaz91jevkcqilgep93hk1v 2426711 2426710 2026-06-15T07:24:49Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1163 (T419635)', diff saved to https://phabricator.wikimedia.org/P94110 and previous config saved to /var/cache/conftool/dbconfig/20260615-072446-fceratto.json 2426711 wikitext text/x-wiki 9re449fwzijrgyorlocrckvfzo4rify 2426712 2426711 2026-06-15T07:24:52Z Stashbot 7414 arnaudb@dns1005: END - running authdns-update 2426712 wikitext text/x-wiki 9ix9wci0yn13xbdcgbtnnopzihh5s5c 2426713 2426712 2026-06-15T07:25:06Z Stashbot 7414 elukey@cumin2002: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudvirt1079.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426713 wikitext text/x-wiki l0d5hld7ozm15a5k6yh4zif40a7r5ol 2426714 2426713 2026-06-15T07:26:08Z Stashbot 7414 elukey@cumin2002: START - Cookbook sre.hosts.provision for host cloudvirt1080.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426714 wikitext text/x-wiki b1fmwz121bz11icxlay8j60t1wrrs3n 2426715 2426714 2026-06-15T07:26:47Z Stashbot 7414 elukey@cumin2002: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudvirt1080.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426715 wikitext text/x-wiki c2m4hwtdkui915vvq05azwu2afr2vze 2426717 2426715 2026-06-15T07:28:50Z Stashbot 7414 dcausse@deploy1003: vadymts1, dcausse: Backport for [[gerrit:1301675|Switch wmgUseCalendar to false for dewikivoyage (T429095)]], [[gerrit:1300301|Add alias namespace for cswiki (T428619)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426717 wikitext text/x-wiki 6wxna1yn5zy3i5hztvd1oe0x6j17uf9 2426718 2426717 2026-06-15T07:31:20Z Stashbot 7414 cwilliams@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:05:00 on db-test2001.codfw.wmnet with reason: Testing 2426718 wikitext text/x-wiki eugjh09vmnf0vzd0ddjmwbb122jf6q0 2426719 2426718 2026-06-15T07:31:53Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426719 wikitext text/x-wiki h01p1hkgapc5r75itoie8xt2aa4scug 2426720 2426719 2026-06-15T07:33:24Z Stashbot 7414 dcausse@deploy1003: vadymts1, dcausse: Continuing with deployment 2426720 wikitext text/x-wiki t8qw6o36dj2t1lak0hchszkrqksj175 2426721 2426720 2026-06-15T07:39:34Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426721 wikitext text/x-wiki 45u09earvasrc7ooavrq9bfu21ttz0u 2426722 2426721 2026-06-15T07:43:27Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426722 wikitext text/x-wiki rhksw1miu8y4m8on6wltgr4u6pmnwkj 2426723 2426722 2026-06-15T07:44:22Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1163 (T419635)', diff saved to https://phabricator.wikimedia.org/P94112 and previous config saved to /var/cache/conftool/dbconfig/20260615-074417-fceratto.json 2426723 wikitext text/x-wiki r81vd81s3dak3r2y9uygkgww81p4o3r 2426724 2426723 2026-06-15T07:46:11Z Stashbot 7414 dcausse@deploy1003: Finished scap sync-world: Backport for [[gerrit:1301675|Switch wmgUseCalendar to false for dewikivoyage (T429095)]], [[gerrit:1300301|Add alias namespace for cswiki (T428619)]] (duration: 34m 37s) 2426724 wikitext text/x-wiki 71oaz82uinou7rv8r2kctzk7peqyd70 2426725 2426724 2026-06-15T07:47:30Z Stashbot 7414 dcausse@deploy1003: mwscript-k8s job started: namespaceDupes cswiki --fix # T428619 2426725 wikitext text/x-wiki 95rwpuvrj0otwu9mmnuetvlcsx903ef 2426726 2426725 2026-06-15T07:49:57Z Stashbot 7414 atsuko@deploy1003: Started scap sync-world: Backport for [[gerrit:1301373|translate: production opensearch on k8s endpoints (T425377)]] 2426726 wikitext text/x-wiki 7yim2cta432i97qua3qk8yjskahqewe 2426727 2426726 2026-06-15T07:52:09Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426727 wikitext text/x-wiki mmcutt1hm2azcrpf46buj0cq1fkw3kc 2426728 2426727 2026-06-15T07:53:51Z Stashbot 7414 atsuko@deploy1003: atsuko: Backport for [[gerrit:1301373|translate: production opensearch on k8s endpoints (T425377)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426728 wikitext text/x-wiki gethxo6y9gfm1wc9zvudqab8ybwprd7 2426729 2426728 2026-06-15T07:54:27Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P94114 and previous config saved to /var/cache/conftool/dbconfig/20260615-075425-fceratto.json 2426729 wikitext text/x-wiki t2kaf6n51imffxjbez4srhiqsr6tf7t 2426730 2426729 2026-06-15T07:55:06Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426730 wikitext text/x-wiki d3p2en7li3kxuybh0ayuay19vnj4pd4 2426731 2426730 2026-06-15T07:55:10Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426731 wikitext text/x-wiki jo7eds7msis57hqc95p6xqqqd12fpot 2426732 2426731 2026-06-15T07:57:15Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426732 wikitext text/x-wiki pb2n1d68an1odd9dl6l3vw6uebmmd2g 2426733 2426732 2026-06-15T07:57:21Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426733 wikitext text/x-wiki s875efvb9cyz8ofbz81z0586b34u5o7 2426734 2426733 2026-06-15T08:03:36Z Stashbot 7414 atsuko@deploy1003: atsuko: Continuing with deployment 2426734 wikitext text/x-wiki 46072bjhloizzvksbpwhg2bvjd3ur8o 2426735 2426734 2026-06-15T08:04:35Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1163', diff saved to https://phabricator.wikimedia.org/P94115 and previous config saved to /var/cache/conftool/dbconfig/20260615-080432-fceratto.json 2426735 wikitext text/x-wiki hhf8gtgjrqq3nxt369r0e1sm5yz014r 2426736 2426735 2026-06-15T08:07:24Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426736 wikitext text/x-wiki 23sbehd34hydx44bwu46ifgggfwttzr 2426737 2426736 2026-06-15T08:08:37Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es2047: Migration of es2047.codfw.wmnet completed 2426737 wikitext text/x-wiki 5kuaz0325dsvnpg134xcbdtfv20ke8c 2426738 2426737 2026-06-15T08:08:40Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2426738 wikitext text/x-wiki hnqa6lv1z4ibfaapywz3ur2o8u9q4eo 2426739 2426738 2026-06-15T08:10:53Z Stashbot 7414 atsuko@deploy1003: Finished scap sync-world: Backport for [[gerrit:1301373|translate: production opensearch on k8s endpoints (T425377)]] (duration: 20m 54s) 2426739 wikitext text/x-wiki fgfmpfscmqw9ng8kfpptcpcj5zwv9q4 2426740 2426739 2026-06-15T08:14:44Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1163 (T419635)', diff saved to https://phabricator.wikimedia.org/P94117 and previous config saved to /var/cache/conftool/dbconfig/20260615-081440-fceratto.json 2426740 wikitext text/x-wiki 1esbpkr4xhvhu8iuxjb7w2qsh3io78n 2426741 2426740 2026-06-15T08:14:58Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance 2426741 wikitext text/x-wiki ik6ipg81e4sep3z7gzn61zvmsr09exv 2426743 2426741 2026-06-15T08:23:13Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2426743 wikitext text/x-wiki pmfdf0az3a7icmxpchvismuf416xkbs 2426747 2426743 2026-06-15T08:35:43Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2426747 wikitext text/x-wiki opekaaocwnhuyz01yg4r2mpapkop8vx 2426749 2426747 2026-06-15T08:36:25Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2426749 wikitext text/x-wiki pr5vnofdqjl9e6wkcu7eqte0kgi7mir 2426752 2426749 2026-06-15T08:40:40Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2426752 wikitext text/x-wiki ashoispminx9utjdqwqnoft5fabytkp 2426753 2426752 2026-06-15T08:41:18Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2426753 wikitext text/x-wiki e6ut19haaiosw3awlnbfkxk53ai70mp 2426755 2426753 2026-06-15T08:43:56Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2426755 wikitext text/x-wiki pt9k4yw49725hzo33l1uu8mws8x5sgk 2426756 2426755 2026-06-15T08:44:29Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2426756 wikitext text/x-wiki ggauri56pgc5n78fy6huoxslsjrhhxn 2426757 2426756 2026-06-15T08:45:52Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ttmserver: apply 2426757 wikitext text/x-wiki gjpfjwnu1d92qlkk0djdb18yt4wk94k 2426758 2426757 2026-06-15T08:45:56Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ttmserver: apply 2426758 wikitext text/x-wiki edqbh27pd1uzmuwkh1y5kj8445leyce 2426759 2426758 2026-06-15T08:46:02Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-ttmserver: apply 2426759 wikitext text/x-wiki lfbvxn8p4crf3iyth9ujdmpatd3ppy6 2426760 2426759 2026-06-15T08:46:09Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/opensearch-ttmserver: apply 2426760 wikitext text/x-wiki c99r6geol4j8r6a9hms0ipcwckoe2v8 2426764 2426760 2026-06-15T08:53:16Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426764 wikitext text/x-wiki b1ghxqdc73c748qs6hnfzibr7qub918 2426765 2426764 2026-06-15T08:53:27Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es2037: Upgrading es2037.codfw.wmnet 2426765 wikitext text/x-wiki mqjkijrdy7g74bkem620yfb6z9ynb2x 2426766 2426765 2026-06-15T08:53:48Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2037: Upgrading es2037.codfw.wmnet 2426766 wikitext text/x-wiki tvoete3xsspjmxs2fzmqvfvkal0jloi 2426767 2426766 2026-06-15T08:55:18Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es2037.codfw.wmnet with OS trixie 2426767 wikitext text/x-wiki 1e02gfxjeehfh2atebdnztfq6wsynb0 2426768 2426767 2026-06-15T08:56:10Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host es2037.codfw.wmnet with OS trixie 2426768 wikitext text/x-wiki igqo7jvwtmnkqon1a3r2594hzha775o 2426769 2426768 2026-06-15T08:59:29Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426769 wikitext text/x-wiki 1u269pa4ri35fcl3fxbx148yekofuo6 2426770 2426769 2026-06-15T09:07:45Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426770 wikitext text/x-wiki aj6ch6t8aaiftf0z2qopmf9285hh285 2426771 2426770 2026-06-15T09:12:05Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) 2426771 wikitext text/x-wiki 8t8jr40n1nmod9t7sca0q190t1fagw4 2426772 2426771 2026-06-15T09:12:25Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426772 wikitext text/x-wiki 1wae5x0059mku72ze9de4kbzmbsnk5j 2426773 2426772 2026-06-15T09:13:43Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426773 wikitext text/x-wiki hyjg8uiapn19lcc1ntm17o429lj2kdy 2426774 2426773 2026-06-15T09:13:48Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426774 wikitext text/x-wiki rrsj407vahdq6uddk7p6eo34ws0wgwd 2426775 2426774 2026-06-15T09:14:28Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es2037.codfw.wmnet with OS trixie 2426775 wikitext text/x-wiki 0ulo9q22n01ae3g7yjmjmard7dzybz3 2426776 2426775 2026-06-15T09:15:46Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426776 wikitext text/x-wiki naxjmfe93a1zyl1wun8mfwye7bz9bdh 2426777 2426776 2026-06-15T09:17:43Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426777 wikitext text/x-wiki m6rnzle2q0djhznm9akytscn1vkaize 2426778 2426777 2026-06-15T09:22:56Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426778 wikitext text/x-wiki 4u718sk30wuizg8rkg3xio7pvasudou 2426779 2426778 2026-06-15T09:22:59Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426779 wikitext text/x-wiki bz8tdyusava4a9x1ss259k76an3ocnv 2426780 2426779 2026-06-15T09:30:48Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es2037.codfw.wmnet with reason: host reimage 2426780 wikitext text/x-wiki 1k6o9tma0v88navvk8tgtch3ee5kwc8 2426781 2426780 2026-06-15T09:33:01Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426781 wikitext text/x-wiki 7wbl4rz4tkk606667o2ca4wcbd8g6sm 2426782 2426781 2026-06-15T09:35:19Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2037.codfw.wmnet with reason: host reimage 2426782 wikitext text/x-wiki eel5wjm1qlm3f8jxi11mzpg1oag8xed 2426783 2426782 2026-06-15T09:40:38Z Stashbot 7414 atsuko@deploy1003: mwscript-k8s job started: foreachwikiindblist mwscript.dblist extensions/Translate/scripts/ttmserver-export.php --ttmserver eqiad-k8s # T425377: populating translation memory (ttmserver-export.php) on eqiad-k8s (dblist: https://phabricator.wikimedia.org/P94120) 2426783 wikitext text/x-wiki ftej11sj7m8j9zi2uqkcf8hruw87veo 2426784 2426783 2026-06-15T09:42:34Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2426784 wikitext text/x-wiki tkcriwok8xptnsajf1fbkr68h7ygpsh 2426785 2426784 2026-06-15T09:43:05Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2426785 wikitext text/x-wiki auf2wr1qin05pxtpzkb4dwapmoi0x6h 2426788 2426785 2026-06-15T09:44:59Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2426788 wikitext text/x-wiki kahatjhfn5nefiiujt17slxdkzaru1u 2426789 2426788 2026-06-15T09:45:42Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2426789 wikitext text/x-wiki rcitjd9nk7ksnkh5fsguc11b6jug3pd 2426790 2426789 2026-06-15T09:45:44Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2426790 wikitext text/x-wiki mgi9v3s2t9z0ypnxz96ad3xgv8yvtg7 2426791 2426790 2026-06-15T09:46:25Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2426791 wikitext text/x-wiki 18wl2ry2ckbfsfvyo3i9nt6kmso7ljk 2426795 2426791 2026-06-15T09:54:52Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426795 wikitext text/x-wiki 7owb8gbq679mxyyehhcr1kpm9dij9yr 2426797 2426795 2026-06-15T09:58:40Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2037.codfw.wmnet with OS trixie 2426797 wikitext text/x-wiki 5k625lmm9dtddnhhoihu15iiwqrhmjv 2426798 2426797 2026-06-15T10:04:56Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426798 wikitext text/x-wiki 7ph6v7tz8hgqn5o8kljkn93t4tc8llg 2426799 2426798 2026-06-15T10:08:42Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es2037: repool after upgrade 2426799 wikitext text/x-wiki gfrm5by9ejqadn7rypbrpu32svjjq5l 2426800 2426799 2026-06-15T10:10:40Z Stashbot 7414 blake@deploy1003: Started scap sync-world: apache config change (T428772) 2426800 wikitext text/x-wiki 6k49do8cgu1mxhew8u3lu2erck614mw 2426801 2426800 2026-06-15T10:11:32Z Stashbot 7414 blake@deploy1003: blake: apache config change (T428772) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426801 wikitext text/x-wiki 4ewhsuahdo91zko2x3jw879v254ggp2 2426802 2426801 2026-06-15T10:12:19Z Stashbot 7414 blake@deploy1003: blake: Continuing with deployment 2426802 wikitext text/x-wiki i1qqpxaclu9bgj5nbe4bozf1iiw106k 2426803 2426802 2026-06-15T10:16:21Z Stashbot 7414 blake@deploy1003: Finished scap sync-world: apache config change (T428772) (duration: 06m 41s) 2426803 wikitext text/x-wiki eyfamoomh3125awf6xuxxaaxl80l4cr 2426806 2426803 2026-06-15T10:23:37Z Stashbot 7414 cgoubert@deploy1003: Started scap sync-world: Backport for [[gerrit:1301341|Close API Portal wiki (T427537)]] 2426806 wikitext text/x-wiki jqicem39jpqqt5pk3fjb1pdh9cabu7l 2426807 2426806 2026-06-15T10:25:23Z Stashbot 7414 cgoubert@deploy1003: cgoubert: Backport for [[gerrit:1301341|Close API Portal wiki (T427537)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426807 wikitext text/x-wiki sbubcvfcwvjnkjyibisp1aoemxtcxfn 2426808 2426807 2026-06-15T10:26:33Z Stashbot 7414 cgoubert@deploy1003: cgoubert: Continuing with deployment 2426808 wikitext text/x-wiki jdqq36sxe4opb9z9hkku74wn9e8slp6 2426809 2426808 2026-06-15T10:30:53Z Stashbot 7414 cgoubert@deploy1003: Finished scap sync-world: Backport for [[gerrit:1301341|Close API Portal wiki (T427537)]] (duration: 07m 16s) 2426809 wikitext text/x-wiki duc1tnsgkzvjhdbcd40kuuexxxd4l1g 2426811 2426809 2026-06-15T10:52:51Z Stashbot 7414 moritzm: installing openssl security updates on bookworm 2426811 wikitext text/x-wiki 3lty67y0jd9ba8r8czxzzvi1xl40ezy 2426812 2426811 2026-06-15T10:54:08Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es2037: repool after upgrade 2426812 wikitext text/x-wiki gmk569kj2y13juv3biftge5ybfod4m6 2426814 2426812 2026-06-15T10:54:33Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.misc-clusters.roll-restart-reboot-eventschemas rolling restart_daemons on A:schema-codfw 2426814 wikitext text/x-wiki cfd7mkxozonsksfp75siyvnncncy0dr 2426815 2426814 2026-06-15T10:55:39Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.misc-clusters.roll-restart-reboot-eventschemas (exit_code=0) rolling restart_daemons on A:schema-codfw 2426815 wikitext text/x-wiki siw844rdqbtoxh4scvshksvdm8ej4bd 2426816 2426815 2026-06-15T10:58:23Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426816 wikitext text/x-wiki gwno1j674eskowt6i1t80jqon0rqtby 2426817 2426816 2026-06-15T10:58:44Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es2036: Upgrading es2036.codfw.wmnet 2426817 wikitext text/x-wiki sa9hky7ykcll2klmd4ok1gzmnq450ks 2426818 2426817 2026-06-15T10:59:16Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2036: Upgrading es2036.codfw.wmnet 2426818 wikitext text/x-wiki 5u8behmchew9dwgtvjdem5mvg1oqx5n 2426819 2426818 2026-06-15T11:00:08Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es2036.codfw.wmnet with OS trixie 2426819 wikitext text/x-wiki cfzhgqnjca8a4zpirv3m38vh5hhaqmm 2426821 2426819 2026-06-15T11:08:44Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.misc-clusters.roll-restart-reboot-eventschemas rolling restart_daemons on A:schema-eqiad 2426821 wikitext text/x-wiki 27h0umpz3fsyc7mumtoiu040rqfvrra 2426822 2426821 2026-06-15T11:09:50Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.misc-clusters.roll-restart-reboot-eventschemas (exit_code=0) rolling restart_daemons on A:schema-eqiad 2426822 wikitext text/x-wiki ctmakchqyu3b8iwtk9z50snzrczzx5j 2426823 2426822 2026-06-15T11:17:17Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es2036.codfw.wmnet with reason: host reimage 2426823 wikitext text/x-wiki gh2645kz1jdd4jyv5dw0p3b3vyybyyn 2426826 2426823 2026-06-15T11:24:08Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2036.codfw.wmnet with reason: host reimage 2426826 wikitext text/x-wiki 13mllv5mfdbtzr6lcjlm0ygc1d5fpx4 2426831 2426826 2026-06-15T11:37:57Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426831 wikitext text/x-wiki 2lp74p2qm2igav7ujbf7oe61e25qbjw 2426836 2426831 2026-06-15T11:42:11Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2036.codfw.wmnet with OS trixie 2426836 wikitext text/x-wiki iz5efsrnykdgqaoemkpcwro6n2k1c8a 2426838 2426836 2026-06-15T11:43:03Z Stashbot 7414 atsuko@deploy1003: mwscript-k8s job started: foreachwikiindblist mwscript.dblist extensions/Translate/scripts/ttmserver-export.php --ttmserver eqiad-k8s # T425377: populating translation memory (ttmserver-export.php) on eqiad-k8s (dblist: https://phabricator.wikimedia.org/P94127) 2426838 wikitext text/x-wiki d28622e3v23ke7uajtrxdb0kwd48t5q 2426839 2426838 2026-06-15T11:43:07Z Stashbot 7414 elukey@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426839 wikitext text/x-wiki alytv0jepi5vwpzanwsfn09uvdl8m2o 2426841 2426839 2026-06-15T11:44:49Z Stashbot 7414 atsuko@deploy1003: mwscript-k8s job started: foreachwikiindblist mwscript.dblist extensions/Translate/scripts/ttmserver-export.php --ttmserver codfw-k8s # T425377: populating translation memory (ttmserver-export.php) on codfw-k8s (dblist: https://phabricator.wikimedia.org/P94128) 2426841 wikitext text/x-wiki 9axkn6v962h7usi9iqh5fd8eta7gp0s 2426842 2426841 2026-06-15T11:45:29Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426842 wikitext text/x-wiki 7dje1czoppdgnvmj9y7fbk7pdgwzowf 2426844 2426842 2026-06-15T11:45:53Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db1251: Upgrading db1251.eqiad.wmnet 2426844 wikitext text/x-wiki 33hfou5m019ryn6wevv6y4skgnedbtp 2426845 2426844 2026-06-15T11:46:30Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1251: Upgrading db1251.eqiad.wmnet 2426845 wikitext text/x-wiki i114lsrcly9rm6sln3yz6z52spxqqdh 2426846 2426845 2026-06-15T11:48:11Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db1251.eqiad.wmnet with OS trixie 2426846 wikitext text/x-wiki gr6w66snw7ltc6zk7gvd30ctakzhgeh 2426848 2426846 2026-06-15T11:49:27Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426848 wikitext text/x-wiki ev6im4y0blg24f7jtze0vula7zwjox8 2426849 2426848 2026-06-15T11:49:47Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db2216: Upgrading db2216.codfw.wmnet 2426849 wikitext text/x-wiki paf8tr0gw517q8yi843uiz6biy6zmqz 2426850 2426849 2026-06-15T11:50:09Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2216: Upgrading db2216.codfw.wmnet 2426850 wikitext text/x-wiki p2at5gcmuiugyx0qe0hii3wy86taq9w 2426852 2426850 2026-06-15T11:53:21Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db2216.codfw.wmnet with OS trixie 2426852 wikitext text/x-wiki bkxjejxgkimv9t47wf8s7jbpgzxoxic 2426853 2426852 2026-06-15T11:54:06Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging1006.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2426853 wikitext text/x-wiki 3dk84jskdmtba941otps7n5f82cpfpa 2426854 2426853 2026-06-15T11:54:36Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es2036: Migration of es2036.codfw.wmnet completed 2426854 wikitext text/x-wiki j42wylzash97egg6eqdmbit3nc4fj60 2426857 2426854 2026-06-15T11:56:00Z Stashbot 7414 jmm@deploy1003: helmfile [staging] START helmfile.d/services/proton: apply 2426857 wikitext text/x-wiki 0jc5i9y2rfy5r41qq9ei18maqkciblm 2426859 2426857 2026-06-15T11:56:47Z Stashbot 7414 jmm@deploy1003: helmfile [staging] DONE helmfile.d/services/proton: apply 2426859 wikitext text/x-wiki insdb0yrb1gx8wi54hn3wdzlm2ac2i8 2 21112 2426654 2275587 2026-06-14T12:40:04Z Dee723723 56300 Dee723723 moved page [[User:Joal~labswiki]] to [[Joal]]: Revert 1961894 wikitext text/x-wiki dv993cexn2y1ir9s6zithgx2obk1l9f 6 442392 2426664 1790647 2026-06-14T23:21:44Z Star walker 40724 now commons 2426664 wikitext text/x-wiki 3tdpgpnt2rp50k8wxu6jmszkwjakiyp 116 444173 2426670 2174978 2026-06-15T04:13:45Z AKlapper (WMF) 421 update some 404 URIs 2426670 wikitext text/x-wiki bg9zwxig3kltg5h8zv58de59icc78fb 10 448238 2426750 1920451 2026-06-15T08:36:40Z ABran-WMF 37196 2426750 wikitext text/x-wiki 0nhn1mv6y4l2ljd6mfflsvuydfk6xvz 2426751 2426750 2026-06-15T08:37:15Z ABran-WMF 37196 2426751 wikitext text/x-wiki taf6ty9u00mjjdy7p07q94cbahnhh9r 6 448316 2426665 1921848 2026-06-14T23:25:20Z Star walker 40724 delete 2426665 wikitext text/x-wiki h7hrc05utnz9ohzils7qzjg42z20z9t 6 448348 2426662 2066590 2026-06-14T23:16:53Z Star walker 40724 correct licence 2426662 wikitext text/x-wiki cjqjwy3n11taq1f2qmarv1lfgmphal6 0 449160 2426666 2426643 2026-06-15T00:02:11Z Dexbot 30554 Bot: Updating the report 2426666 wikitext text/x-wiki mdl95vxl2qhs0pqk6kvh6iuv81c0zj8 2426716 2426666 2026-06-15T07:27:08Z Dexbot 30554 Bot: Updating the report 2426716 wikitext text/x-wiki gmydzb3z2whnldollydhfbg6a5m130d 2 451026 2426763 2232245 2026-06-15T08:52:56Z FNegri-WMF 32595 Add "subpages" section 2426763 wikitext text/x-wiki 6j9yb5163vp3iej94yi7bi5hjao3u83 116 453906 2426656 2426648 2026-06-14T17:45:27Z Gitlabaccountapprovalbot 37332 @surajseth520 was approved. 2426656 wikitext text/x-wiki 8knvvhx86wfjkmk1ftorsyem8wvtlyt 2426813 2426656 2026-06-15T10:54:14Z Gitlabaccountapprovalbot 37332 kwametech was rejected. 2426813 wikitext text/x-wiki 6syz0bb81xtasxm5a62jawagswoazbt 6 454407 2426663 2169067 2026-06-14T23:20:05Z Star walker 40724 correct licence 2426663 wikitext text/x-wiki a1w1d8xf5ej2iqf0rp5r38agzcfuafb 2 457864 2426745 2271151 2026-06-15T08:30:25Z MABot 10804 Bot: Redirect to a deleted or non-existent page 2426745 wikitext text/x-wiki 7d5sbaaqjt83erj391m8mmr2tpxa3wu 0 459290 2426744 2425048 2026-06-15T08:28:26Z APizzata-WMF 47941 add 1300876 2426744 wikitext text/x-wiki fxzskdgwgglfjezffhm9a0npmxuebod 2426804 2426744 2026-06-15T10:17:07Z APizzata-WMF 47941 1301381 2426804 wikitext text/x-wiki hual5j0b9ljfpra41c7e8xyp0witak5 2426805 2426804 2026-06-15T10:17:47Z APizzata-WMF 47941 fix link 2426805 wikitext text/x-wiki si2wkluwj8xyxuwmgmmjldyegwehxzq 0 459699 2426840 2426588 2026-06-15T11:43:59Z Stashbot 7414 damilare: donorwiki upgraded from 3bc70a73 to 1f5f40f9 2426840 wikitext text/x-wiki bqb92hpym4fc2qpqxy4r6cjj5614fkm 116 460070 2426796 2426622 2026-06-15T09:55:56Z EtherpadBackupBot 54504 EYG01 archived by Ericliu1912 2426796 wikitext text/x-wiki pbu2ujhho8ceig9imhftux34tyy8adx 498 460173 2426660 2426630 2026-06-14T21:46:33Z ZI Jony 13427 2426660 wikitext text/x-wiki 45bjj97n8my674zqve4wy4ragdpp6mg 0 460194 2426810 2421061 2026-06-15T10:39:43Z HNowlan (WMF) 15760 /* Tips */ 2426810 wikitext text/x-wiki mzl61t1z5ikw5rvfj9dwkd6wl990d4g 0 460318 2426742 2426571 2026-06-15T08:16:54Z Atsuko-WMF 54082 /* Layout */ 2426742 wikitext text/x-wiki lqg8t0mmwruz9fe46maw77lwm6r6w9b 2 460330 2426659 2426574 2026-06-14T21:34:19Z Quiddity 1884 add links; fix typo; attempt a partial-restructure with bolded keywords/etc. FYI ping @[[User:taavi]] (and revert any/all of this freely!) 2426659 wikitext text/x-wiki ed5s9z207nctrr5wuzzqf6ibjuyz1yi 0 460331 2426761 2426602 2026-06-15T08:50:12Z Tgr (WMF) 39134 Remove the part about wgServer beginning with a slash - it starts with // (protocol-relative), that should work fine without prefixing. Add some information about linking to special pages. 2426761 wikitext text/x-wiki 5vrd2ixw544ob2wodwitvz3ux5yud0k 2426762 2426761 2026-06-15T08:50:32Z Tgr (WMF) 39134 /* Developing JS code running on auth.wikimedia.org */ 2426762 wikitext text/x-wiki 4c4ctksw3lk4gt7oqll0erjx884uvhv 10 460334 2426661 2026-06-14T23:14:55Z Star walker 40724 new licence 2426661 wikitext text/x-wiki g6s0hgk6re67cp5qw3di2jxd71owav0 3 460335 2426690 2026-06-15T06:20:49Z StrikerBot 8475 Welcome to Toolforge! 2426690 wikitext text/x-wiki pzhcz4b96og6f58ytsqh1ox5c1fii9i 0 460336 2426746 2026-06-15T08:35:38Z ABran-WMF 37196 Created page with "== SSH hostname migration: gitlab-ssh.wikimedia.org == As part of moving GitLab's web traffic behind the Wikimedia CDN ([[phab:T425441|T425441]]), '''SSH access to GitLab is moving to a dedicated hostname''': <code>gitlab-ssh.wikimedia.org</code>. HTTPS (web UI, clones over <code>https://</code>, API) stays on <code>gitlab.wikimedia.org</code> and is not affected. Both hostnames currently resolve to the same server and serve the '''same SSH host key''', so you can migr..." 2426746 wikitext text/x-wiki 296lq2sxjp3ay1bnieynukyvrknxq66 2426754 2426746 2026-06-15T08:41:22Z ABran-WMF 37196 2426754 wikitext text/x-wiki e64rujm6c43uxtnjjq04lxobtfubxt7 2 460337 2426748 2026-06-15T08:36:13Z FNegri-WMF 32595 Create new page with my notes from PyCon 2426748 wikitext text/x-wiki apq905qejh5fjo8hdo7q3sfe3k2fcp7