Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.46.0-wmf.26 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 0 4108 2408065 2407929 2026-04-30T12:41:17Z ScheduleDeploymentBot 37566 Add [[gerrit:1280386]] to Thursday, April 30 UTC afternoon backport window 2408065 wikitext text/x-wiki p5z3dza54ttabtruftuer4to0ibepl3 2408083 2408065 2026-04-30T13:04:21Z ScheduleDeploymentBot 37566 Add [[gerrit:1280387]] to Thursday, April 30 UTC afternoon backport window 2408083 wikitext text/x-wiki gzl8ypxu995lsh0u3qn0agpjiynixjy 2408085 2408083 2026-04-30T13:09:00Z SGimeno (WMF) 27243 /* {{Deployment_day|date=2026-04-30}} */ 2408085 wikitext text/x-wiki 7krz7jm1uvup2f8umw5zl6kpq98k4yc 2408095 2408085 2026-04-30T13:24:09Z ScheduleDeploymentBot 37566 Add [[gerrit:1279477]] to Thursday, April 30 UTC late backport window 2408095 wikitext text/x-wiki hi486jr9lwk85zoxn6omrd44pgos7fk 2408097 2408095 2026-04-30T13:30:01Z ScheduleDeploymentBot 37566 Add [[gerrit:1247186]] to Thursday, April 30 UTC late backport window 2408097 wikitext text/x-wiki k4wg0rz959o2sics82rh9afl0uruzt5 2408126 2408097 2026-04-30T14:12:23Z ScheduleDeploymentBot 37566 Add [[gerrit:1236361]] to Thursday, April 30 UTC late backport window 2408126 wikitext text/x-wiki hsj8hp3m4dkebeyjuzht54ukc1upg4x 2408150 2408126 2026-04-30T14:35:39Z ScheduleDeploymentBot 37566 Add [[gerrit:1280449]] to Thursday, April 30 UTC late backport window 2408150 wikitext text/x-wiki iwm7k58213kfubhnt6u4rgtiar2qwpd 2408207 2408150 2026-04-30T16:32:15Z ScheduleDeploymentBot 37566 Add [[gerrit:1280516]] to Thursday, April 30 UTC late backport window 2408207 wikitext text/x-wiki eqst8nx7mlntbjz8mxmm9aioy1ubf3q 2408237 2408207 2026-04-30T18:09:00Z ScheduleDeploymentBot 37566 Add [[gerrit:1280552]] to Thursday, April 30 UTC late backport window 2408237 wikitext text/x-wiki nprhgh35k6zmn6r0p9wb8l10kpvv7ox 2408262 2408237 2026-04-30T20:12:05Z ScheduleDeploymentBot 37566 Add [[gerrit:1280657]] to Thursday, April 30 UTC late backport window 2408262 wikitext text/x-wiki 28yh8mfrphd2fytnigpguwsyi47fu9i 2408263 2408262 2026-04-30T20:12:31Z ScheduleDeploymentBot 37566 Add [[gerrit:1280656]] to Thursday, April 30 UTC late backport window 2408263 wikitext text/x-wiki a5g8a6ah1dmnmoyom99wwo78uj8b7bo 0 4673 2408304 2397727 2026-05-01T00:11:30Z JrandWP 37706 /* 2025-present */ archive April 2026 2408304 wikitext text/x-wiki 7y7appzfg4797t2ut6phlf6mhacy7li 0 7919 2408021 2408020 2026-04-30T12:00:38Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1159', diff saved to https://phabricator.wikimedia.org/P92045 and previous config saved to /var/cache/conftool/dbconfig/20260430-120036-fceratto.json 2408021 wikitext text/x-wiki 9qspea0w4c2dq6y2woccex38jhflhfy 2408022 2408021 2026-04-30T12:00:55Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1377.eqiad.wmnet with reason: host reimage 2408022 wikitext text/x-wiki gbdb5qr87uih2fdpfuo0wb3jz3nb30u 2408023 2408022 2026-04-30T12:03:02Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2408023 wikitext text/x-wiki 2hkandn0e3qb1fadv058ecpymnc2skk 2408024 2408023 2026-04-30T12:04:06Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1378.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408024 wikitext text/x-wiki 04o75hizg73rjxrrxcv171ltnwzcq5d 2408025 2408024 2026-04-30T12:04:55Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker1378.eqiad.wmnet with OS trixie 2408025 wikitext text/x-wiki aw1aokq02bgyfvbnp0umr959t0z4v9w 2408026 2408025 2026-04-30T12:05:21Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host bast5005.wikimedia.org with OS trixie 2408026 wikitext text/x-wiki 0axjkzfa33ivtkxxqx7xgn4gwmxa3ja 2408027 2408026 2026-04-30T12:05:24Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host bast5005.wikimedia.org 2408027 wikitext text/x-wiki jnl6ysfv1d7z6jfqjb26p56a43rmuam 2408028 2408027 2026-04-30T12:07:22Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2203', diff saved to https://phabricator.wikimedia.org/P92046 and previous config saved to /var/cache/conftool/dbconfig/20260430-120720-fceratto.json 2408028 wikitext text/x-wiki qt53j3t7rh7hvektouni86fegzef9ab 2408029 2408028 2026-04-30T12:10:48Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1159 (T419635)', diff saved to https://phabricator.wikimedia.org/P92048 and previous config saved to /var/cache/conftool/dbconfig/20260430-121044-fceratto.json 2408029 wikitext text/x-wiki 647kpgef6404ti6f41mvblfj1dvrmyf 2408030 2408029 2026-04-30T12:11:04Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1161.eqiad.wmnet with reason: Maintenance 2408030 wikitext text/x-wiki 6x13y2xe95413bhm6h7ouzlsfj7n9oe 2408031 2408030 2026-04-30T12:11:11Z Stashbot 7414 moritzm: installing gdk-pixbuf security updates 2408031 wikitext text/x-wiki 1lqfra0tyzpwnisvmnwrd3gjqxuq0xi 2408032 2408031 2026-04-30T12:11:24Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1016,1020].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance 2408032 wikitext text/x-wiki id66kd92bd9kbyvtxrezsrz2pm8gj38 2408033 2408032 2026-04-30T12:11:34Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1161 (T419635)', diff saved to https://phabricator.wikimedia.org/P92049 and previous config saved to /var/cache/conftool/dbconfig/20260430-121130-fceratto.json 2408033 wikitext text/x-wiki gixs6zdu2f0wzhsrya60hrefkmupyv6 2408034 2408033 2026-04-30T12:13:44Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1161 (T419635)', diff saved to https://phabricator.wikimedia.org/P92050 and previous config saved to /var/cache/conftool/dbconfig/20260430-121340-fceratto.json 2408034 wikitext text/x-wiki 1ptfqv650325svgotynmqf7n1h1cihe 2408035 2408034 2026-04-30T12:17:17Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" 2408035 wikitext text/x-wiki b6y8pl63nx09ymbcomoxdfqtnkb7oh5 2408036 2408035 2026-04-30T12:17:31Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2203 (T419961)', diff saved to https://phabricator.wikimedia.org/P92051 and previous config saved to /var/cache/conftool/dbconfig/20260430-121728-fceratto.json 2408036 wikitext text/x-wiki loba2f9eupf4m0er6dn6q08jbtd1epc 2408037 2408036 2026-04-30T12:17:53Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2216.codfw.wmnet with reason: Maintenance 2408037 wikitext text/x-wiki 97suiha1peb7ol4y1wrw2g4gb46l3gp 2408038 2408037 2026-04-30T12:18:01Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db2216 (T419961)', diff saved to https://phabricator.wikimedia.org/P92052 and previous config saved to /var/cache/conftool/dbconfig/20260430-121758-fceratto.json 2408038 wikitext text/x-wiki 0se1fbvfg5vr00qokbxkzzr4q35303a 2408039 2408038 2026-04-30T12:19:18Z Stashbot 7414 urbanecm@deploy1003: Started scap sync-world: Backport for [[gerrit:1280368|ReassignMentees: Add logging information (T418194)]], [[gerrit:1280370|ReassignMentees: Add logging information (T418194)]] 2408039 wikitext text/x-wiki ixnmh8a7fe8rxbunl74qr06pz6ckzov 2408040 2408039 2026-04-30T12:19:21Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of ncredir4003.ulsfo.wmnet to plain 2408040 wikitext text/x-wiki nkf0b930gjvh23la3fogfxz0r0dzrte 2408041 2408040 2026-04-30T12:20:08Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ncredir4003.ulsfo.wmnet to plain 2408041 wikitext text/x-wiki 8ja4i96iq3xvk93t1zblnqwz7g4fzup 2408042 2408041 2026-04-30T12:21:10Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Backport for [[gerrit:1280368|ReassignMentees: Add logging information (T418194)]], [[gerrit:1280370|ReassignMentees: Add logging information (T418194)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2408042 wikitext text/x-wiki b7nnd0lbzse0a36iru2rm5uha3p6ei9 2408043 2408042 2026-04-30T12:21:55Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of ncredir4004.ulsfo.wmnet to plain 2408043 wikitext text/x-wiki o4y01fuh3sqommhawgg3zgs13cmm2th 2408046 2408043 2026-04-30T12:23:39Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ncredir4004.ulsfo.wmnet to plain 2408046 wikitext text/x-wiki bkluarkej3hqnywpjlpy75dfkezjfez 2408047 2408046 2026-04-30T12:23:47Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Continuing with deployment 2408047 wikitext text/x-wiki ddtp4w8qqxwcdejai5ickzxlfsqfv4o 2408048 2408047 2026-04-30T12:23:50Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1161', diff saved to https://phabricator.wikimedia.org/P92053 and previous config saved to /var/cache/conftool/dbconfig/20260430-122348-fceratto.json 2408048 wikitext text/x-wiki jzr3m4o71jx6bbea96meq9yb9gtq6yq 2408050 2408048 2026-04-30T12:24:32Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2205: after reimage to trixie 2408050 wikitext text/x-wiki dozfcgwnxc9cpvdfeim2yuq3uagdn25 2408051 2408050 2026-04-30T12:25:19Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2216 (T419961)', diff saved to https://phabricator.wikimedia.org/P92055 and previous config saved to /var/cache/conftool/dbconfig/20260430-122516-fceratto.json 2408051 wikitext text/x-wiki 7xebiuq9jxamo3u4pwo1y0sg8hti2lj 2408053 2408051 2026-04-30T12:28:24Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of prometheus4003.ulsfo.wmnet to plain 2408053 wikitext text/x-wiki 9atc23q4xl48yujpdl0yelecd2m7kre 2408054 2408053 2026-04-30T12:28:52Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of prometheus4003.ulsfo.wmnet to plain 2408054 wikitext text/x-wiki 9a5fri6tfrd0yvh1fkcw3z3yfowuq61 2408055 2408054 2026-04-30T12:29:49Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: correct typo with reverse for mr1-ulsfo address - cmooney@cumin1003" 2408055 wikitext text/x-wiki t5pb10bopr4pclo9jmk99i2jld3q93p 2408056 2408055 2026-04-30T12:32:29Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of netflow4003.ulsfo.wmnet to plain 2408056 wikitext text/x-wiki py1v7if23bocc0slk1zyu77dw8vdw74 2408057 2408056 2026-04-30T12:33:59Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1161', diff saved to https://phabricator.wikimedia.org/P92056 and previous config saved to /var/cache/conftool/dbconfig/20260430-123356-fceratto.json 2408057 wikitext text/x-wiki 9h9kwvp09be1x9sooj59984zat5llqi 2408058 2408057 2026-04-30T12:34:02Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: correct typo with reverse for mr1-ulsfo address - cmooney@cumin1003" 2408058 wikitext text/x-wiki a68b0soyaks46anpx4lo9zaq3awyv3g 2408059 2408058 2026-04-30T12:34:04Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2408059 wikitext text/x-wiki ml8t0t6owayto0fe85525u2gcioy4ji 2408060 2408059 2026-04-30T12:34:39Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of netflow4003.ulsfo.wmnet to plain 2408060 wikitext text/x-wiki 2geo7iipm2ojfy8kcxxuflbxowntgsy 2408061 2408060 2026-04-30T12:35:27Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2216', diff saved to https://phabricator.wikimedia.org/P92057 and previous config saved to /var/cache/conftool/dbconfig/20260430-123524-fceratto.json 2408061 wikitext text/x-wiki dqx5wtc2mbg6vpcf6k6ylmfhhhica6s 2408063 2408061 2026-04-30T12:37:58Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" 2408063 wikitext text/x-wiki 6cqz16yw450pp0qpqrdkv88yxqk7w16 2408064 2408063 2026-04-30T12:38:01Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1377.eqiad.wmnet with OS trixie 2408064 wikitext text/x-wiki o5ze6kuhtqp7zuk1n1mo3non9y44w6b 2408066 2408064 2026-04-30T12:44:08Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1161 (T419635)', diff saved to https://phabricator.wikimedia.org/P92058 and previous config saved to /var/cache/conftool/dbconfig/20260430-124405-fceratto.json 2408066 wikitext text/x-wiki o883eti67umrpgjjof4inlh4omzpu8p 2408067 2408066 2026-04-30T12:44:24Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1185.eqiad.wmnet with reason: Maintenance 2408067 wikitext text/x-wiki j4cb7cq8vmy0jka7i44w0i4evvzdtg7 2408068 2408067 2026-04-30T12:44:33Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1185 (T419635)', diff saved to https://phabricator.wikimedia.org/P92059 and previous config saved to /var/cache/conftool/dbconfig/20260430-124429-fceratto.json 2408068 wikitext text/x-wiki pcco3nndyg4rhat5scvpprnefo1f1bm 2408069 2408068 2026-04-30T12:45:34Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2216', diff saved to https://phabricator.wikimedia.org/P92060 and previous config saved to /var/cache/conftool/dbconfig/20260430-124532-fceratto.json 2408069 wikitext text/x-wiki 1oghb21x7z500tfzt6wtqn7rq877d2p 2408070 2408069 2026-04-30T12:45:43Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1185 (T419635)', diff saved to https://phabricator.wikimedia.org/P92061 and previous config saved to /var/cache/conftool/dbconfig/20260430-124539-fceratto.json 2408070 wikitext text/x-wiki 3y1rfjxgwbudl15zb8aiqkxy3nqhmno 2408072 2408070 2026-04-30T12:49:38Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of hcaptcha-proxy4003.wikimedia.org to plain 2408072 wikitext text/x-wiki 5zibq5imbt3kh1c37wlc786rtpu9vw5 2408073 2408072 2026-04-30T12:50:41Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of hcaptcha-proxy4003.wikimedia.org to plain 2408073 wikitext text/x-wiki cqzn2xcwnep6b0w4njcr0qdr35f2zh0 2408074 2408073 2026-04-30T12:50:50Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2408074 wikitext text/x-wiki ghg8ck3nprweohv972toff2amio1pki 2408075 2408074 2026-04-30T12:50:58Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2408075 wikitext text/x-wiki ocv6gh9uod4rgv2bqn9m48ba6xnyl71 2408076 2408075 2026-04-30T12:55:43Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2216 (T419961)', diff saved to https://phabricator.wikimedia.org/P92062 and previous config saved to /var/cache/conftool/dbconfig/20260430-125540-fceratto.json 2408076 wikitext text/x-wiki t08zni1iivwm0cheofa9cml88fqxooo 2408077 2408076 2026-04-30T12:55:50Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1185', diff saved to https://phabricator.wikimedia.org/P92063 and previous config saved to /var/cache/conftool/dbconfig/20260430-125547-fceratto.json 2408077 wikitext text/x-wiki f3dmm2yt36wbcm8kf3nax7xbzg55lpk 2408078 2408077 2026-04-30T13:00:00Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [eqiad] START helmfile.d/services/changeprop: sync 2408078 wikitext text/x-wiki 9pyhu6nzdyd1bdsdgpxx4m8g9wc2cs9 2408079 2408078 2026-04-30T13:00:39Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [eqiad] DONE helmfile.d/services/changeprop: sync 2408079 wikitext text/x-wiki 1mexyx73ksqpnzccp0yei1tzreyyn9h 2408080 2408079 2026-04-30T13:00:42Z Stashbot 7414 moritzm: temporarily remove ganeti4008 from the ulsfo02 Ganeti cluster in preparation of forthcoming switch maintenance in ulsfo T424686 2408080 wikitext text/x-wiki 6oei32mymetavn3m974w0a08yx5iti5 2408081 2408080 2026-04-30T13:01:01Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop: sync 2408081 wikitext text/x-wiki 50c1l1atndusrj8k0c90284q7uyvwgn 2408082 2408081 2026-04-30T13:01:26Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop: sync 2408082 wikitext text/x-wiki ar8le7aln57tqk6dw0jopoz6z3vqtpz 2408084 2408082 2026-04-30T13:05:58Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1185', diff saved to https://phabricator.wikimedia.org/P92064 and previous config saved to /var/cache/conftool/dbconfig/20260430-130556-fceratto.json 2408084 wikitext text/x-wiki ng0b3rawrj2t25l6gr0t0wrd4ul7bj3 2408086 2408084 2026-04-30T13:12:43Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1186.eqiad.wmnet with reason: Maintenance 2408086 wikitext text/x-wiki eara2qyyeendns3x3qs9udz5dqnv1by 2408087 2408086 2026-04-30T13:12:52Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1186 (T419961)', diff saved to https://phabricator.wikimedia.org/P92065 and previous config saved to /var/cache/conftool/dbconfig/20260430-131249-fceratto.json 2408087 wikitext text/x-wiki hqupiuahuf3b6s824m5ilzqm8imz4e8 2408089 2408087 2026-04-30T13:16:08Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1185 (T419635)', diff saved to https://phabricator.wikimedia.org/P92066 and previous config saved to /var/cache/conftool/dbconfig/20260430-131604-fceratto.json 2408089 wikitext text/x-wiki tie0rk1fhr9mhfhyo4lvage6x6yjb14 2408090 2408089 2026-04-30T13:16:24Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1200.eqiad.wmnet with reason: Maintenance 2408090 wikitext text/x-wiki 8weefsi6h3n8n2nskluyjabhxl3vmnp 2408091 2408090 2026-04-30T13:16:33Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1200 (T419635)', diff saved to https://phabricator.wikimedia.org/P92067 and previous config saved to /var/cache/conftool/dbconfig/20260430-131629-fceratto.json 2408091 wikitext text/x-wiki 83fhx1gfxnkiqxz1bkzlvp7tqgp9a5c 2408092 2408091 2026-04-30T13:17:43Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1200 (T419635)', diff saved to https://phabricator.wikimedia.org/P92068 and previous config saved to /var/cache/conftool/dbconfig/20260430-131739-fceratto.json 2408092 wikitext text/x-wiki qg19apsq5e8c1x8gccvh5yxn0f5kapu 2408094 2408092 2026-04-30T13:21:16Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1186 (T419961)', diff saved to https://phabricator.wikimedia.org/P92069 and previous config saved to /var/cache/conftool/dbconfig/20260430-132114-fceratto.json 2408094 wikitext text/x-wiki 3peibwfwdzzkztxzi7ol19hpkakkwxj 2408096 2408094 2026-04-30T13:27:51Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1200', diff saved to https://phabricator.wikimedia.org/P92070 and previous config saved to /var/cache/conftool/dbconfig/20260430-132747-fceratto.json 2408096 wikitext text/x-wiki 8cit6yd2s3fs5jc388gba5gfyvfm1qs 2408098 2408096 2026-04-30T13:31:24Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1186', diff saved to https://phabricator.wikimedia.org/P92071 and previous config saved to /var/cache/conftool/dbconfig/20260430-133122-fceratto.json 2408098 wikitext text/x-wiki buohjvbzbscclkgldsa1ayyrxrn41ma 2408099 2408098 2026-04-30T13:34:37Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2408099 wikitext text/x-wiki cg9isdeiq2ycd09utuenydugccsv4xe 2408100 2408099 2026-04-30T13:35:11Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2408100 wikitext text/x-wiki 76aj6ez0qqx8jwwno69asowtkiqe4nv 2408101 2408100 2026-04-30T13:37:59Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1200', diff saved to https://phabricator.wikimedia.org/P92072 and previous config saved to /var/cache/conftool/dbconfig/20260430-133756-fceratto.json 2408101 wikitext text/x-wiki bjuxtdq103tq0nk3zvmksb37uurt9xs 2408102 2408101 2026-04-30T13:41:34Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1186', diff saved to https://phabricator.wikimedia.org/P92073 and previous config saved to /var/cache/conftool/dbconfig/20260430-134130-fceratto.json 2408102 wikitext text/x-wiki q2k4rbzjuwi7fyckkvyzclyfw2exi3u 2408103 2408102 2026-04-30T13:45:34Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2408103 wikitext text/x-wiki p8s1r8woomfkaq7o3zg2nq1jfh5oc0w 2408104 2408103 2026-04-30T13:45:50Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2408104 wikitext text/x-wiki nq4h7avog9h6p9txivq5elxx4fn8o4u 2408105 2408104 2026-04-30T13:48:09Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1200 (T419635)', diff saved to https://phabricator.wikimedia.org/P92074 and previous config saved to /var/cache/conftool/dbconfig/20260430-134804-fceratto.json 2408105 wikitext text/x-wiki 69fcoos4oyro75s5j5i8j6p8nakuyhq 2408106 2408105 2026-04-30T13:48:23Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1207.eqiad.wmnet with reason: Maintenance 2408106 wikitext text/x-wiki 5qji836okg3g87urvdakssojzp0of55 2408107 2408106 2026-04-30T13:48:34Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1207 (T419635)', diff saved to https://phabricator.wikimedia.org/P92075 and previous config saved to /var/cache/conftool/dbconfig/20260430-134829-fceratto.json 2408107 wikitext text/x-wiki gryrqopx0v8ijjfgqf4t195gc6r039i 2408108 2408107 2026-04-30T13:50:44Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1207 (T419635)', diff saved to https://phabricator.wikimedia.org/P92076 and previous config saved to /var/cache/conftool/dbconfig/20260430-135040-fceratto.json 2408108 wikitext text/x-wiki 25q96e41k1bn1wuxaajyk1k15j15bz0 2408109 2408108 2026-04-30T13:51:41Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1186 (T419961)', diff saved to https://phabricator.wikimedia.org/P92077 and previous config saved to /var/cache/conftool/dbconfig/20260430-135139-fceratto.json 2408109 wikitext text/x-wiki jp7t5tcm46wr1i6unwnx74n9bljj8g2 2408110 2408109 2026-04-30T13:52:01Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1195.eqiad.wmnet with reason: Maintenance 2408110 wikitext text/x-wiki 9eb5acku4fdl2q5znq3ss4kujqpgeuo 2408111 2408110 2026-04-30T13:52:10Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1195 (T419961)', diff saved to https://phabricator.wikimedia.org/P92078 and previous config saved to /var/cache/conftool/dbconfig/20260430-135207-fceratto.json 2408111 wikitext text/x-wiki 84ml8a6aqnswrht0lyu35157fr7jonh 2408112 2408111 2026-04-30T13:54:02Z Stashbot 7414 herron@cumin1003: START - Cookbook sre.hosts.reimage for host kafka-logging2005.codfw.wmnet with OS trixie 2408112 wikitext text/x-wiki sy6pyxj4krgwau0ga8dqidhciqzrldm 2408113 2408112 2026-04-30T13:54:31Z Stashbot 7414 herron@cumin1003: START - Cookbook sre.hosts.move-vlan for host kafka-logging2005 2408113 wikitext text/x-wiki 3l03fyytuxu8u6qjg1n934msi54grgu 2408114 2408113 2026-04-30T14:00:33Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1195 (T419961)', diff saved to https://phabricator.wikimedia.org/P92079 and previous config saved to /var/cache/conftool/dbconfig/20260430-140030-fceratto.json 2408114 wikitext text/x-wiki h4y80q3rpo41epx9m9nkxoj2ofufvoj 2408115 2408114 2026-04-30T14:00:51Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1207', diff saved to https://phabricator.wikimedia.org/P92080 and previous config saved to /var/cache/conftool/dbconfig/20260430-140048-fceratto.json 2408115 wikitext text/x-wiki c84l6b5tkapv49bxjyvwr15cncb6mb5 2408116 2408115 2026-04-30T14:05:41Z Stashbot 7414 herron@cumin1003: START - Cookbook sre.dns.netbox 2408116 wikitext text/x-wiki pisqho983rsi77580d3adtt9822ahr4 2408117 2408116 2026-04-30T14:10:40Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1195', diff saved to https://phabricator.wikimedia.org/P92081 and previous config saved to /var/cache/conftool/dbconfig/20260430-141038-fceratto.json 2408117 wikitext text/x-wiki gs3uhlah99htg0mli8sx0on249acye0 2408118 2408117 2026-04-30T14:10:59Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1207', diff saved to https://phabricator.wikimedia.org/P92082 and previous config saved to /var/cache/conftool/dbconfig/20260430-141057-fceratto.json 2408118 wikitext text/x-wiki lr1evht9pxhv4gek2773aw8iqss94lt 2408119 2408118 2026-04-30T14:11:05Z Stashbot 7414 herron@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host kafka-logging2005 - herron@cumin1003" 2408119 wikitext text/x-wiki br5imxd0gmsfq2jrw2tdfog027m5v0b 2408120 2408119 2026-04-30T14:11:11Z Stashbot 7414 herron@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host kafka-logging2005 - herron@cumin1003" 2408120 wikitext text/x-wiki rorurv8bahh8l6pjka9vtrjrpa95pi1 2408121 2408120 2026-04-30T14:11:13Z Stashbot 7414 herron@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2408121 wikitext text/x-wiki p3xbbssjsytd4js1u6bvzdezxnt383h 2408122 2408121 2026-04-30T14:11:16Z Stashbot 7414 herron@cumin1003: START - Cookbook sre.dns.wipe-cache kafka-logging2005.codfw.wmnet 85.48.192.10.in-addr.arpa 5.8.0.0.8.4.0.0.2.9.1.0.0.1.0.0.4.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2408122 wikitext text/x-wiki pjvdq5nknbpva5v9ywbtgy5ypnzpzb1 2408123 2408122 2026-04-30T14:11:19Z Stashbot 7414 herron@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) kafka-logging2005.codfw.wmnet 85.48.192.10.in-addr.arpa 5.8.0.0.8.4.0.0.2.9.1.0.0.1.0.0.4.0.1.0.0.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2408123 wikitext text/x-wiki g0wz8vrci1bg874xrzkv7ptg4llfgj7 2408124 2408123 2026-04-30T14:11:22Z Stashbot 7414 herron@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host kafka-logging2005 2408124 wikitext text/x-wiki cyra2zc9vmj9k3bok7uu9tfk93zkgz3 2408125 2408124 2026-04-30T14:12:23Z Stashbot 7414 herron@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host kafka-logging2005 2408125 wikitext text/x-wiki nxolh6ertxdtyc09vnr8t04e46284gl 2408127 2408125 2026-04-30T14:12:25Z Stashbot 7414 herron@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host kafka-logging2005 2408127 wikitext text/x-wiki qk3jvlywo5u4l28ev2p65r50mp40boh 2408128 2408127 2026-04-30T14:20:48Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1195', diff saved to https://phabricator.wikimedia.org/P92083 and previous config saved to /var/cache/conftool/dbconfig/20260430-142046-fceratto.json 2408128 wikitext text/x-wiki s1a3wvtkw8c4sgbdeo7idof6a1918js 2408129 2408128 2026-04-30T14:21:08Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1207 (T419635)', diff saved to https://phabricator.wikimedia.org/P92084 and previous config saved to /var/cache/conftool/dbconfig/20260430-142105-fceratto.json 2408129 wikitext text/x-wiki ceiykggnw4063ssb51co2hoi0me3nne 2408130 2408129 2026-04-30T14:21:13Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1216.eqiad.wmnet with reason: Maintenance 2408130 wikitext text/x-wiki jnmdb89vmv2ckaqllc1m8od0v8lsgu4 2408132 2408130 2026-04-30T14:22:44Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker1378.eqiad.wmnet with OS trixie 2408132 wikitext text/x-wiki 6891b39tbbolbc2gtgwhuc8ye53p9nv 2408133 2408132 2026-04-30T14:24:00Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408133 wikitext text/x-wiki q02173kxilbcwvkeut6vomg8ucxn4hy 2408134 2408133 2026-04-30T14:24:55Z Stashbot 7414 elukey@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408134 wikitext text/x-wiki 19x1wiwfnbyq0h1pg3xgjy3xcqe8878 2408135 2408134 2026-04-30T14:25:15Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408135 wikitext text/x-wiki 48c0epact0lbxzkh4wupf8r9vd65j4k 2408136 2408135 2026-04-30T14:25:50Z Stashbot 7414 elukey@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408136 wikitext text/x-wiki 7fkpngl2ju2q5dmbfg8hico01dqp27a 2408137 2408136 2026-04-30T14:26:33Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1230.eqiad.wmnet with reason: Maintenance 2408137 wikitext text/x-wiki gmj9h2vysktroot01karlvgju9agzhk 2408138 2408137 2026-04-30T14:26:52Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1230 (T419635)', diff saved to Unable to send diff to phaste and previous config saved to /var/cache/conftool/dbconfig/20260430-142639-fceratto.json 2408138 wikitext text/x-wiki nuciu9ium7xbelycqvokqarfgpxkcy3 2408139 2408138 2026-04-30T14:27:34Z Stashbot 7414 herron@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-logging2005.codfw.wmnet with reason: host reimage 2408139 wikitext text/x-wiki egafyp0akj9x3znh7jkmwcnjjm4lssu 2408140 2408139 2026-04-30T14:30:50Z Stashbot 7414 urbanecm@deploy1003: Finished scap sync-world: Backport for [[gerrit:1280368|ReassignMentees: Add logging information (T418194)]], [[gerrit:1280370|ReassignMentees: Add logging information (T418194)]] (duration: 131m 31s) 2408140 wikitext text/x-wiki efukpui1utnopiqkc7senwk8q3pwo1j 2408141 2408140 2026-04-30T14:30:57Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1195 (T419961)', diff saved to https://phabricator.wikimedia.org/P92086 and previous config saved to /var/cache/conftool/dbconfig/20260430-143054-fceratto.json 2408141 wikitext text/x-wiki b1bj1twx6hl9y4vqey7j49minugjago 2408142 2408141 2026-04-30T14:31:15Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.252.0" for 2 host(s) 2408142 wikitext text/x-wiki 33oprt2lzf37k6iqkb6pmzdpnxlrqhx 2408143 2408142 2026-04-30T14:31:18Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1196.eqiad.wmnet with reason: Maintenance 2408143 wikitext text/x-wiki tfdtwv84tnjbaq3yi2pllsn1pxstlk6 2408144 2408143 2026-04-30T14:31:37Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1013,1017].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance 2408144 wikitext text/x-wiki 6oz7ofisjfdk8zawyl84vopy4f9ksyl 2408145 2408144 2026-04-30T14:31:46Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1196 (T419961)', diff saved to https://phabricator.wikimedia.org/P92087 and previous config saved to /var/cache/conftool/dbconfig/20260430-143143-fceratto.json 2408145 wikitext text/x-wiki rr9b67vq0azduayaz0gfwmrul5vv20m 2408146 2408145 2026-04-30T14:33:02Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.252.0" completed for 2 hosts 2408146 wikitext text/x-wiki 6bq5y3799sp6x9s8oirjv8mqi65qvn3 2408147 2408146 2026-04-30T14:33:33Z Stashbot 7414 herron@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-logging2005.codfw.wmnet with reason: host reimage 2408147 wikitext text/x-wiki biwv6e3subd7p8enpfudofkukkiduq7 2408148 2408147 2026-04-30T14:34:35Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.255.0" for 2 host(s) 2408148 wikitext text/x-wiki oxndtto9iql2vwl9ca88v9wd01nc82f 2408149 2408148 2026-04-30T14:34:38Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1378.eqiad.wmnet with reason: host reimage 2408149 wikitext text/x-wiki q5m7bx6t95raplp8srkh9cfc00hh643 2408151 2408149 2026-04-30T14:36:15Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.255.0" completed for 2 hosts 2408151 wikitext text/x-wiki 4pjw5pm58c51p7q31un4frn5s1t99ju 2408152 2408151 2026-04-30T14:37:54Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1378.eqiad.wmnet with reason: host reimage 2408152 wikitext text/x-wiki 134pozudy59tgxrgk3i024iqx1bzdo4 2408153 2408152 2026-04-30T14:41:08Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1196 (T419961)', diff saved to https://phabricator.wikimedia.org/P92088 and previous config saved to /var/cache/conftool/dbconfig/20260430-144105-fceratto.json 2408153 wikitext text/x-wiki n7l1ilo65glzytwo7jrfyig2i4id35p 2408154 2408153 2026-04-30T14:41:20Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2408154 wikitext text/x-wiki 7a21izn1pt2zje3g60qt10o11ozcebw 2408155 2408154 2026-04-30T14:41:27Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2408155 wikitext text/x-wiki f40t35ohc3nwl0wn3q7t1rzqvgajpua 2408156 2408155 2026-04-30T14:41:51Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408156 wikitext text/x-wiki jg48rd5gyl004f88yuavf0drnx99wxx 2408157 2408156 2026-04-30T14:42:28Z Stashbot 7414 elukey@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408157 wikitext text/x-wiki 2eafi9o4rwuozzfe3qzolcp3r6rsub7 2408158 2408157 2026-04-30T14:45:50Z Stashbot 7414 moritzm: installing pdns security updates 2408158 wikitext text/x-wiki aeyjzeu8srzbuu9odz6qhdr68xfb89p 2408160 2408158 2026-04-30T14:47:47Z Stashbot 7414 akhatun@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply 2408160 wikitext text/x-wiki oyfvhyo5v3q9urcty80ud33fe39299y 2408162 2408160 2026-04-30T14:51:14Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1196', diff saved to https://phabricator.wikimedia.org/P92089 and previous config saved to /var/cache/conftool/dbconfig/20260430-145112-fceratto.json 2408162 wikitext text/x-wiki 7no5p4u1o0vqeavdndwefpbr57302qt 2408163 2408162 2026-04-30T14:53:03Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1279453|Increase Parsoid Read Views to 60% of enwiki mobile web traffic (T424880)]] 2408163 wikitext text/x-wiki a575422uidwfzzs9fc7fb81egcadexx 2408164 2408163 2026-04-30T14:53:38Z Stashbot 7414 akhatun@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply 2408164 wikitext text/x-wiki 4uen7ls2gf6itil6in7xi50pdcl9qif 2408165 2408164 2026-04-30T14:54:05Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" 2408165 wikitext text/x-wiki q2ebezdsq9tqgx7wmvcsv7l5ytrs5xa 2408166 2408165 2026-04-30T14:54:58Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1279453|Increase Parsoid Read Views to 60% of enwiki mobile web traffic (T424880)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2408166 wikitext text/x-wiki 33ltohdshk4o1sher8zosoar8h3x015 2408167 2408166 2026-04-30T14:55:35Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - jclark@cumin1003" 2408167 wikitext text/x-wiki 3xv5nxm3pf4o014x9nahf6f2thrlrr9 2408168 2408167 2026-04-30T14:55:38Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1378.eqiad.wmnet with OS trixie 2408168 wikitext text/x-wiki jvp8kuh8akcu0zf87zw5qri9xlyg1ra 2408169 2408168 2026-04-30T14:59:41Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2408169 wikitext text/x-wiki fvau1xhw4cqyroavvol7bx07i2z2rfj 2408170 2408169 2026-04-30T14:59:54Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2408170 wikitext text/x-wiki 6jzougtakm72ycsr4lp6fyu628pwsz9 2408171 2408170 2026-04-30T15:01:23Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1196', diff saved to https://phabricator.wikimedia.org/P92091 and previous config saved to /var/cache/conftool/dbconfig/20260430-150120-fceratto.json 2408171 wikitext text/x-wiki kgix42pd2gz2daxvidr9tugd2u3v98t 2408172 2408171 2026-04-30T15:02:31Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2408172 wikitext text/x-wiki c7ym59rod67eotb9924y2g862jkiwon 2408173 2408172 2026-04-30T15:03:13Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2408173 wikitext text/x-wiki 88x2fhdb4pzlkdy9z6hp8ycd62l3yty 2408174 2408173 2026-04-30T15:04:44Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2408174 wikitext text/x-wiki ifj75sljdiqv1znqy88a9gvifl0rsz1 2408175 2408174 2026-04-30T15:05:23Z Stashbot 7414 eevans@deploy1003: helmfile [staging] START helmfile.d/services/linked-artifacts: apply 2408175 wikitext text/x-wiki m7fp1p2wvup5hbwg27ejrzgzd9mrufc 2408176 2408175 2026-04-30T15:05:38Z Stashbot 7414 eevans@deploy1003: helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply 2408176 wikitext text/x-wiki mt9srn7mtcbq6kk70qpwy83txrs8vij 2408177 2408176 2026-04-30T15:06:18Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1279453|Increase Parsoid Read Views to 60% of enwiki mobile web traffic (T424880)]] (duration: 13m 15s) 2408177 wikitext text/x-wiki 6plnsse8tn0e5xa1w9g5mmmf5nh20l1 2408178 2408177 2026-04-30T15:06:43Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2408178 wikitext text/x-wiki jkk8t42gkgcwc6zfijgb5bwn4d9uhz8 2408179 2408178 2026-04-30T15:09:00Z Stashbot 7414 bearloga@deploy1003: Started scap sync-world: Backport for [[gerrit:1270454|EventStreamConfig: remove ABST contextual attribute (T422001)]] 2408179 wikitext text/x-wiki 5dxiodfcdqhnm1e20k5qm2n5e7j00uo 2408180 2408179 2026-04-30T15:10:54Z Stashbot 7414 bearloga@deploy1003: bearloga: Backport for [[gerrit:1270454|EventStreamConfig: remove ABST contextual attribute (T422001)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2408180 wikitext text/x-wiki 3e4gk7l0govwrksqj7vecbul7m2j69y 2408181 2408180 2026-04-30T15:11:06Z Stashbot 7414 herron@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-logging2005.codfw.wmnet with OS trixie 2408181 wikitext text/x-wiki h1vt693b5pj3h6w3x2npij4vtd89akf 2408182 2408181 2026-04-30T15:11:31Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1196 (T419961)', diff saved to https://phabricator.wikimedia.org/P92092 and previous config saved to /var/cache/conftool/dbconfig/20260430-151128-fceratto.json 2408182 wikitext text/x-wiki egk8q3shjojlgk2g9zh1nr5l1hbzy7o 2408183 2408182 2026-04-30T15:11:50Z Stashbot 7414 bearloga@deploy1003: bearloga: Continuing with deployment 2408183 wikitext text/x-wiki 7iboyxp5kmxnqz87anet0ollxr0rqha 2408184 2408183 2026-04-30T15:11:53Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1206.eqiad.wmnet with reason: Maintenance 2408184 wikitext text/x-wiki 4ehp5l6eg1oq0xh5mpj7yr554vnabw2 2408185 2408184 2026-04-30T15:12:00Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1206 (T419961)', diff saved to https://phabricator.wikimedia.org/P92093 and previous config saved to /var/cache/conftool/dbconfig/20260430-151157-fceratto.json 2408185 wikitext text/x-wiki a1uc0xb7cu3iu5byju1vfkxydwpn9el 2408186 2408185 2026-04-30T15:16:26Z Stashbot 7414 bearloga@deploy1003: Finished scap sync-world: Backport for [[gerrit:1270454|EventStreamConfig: remove ABST contextual attribute (T422001)]] (duration: 07m 25s) 2408186 wikitext text/x-wiki eqrfh5mi8hznyoauyskh4jqvscvmneo 2408188 2408186 2026-04-30T15:20:18Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1206 (T419961)', diff saved to https://phabricator.wikimedia.org/P92094 and previous config saved to /var/cache/conftool/dbconfig/20260430-152011-fceratto.json 2408188 wikitext text/x-wiki 827jxli5a2x474bqjxnvtm54qg9krkx 2408189 2408188 2026-04-30T15:30:21Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P92095 and previous config saved to /var/cache/conftool/dbconfig/20260430-153019-fceratto.json 2408189 wikitext text/x-wiki nqg1h6w0huct3nckfd4mennmppozyjm 2408190 2408189 2026-04-30T15:33:37Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1280491|Enable Parsoid postprocessing cache on enwiki (T424880)]] 2408190 wikitext text/x-wiki izgz2svlahlm2imozgmn0ntjdydghc5 2408191 2408190 2026-04-30T15:35:28Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1280491|Enable Parsoid postprocessing cache on enwiki (T424880)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2408191 wikitext text/x-wiki jsrub05rrevv9wv8n2wzrqeq3s977yf 2408192 2408191 2026-04-30T15:38:00Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2408192 wikitext text/x-wiki 67uavm9lqi9yvcorue5j1hrwnr3dg0i 2408193 2408192 2026-04-30T15:40:30Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1206', diff saved to https://phabricator.wikimedia.org/P92096 and previous config saved to /var/cache/conftool/dbconfig/20260430-154027-fceratto.json 2408193 wikitext text/x-wiki 2u08jsngzurudzpanmzpr0oifkffss6 2408194 2408193 2026-04-30T15:41:51Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1280491|Enable Parsoid postprocessing cache on enwiki (T424880)]] (duration: 08m 13s) 2408194 wikitext text/x-wiki pipne07al0fvegv2sup1xs6rk47vk4m 2408195 2408194 2026-04-30T15:44:43Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.256.0" for 2 host(s) 2408195 wikitext text/x-wiki m8jj3g6ua9k8oorgzm69mmwbzrthq4t 2408196 2408195 2026-04-30T15:46:33Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.256.0" completed for 2 hosts 2408196 wikitext text/x-wiki rqejbpikq57v4bhtgkcezi24u89shhf 2408197 2408196 2026-04-30T15:50:36Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1206 (T419961)', diff saved to https://phabricator.wikimedia.org/P92098 and previous config saved to /var/cache/conftool/dbconfig/20260430-155034-fceratto.json 2408197 wikitext text/x-wiki fyl6b0kb1v57ld1rnskqut0nniqvec2 2408198 2408197 2026-04-30T15:50:56Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1218.eqiad.wmnet with reason: Maintenance 2408198 wikitext text/x-wiki mgua1trjm07mo5mmv53rqf9w0xpuqpj 2408199 2408198 2026-04-30T15:51:05Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1218 (T419961)', diff saved to https://phabricator.wikimedia.org/P92099 and previous config saved to /var/cache/conftool/dbconfig/20260430-155102-fceratto.json 2408199 wikitext text/x-wiki 9d5lgxvn3cmoajbmejd7fk6rwj75hhe 2408200 2408199 2026-04-30T16:03:10Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1218 (T419961)', diff saved to https://phabricator.wikimedia.org/P92100 and previous config saved to /var/cache/conftool/dbconfig/20260430-160307-fceratto.json 2408200 wikitext text/x-wiki 8ko0c61z426l9wmwaqg77pojvtln126 2408201 2408200 2026-04-30T16:13:17Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1218', diff saved to https://phabricator.wikimedia.org/P92103 and previous config saved to /var/cache/conftool/dbconfig/20260430-161315-fceratto.json 2408201 wikitext text/x-wiki 9gcgi0c0dg7q42h66b5xt027b2uq17b 2408202 2408201 2026-04-30T16:23:26Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1218', diff saved to https://phabricator.wikimedia.org/P92104 and previous config saved to /var/cache/conftool/dbconfig/20260430-162323-fceratto.json 2408202 wikitext text/x-wiki t7375tzi2rjmwttzfjmcl87r0sdpxd3 2408203 2408202 2026-04-30T16:25:52Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2408203 wikitext text/x-wiki nlnv4buj4zjp1l7jay2jytso8p3dhqp 2408204 2408203 2026-04-30T16:26:04Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2408204 wikitext text/x-wiki 41hsb2ice3ayjpfvoeo1mh5g8g7ojk6 2408205 2408204 2026-04-30T16:30:03Z Stashbot 7414 akhatun@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply 2408205 wikitext text/x-wiki keys32chfeznz7h9uezm877r926a5pu 2408206 2408205 2026-04-30T16:30:06Z Stashbot 7414 akhatun@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply 2408206 wikitext text/x-wiki suuhj0rax459q5nuqpg4d5xp5ssshop 2408208 2408206 2026-04-30T16:33:34Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1218 (T419961)', diff saved to https://phabricator.wikimedia.org/P92105 and previous config saved to /var/cache/conftool/dbconfig/20260430-163332-fceratto.json 2408208 wikitext text/x-wiki ez44li7ouu3xx23facwdtm9w66mr26y 2408209 2408208 2026-04-30T16:33:54Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1219.eqiad.wmnet with reason: Maintenance 2408209 wikitext text/x-wiki 0bbostuc6ls5vi1qdsrkbgbeb5pz1z1 2408210 2408209 2026-04-30T16:34:02Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1219 (T419961)', diff saved to https://phabricator.wikimedia.org/P92106 and previous config saved to /var/cache/conftool/dbconfig/20260430-163400-fceratto.json 2408210 wikitext text/x-wiki r6371riiortdog02vh9glxz7agzb2mi 2408211 2408210 2026-04-30T16:42:16Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1219 (T419961)', diff saved to https://phabricator.wikimedia.org/P92107 and previous config saved to /var/cache/conftool/dbconfig/20260430-164211-fceratto.json 2408211 wikitext text/x-wiki 8x8jhfmahtumgw8vqg2nt0logp8sm7m 2408212 2408211 2026-04-30T16:52:23Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1219', diff saved to https://phabricator.wikimedia.org/P92108 and previous config saved to /var/cache/conftool/dbconfig/20260430-165221-fceratto.json 2408212 wikitext text/x-wiki jlxfqf2whaq1udsfl7zi1btz9ddfkpl 2408213 2408212 2026-04-30T17:02:32Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1219', diff saved to https://phabricator.wikimedia.org/P92109 and previous config saved to /var/cache/conftool/dbconfig/20260430-170229-fceratto.json 2408213 wikitext text/x-wiki fhc2ms4zx1lfq0jrj8cdvv083dpidun 2408214 2408213 2026-04-30T17:04:43Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.257.0" for 2 host(s) 2408214 wikitext text/x-wiki 4dpz5zzz7nacnpdsakghnmqtxl5okdz 2408215 2408214 2026-04-30T17:06:33Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.257.0" completed for 2 hosts 2408215 wikitext text/x-wiki cndu14vp3jt1wlt29a761ztrmsavzer 2408216 2408215 2026-04-30T17:12:40Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1219 (T419961)', diff saved to https://phabricator.wikimedia.org/P92110 and previous config saved to /var/cache/conftool/dbconfig/20260430-171237-fceratto.json 2408216 wikitext text/x-wiki 01xwnirijwzdmez4rknjh5q2blbk31p 2408217 2408216 2026-04-30T17:13:00Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1232.eqiad.wmnet with reason: Maintenance 2408217 wikitext text/x-wiki 6c9g2o28ir3yg9zpmtp81b501diud63 2408218 2408217 2026-04-30T17:13:09Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1232 (T419961)', diff saved to https://phabricator.wikimedia.org/P92111 and previous config saved to /var/cache/conftool/dbconfig/20260430-171306-fceratto.json 2408218 wikitext text/x-wiki gwetek7yqpcttmwmtakf4kzfhd41yx3 2408219 2408218 2026-04-30T17:13:27Z Stashbot 7414 gengh@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2408219 wikitext text/x-wiki nh10peq4d9nmmx2378rgff1h5nyx456 2408220 2408219 2026-04-30T17:13:36Z Stashbot 7414 gengh@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2408220 wikitext text/x-wiki c6eoqke0ulm82r41yk4xldqb0zvra2x 2408221 2408220 2026-04-30T17:14:36Z Stashbot 7414 gengh@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: sync 2408221 wikitext text/x-wiki tq4qc09d827dqd59x9w21czehzg5e7h 2408222 2408221 2026-04-30T17:14:40Z Stashbot 7414 gengh@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: sync 2408222 wikitext text/x-wiki mmnvuj0rad8tjung584id98lbjx0e51 2408224 2408222 2026-04-30T17:21:22Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1232 (T419961)', diff saved to https://phabricator.wikimedia.org/P92112 and previous config saved to /var/cache/conftool/dbconfig/20260430-172119-fceratto.json 2408224 wikitext text/x-wiki h8tm96z5h0rlkccga8j5uzoav5q6bi1 2408225 2408224 2026-04-30T17:22:23Z Stashbot 7414 gengh@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2408225 wikitext text/x-wiki eu3vz5c1r3gb7axw6xq25hbl9n9rhkx 2408226 2408225 2026-04-30T17:22:41Z Stashbot 7414 gengh@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2408226 wikitext text/x-wiki 6nq7m7r4e926oiuqpq8po79w6j5aytl 2408228 2408226 2026-04-30T17:31:30Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1232', diff saved to https://phabricator.wikimedia.org/P92113 and previous config saved to /var/cache/conftool/dbconfig/20260430-173127-fceratto.json 2408228 wikitext text/x-wiki ei2eol1z9to5vgl4s4weyef642jkj6v 2408230 2408228 2026-04-30T17:41:37Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1232', diff saved to https://phabricator.wikimedia.org/P92114 and previous config saved to /var/cache/conftool/dbconfig/20260430-174135-fceratto.json 2408230 wikitext text/x-wiki lt7hjyarxiubwlp4ygnoynvl7v7zgoi 2408231 2408230 2026-04-30T17:51:46Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1232 (T419961)', diff saved to https://phabricator.wikimedia.org/P92115 and previous config saved to /var/cache/conftool/dbconfig/20260430-175143-fceratto.json 2408231 wikitext text/x-wiki b7x7viiwiyzf2a9gwrxfra95epb6m5s 2408232 2408231 2026-04-30T17:52:05Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1234.eqiad.wmnet with reason: Maintenance 2408232 wikitext text/x-wiki h25cdxi09s5ymnnu6t7arbjqwoyvgl7 2408233 2408232 2026-04-30T17:52:13Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1234 (T419961)', diff saved to https://phabricator.wikimedia.org/P92116 and previous config saved to /var/cache/conftool/dbconfig/20260430-175211-fceratto.json 2408233 wikitext text/x-wiki ls3yo5q29qtvfmjawz5yafp2dlsdru0 2408234 2408233 2026-04-30T18:00:39Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1234 (T419961)', diff saved to https://phabricator.wikimedia.org/P92117 and previous config saved to /var/cache/conftool/dbconfig/20260430-180036-fceratto.json 2408234 wikitext text/x-wiki efvuhkt9jih6m2tlp35poogrrih0tso 2408235 2408234 2026-04-30T18:04:15Z Stashbot 7414 cdobbins@dns1005: START - running authdns-update 2408235 wikitext text/x-wiki 9920nm0w6jt43crdv29mlw9v0ni8g6j 2408236 2408235 2026-04-30T18:05:55Z Stashbot 7414 cdobbins@dns1005: END - running authdns-update 2408236 wikitext text/x-wiki 3enrti8gk6jtsz6kdus0f5csxgtxh1j 2408238 2408236 2026-04-30T18:10:47Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1234', diff saved to https://phabricator.wikimedia.org/P92118 and previous config saved to /var/cache/conftool/dbconfig/20260430-181044-fceratto.json 2408238 wikitext text/x-wiki i81ja1orbdro26l4g1sefdmnygyjm2n 2408239 2408238 2026-04-30T18:15:16Z Stashbot 7414 jhuneidi@deploy1003: rebuilt and synchronized wikiversions files: group2 to 1.46.0-wmf.26 refs T423877 2408239 wikitext text/x-wiki q8d3na96mwk1qxvihvxheubk6vo5wso 2408240 2408239 2026-04-30T18:20:55Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1234', diff saved to https://phabricator.wikimedia.org/P92119 and previous config saved to /var/cache/conftool/dbconfig/20260430-182052-fceratto.json 2408240 wikitext text/x-wiki p56v4prbt2cnsp8a5kwqdgaq1myv4ve 2408241 2408240 2026-04-30T18:28:08Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2408241 wikitext text/x-wiki 2wiyxkdns6zynnhbxurysulsfnwt53p 2408242 2408241 2026-04-30T18:28:13Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2408242 wikitext text/x-wiki rkocpgie2xq00wznnh97gvp1vwfdu3i 2408243 2408242 2026-04-30T18:31:04Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1234 (T419961)', diff saved to https://phabricator.wikimedia.org/P92120 and previous config saved to /var/cache/conftool/dbconfig/20260430-183100-fceratto.json 2408243 wikitext text/x-wiki prr7t9ol8i1qtpxaxub1mwgyzeqyzms 2408244 2408243 2026-04-30T18:31:25Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1235.eqiad.wmnet with reason: Maintenance 2408244 wikitext text/x-wiki cg9fhdflcjfrvykf5hlxu9768ojk4bu 2408245 2408244 2026-04-30T18:31:32Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1235 (T419961)', diff saved to https://phabricator.wikimedia.org/P92121 and previous config saved to /var/cache/conftool/dbconfig/20260430-183130-fceratto.json 2408245 wikitext text/x-wiki ik2scoee6a0n2xrabgw7jydh1z88118 2408246 2408245 2026-04-30T18:44:48Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1235 (T419961)', diff saved to https://phabricator.wikimedia.org/P92122 and previous config saved to /var/cache/conftool/dbconfig/20260430-184439-fceratto.json 2408246 wikitext text/x-wiki a8shhynme8v2joozhnyt5o8yac1a374 2408247 2408246 2026-04-30T18:54:53Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1235', diff saved to https://phabricator.wikimedia.org/P92123 and previous config saved to /var/cache/conftool/dbconfig/20260430-185451-fceratto.json 2408247 wikitext text/x-wiki 6dk0lieklvo4idmbrr5p0dnb1x3c6uw 2408248 2408247 2026-04-30T19:05:01Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1235', diff saved to https://phabricator.wikimedia.org/P92124 and previous config saved to /var/cache/conftool/dbconfig/20260430-190459-fceratto.json 2408248 wikitext text/x-wiki stsv0e2mdee67yl6ckqdtw7t6qcao5e 2408250 2408248 2026-04-30T19:15:09Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1235 (T419961)', diff saved to https://phabricator.wikimedia.org/P92125 and previous config saved to /var/cache/conftool/dbconfig/20260430-191507-fceratto.json 2408250 wikitext text/x-wiki qee916k7tukb62sigryzgz070u3wx4y 2408251 2408250 2026-04-30T19:15:22Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1251.eqiad.wmnet with reason: Maintenance 2408251 wikitext text/x-wiki 81564khz2pljhpnp013bg13qir6ysvg 2408252 2408251 2026-04-30T19:15:29Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1251 (T419961)', diff saved to https://phabricator.wikimedia.org/P92126 and previous config saved to /var/cache/conftool/dbconfig/20260430-191527-fceratto.json 2408252 wikitext text/x-wiki q084urd5z3nifihoh1x2qcls2lyle7d 2408253 2408252 2026-04-30T19:24:09Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1251 (T419961)', diff saved to https://phabricator.wikimedia.org/P92127 and previous config saved to /var/cache/conftool/dbconfig/20260430-192407-fceratto.json 2408253 wikitext text/x-wiki 9ep1wtj6kwsh8o62nib9bdu7q0dk13l 2408254 2408253 2026-04-30T19:34:17Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1251', diff saved to https://phabricator.wikimedia.org/P92128 and previous config saved to /var/cache/conftool/dbconfig/20260430-193415-fceratto.json 2408254 wikitext text/x-wiki dh0g62710jp2lfzr2tap20uxjxixywa 2408256 2408254 2026-04-30T19:44:26Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1251', diff saved to https://phabricator.wikimedia.org/P92129 and previous config saved to /var/cache/conftool/dbconfig/20260430-194423-fceratto.json 2408256 wikitext text/x-wiki g6pevkbthely0bspiylxdtwqyhor4fh 2408257 2408256 2026-04-30T19:54:34Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1251 (T419961)', diff saved to https://phabricator.wikimedia.org/P92130 and previous config saved to /var/cache/conftool/dbconfig/20260430-195431-fceratto.json 2408257 wikitext text/x-wiki p8qqp9gx6skii3xv9b4prlzpudb2p5o 2408258 2408257 2026-04-30T20:02:52Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1279454|Increase Parsoid Read Views to 100% of enwiki mobile web traffic (T424880)]] 2408258 wikitext text/x-wiki j3lsqsjkw2z6nybzthe1xedy5dezeco 2408259 2408258 2026-04-30T20:04:35Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1279454|Increase Parsoid Read Views to 100% of enwiki mobile web traffic (T424880)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2408259 wikitext text/x-wiki ivevldpjq2p3x9qnmuviq9g93fn1e6t 2408260 2408259 2026-04-30T20:06:03Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2408260 wikitext text/x-wiki dul2jehnwvy15otcgauks8vnhm5uvd6 2408261 2408260 2026-04-30T20:09:53Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1279454|Increase Parsoid Read Views to 100% of enwiki mobile web traffic (T424880)]] (duration: 07m 01s) 2408261 wikitext text/x-wiki i66kht9onnmwslhxm9adzys72mqj038 2408267 2408261 2026-04-30T20:21:55Z Stashbot 7414 jhuneidi@deploy1003: Started scap sync-world: Backport for [[gerrit:1274928|ukwiki: Remove the patroller user group and adjust various user rights (T423461)]], [[gerrit:1279477|nlwiki: Modify autoconfirmed requirements for nlwiki (T424898)]], [[gerrit:1247186|dewiki: Add abusefilter group (T418815)]], [[gerrit:1236361|Add map domains for ruwiki to the list of externallinks-excluded domains (T416174)]], [[gerrit:128044 2408267 wikitext text/x-wiki tul4qh04smyxxgmyjax1s7r9c62olk9 2408268 2408267 2026-04-30T20:23:36Z Stashbot 7414 jhuneidi@deploy1003: vadymts1, seawolf35gerrit, jhuneidi, codenamenoreste, mgchecker: Backport for [[gerrit:1274928|ukwiki: Remove the patroller user group and adjust various user rights (T423461)]], [[gerrit:1279477|nlwiki: Modify autoconfirmed requirements for nlwiki (T424898)]], [[gerrit:1247186|dewiki: Add abusefilter group (T418815)]], [[gerrit:1236361|Add map domains for ruwiki to the list of externallinks-exclu 2408268 wikitext text/x-wiki l8tu8ajn34l9na3veypa9sf5ajt3siq 2408271 2408268 2026-04-30T20:29:56Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408271 wikitext text/x-wiki 20oa2hupxnle34pr9qzt51ifj30mqss 2408272 2408271 2026-04-30T20:30:35Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408272 wikitext text/x-wiki spud07yg2n81sc1pzixenk34irueshw 2408273 2408272 2026-04-30T20:31:58Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408273 wikitext text/x-wiki 28zq0r4tm91bq2vsxdnwywt2cgt50sv 2408274 2408273 2026-04-30T20:32:28Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1007.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2408274 wikitext text/x-wiki p2ganku6jsw0jor9voiv2g9gi9r5dz9 2408275 2408274 2026-04-30T20:32:51Z Stashbot 7414 jhuneidi@deploy1003: vadymts1, seawolf35gerrit, jhuneidi, codenamenoreste, mgchecker: Continuing with deployment 2408275 wikitext text/x-wiki h9njh7n5beffamj8gum9e81aynzt9r8 2408276 2408275 2026-04-30T20:35:41Z Stashbot 7414 jasmine@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/aux-k8s-services/sophroid: apply 2408276 wikitext text/x-wiki qg64339jvb3a9nekq63yu4b35dqzf55 2408277 2408276 2026-04-30T20:36:58Z Stashbot 7414 jhuneidi@deploy1003: Finished scap sync-world: Backport for [[gerrit:1274928|ukwiki: Remove the patroller user group and adjust various user rights (T423461)]], [[gerrit:1279477|nlwiki: Modify autoconfirmed requirements for nlwiki (T424898)]], [[gerrit:1247186|dewiki: Add abusefilter group (T418815)]], [[gerrit:1236361|Add map domains for ruwiki to the list of externallinks-excluded domains (T416174)]], [[gerrit:12804 2408277 wikitext text/x-wiki 3jdlm2pnsu7jyjodqfcx816teqyuwmp 2408278 2408277 2026-04-30T20:37:45Z Stashbot 7414 jasmine@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/aux-k8s-services/sophroid: apply 2408278 wikitext text/x-wiki 9q7de4rap7pv44jihhmng15fuvfvnbl 2408279 2408278 2026-04-30T20:42:30Z Stashbot 7414 jhuneidi@deploy1003: Started scap sync-world: Backport for [[gerrit:1280516|Suggestion Mode controlled experiment: limit exposure to newcomers (T422736)]], [[gerrit:1280552|Abandon the editor survey: update edit count restriction (T422931)]] 2408279 wikitext text/x-wiki ho76qvhz2j1ujxnu7r3eeyvuxcv7d90 2408280 2408279 2026-04-30T20:44:11Z Stashbot 7414 jhuneidi@deploy1003: caro, jhuneidi: Backport for [[gerrit:1280516|Suggestion Mode controlled experiment: limit exposure to newcomers (T422736)]], [[gerrit:1280552|Abandon the editor survey: update edit count restriction (T422931)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2408280 wikitext text/x-wiki 8u56mmeig11rzqmk38agr1gnn2kb6ob 2408281 2408280 2026-04-30T20:46:32Z Stashbot 7414 jasmine@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/sophroid: apply 2408281 wikitext text/x-wiki 72wr2thslt620wq8vkggn9yckpa0in6 2408282 2408281 2026-04-30T20:46:56Z Stashbot 7414 jasmine@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/sophroid: apply 2408282 wikitext text/x-wiki 9fms2n4p4qgnkp91vs9mhlzuoihk2az 2408283 2408282 2026-04-30T20:47:15Z Stashbot 7414 jhuneidi@deploy1003: caro, jhuneidi: Continuing with deployment 2408283 wikitext text/x-wiki 3f3wlovykjqn2ar72x2ms7babeok42j 2408284 2408283 2026-04-30T20:51:03Z Stashbot 7414 jhuneidi@deploy1003: Finished scap sync-world: Backport for [[gerrit:1280516|Suggestion Mode controlled experiment: limit exposure to newcomers (T422736)]], [[gerrit:1280552|Abandon the editor survey: update edit count restriction (T422931)]] (duration: 08m 33s) 2408284 wikitext text/x-wiki s9iyjcfyk010clx6ikpae5cj7qyqaox 2408286 2408284 2026-04-30T21:06:10Z Stashbot 7414 jhuneidi@deploy1003: Started scap sync-world: Backport for [[gerrit:1280657|hCaptcha: Reduce default MAX_LOAD_ATTEMPTS from 10 to 6 (T421204)]], [[gerrit:1280656|hCaptcha: Label load and execute duration metrics with outcome (T421204)]] 2408286 wikitext text/x-wiki qyksu27cvgdslze2yn3hq1tg6iszr7l 2408287 2408286 2026-04-30T21:07:11Z Stashbot 7414 mutante: zuul1001/zuul2001 - rmdir /etc/nodepool 2408287 wikitext text/x-wiki iu4j6nkzwp7crzlzhjs7e6pglj2geel 2408288 2408287 2026-04-30T21:07:50Z Stashbot 7414 jhuneidi@deploy1003: kharlan, jhuneidi: Backport for [[gerrit:1280657|hCaptcha: Reduce default MAX_LOAD_ATTEMPTS from 10 to 6 (T421204)]], [[gerrit:1280656|hCaptcha: Label load and execute duration metrics with outcome (T421204)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2408288 wikitext text/x-wiki gusmb7t2umfgh1d58hgwehohsdutrwz 2408289 2408288 2026-04-30T21:08:07Z Stashbot 7414 jhuneidi@deploy1003: kharlan, jhuneidi: Continuing with deployment 2408289 wikitext text/x-wiki nk05luv24mvbacrkqab5p3kkp57z0iu 2408291 2408289 2026-04-30T21:11:57Z Stashbot 7414 jhuneidi@deploy1003: Finished scap sync-world: Backport for [[gerrit:1280657|hCaptcha: Reduce default MAX_LOAD_ATTEMPTS from 10 to 6 (T421204)]], [[gerrit:1280656|hCaptcha: Label load and execute duration metrics with outcome (T421204)]] (duration: 05m 47s) 2408291 wikitext text/x-wiki ojukdtfidnjcfk25o69bj3krzjecnen 2408292 2408291 2026-04-30T21:28:16Z Stashbot 7414 cdobbins@cumin2002: conftool action : get/pooled; selector: name=cp4041.ulsfo.wmnet 2408292 wikitext text/x-wiki 6aj3g9skzhzsqw2nso8sw1ys9ff3pjt 2408293 2408292 2026-04-30T21:28:43Z Stashbot 7414 cdobbins@cumin2002: conftool action : get/pooled; selector: name=cp* 2408293 wikitext text/x-wiki 59qgpbalhf4x78p4c7yehlgyckcnjeg 2408294 2408293 2026-04-30T21:31:42Z Stashbot 7414 cdobbins@cumin2002: conftool action : get/pooled; selector: name=cp4044.ulsfo.wmnet 2408294 wikitext text/x-wiki i2zriixebpj767xhj5kdd9mc77pf8pk 2408295 2408294 2026-04-30T21:31:50Z Stashbot 7414 cdobbins@cumin2002: conftool action : get/pooled; selector: name=cp4040.ulsfo.wmnet 2408295 wikitext text/x-wiki 38lvfb0fk57ozh7iel1r288xzfkiu6z 2408298 2408295 2026-04-30T23:51:29Z Stashbot 7414 dzahn@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on zuul2001.codfw.wmnet with reason: T421398 2408298 wikitext text/x-wiki feq7r6mjb0igvw79w64sbcsyw027cum 2408299 2408298 2026-04-30T23:52:00Z Stashbot 7414 dzahn@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on zuul1001.eqiad.wmnet with reason: T421398 2408299 wikitext text/x-wiki 4t7gbv4n6cg1d5nd4x2kq4xat4j4v85 2408302 2408299 2026-05-01T00:09:54Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1280417|Add script to fix fr_deleted drifts (T424553)]] 2408302 wikitext text/x-wiki 967tht699nlm6f3ytitqpsa7maw1mhc 2408303 2408302 2026-05-01T00:10:54Z JrandWP 37706 archive April 2026 2408303 wikitext text/x-wiki oxzmwngg8twsk4gfifc7dzbd050n3kq 2408305 2408303 2026-05-01T00:11:35Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1280417|Add script to fix fr_deleted drifts (T424553)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2408305 wikitext text/x-wiki o7p6t1apl7sggbgdb0wk6n4aq7jh9s3 2408306 2408305 2026-05-01T00:13:10Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with deployment 2408306 wikitext text/x-wiki je71obbxervc8hhsyk7q9kshq68ocgb 2408307 2408306 2026-05-01T00:16:58Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1280417|Add script to fix fr_deleted drifts (T424553)]] (duration: 07m 05s) 2408307 wikitext text/x-wiki 4zf7o182gyubnzj44tqaj12m7k8633d 2408309 2408307 2026-05-01T02:00:35Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2408309 wikitext text/x-wiki gf0qv1e0p8sa0y9l5wbgggt2yrpjojn 2408310 2408309 2026-05-01T02:07:16Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 06m 41s) 2408310 wikitext text/x-wiki 897peu44l9inntj29ttwoiubwrquheh 2408314 2408310 2026-05-01T03:26:21Z Stashbot 7414 akhatun@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply 2408314 wikitext text/x-wiki 3gcq3s1aazf4lg2z8m09mfbbvze5ply 2408315 2408314 2026-05-01T03:26:29Z Stashbot 7414 akhatun@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply 2408315 wikitext text/x-wiki hpg6rw2h6k08bvzyar49rje9bn2geyq 2408321 2408315 2026-05-01T08:12:49Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2408321 wikitext text/x-wiki scjthjshh05eyn62ap8i5436udv1sil 2408322 2408321 2026-05-01T08:13:02Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2408322 wikitext text/x-wiki 7fj2niehprxpxd5og6tld9jr68rqfj9 2408323 2408322 2026-05-01T08:13:10Z Stashbot 7414 cgoubert@deploy1003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2408323 wikitext text/x-wiki 61bmi7im1t7zdhewgq7aalyxugh6pch 2408324 2408323 2026-05-01T08:13:30Z Stashbot 7414 cgoubert@deploy1003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2408324 wikitext text/x-wiki ftxz1kdws1hkvbi610asz6pwyi5aefz 2408325 2408324 2026-05-01T08:13:37Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2408325 wikitext text/x-wiki j82vynmxsf4u6t1qss3maqajau2wpqe 2408326 2408325 2026-05-01T08:13:58Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2408326 wikitext text/x-wiki dewxm6vi820u2wr8ol36160e0kgdr8w 2408330 2408326 2026-05-01T09:32:03Z Stashbot 7414 urbanecm@deploy1003: Started scap sync-world: Backport for [[gerrit:1281426|Update the interwiki cache (T239173)]] 2408330 wikitext text/x-wiki iilg1q774fogiv37gspp7wxlgcl8gqw 2408331 2408330 2026-05-01T09:38:09Z Stashbot 7414 urbanecm@deploy1003: Finished scap sync-world: Backport for [[gerrit:1281426|Update the interwiki cache (T239173)]] (duration: 06m 05s) 2408331 wikitext text/x-wiki tc9tlbmb4u9r8683csyv78ompuoserf 2408334 2408331 2026-05-01T09:50:47Z Stashbot 7414 samtar@deploy1003: Started scap sync-world: Backport for [[gerrit:1281423|Switch watchstar from Popover to Dialog (T417847)]] 2408334 wikitext text/x-wiki b2a6upmkvsfet94ejtcl45p7upoh3ce 2408335 2408334 2026-05-01T09:52:29Z Stashbot 7414 samtar@deploy1003: samtar: Backport for [[gerrit:1281423|Switch watchstar from Popover to Dialog (T417847)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2408335 wikitext text/x-wiki jpvv260vuchv6ssu9h8bi48oazv17vu 2408336 2408335 2026-05-01T09:53:46Z Stashbot 7414 samtar@deploy1003: samtar: Continuing with deployment 2408336 wikitext text/x-wiki kl9alwk4smnebygybchx213l9f79evf 2408337 2408336 2026-05-01T09:57:37Z Stashbot 7414 samtar@deploy1003: Finished scap sync-world: Backport for [[gerrit:1281423|Switch watchstar from Popover to Dialog (T417847)]] (duration: 06m 49s) 2408337 wikitext text/x-wiki fgt4q1usc97h1frm61otuj2x0d8vk2y 0 14218 2408049 2404456 2026-04-30T12:24:02Z FCeratto-WMF 39104 /* Zarcillo */ 2408049 wikitext text/x-wiki hsz04wd70vcj5qs7tna3tblbt56ivov 2408052 2408049 2026-04-30T12:25:43Z FCeratto-WMF 39104 Update Zarcillo per https://phabricator.wikimedia.org/T384212#11382191 2408052 wikitext text/x-wiki oinpl4tx9lwwcad9vb7tao1vkvpv1g8 0 17290 2408187 2407598 2026-04-30T15:19:12Z Stashbot 7414 mutante: upgrading zuul to 14.2.0-1 on "new zuul" machines (T424879) 2408187 wikitext text/x-wiki qfywejem0wz14x0e5dkffa8lsbagkn7 2408223 2408187 2026-04-30T17:16:45Z Stashbot 7414 brennen: wikibugs: most maintainers at hackathon, so go release-engineering added as a maintainer while looking to debug error at https://gitlab.wikimedia.org/toolforge-repos/wikibugs2/-/jobs/810904 2408223 wikitext text/x-wiki 89uhkt669ijwg0w9enryxamo461ptqi 2408264 2408223 2026-04-30T20:14:30Z Stashbot 7414 James_F: Zuul: [mediawiki/extensions/WebAuthn] Archive, for T415832 / T303495 2408264 wikitext text/x-wiki 0975a3vgqy8kai7kw0swj913t1ix2ix 2408265 2408264 2026-04-30T20:16:34Z Stashbot 7414 James_F: jforrester@doc1004:~$ # sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/WebAuthn/ # T415832 2408265 wikitext text/x-wiki iqb2cb4nqty5tkbq5bg2tscy16hru1x 2408270 2408265 2026-04-30T20:26:26Z Stashbot 7414 James_F: Zuul: [mediawiki/tools/api-testing] Make PHP 8.5 CI voting 2408270 wikitext text/x-wiki f2bm1nppgcplbno7dovthdclon4xeic 2408296 2408270 2026-04-30T21:36:35Z Stashbot 7414 brennen: gitlab-webhooks: building & restarting to deploy https://gitlab.wikimedia.org/repos/releng/gitlab-webhooks/-/merge_requests/40 2408296 wikitext text/x-wiki i61b7fhtyrqk9i9bsl3futmi57nfg3i 2408318 2408296 2026-05-01T07:33:09Z Stashbot 7414 James_F: Zuul: Test Wikimedia production libraries in PHP 8.3+, dropping 8.2 2408318 wikitext text/x-wiki ne8qre78ahpl6rtu78z8yoog7jjo7jj 2408319 2408318 2026-05-01T07:37:46Z Stashbot 7414 James_F: Zuul: Switch release branches' selenium jobs to PHP 8.3 2408319 wikitext text/x-wiki ap832o0deferimik4lq76lasc51btmj 2408320 2408319 2026-05-01T08:02:14Z Stashbot 7414 James_F: Zuul: Update xtex's e-mail in the allowlist 2408320 wikitext text/x-wiki r47s6otef1fizfjuo5dbrbm2jc4v3lx 0 24479 2408131 2360455 2026-04-30T14:22:22Z Ottomata 88 page_id and namespace_id now set for mobile app requests. 2408131 wikitext text/x-wiki a1ixst8p0rucnsjgs8o53wbmw22hidk 0 442598 2408062 2407728 2026-04-30T12:36:06Z LErickson-WMF 51715 /* Server de-synchronization */ 2408062 wikitext text/x-wiki 0qhv5no91xh8vgeo4vvzeca0ncph4la 2408159 2408062 2026-04-30T14:46:54Z LErickson-WMF 51715 /* Known issues */ 2408159 wikitext text/x-wiki cd6xcuolft8asqgcfkyh17c83m34loj 2408161 2408159 2026-04-30T14:50:29Z LErickson-WMF 51715 /* Server de-synchronization or updates not propagated */ 2408161 wikitext text/x-wiki lphhd9hu9i6i2yc8cebljfs0srgayb8 2408266 2408161 2026-04-30T20:21:11Z LErickson-WMF 51715 /* Timeouts */ 2408266 wikitext text/x-wiki 2onknqpgz39z86i1ya4ordk4n5cxj6p 0 446030 2408269 2368692 2026-04-30T20:25:28Z LErickson-WMF 51715 /* The consumers are backlogged */ 2408269 wikitext text/x-wiki 5low2g53xzl867xmdimf152zk23gd97 10 448181 2408311 2340459 2026-05-01T02:45:24Z Tech cnio ogojo' 55191 2408311 wikitext text/x-wiki ieqxkigmsexslvdhawt28z1h47fn5iy 2408313 2408311 2026-05-01T03:02:05Z Isma4l 48853 Reverted edit(s) by [[Special:Contributions/Tech cnio ogojo'|Tech cnio ogojo']] ([[User talk:Tech cnio ogojo'|talk]]) // [[:m:User:Isma4l/AdvancedRollback|AdvancedRollback]] 2408313 wikitext text/x-wiki ifp4vu92ozeq6h1nkply4n2gs398eeb 0 449160 2408088 2408005 2026-04-30T13:14:33Z Dexbot 30554 Bot: Updating the report 2408088 wikitext text/x-wiki 0ur0l26vc2jkj7vzbwyz5dcwz0hsmxy 2408300 2408088 2026-05-01T00:01:15Z Dexbot 30554 Bot: Updating the report 2408300 wikitext text/x-wiki 8zihsjbfxvvil8faf8ziuz2jvuceycg 0 452452 2408333 2293831 2026-05-01T09:48:13Z GKyziridis-WMF 39160 /* Streams (Admins only, Machine Learning team) */ 2408333 wikitext text/x-wiki 108cmlyhm8ven4xs665lxwuyras4v9j 0 452746 2408308 2407582 2026-05-01T00:26:48Z AKhatun (WMF) 50461 /* Enrichment Jobs */ Add new feature counts change stream doc 2408308 wikitext text/x-wiki hb6obtb4qte9m59jqko3i8i7lc8xg0i 116 453906 2408229 2407868 2026-04-30T17:33:26Z Gitlabaccountapprovalbot 37332 @uyen was approved. 2408229 wikitext text/x-wiki mxlrb04m7phdjqzsa3r8f4o4q7oa6s2 2408285 2408229 2026-04-30T20:54:28Z Gitlabaccountapprovalbot 37332 @tfmorris was approved. 2408285 wikitext text/x-wiki hzrsenvxnstiym4hu8xyji0ud18j7f4 2408297 2408285 2026-04-30T21:42:12Z Gitlabaccountapprovalbot 37332 merohibine was rejected. 2408297 wikitext text/x-wiki davmbdg7pp7zh4ea30b18h5o6h56qmh 0 456086 2408044 2335853 2026-04-30T12:23:11Z FCeratto-WMF 39104 FCeratto-WMF moved page [[Zarcillo]] to [[MariaDB/Zarcillo]] 2335853 wikitext text/x-wiki 8iet82dstm25dxqjkafjj85u94wngjr 2408071 2408044 2026-04-30T12:47:51Z FCeratto-WMF 39104 Add initial version 2408071 wikitext text/x-wiki t5ib0ynnkvva3yor7jn0v6840ls8473 0 456279 2408093 2377344 2026-04-30T13:20:16Z GGoncalves-WMF 42848 Remove draft template :) 2408093 wikitext text/x-wiki fypev1azff0e0sg6ph8nx5b0uuv8vdu 0 459343 2408290 2405362 2026-04-30T21:10:06Z BKing (WMF) 29017 /* Deploying a New OpenSearch on K8s Cluster */ 2408290 wikitext text/x-wiki lmwg7bst4j4s87r42h1tmccho9o9u8t 1 459740 2408327 2407244 2026-05-01T08:53:26Z Tgr (WMF) 39134 /* Request for clarification */ Reply 2408327 wikitext text/x-wiki i2upardkwf69msnqaeft8qzi66sxrpm 0 459743 2408249 2407712 2026-04-30T19:12:47Z LErickson-WMF 51715 /* Runbooks */ 2408249 wikitext text/x-wiki oc5l84vbbccmkoxlb93pok814fktaa6 1 460012 2408328 2396655 2026-05-01T08:58:44Z Tgr (WMF) 39134 /* Re. resetting the throttle for events within 72hrs */ Reply 2408328 wikitext text/x-wiki nnwrnds8ruvepy6tsqxuskgy3itr4fg 116 460070 2408338 2407078 2026-05-01T10:05:38Z EtherpadBackupBot 54504 hhvmdeploy archived by BDavis (WMF) 2408338 wikitext text/x-wiki 1ecb1ql77mtz8factf5ydgknajkwpq7 0 460117 2408045 2026-04-30T12:23:11Z FCeratto-WMF 39104 FCeratto-WMF moved page [[Zarcillo]] to [[MariaDB/Zarcillo]] 2408045 wikitext text/x-wiki mvqm5xn7hjalicl5z2xgtuw06cpkro3 0 460118 2408227 2026-04-30T17:29:07Z BKing (WMF) 29017 Created page with "{{irdoc|status=draft}} == Summary == {{Incident scorecard | task = | paged-num = | responders-num = | coordinators = | start = | end = }} … <!-- Reminder: No private information on this page! --><mark>Summary of what happened, in one or two paragraphs. Avoid assuming deep knowledge of the systems here, and try to differentiate between proximate causes and root causes.</mark> {{TOC|align=right}} ==Timeline== <mark>Write a step by step outline of what happened..." 2408227 wikitext text/x-wiki tn08wk76xcoau44g55y7bsgo9lps8zo 2408255 2408227 2026-04-30T19:38:16Z BKing (WMF) 29017 2408255 wikitext text/x-wiki hwo0uihiiu1mz69gx2sa4k6yuqefvt9 0 460119 2408301 2026-05-01T00:09:46Z JrandWP 37706 archive April 2026 2408301 wikitext text/x-wiki 7dyaqw1drxwbmpzgtn6dytbcs1s2kv9 0 460121 2408316 2026-05-01T04:20:26Z AKhatun (WMF) 50461 Add documentation for new html feature counts stream 2408316 wikitext text/x-wiki b8bxdof49ftndcr3rxvflkumy3e3ba5 2408317 2408316 2026-05-01T04:27:18Z AKhatun (WMF) 50461 Small fixes 2408317 wikitext text/x-wiki 8cqrbgbr6g5cr0yiv571fa1dmykxada 2 460122 2408329 2026-05-01T09:30:38Z GModena (WMF) 20194 Created page with "'''Team''': Wikidata Platform<br /> '''Date:''' 2026-3<br /> <span id="overview"></span> = Overview = This document describes the design of the architecture of the next version of the WDQS service. As we move the backend away from Blazegraph, we need to decouple the database from service layers, and handle bespoke logic that is currently implemented in the database itself. We want the next version of WDQS to be database agnostic, with an API contract that supports the..." 2408329 wikitext text/x-wiki 5tmmia4z091qyc3q5mhfqtnykl1x9ae 2408332 2408329 2026-05-01T09:41:48Z GModena (WMF) 20194 2408332 wikitext text/x-wiki ohs5cl7cybpsymddxmsjvzmox5hucnv 2408342 2408332 2026-05-01T11:14:08Z GModena (WMF) 20194 Add links to diagrams 2408342 wikitext text/x-wiki 0errx9yrsxaoyoabqwgol0fjrgo4qvj 2408343 2408342 2026-05-01T11:23:03Z GModena (WMF) 20194 2408343 wikitext text/x-wiki 7nla6y7p66jmoihw6504r6sywzpn0qp 498 460123 2408339 2026-05-01T10:17:53Z Stashbot 7414 wmbot~bd808@tools-bastion-14: Built and deployed image from ecf5892c (T422958) 2408339 wikitext text/x-wiki 2d9jnwy3gnvk9n06n3vney62it6tmlk 3 460124 2408340 2026-05-01T10:44:00Z StrikerBot 8475 Welcome to Toolforge! 2408340 wikitext text/x-wiki 4oxvrfmygheeqjhdm5l0hhnkshwcwrv 116 460125 2408341 2026-05-01T10:56:57Z BryanDavis 1604 initial docs 2408341 wikitext text/x-wiki 8b57o6t1oqtr3zkn9zq3tr1sscba5nt