Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.46.0-wmf.23 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Nova Resource:Tools/SAL 498 3086 2400926 2400612 2026-04-13T07:33:07Z Stashbot 7414 taavi: bump istio traffic percentage 10% -> 25% T392356 2400926 wikitext text/x-wiki 0a3hae3ds6fkttch55sowy59guh5ukt 2400945 2400926 2026-04-13T09:11:13Z Stashbot 7414 taavi: bump istio traffic percentage 25% -> 50% T392356 2400945 wikitext text/x-wiki 0rbf3vnpsxrn3ft7xi5oid4n0fnrvyy Php-wmerrors 0 3727 2401024 2122581 2026-04-13T11:45:36Z Uzume 290 gitiles 2401024 wikitext text/x-wiki k1tpku2dkppyp26m7c6vx4vyqgn250a Deployments 0 4108 2400942 2400796 2026-04-13T09:09:31Z ScheduleDeploymentBot 37566 Add [[gerrit:1268965]] to Monday, April 13 UTC afternoon backport window 2400942 wikitext text/x-wiki 43uhy2sffucxqlypan5ke3afddu7kqa 2400997 2400942 2026-04-13T10:40:53Z ScheduleDeploymentBot 37566 Add [[gerrit:1247960]] to Monday, April 20 UTC afternoon backport window 2400997 wikitext text/x-wiki 1pkgioaq0sjy2huys1ilpe0oxrwl3i1 2400998 2400997 2026-04-13T10:43:16Z ScheduleDeploymentBot 37566 Add [[gerrit:1270384]] to Monday, April 13 UTC afternoon backport window 2400998 wikitext text/x-wiki 5qxm53qjp5oxkh8ctujf3bjrg8yofzi 2400999 2400998 2026-04-13T10:43:30Z ScheduleDeploymentBot 37566 Add [[gerrit:1270383]] to Monday, April 13 UTC afternoon backport window 2400999 wikitext text/x-wiki tpliwhjgq4h6i2v4ryzhea35im0ysf4 2401003 2400999 2026-04-13T10:51:03Z ScheduleDeploymentBot 37566 Add [[gerrit:1269495]] to Monday, April 13 UTC afternoon backport window 2401003 wikitext text/x-wiki 46q173x4yxok35x2gkx5iaiexfv0bt3 2401036 2401003 2026-04-13T11:51:10Z DKinzler (WMF) 156 deploy today 2401036 wikitext text/x-wiki b9hiowr4aj3tamkkgoxzvbtau3jybix Template:Gitweb 10 4556 2401010 2247521 2026-04-13T11:33:36Z Uzume 290 gitiles 2401010 wikitext text/x-wiki av1vty88vqaw25lmf6oow8qt3czqhly Server Admin Log 0 7919 2400889 2400888 2026-04-12T14:32:58Z Stashbot 7414 cgoubert@dns2004: START - running authdns-update 2400889 wikitext text/x-wiki flmez1v9251uamq9q3sytq5kywvulvf 2400892 2400889 2026-04-12T20:24:38Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1191 (T410589)', diff saved to https://phabricator.wikimedia.org/P90456 and previous config saved to /var/cache/conftool/dbconfig/20260412-202435-ladsgroup.json 2400892 wikitext text/x-wiki a04t2hanp2j2vcizgs4vfsz46fuc2oc 2400893 2400892 2026-04-12T20:34:45Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P90457 and previous config saved to /var/cache/conftool/dbconfig/20260412-203443-ladsgroup.json 2400893 wikitext text/x-wiki 23jed65mzhrs7osux0fjeqoa0p3cwuz 2400894 2400893 2026-04-12T20:44:53Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P90458 and previous config saved to /var/cache/conftool/dbconfig/20260412-204451-ladsgroup.json 2400894 wikitext text/x-wiki nb72iqkh2fyhg44a7nqghz4g4xasvmf 2400895 2400894 2026-04-12T20:50:23Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2182 (T410589)', diff saved to https://phabricator.wikimedia.org/P90459 and previous config saved to /var/cache/conftool/dbconfig/20260412-205020-ladsgroup.json 2400895 wikitext text/x-wiki e6wzd8648f34p3q5fhh97jimm7oykl2 2400896 2400895 2026-04-12T20:55:02Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1191 (T410589)', diff saved to https://phabricator.wikimedia.org/P90460 and previous config saved to /var/cache/conftool/dbconfig/20260412-205500-ladsgroup.json 2400896 wikitext text/x-wiki lgni73pggf8dwmiuq00aa2q0p0gsj3i 2400897 2400896 2026-04-12T20:55:18Z Stashbot 7414 ladsgroup@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1194.eqiad.wmnet with reason: Maintenance 2400897 wikitext text/x-wiki m7prvi748pzlcsmtz37sydq4ithfuvx 2400898 2400897 2026-04-12T20:55:28Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Depooling db1194 (T410589)', diff saved to https://phabricator.wikimedia.org/P90461 and previous config saved to /var/cache/conftool/dbconfig/20260412-205525-ladsgroup.json 2400898 wikitext text/x-wiki o71nsxflf3zu04t1tvgg5kiz1b7gcbb 2400899 2400898 2026-04-12T21:00:30Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P90462 and previous config saved to /var/cache/conftool/dbconfig/20260412-210028-ladsgroup.json 2400899 wikitext text/x-wiki 0kgab7nyfnf57y98nlq6v55b1udbuf4 2400900 2400899 2026-04-12T21:10:38Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P90463 and previous config saved to /var/cache/conftool/dbconfig/20260412-211036-ladsgroup.json 2400900 wikitext text/x-wiki qjy1rjjh1dwqun2h83ejn88ymyav60g 2400901 2400900 2026-04-12T21:20:46Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2182 (T410589)', diff saved to https://phabricator.wikimedia.org/P90464 and previous config saved to /var/cache/conftool/dbconfig/20260412-212043-ladsgroup.json 2400901 wikitext text/x-wiki j6ox7ws2w2bhubpcxvzfkvbke6voilz 2400902 2400901 2026-04-12T21:21:01Z Stashbot 7414 ladsgroup@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2198.codfw.wmnet with reason: Maintenance 2400902 wikitext text/x-wiki 4322snx3wdh4bd5h76v40urgybia6x6 2400904 2400902 2026-04-13T03:34:43Z Stashbot 7414 TimStarling: on gerrit2003 restarted gerrit T423027 2400904 wikitext text/x-wiki 133ox1kxt6zxie4cj44i1bbro2x2g9d 2400907 2400904 2026-04-13T05:20:45Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1194 (T410589)', diff saved to https://phabricator.wikimedia.org/P90465 and previous config saved to /var/cache/conftool/dbconfig/20260413-052042-ladsgroup.json 2400907 wikitext text/x-wiki gbdkd9xto8k0f7l67g14cfls5fipbog 2400914 2400907 2026-04-13T05:30:52Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P90466 and previous config saved to /var/cache/conftool/dbconfig/20260413-053050-ladsgroup.json 2400914 wikitext text/x-wiki 2n1fkmxsps87s3lk0fze6xetnw91u52 2400915 2400914 2026-04-13T05:41:01Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P90467 and previous config saved to /var/cache/conftool/dbconfig/20260413-054100-ladsgroup.json 2400915 wikitext text/x-wiki t7k0se8tcrwsjuyaldt06smn6dbm70m 2400916 2400915 2026-04-13T05:51:09Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1194 (T410589)', diff saved to https://phabricator.wikimedia.org/P90468 and previous config saved to /var/cache/conftool/dbconfig/20260413-055106-ladsgroup.json 2400916 wikitext text/x-wiki og0mrbdc5r591u76wrnxirfaduv239a 2400917 2400916 2026-04-13T05:51:23Z Stashbot 7414 ladsgroup@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1202.eqiad.wmnet with reason: Maintenance 2400917 wikitext text/x-wiki j67yikensxmxzi8chpsebqbwmden2b3 2400918 2400917 2026-04-13T05:51:33Z Stashbot 7414 ladsgroup@cumin1003: dbctl commit (dc=all): 'Depooling db1202 (T410589)', diff saved to https://phabricator.wikimedia.org/P90469 and previous config saved to /var/cache/conftool/dbconfig/20260413-055130-ladsgroup.json 2400918 wikitext text/x-wiki dchcj9y3alhtx5wkxigmthrd1amg8im 2400919 2400918 2026-04-13T07:09:27Z Stashbot 7414 moritzm: installing openssh security updates 2400919 wikitext text/x-wiki jrb1fdzl6w6wc89i2c5zkk7r27crjgn 2400922 2400919 2026-04-13T07:16:44Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host mirror1001.wikimedia.org 2400922 wikitext text/x-wiki ts2cyixpzx98z2e1sqr2lmr3asfad56 2400923 2400922 2026-04-13T07:20:29Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook-next: apply 2400923 wikitext text/x-wiki t379g6xjuuaknkwhh0hrzl6j96uztxr 2400924 2400923 2026-04-13T07:21:32Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthboo-next: apply 2400924 wikitext text/x-wiki hm8zinn6kb97w48i4l1ehgkxdapn8m6 2400925 2400924 2026-04-13T07:23:32Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mirror1001.wikimedia.org 2400925 wikitext text/x-wiki j7p8yi7i4n2h7otwz9vb9dqg3jzxihx 2400927 2400925 2026-04-13T07:35:35Z Stashbot 7414 elukey@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'edit-check' for release 'main' . 2400927 wikitext text/x-wiki rz60bsyo6frehq8dn7fwgbyv92877yf 2400929 2400927 2026-04-13T07:40:28Z Stashbot 7414 elukey@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'edit-check' for release 'main' . 2400929 wikitext text/x-wiki lw4c42duss6qfglhsb5eo5uxdwu6f44 2400930 2400929 2026-04-13T08:06:16Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-descriptions' for release 'main' . 2400930 wikitext text/x-wiki emmkldobh6c7ubx316hsohtd1xfzg72 2400931 2400930 2026-04-13T08:09:25Z Stashbot 7414 taavi@dns1004: START - running authdns-update 2400931 wikitext text/x-wiki 6keurbqzo92j48xtmwm8p25xb8oxtcv 2400932 2400931 2026-04-13T08:10:47Z Stashbot 7414 taavi@dns1004: END - running authdns-update 2400932 wikitext text/x-wiki iuk9ujangszxsvdx864ixjnhg97c5z5 2400934 2400932 2026-04-13T08:21:46Z Stashbot 7414 fceratto@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2150.codfw.wmnet with reason: Maintenance 2400934 wikitext text/x-wiki 6243a6q14z89sjnrjyizlgnj9zi5jzx 2400935 2400934 2026-04-13T08:22:38Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Depooling db2150 (T419635)', diff saved to https://phabricator.wikimedia.org/P90470 and previous config saved to /var/cache/conftool/dbconfig/20260413-082233-fceratto.json 2400935 wikitext text/x-wiki fpq9h761bmul7niawhfm4ewegvvpjqo 2400937 2400935 2026-04-13T08:38:05Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2150 (T419635)', diff saved to https://phabricator.wikimedia.org/P90471 and previous config saved to /var/cache/conftool/dbconfig/20260413-083801-fceratto.json 2400937 wikitext text/x-wiki dm1yw7tdrol2lwgxestannraxaza5qx 2400938 2400937 2026-04-13T08:43:07Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host bast1003.wikimedia.org 2400938 wikitext text/x-wiki ctno2g7bvouooe0essailjkjdjgd6pa 2400939 2400938 2026-04-13T08:48:52Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P90473 and previous config saved to /var/cache/conftool/dbconfig/20260413-084850-fceratto.json 2400939 wikitext text/x-wiki 8rqkcmiboxtc3rrclvfr08znd76kwqo 2400940 2400939 2026-04-13T08:48:53Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast1003.wikimedia.org 2400940 wikitext text/x-wiki 7v605o1zcyqur4jwnv7u039858rxtb3 2400941 2400940 2026-04-13T08:59:40Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2150', diff saved to https://phabricator.wikimedia.org/P90474 and previous config saved to /var/cache/conftool/dbconfig/20260413-085938-fceratto.json 2400941 wikitext text/x-wiki g5w20pgwqf9x83zswmaiqn94aqviudx 2400943 2400941 2026-04-13T09:10:30Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2150 (T419635)', diff saved to https://phabricator.wikimedia.org/P90476 and previous config saved to /var/cache/conftool/dbconfig/20260413-091027-fceratto.json 2400943 wikitext text/x-wiki 8630pfz13z0yqrwv2nlsxweatgbznp5 2400944 2400943 2026-04-13T09:10:36Z Stashbot 7414 fceratto@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2159.codfw.wmnet with reason: Maintenance 2400944 wikitext text/x-wiki hj5lh0crg730j4hnt6adnniu4750jv9 2400946 2400944 2026-04-13T09:11:25Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Depooling db2159 (T419635)', diff saved to https://phabricator.wikimedia.org/P90477 and previous config saved to /var/cache/conftool/dbconfig/20260413-091122-fceratto.json 2400946 wikitext text/x-wiki tq1lywbv03pnbsfzmlhczaqkzhbmflt 2400947 2400946 2026-04-13T09:15:40Z Stashbot 7414 root@cumin1003: START - Cookbook sre.mysql.depool depool pc1011: Security updates 2400947 wikitext text/x-wiki 7b7p5xfd8rwfz2tv46h72pd0st1yvyl 2400948 2400947 2026-04-13T09:15:41Z Stashbot 7414 root@cumin1003: START - Cookbook sre.mysql.parsercache 2400948 wikitext text/x-wiki 6lznxi79ne5a4r8j2tduuw3qm4wl8f6 2400949 2400948 2026-04-13T09:15:48Z Stashbot 7414 root@cumin1003: END (FAIL) - Cookbook sre.mysql.parsercache (exit_code=99) 2400949 wikitext text/x-wiki 4ia3c5qcv40pg94qc1lgq1ebfnpze3p 2400950 2400949 2026-04-13T09:15:49Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1011: Security updates 2400950 wikitext text/x-wiki scrixbh9ihlldqrop71bgezro9d72ws 2400951 2400950 2026-04-13T09:17:10Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.depool depool pc1011: Security updates 2400951 wikitext text/x-wiki 82m8brhrx8e3zjp5xp4ujj4cjm07n9h 2400952 2400951 2026-04-13T09:17:11Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.parsercache 2400952 wikitext text/x-wiki sd441pva6lngdh1c9v9lhdt0jfnk8m6 2400953 2400952 2026-04-13T09:17:16Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) 2400953 wikitext text/x-wiki k1wobtboef3nda6ppaku4o5engtx9v4 2400954 2400953 2026-04-13T09:17:17Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1011: Security updates 2400954 wikitext text/x-wiki 1qyc0qtaqlurfpd9meq89nmc7gtv2hs 2400955 2400954 2026-04-13T09:19:07Z Stashbot 7414 root@cumin1003: START - Cookbook sre.mysql.depool depool pc1011: Security updates 2400955 wikitext text/x-wiki grp81ichjycgmaedcr3da4npayt63n7 2400956 2400955 2026-04-13T09:19:09Z Stashbot 7414 root@cumin1003: START - Cookbook sre.mysql.parsercache 2400956 wikitext text/x-wiki nlv1wv4is584mrizw8hcfbcfpj3n347 2400957 2400956 2026-04-13T09:19:12Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) 2400957 wikitext text/x-wiki 5ssg5o72vrgidq5mxtkgr6ee7d04xsp 2400958 2400957 2026-04-13T09:19:13Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1011: Security updates 2400958 wikitext text/x-wiki 03w6fwmqnt2ltmvagk99lrao08ussl6 2400959 2400958 2026-04-13T09:19:38Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'edit-check' for release 'main' . 2400959 wikitext text/x-wiki hk8ozlqwpuuq24zwrvxippkqspq2521 2400960 2400959 2026-04-13T09:26:43Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2159 (T419635)', diff saved to https://phabricator.wikimedia.org/P90479 and previous config saved to /var/cache/conftool/dbconfig/20260413-092640-fceratto.json 2400960 wikitext text/x-wiki lcbrt0u8fex6lddh93ffi98o6ok8tng 2400961 2400960 2026-04-13T09:37:31Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P90480 and previous config saved to /var/cache/conftool/dbconfig/20260413-093729-fceratto.json 2400961 wikitext text/x-wiki itr2g1drqxyqha44yexlv58mszp5xb3 2400962 2400961 2026-04-13T09:38:25Z Stashbot 7414 ladsgroup@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db2200.codfw.wmnet with reason: Maintenance 2400962 wikitext text/x-wiki h0762x8n48fqkn0up2smvf65vzcbifh 2400966 2400962 2026-04-13T09:47:46Z Stashbot 7414 daniel@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2400966 wikitext text/x-wiki 93fg04zfzq1ssvd1ulaboe1xka17dyx 2400967 2400966 2026-04-13T09:48:20Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2159', diff saved to https://phabricator.wikimedia.org/P90481 and previous config saved to /var/cache/conftool/dbconfig/20260413-094818-fceratto.json 2400967 wikitext text/x-wiki 6926j17b88tae8ii0k20j1k1v8yzqg4 2400968 2400967 2026-04-13T09:49:29Z Stashbot 7414 daniel@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2400968 wikitext text/x-wiki 39lijlzu7viz6e4xb7cbo97ro7ri5s5 2400969 2400968 2026-04-13T09:59:10Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2159 (T419635)', diff saved to https://phabricator.wikimedia.org/P90482 and previous config saved to /var/cache/conftool/dbconfig/20260413-095906-fceratto.json 2400969 wikitext text/x-wiki trr87kno7mnpl1609a2i7bhf3opj6c3 2400970 2400969 2026-04-13T09:59:16Z Stashbot 7414 fceratto@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2168.codfw.wmnet with reason: Maintenance 2400970 wikitext text/x-wiki egshs9z5xss2qt7ms3t4hvo3h7lqd6z 2400971 2400970 2026-04-13T10:00:06Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Depooling db2168 (T419635)', diff saved to https://phabricator.wikimedia.org/P90483 and previous config saved to /var/cache/conftool/dbconfig/20260413-100003-fceratto.json 2400971 wikitext text/x-wiki qtzvmw1f83jj6wo8r8n6dspq72gwec8 2400972 2400971 2026-04-13T10:05:43Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2400972 wikitext text/x-wiki nbhq5ivbasx3bwsx69menxy0yfrrstv 2400973 2400972 2026-04-13T10:05:55Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2400973 wikitext text/x-wiki ropy2qye1d4bjxal1qtrx8bpffzy3fn 2400974 2400973 2026-04-13T10:06:40Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2400974 wikitext text/x-wiki t77egzpff6le3ppslg2psohddmdkh5a 2400975 2400974 2026-04-13T10:07:26Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2400975 wikitext text/x-wiki eqsvb00ub9pqrcfrdg4a7a4k5r4mu6z 2400976 2400975 2026-04-13T10:09:20Z Stashbot 7414 daniel@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2400976 wikitext text/x-wiki tj1nnzgdsaiznt6xsnqgq0cxsumkt97 2400977 2400976 2026-04-13T10:09:25Z Stashbot 7414 daniel@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2400977 wikitext text/x-wiki 9kdhdu9hd961mb77lzpsik1nayg4dhq 2400978 2400977 2026-04-13T10:14:14Z Stashbot 7414 daniel@deploy1003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2400978 wikitext text/x-wiki m1qiry4fknvev0ckn4nnjfh5oysr3yg 2400979 2400978 2026-04-13T10:14:23Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host krb1002.eqiad.wmnet 2400979 wikitext text/x-wiki iolrpqrzq07pvmjirqrpwbdkv8e9jyz 2400980 2400979 2026-04-13T10:14:53Z Stashbot 7414 daniel@deploy1003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2400980 wikitext text/x-wiki 88rd5755sahd7pfdn3u3f0stkbipjm1 2400981 2400980 2026-04-13T10:15:12Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2400981 wikitext text/x-wiki kve7ilgf0vycxwx8jygzet6akeyz0rq 2400982 2400981 2026-04-13T10:15:34Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2168 (T419635)', diff saved to https://phabricator.wikimedia.org/P90484 and previous config saved to /var/cache/conftool/dbconfig/20260413-101530-fceratto.json 2400982 wikitext text/x-wiki laa88lme0b3usryehtrryghoy52cy7a 2400983 2400982 2026-04-13T10:15:45Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2400983 wikitext text/x-wiki ik4g91yedmjqk57caxthomqjkrs6rcq 2400984 2400983 2026-04-13T10:19:21Z Stashbot 7414 daniel@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2400984 wikitext text/x-wiki agc9cj866sbttqlrhn8kqfx0e5bdfes 2400985 2400984 2026-04-13T10:19:35Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host krb1002.eqiad.wmnet 2400985 wikitext text/x-wiki 4ib2q1uqmjc6o3gt45mlt28e6cmozz4 2400986 2400985 2026-04-13T10:19:43Z Stashbot 7414 daniel@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2400986 wikitext text/x-wiki s8kosw4drdveefyuhsdtb1q3rluh58v 2400987 2400986 2026-04-13T10:26:21Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P90485 and previous config saved to /var/cache/conftool/dbconfig/20260413-102619-fceratto.json 2400987 wikitext text/x-wiki 9cd3h3oqa0j5s0vf7sw7nmykfem50au 2400988 2400987 2026-04-13T10:26:41Z Stashbot 7414 vgutierrez@cumin1003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on P{cp[3067,3074].esams.wmnet} and A:cp - 9.2.13 upgrade (T422328) 2400988 wikitext text/x-wiki e98rspa2fgp8kf0hm0jdud90t028h96 2400989 2400988 2026-04-13T10:28:33Z Stashbot 7414 daniel@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2400989 wikitext text/x-wiki fgsmwzg23f5wud71x4feuahvua410nj 2400990 2400989 2026-04-13T10:29:19Z Stashbot 7414 daniel@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2400990 wikitext text/x-wiki m893r7v538wij95sgpku6e41ncg7tal 2400991 2400990 2026-04-13T10:33:20Z Stashbot 7414 daniel@deploy1003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2400991 wikitext text/x-wiki rjvsef8bu5ywdlmy14jflzpnofv85wm 2400992 2400991 2026-04-13T10:34:01Z Stashbot 7414 daniel@deploy1003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2400992 wikitext text/x-wiki rqho5sy37xmp7kq75uni1e2ozsits4r 2400993 2400992 2026-04-13T10:37:10Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2168', diff saved to https://phabricator.wikimedia.org/P90486 and previous config saved to /var/cache/conftool/dbconfig/20260413-103707-fceratto.json 2400993 wikitext text/x-wiki 9lrtnupcte8usch3o9nl4yyy6sk413m 2400994 2400993 2026-04-13T10:37:41Z Stashbot 7414 vgutierrez@cumin1003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on P{cp[3067,3074].esams.wmnet} and A:cp - 9.2.13 upgrade (T422328) 2400994 wikitext text/x-wiki drycv7m8w2ek4ovleyap48ojl52s036 2400995 2400994 2026-04-13T10:38:16Z Stashbot 7414 daniel@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2400995 wikitext text/x-wiki semq3ckofncz9538gps5au7cfxhzvit 2400996 2400995 2026-04-13T10:38:42Z Stashbot 7414 daniel@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2400996 wikitext text/x-wiki fbzlps0flzrztkvf600zf14hn472uhp 2401000 2400996 2026-04-13T10:47:59Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2168 (T419635)', diff saved to https://phabricator.wikimedia.org/P90487 and previous config saved to /var/cache/conftool/dbconfig/20260413-104756-fceratto.json 2401000 wikitext text/x-wiki lxp0iskj697f9mwc4xv53q3tuyaoran 2401001 2401000 2026-04-13T10:48:05Z Stashbot 7414 fceratto@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2182.codfw.wmnet with reason: Maintenance 2401001 wikitext text/x-wiki 8ls9utvtsggznpwie97qhek04c32gk4 2401002 2401001 2026-04-13T10:48:56Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Depooling db2182 (T419635)', diff saved to https://phabricator.wikimedia.org/P90488 and previous config saved to /var/cache/conftool/dbconfig/20260413-104852-fceratto.json 2401002 wikitext text/x-wiki rln80o8uome6fgairpfpgv51xn6911q 2401004 2401002 2026-04-13T11:04:08Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2182 (T419635)', diff saved to https://phabricator.wikimedia.org/P90489 and previous config saved to /var/cache/conftool/dbconfig/20260413-110405-fceratto.json 2401004 wikitext text/x-wiki mrn91kyfhgj9nn1uz2h9crh1k0ku2ec 2401005 2401004 2026-04-13T11:14:55Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P90490 and previous config saved to /var/cache/conftool/dbconfig/20260413-111452-fceratto.json 2401005 wikitext text/x-wiki fihatlhjf7t81wyzozro1orzxjr92e8 2401009 2401005 2026-04-13T11:25:44Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P90491 and previous config saved to /var/cache/conftool/dbconfig/20260413-112541-fceratto.json 2401009 wikitext text/x-wiki lwb9sve2e9yf4j7gnnanwcvs6hx2ib0 2401011 2401009 2026-04-13T11:36:35Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Repooling after maintenance db2182 (T419635)', diff saved to https://phabricator.wikimedia.org/P90492 and previous config saved to /var/cache/conftool/dbconfig/20260413-113630-fceratto.json 2401011 wikitext text/x-wiki 2zhzidcrec058zcxwqy9up5hoza9u0d 2401012 2401011 2026-04-13T11:36:40Z Stashbot 7414 fceratto@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2200.codfw.wmnet with reason: Maintenance 2401012 wikitext text/x-wiki phfbduekrg26enblao7c96sxipdf25d 2401013 2401012 2026-04-13T11:36:49Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2401013 wikitext text/x-wiki 7dlqvrv6aqj4cvcrn67223q7vbtf1el 2401014 2401013 2026-04-13T11:38:07Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2401014 wikitext text/x-wiki nore39svs02qc12yaqx2qfvaqf2v3wd 2401030 2401014 2026-04-13T11:48:17Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host puppetserver2004.codfw.wmnet 2401030 wikitext text/x-wiki 99ogeurpzppvymdrt0g2g3rjmvyo9xt 2401032 2401030 2026-04-13T11:49:14Z Stashbot 7414 fceratto@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2208.codfw.wmnet with reason: Maintenance 2401032 wikitext text/x-wiki rc7udt6u0nwgy72l6u4e8x20ucnl660 2401034 2401032 2026-04-13T11:49:57Z Stashbot 7414 fceratto@cumin2002: dbctl commit (dc=all): 'Depooling db2208 (T419635)', diff saved to https://phabricator.wikimedia.org/P90493 and previous config saved to /var/cache/conftool/dbconfig/20260413-114953-fceratto.json 2401034 wikitext text/x-wiki lzc6l2bkncalcgjsk4qawuie8ewy1eu 2401041 2401034 2026-04-13T11:54:32Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetserver2004.codfw.wmnet 2401041 wikitext text/x-wiki 6fqih4u3ufbb38x5uvl4b4pd57mstqz 2401043 2401041 2026-04-13T11:55:41Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host puppetserver1003.eqiad.wmnet 2401043 wikitext text/x-wiki 32rynb5yxc0p62qdzo0piqm9yxt7bo7 Query killer 0 15795 2401023 1929215 2026-04-13T11:45:07Z Uzume 290 gitiles 2401023 wikitext text/x-wiki lqsu6it1kw3xgq7adtx58veq5z9xum4 History of job queue runners at WMF 0 16009 2401042 2246610 2026-04-13T11:54:45Z Uzume 290 gitiles 2401042 wikitext text/x-wiki 0n976g08lsuq3e8aci87wmfqohhf1fm Release Engineering/SAL 0 17290 2400891 2400774 2026-04-12T18:21:22Z Stashbot 7414 James_F: jforrester@contint1002:~$ sudo /usr/sbin/service zuul restart && tail -f -n100 /var/log/zuul/zuul.log # T423027 2400891 wikitext text/x-wiki 1qkanhpzzmhuqng1jvwu51lx3w2xjj3 Data Platform/Systems/Cluster/Geotagging 0 26424 2401026 2231193 2026-04-13T11:46:51Z Uzume 290 gitiles 2401026 wikitext text/x-wiki 43e4r0rdck653b21rh3o7quunbq02sr Data Platform/Systems/Wikistats 2 0 112628 2401038 2371081 2026-04-13T11:53:18Z Uzume 290 gitiles 2401038 wikitext text/x-wiki b6fr4r75y9uusge6v9h00grac3lnyiy Streamlined Service Delivery Design/current-ci 0 443255 2401020 1812655 2026-04-13T11:43:15Z Uzume 290 gitiles 2401020 wikitext text/x-wiki 34ln1ll8j42p1wzn1bdkpnlubagph77 Release Engineering/Runbook/Fresnel 0 443466 2401016 2119965 2026-04-13T11:40:40Z Uzume 290 gitiles 2401016 wikitext text/x-wiki 8gaawahlspwsl6d3gy1ymolorxs0mtl Release Engineering/Runbook/Puppet patches 0 443512 2401017 2314268 2026-04-13T11:41:21Z Uzume 290 gitiles 2401017 wikitext text/x-wiki k6oezexz0tj57fsy1huiuyjhlg5x1u6 Zotero/Deploying zotero 0 443685 2401039 2372407 2026-04-13T11:53:41Z Uzume 290 gitiles 2401039 wikitext text/x-wiki gety1fu5kejfxgupod1y31ahxj7wafb Wmf-laptop 0 445828 2401045 2377388 2026-04-13T11:56:06Z Uzume 290 gitiles 2401045 wikitext text/x-wiki tjdbbh8psrtw3j0jkqnkfkaqpmsj4hm Puppet/Pontoon 0 445919 2401040 2370557 2026-04-13T11:54:09Z Uzume 290 gitiles 2401040 wikitext text/x-wiki 064cvncq5rmdnn29mimyi121qoekplg Static-codereview.wikimedia.org 0 446028 2401022 1866054 2026-04-13T11:44:39Z Uzume 290 gitiles 2401022 wikitext text/x-wiki 814up3qroaap2bk0izxnuoobmdu13t4 User talk:DCaro (WMF) 3 446778 2400890 2399382 2026-04-12T15:54:07Z MBH 3865 /* Webservice on Toolforge */ reply to DCaro (WMF) ([[mw:c:Special:MyLanguage/User:JWBTH/CD|CD]]) 2400890 wikitext text/x-wiki 2hdycm7bzgenpe09lpuw5csh0nktwqi Release Engineering/Runbook/WikimediaDebug 0 446874 2401015 2306448 2026-04-13T11:38:36Z Uzume 290 gitiles 2401015 wikitext text/x-wiki opqx25d5hkzma7uf5h4dd8j1lyxc4ba Wikimedia Cloud Services team/EnhancementProposals/Toolforge push to deploy/Blog post 0 446927 2401018 1898616 2026-04-13T11:42:20Z Uzume 290 gitiles 2401018 wikitext text/x-wiki 7hqfou1xngowdvjvwydggq0j29i9ixw SRE/Observability/Ownership 0 448007 2401019 2099461 2026-04-13T11:42:47Z Uzume 290 gitiles 2401019 wikitext text/x-wiki 9ttihyebwmg5i2hj2j5qeweko2tc3wg Switch Datacenter/Not switching 0 448037 2401021 1916792 2026-04-13T11:44:05Z Uzume 290 gitiles 2401021 wikitext text/x-wiki czm6mv7871u5mpj3f1o9wa474dkfezw Nova Resource:Trove/SAL 498 448391 2400963 2399202 2026-04-13T09:42:27Z Stashbot 7414 godog: delete non-durable guestagent rabbit exchanges and roll-restart guest-agent - T421857 2400963 wikitext text/x-wiki tazcepa0zrsmpu5vac823mmw4yxb72q Map of database maintenance 0 449160 2400903 2400876 2026-04-13T00:00:12Z Dexbot 30554 Bot: Updating the report 2400903 wikitext text/x-wiki 5pmbw3av855il8hp683ribk29i5a0gn 2400908 2400903 2026-04-13T05:21:51Z Dexbot 30554 Bot: Updating the report 2400908 wikitext text/x-wiki 9lq4uocau819w0wvt1r4qvscnstz2h3 2400936 2400908 2026-04-13T08:25:13Z Dexbot 30554 Bot: Updating the report 2400936 wikitext text/x-wiki 0sn89sab7059aboglnh39ikp22uevgx Image-suggestion 0 450898 2401028 2234483 2026-04-13T11:47:39Z Uzume 290 gitiles 2401028 wikitext text/x-wiki 5bbvd3lg2ebakuena6q8r8sj44ff3zx Gerrit/Events ingestion 0 451187 2401025 2230386 2026-04-13T11:46:22Z Uzume 290 gitiles 2401025 wikitext text/x-wiki 9c7psf00i9omvn6ctfxkwjbm51hll34 User-agent client hints 0 453375 2401029 2306226 2026-04-13T11:48:05Z Uzume 290 gitiles 2401029 wikitext text/x-wiki 61i6hvlec8p6qwd0qqrs99kp66ujojv MariaDB/Clone a host 0 453707 2401027 2288226 2026-04-13T11:47:13Z Uzume 290 gitiles 2401027 wikitext text/x-wiki kabpv2nhit7x01zrfd1v67c7f7no88f Portal:Data Services/Admin/Dumps 0 454144 2400933 2399170 2026-04-13T08:14:40Z Taavi-WMF 41365 update for LVS 2400933 wikitext text/x-wiki qjxphqdn8520q6otiyc635l2ivra61t MediaWiki Externalized Data Problem 0 454239 2401037 2360456 2026-04-13T11:52:34Z Uzume 290 gitiles 2401037 wikitext text/x-wiki r78mbg8cz85nthzen8b0gpbbhw0mk05 Chart renderer 0 455559 2401035 2358660 2026-04-13T11:50:55Z Uzume 290 gitiles 2401035 wikitext text/x-wiki jc08dwuzr0fg6kjteqwwdbq4mf0uvi7 Portal:Cloud VPS/Admin/Cloud roots and Cloud admins 0 455690 2401033 2342736 2026-04-13T11:49:28Z Uzume 290 gitiles 2401033 wikitext text/x-wiki iob15z3dd1nm24drykep50xtop5dvvj MediaWiki JobQueue/Operations 0 456144 2401044 2246519 2026-04-13T11:55:42Z Uzume 290 gitiles 2401044 wikitext text/x-wiki th2k6s3xhonc6c7lspukkaxluo82awh Nokia Networking/SR Linux Commands 0 458675 2401006 2376318 2026-04-13T11:20:14Z CMooney (WMF) 24288 /* Show BGP routes advertised/received */ 2401006 wikitext text/x-wiki m3k6ev0sw86a1a9z7nxm0ai79xne0ck 2401007 2401006 2026-04-13T11:20:53Z CMooney (WMF) 24288 /* Show BGP routes rejected by policy */ 2401007 wikitext text/x-wiki 57vwir535467g0g66nccq918xwvd98m 2401008 2401007 2026-04-13T11:22:32Z CMooney (WMF) 24288 /* Show BGP routes rejected */ 2401008 wikitext text/x-wiki 79vsh2m27sxpq7xe33mya7zegt2l9gt Single Version MediaWiki/Rationale 0 458687 2401046 2336771 2026-04-13T11:56:38Z Uzume 290 gitiles 2401046 wikitext text/x-wiki o6qk9klw0rdjlzy2m3hqc74yr99dhcp Portal:Cloud VPS/Admin/VM access 0 459146 2401031 2342737 2026-04-13T11:48:34Z Uzume 290 gitiles 2401031 wikitext text/x-wiki dipvc80l6agv88u1kunwz51bnl7szjl User:Krinkle/SEO/New page patrol (2026) 2 460015 2400905 2397618 2026-04-13T05:16:21Z Krinkle 44 Krinkle moved page [[User:Krinkle/SEO/New page patrol (2026)]] to [[User:Krinkle/SEO]] 2397618 wikitext text/x-wiki 83r7gnfwti565t8y8dtqezsb2o4tcrm 2400909 2400905 2026-04-13T05:23:49Z Krinkle 44 Replaced content with "In Feb 2026 we learned that '''new articles often take weeks or months to surface in Google Search'''. The current investigation started after a discussion on the English Wikipedia VPT about new pages that get patrolled but not indexed in Google. == Moved == Moved to https://phabricator.wikimedia.org/T423068. == See also == * :en:Wikipedia:Village_pump_(technical)/Archive_227#c-MediaKyle-20260210160400-Indexed_article_omitted_from_Google|Indexed article omitted..." 2400909 wikitext text/x-wiki haq3ssfejay719s0pj26o79k8q0433u 2400910 2400909 2026-04-13T05:24:08Z Krinkle 44 Krinkle moved page [[User:Krinkle/SEO]] to [[User:Krinkle/SEO/New page patrol (2026)]] over redirect 2400909 wikitext text/x-wiki haq3ssfejay719s0pj26o79k8q0433u 2400912 2400910 2026-04-13T05:24:08Z Krinkle 44 Krinkle moved page [[User:Krinkle/SEO/New page patrol (2026)]] to [[User:Krinkle/SEO/New page patrol (2026)/New page patrol (2026)]] 2400909 wikitext text/x-wiki haq3ssfejay719s0pj26o79k8q0433u 2400920 2400912 2026-04-13T07:10:39Z Krinkle 44 Krinkle moved page [[User:Krinkle/SEO/New page patrol (2026)/New page patrol (2026)]] to [[User:Krinkle/SEO/New page patrol (2026)]] over redirect 2400909 wikitext text/x-wiki haq3ssfejay719s0pj26o79k8q0433u 2400928 2400920 2026-04-13T07:39:41Z Taavi 13997 /* See also */ LISTGAP 2400928 wikitext text/x-wiki 32p6r7h50jl9co0mp77q3k2z1cy9j7a User:Krinkle/SEO 2 460043 2400911 2026-04-13T05:24:08Z Krinkle 44 Krinkle moved page [[User:Krinkle/SEO]] to [[User:Krinkle/SEO/New page patrol (2026)]] over redirect 2400911 wikitext text/x-wiki 7s1plbuwno39x660ade1udusgpdhy6b