Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.45.0-wmf.8 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Nova Resource:Tools/SAL 498 3086 2320551 2320502 2025-07-03T13:09:27Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-24 2320551 wikitext text/x-wiki 4aie8heb5gwzmb9ufcj3arye1abpqoe 2320554 2320551 2025-07-03T13:15:22Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-24 2320554 wikitext text/x-wiki t5qn3fv4ga447ne3zc77lihr14vv54k 2320564 2320554 2025-07-03T13:23:09Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logging 2320564 wikitext text/x-wiki dcyhdm9qfw3lv37ygqax8j1pqhhjc1r 2320566 2320564 2025-07-03T13:26:19Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logging 2320566 wikitext text/x-wiki hwbkc3cretbjgg86esz47mb5g7lrnoy 2320571 2320566 2025-07-03T13:31:26Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2320571 wikitext text/x-wiki 16k3nsglgzs4dwlc8cp9ufei0q5b1r1 2320576 2320571 2025-07-03T13:36:45Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2320576 wikitext text/x-wiki 80pdb58hvz7ai4e0hbpetwp6zcpfcfy 2320591 2320576 2025-07-03T14:02:24Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-cli 2320591 wikitext text/x-wiki nzuco8eu394hznzoge8xmw8tfrra51y 2320595 2320591 2025-07-03T14:06:04Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-cli 2320595 wikitext text/x-wiki h8fumbc87sick7pwfjin7nsfpxydm40 2320651 2320595 2025-07-03T16:31:01Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2320651 wikitext text/x-wiki 5llw61kv78vhdylkpm0jgf4v9z4fqv3 2320656 2320651 2025-07-03T16:36:39Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2320656 wikitext text/x-wiki lg2xdyc11dyoxv1l4oqlco0nns8rps4 Deployments 0 4108 2320543 2320509 2025-07-03T12:11:04Z ScheduleDeploymentBot 37566 Add [[gerrit:1165635]] to Thursday, July 03 UTC afternoon backport window 2320543 wikitext text/x-wiki stx37gtg20bgifvnnmlrb0i0c6d8jl3 2320598 2320543 2025-07-03T14:11:59Z ScheduleDeploymentBot 37566 Add [[gerrit:1166206]] to Thursday, July 03 UTC late backport window 2320598 wikitext text/x-wiki o3mcfvkpwo2h6xtwtrrz4j6z7apqhhy 2320669 2320598 2025-07-03T18:01:04Z ScheduleDeploymentBot 37566 Add [[gerrit:1166236]] to Thursday, July 03 UTC late backport window 2320669 wikitext text/x-wiki dn9u99eualyhroxynzxmfacea044zyl 2320670 2320669 2025-07-03T19:31:19Z ScheduleDeploymentBot 37566 Add [[gerrit:1166012]] to Thursday, July 03 UTC late backport window 2320670 wikitext text/x-wiki 62tim3ldfeqo23jnhge3e2v12mgni08 2320675 2320670 2025-07-03T19:53:11Z ScheduleDeploymentBot 37566 Add [[gerrit:1166133]] to Thursday, July 03 UTC late backport window 2320675 wikitext text/x-wiki 0hos1aad6zsf9v4zr16i8trn3mfa97s Nova Resource:Toolsbeta/SAL 498 6726 2320563 2320497 2025-07-03T13:23:07Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2320563 wikitext text/x-wiki sru9uj4g69zsm1ffex7hn3n32p2izi5 2320569 2320563 2025-07-03T13:27:51Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2320569 wikitext text/x-wiki ffud9fuufuy0stneu938se83cevqzzn 2320588 2320569 2025-07-03T13:55:59Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-cli 2320588 wikitext text/x-wiki n8wx4soxcb002ksful3z9i8suwvi91a 2320590 2320588 2025-07-03T14:00:29Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-cli 2320590 wikitext text/x-wiki krqjb0yq8ixisqta15pv09bzml0n0df 2320630 2320590 2025-07-03T15:10:59Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2320630 wikitext text/x-wiki e890uk1zol9hev2h16u6pvsrf687hlh 2320631 2320630 2025-07-03T15:15:47Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2320631 wikitext text/x-wiki c9a1zz50u0uyiffmx1eq1lbhnf91wtb Server Admin Log 0 7919 2320544 2320542 2025-07-03T12:51:08Z Stashbot 7414 mfossati@deploy1003: Started deploy [airflow-dags/platform_eng@09893e3]: bump section topics to v1.7.0 2320544 wikitext text/x-wiki o1j8j4nr960n6f30u6hoitewqao11vl 2320546 2320544 2025-07-03T12:54:12Z Stashbot 7414 mfossati@deploy1003: Finished deploy [airflow-dags/platform_eng@09893e3]: bump section topics to v1.7.0 (duration: 03m 20s) 2320546 wikitext text/x-wiki kxdx8onieh2r8xqnofbbf5ydsyzt400 2320547 2320546 2025-07-03T12:59:15Z Stashbot 7414 andrew@cumin1003: START - Cookbook sre.hosts.reimage for host cloudcephmon2005-dev.codfw.wmnet with OS bullseye 2320547 wikitext text/x-wiki rcyxp8uebxjrwd25gykg2ruyzhcfjqg 2320548 2320547 2025-07-03T12:59:20Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of ncredir6001.drmrs.wmnet to drbd 2320548 wikitext text/x-wiki aa88ea0llkmqj2o66eekd263gz8ppaq 2320549 2320548 2025-07-03T13:04:50Z Stashbot 7414 samtar@deploy1003: Started scap sync-world: Backport for [[gerrit:1166155|InitialiseSettings: Enable wgTemplateDataEnableDiscovery as default (T377978)]], [[gerrit:1165635|Allow abusefilter block action on plwikiquote (T398137)]] 2320549 wikitext text/x-wiki eflfts92t45n0h6t67u45m58ezo7yj7 2320550 2320549 2025-07-03T13:08:46Z Stashbot 7414 samtar@deploy1003: samtar, eggroll97: Backport for [[gerrit:1166155|InitialiseSettings: Enable wgTemplateDataEnableDiscovery as default (T377978)]], [[gerrit:1165635|Allow abusefilter block action on plwikiquote (T398137)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2320550 wikitext text/x-wiki 65kk5iqphtutyxscv7rbc67cwjmz1fl 2320552 2320550 2025-07-03T13:10:11Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ncredir6001.drmrs.wmnet to drbd 2320552 wikitext text/x-wiki 4oof2nc2opmvpvs2k7rls9qf6j8ln2a 2320553 2320552 2025-07-03T13:11:21Z Stashbot 7414 samtar@deploy1003: samtar, eggroll97: Continuing with sync 2320553 wikitext text/x-wiki bgqt5t6mfquhd1g535q9ofluu55xrcm 2320556 2320553 2025-07-03T13:17:59Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of doh6001.wikimedia.org to drbd 2320556 wikitext text/x-wiki 2un5nfqfnyt7ncz3wnhmhl2q83kwu8o 2320557 2320556 2025-07-03T13:18:33Z Stashbot 7414 sukhe: sudo cumin 'C:bird' "disable-puppet 'merging CR 1163858'": T374619 2320557 wikitext text/x-wiki i8cgoyuynzxhn8n92likuv5cp7jgsnm 2320558 2320557 2025-07-03T13:18:54Z Stashbot 7414 samtar@deploy1003: Finished scap sync-world: Backport for [[gerrit:1166155|InitialiseSettings: Enable wgTemplateDataEnableDiscovery as default (T377978)]], [[gerrit:1165635|Allow abusefilter block action on plwikiquote (T398137)]] (duration: 14m 04s) 2320558 wikitext text/x-wiki frabxfonxozpby615r1jyo1suxs3ew4 2320559 2320558 2025-07-03T13:18:57Z Stashbot 7414 andrew@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephmon2005-dev.codfw.wmnet with reason: host reimage 2320559 wikitext text/x-wiki c0uj7v3y7ceutenmojswowl2ns2gqln 2320560 2320559 2025-07-03T13:20:02Z Stashbot 7414 TheresNoTime: done UTC afternoon backport window 2320560 wikitext text/x-wiki fobh1pj3op23gkcfpi3q8iv4wot63v5 2320561 2320560 2025-07-03T13:21:40Z Stashbot 7414 sukhe: sudo cumin -b11 'C:bird' "run-puppet-agent --enable 'merging CR 1163858'": NOOP change T374619 2320561 wikitext text/x-wiki d3p36stj0cn79d9a3crucxapfvy4wvb 2320562 2320561 2025-07-03T13:22:09Z Stashbot 7414 andrew@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephmon2005-dev.codfw.wmnet with reason: host reimage 2320562 wikitext text/x-wiki eb5p54h1xh1xz2oco5539geq6g1usle 2320567 2320562 2025-07-03T13:26:31Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of doh6001.wikimedia.org to drbd 2320567 wikitext text/x-wiki 4lasqn5j0u302sm1x671n17dlcag23x 2320570 2320567 2025-07-03T13:28:30Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of durum6001.drmrs.wmnet to drbd 2320570 wikitext text/x-wiki 6wmf0wqbdh6md1c6uc866dwor1ksa0f 2320574 2320570 2025-07-03T13:35:35Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.reboot-single for host registry2004.codfw.wmnet 2320574 wikitext text/x-wiki 3boseerxu8s786cs61txwhb5l48pctu 2320577 2320574 2025-07-03T13:38:14Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of durum6001.drmrs.wmnet to drbd 2320577 wikitext text/x-wiki 3s1swlaahl7yww8ndwv6yqk8gscimk9 2320578 2320577 2025-07-03T13:39:13Z Stashbot 7414 andrew@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephmon2005-dev.codfw.wmnet with OS bullseye 2320578 wikitext text/x-wiki su3uw7j5gqxlp1xql6jlixbk80i6v47 2320579 2320578 2025-07-03T13:40:18Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry2004.codfw.wmnet 2320579 wikitext text/x-wiki 9cwonh6yoffpj40un8ons0rhtk4snjr 2320580 2320579 2025-07-03T13:40:34Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.reboot-single for host registry2005.codfw.wmnet 2320580 wikitext text/x-wiki l31vnql781ej8nlo2zsvns3n0trsirn 2320581 2320580 2025-07-03T13:40:54Z Stashbot 7414 moritzm: installing libxml2 security updates on bookworm 2320581 wikitext text/x-wiki sd7lld7asz0h1wqx6tnq0up1y7hf5p8 2320583 2320581 2025-07-03T13:45:01Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry2005.codfw.wmnet 2320583 wikitext text/x-wiki cwh31vk152aq43qiqs00gdvdsfmidnn 2320584 2320583 2025-07-03T13:46:22Z Stashbot 7414 sukhe: sudo cumin 'A:wikidough' "disable-puppet 'merging CR 1163859'" 2320584 wikitext text/x-wiki pisduphm40x9tij5yub46be9n5ulcle 2320585 2320584 2025-07-03T13:46:44Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1047.eqiad.wmnet 2320585 wikitext text/x-wiki c90tci34mwudsgxik6joyvbefuzy953 2320586 2320585 2025-07-03T13:47:21Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1047.eqiad.wmnet 2320586 wikitext text/x-wiki ndjwl13z4bgep7lm74k47xdnbv5eltw 2320589 2320586 2025-07-03T13:59:25Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.hosts.reboot-single for host zookeeper-test1002.eqiad.wmnet 2320589 wikitext text/x-wiki my6q4v99amggtqsolf9skgwh1ihcaxz 2320592 2320589 2025-07-03T14:03:11Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host zookeeper-test1002.eqiad.wmnet 2320592 wikitext text/x-wiki orawfotlj63b5pxhx06ql53vrb2qvl2 2320594 2320592 2025-07-03T14:05:37Z Stashbot 7414 moritzm: restarting clamav to pick up libxml security updates 2320594 wikitext text/x-wiki cih1pyxxqx2oj0gmdnw1c3r3zanc0xj 2320596 2320594 2025-07-03T14:08:30Z Stashbot 7414 jynus@cumin1002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on backup1006.eqiad.wmnet with reason: Maintenance and reboot 2320596 wikitext text/x-wiki efzj2j7wissdiw8wp0g7o8lmvjocvb7 2320597 2320596 2025-07-03T14:09:23Z Stashbot 7414 jynus@cumin1002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on backup1007.eqiad.wmnet with reason: Maintenance and reboot 2320597 wikitext text/x-wiki cj9wk2kemhhvuqxfopgdzqa0h59xmus 2320600 2320597 2025-07-03T14:17:19Z Stashbot 7414 vgutierrez: depooling cp7006 for testing 2320600 wikitext text/x-wiki k3owdwf09zo6bbzgnlnh5sdovrudem9 2320601 2320600 2025-07-03T14:23:34Z Stashbot 7414 jclark@cumin1002: START - Cookbook sre.hosts.reimage for host an-worker1176.eqiad.wmnet with OS bullseye 2320601 wikitext text/x-wiki jj4obf8w657usepyqyfx9h9qbczamyx 2320602 2320601 2025-07-03T14:32:36Z Stashbot 7414 moritzm: installing bootstrap4 security updates 2320602 wikitext text/x-wiki 0n4l1jz8z16se9iwlid8or8jsapviil 2320603 2320602 2025-07-03T14:38:47Z Stashbot 7414 fceratto@cumin1002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2213.codfw.wmnet with reason: Maintenance 2320603 wikitext text/x-wiki 5909e53q4uglsleaawdgoyxrpqgmvx2 2320604 2320603 2025-07-03T14:38:55Z Stashbot 7414 fceratto@cumin1002: dbctl commit (dc=all): 'Depooling db2213 (T395241)', diff saved to https://phabricator.wikimedia.org/P78751 and previous config saved to /var/cache/conftool/dbconfig/20250703-143854-fceratto.json 2320604 wikitext text/x-wiki 8dv4n3d1y8y0xg8z8ieksmf1vtm830q 2320609 2320604 2025-07-03T14:43:18Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:aux-worker-eqiad 2320609 wikitext text/x-wiki 3fgbi4gusp0po775vzaf66sh9lhvjca 2320610 2320609 2025-07-03T14:44:10Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2320610 wikitext text/x-wiki pv69c347hh6dn4sr6ga9wa7dae3godm 2320613 2320610 2025-07-03T14:45:15Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2320613 wikitext text/x-wiki cwf90wcijkczwroe7bbfdra3qw7hwc8 2320614 2320613 2025-07-03T14:45:22Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.reboot-single for host registry1004.eqiad.wmnet 2320614 wikitext text/x-wiki 3xovrgusgz3cgzq4pc247wn43blbb4f 2320615 2320614 2025-07-03T14:46:20Z Stashbot 7414 fceratto@cumin1002: dbctl commit (dc=all): 'Repooling after maintenance db2213 (T395241)', diff saved to https://phabricator.wikimedia.org/P78752 and previous config saved to /var/cache/conftool/dbconfig/20250703-144619-fceratto.json 2320615 wikitext text/x-wiki ny5bw6071qw68mvbe5wr4jjbwxgzhyx 2320617 2320615 2025-07-03T14:48:15Z Stashbot 7414 vgutierrez: repooling cp7006 2320617 wikitext text/x-wiki jer8irqgs1yvyd1m848kqgl6mawcggz 2320618 2320617 2025-07-03T14:49:49Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry1004.eqiad.wmnet 2320618 wikitext text/x-wiki 1nxn88xs1xfvfkmd45sh6jh96on8whh 2320619 2320618 2025-07-03T14:50:14Z Stashbot 7414 volans: uploaded debmonitor-server,python3-debmonitor_0.6.6 to apt.wikimedia.org bookworm-wikimedia 2320619 wikitext text/x-wiki lcjnlyv7lvjcoxkmhsblzyqieult952 2320621 2320619 2025-07-03T14:50:43Z Stashbot 7414 jynus@cumin1002: DONE (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for backup1006.eqiad.wmnet: Renew puppet certificate - jynus@cumin1002 2320621 wikitext text/x-wiki brkdpo66slsu1jqnfm6ahyohw4rz19u 2320622 2320621 2025-07-03T14:51:17Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.reboot-single for host registry1005.eqiad.wmnet 2320622 wikitext text/x-wiki l0tqr3yfaatu9xisxxxj3w0lcoq04xy 2320623 2320622 2025-07-03T14:55:57Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry1005.eqiad.wmnet 2320623 wikitext text/x-wiki aqgjnmjxvu4bl48wt3wuhmhbbqq3kyr 2320624 2320623 2025-07-03T14:56:57Z Stashbot 7414 jynus@cumin1002: DONE (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for backup1007.eqiad.wmnet: Renew puppet certificate - jynus@cumin1002 2320624 wikitext text/x-wiki krcm66cskvald8ob0cuadnzu8b9hfz4 2320626 2320624 2025-07-03T15:01:27Z Stashbot 7414 fceratto@cumin1002: dbctl commit (dc=all): 'Repooling after maintenance db2213', diff saved to https://phabricator.wikimedia.org/P78753 and previous config saved to /var/cache/conftool/dbconfig/20250703-150126-fceratto.json 2320626 wikitext text/x-wiki 6zc3y81bq17shcrogiksc2nazn9b1r3 2320627 2320626 2025-07-03T15:04:38Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:aux-worker-eqiad 2320627 wikitext text/x-wiki 8skvy603k96yf1wfsq9f5l99b9dyffi 2320628 2320627 2025-07-03T15:04:50Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:aux-worker-codfw 2320628 wikitext text/x-wiki 0ruq2j48orkfk1akpu7qnqbh942852j 2320629 2320628 2025-07-03T15:10:42Z Stashbot 7414 vgutierrez@cumin1002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on lvs5006.eqsin.wmnet with reason: katran migration 2320629 wikitext text/x-wiki bgfqveu9ejisb96qejwopkehxjp93ot 2320632 2320629 2025-07-03T15:16:34Z Stashbot 7414 fceratto@cumin1002: dbctl commit (dc=all): 'Repooling after maintenance db2213', diff saved to https://phabricator.wikimedia.org/P78754 and previous config saved to /var/cache/conftool/dbconfig/20250703-151633-fceratto.json 2320632 wikitext text/x-wiki 8gwszpwk8wdqcatu62l83qr8pl7l7x9 2320633 2320632 2025-07-03T15:21:44Z Stashbot 7414 vgutierrez@cumin1002: START - Cookbook sre.hosts.remove-downtime for lvs5006.eqsin.wmnet 2320633 wikitext text/x-wiki 8q9muuec7ofsln67xvflvb8vtpun7gl 2320634 2320633 2025-07-03T15:21:45Z Stashbot 7414 vgutierrez@cumin1002: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for lvs5006.eqsin.wmnet 2320634 wikitext text/x-wiki mj0gs4vc5gi6qye133j1aoytjc90l9c 2320635 2320634 2025-07-03T15:22:31Z Stashbot 7414 vgutierrez: lvs5006 migrated to katran - T396561 2320635 wikitext text/x-wiki plkgmn2bcogbwwhc5toytevr1qen1of 2320636 2320635 2025-07-03T15:23:33Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2320636 wikitext text/x-wiki 2s8tjp4662omwsxigmsi07t2rre5civ 2320637 2320636 2025-07-03T15:25:46Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:aux-worker-codfw 2320637 wikitext text/x-wiki 3qd6dgy4h55he5guii41sqzcw5b0nf1 2320638 2320637 2025-07-03T15:31:42Z Stashbot 7414 fceratto@cumin1002: dbctl commit (dc=all): 'Repooling after maintenance db2213 (T395241)', diff saved to https://phabricator.wikimedia.org/P78755 and previous config saved to /var/cache/conftool/dbconfig/20250703-153141-fceratto.json 2320638 wikitext text/x-wiki ex182r2ktgt2eadfgutqbc2bdlmke8y 2320639 2320638 2025-07-03T15:33:16Z Stashbot 7414 vgutierrez: depooling cp7006 for testing 2320639 wikitext text/x-wiki l7uzuzxv5mfodg4rafzrwz5nyortfi4 2320640 2320639 2025-07-03T15:34:28Z Stashbot 7414 vgutierrez@cumin1002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on cp7006.magru.wmnet with reason: testing 2320640 wikitext text/x-wiki r4ni1t13v819kes0czozwem1p53ari5 2320641 2320640 2025-07-03T15:38:48Z Stashbot 7414 jclark@cumin1002: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-worker1176.eqiad.wmnet with OS bullseye 2320641 wikitext text/x-wiki 2bdkvgt7sq42ya1qghvh4e4jycc5m58 2320642 2320641 2025-07-03T15:42:16Z Stashbot 7414 jclark@cumin1002: START - Cookbook sre.hosts.reimage for host an-worker1176.eqiad.wmnet with OS bullseye 2320642 wikitext text/x-wiki pjs0xzydoegxq14v521mb1mng4k5qf8 2320643 2320642 2025-07-03T15:46:27Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] START helmfile.d/services/api-gateway: apply 2320643 wikitext text/x-wiki fxtgl1s1xz3ib724kuoo3q92ou83bx1 2320644 2320643 2025-07-03T15:46:46Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] DONE helmfile.d/services/api-gateway: apply 2320644 wikitext text/x-wiki gw3pkz526b57ezmbcjtfvprzxlxdt6a 2320646 2320644 2025-07-03T15:52:40Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] START helmfile.d/services/api-gateway: apply 2320646 wikitext text/x-wiki dxbfc9roqil43w2ff4rvrf1mpclbkg9 2320647 2320646 2025-07-03T15:52:54Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply 2320647 wikitext text/x-wiki 3h0fl9d44khxngxxxl5p0nj70cn72f0 2320648 2320647 2025-07-03T16:09:22Z Stashbot 7414 vgutierrez@cumin1002: START - Cookbook sre.hosts.remove-downtime for cp7006.magru.wmnet 2320648 wikitext text/x-wiki 5a8s9392e7qx7dum3o4ltig72kywvpj 2320649 2320648 2025-07-03T16:09:23Z Stashbot 7414 vgutierrez@cumin1002: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp7006.magru.wmnet 2320649 wikitext text/x-wiki 1wyb0knn5nbly9xk8bwduzg4g0osxl1 2320650 2320649 2025-07-03T16:11:45Z Stashbot 7414 vgutierrez: repooling cp7006 2320650 wikitext text/x-wiki 9pjrvb73ou2efqzboiosf165mdi9nml 2320652 2320650 2025-07-03T16:31:50Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] START helmfile.d/services/api-gateway: apply 2320652 wikitext text/x-wiki rk8w7azrewh1rd7jejqqiosgcfqtp6r 2320653 2320652 2025-07-03T16:32:13Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] DONE helmfile.d/services/api-gateway: apply 2320653 wikitext text/x-wiki q1s4jhcy0v1lp3iq7ml2jq1zxpmowsw 2320654 2320653 2025-07-03T16:32:15Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] START helmfile.d/services/api-gateway: apply 2320654 wikitext text/x-wiki hv1ovj9l0cde1wfbv0pr0nwtucriq08 2320655 2320654 2025-07-03T16:32:27Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] DONE helmfile.d/services/api-gateway: apply 2320655 wikitext text/x-wiki f5agd4kl9zbkr335upu32dl78mz6ae5 2320657 2320655 2025-07-03T17:01:04Z Stashbot 7414 stevemunene@cumin1002: START - Cookbook sre.hosts.reimage for host an-worker1176.eqiad.wmnet with OS bullseye 2320657 wikitext text/x-wiki enzlt0ajyx6gv7xtiovmwuo9c6dpq08 2320658 2320657 2025-07-03T17:12:47Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary 2320658 wikitext text/x-wiki ru973dc7shd9p95qc9trwh8mm2tdjbw 2320659 2320658 2025-07-03T17:13:02Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary 2320659 wikitext text/x-wiki 3juv952w0b4d0yavbrgcysvncputgwi 2320660 2320659 2025-07-03T17:13:09Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox 2320660 wikitext text/x-wiki 21z1ey3lzpbby6yfezn65zokdlt5ki1 2320661 2320660 2025-07-03T17:13:38Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox 2320661 wikitext text/x-wiki dht4o8ekmyw1c73qca34ovn3380jd5t 2320662 2320661 2025-07-03T17:15:27Z Stashbot 7414 stevemunene@cumin1002: START - Cookbook sre.hosts.downtime for 2:00:00 on an-worker1176.eqiad.wmnet with reason: host reimage 2320662 wikitext text/x-wiki 78vpjo5ex1uyxuqm1aos5uqkdg4z8yh 2320663 2320662 2025-07-03T17:18:48Z Stashbot 7414 stevemunene@cumin1002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-worker1176.eqiad.wmnet with reason: host reimage 2320663 wikitext text/x-wiki 7goqrtbwq1glhypfilqjyk7uit053f3 2320664 2320663 2025-07-03T17:24:40Z Stashbot 7414 joal@deploy1003: Started deploy [airflow-dags/analytics_test@9088e59]: Synchronize artifacat for airflow_dags/analytics_test 2320664 wikitext text/x-wiki e9bztbm8q969pdmb8greajzu45e5zj3 2320665 2320664 2025-07-03T17:24:56Z Stashbot 7414 joal@deploy1003: Finished deploy [airflow-dags/analytics_test@9088e59]: Synchronize artifacat for airflow_dags/analytics_test (duration: 00m 15s) 2320665 wikitext text/x-wiki b4yyom8at76tb1cvdsn8ao4k1cejg1k 2320666 2320665 2025-07-03T17:25:41Z Stashbot 7414 joal@deploy1003: Started deploy [airflow-dags/analytics@9088e59]: Synchronize artifacts for airflow_dags/analytics 2320666 wikitext text/x-wiki s3fzdpqiymeytr53ikefagk6ry6i5kg 2320667 2320666 2025-07-03T17:26:22Z Stashbot 7414 joal@deploy1003: Finished deploy [airflow-dags/analytics@9088e59]: Synchronize artifacts for airflow_dags/analytics (duration: 00m 40s) 2320667 wikitext text/x-wiki f0hdj24ov3xb4ns53xajoato2qs0y66 2320668 2320667 2025-07-03T17:33:12Z Stashbot 7414 stevemunene@cumin1002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-worker1176.eqiad.wmnet with OS bullseye 2320668 wikitext text/x-wiki cbgqjzzxm5srej7xuqiym525bkkjg8m 2320671 2320668 2025-07-03T19:34:42Z Stashbot 7414 joal@deploy1003: Started deploy [airflow-dags/analytics_test@7ba4a7b]: BUGFIX - Synchronize artifact for airflow_dags/analytics_test 2320671 wikitext text/x-wiki aki2lahyut1tqw9zpfd853smwb34aex 2320672 2320671 2025-07-03T19:34:58Z Stashbot 7414 joal@deploy1003: Finished deploy [airflow-dags/analytics_test@7ba4a7b]: BUGFIX - Synchronize artifact for airflow_dags/analytics_test (duration: 00m 16s) 2320672 wikitext text/x-wiki bcwadxcec65vflsudll59kr9fsbh7m4 2320673 2320672 2025-07-03T19:35:45Z Stashbot 7414 joal@deploy1003: Started deploy [airflow-dags/analytics@7ba4a7b]: BUGFIX - Synchronize artifact for airflow_dags/analytics 2320673 wikitext text/x-wiki 7nodc7lf1k0i3e9evjm4f291rhhv5f4 2320674 2320673 2025-07-03T19:36:47Z Stashbot 7414 joal@deploy1003: Finished deploy [airflow-dags/analytics@7ba4a7b]: BUGFIX - Synchronize artifact for airflow_dags/analytics (duration: 01m 02s) 2320674 wikitext text/x-wiki rkizuybll7519i6o0b2h9ollvev5pqz 2320676 2320674 2025-07-03T20:03:28Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1166133|Use correct index on categorylinks (T385890)]] 2320676 wikitext text/x-wiki qeplu3tyjhykv6mp3hwtmjon7bltb5l 2320677 2320676 2025-07-03T20:05:25Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1166133|Use correct index on categorylinks (T385890)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2320677 wikitext text/x-wiki 1jn0rzy6qq0yvy2y3ae649odcu3mpn8 2320678 2320677 2025-07-03T20:06:09Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with sync 2320678 wikitext text/x-wiki qwhlx9lb2g6ke0vtfbylsk7tqnfmieg 2320679 2320678 2025-07-03T20:12:00Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1166133|Use correct index on categorylinks (T385890)]] (duration: 08m 32s) 2320679 wikitext text/x-wiki 1l4tg294wqrsbrdqrhtub0owr8gb5z8 2320680 2320679 2025-07-03T20:27:34Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1166206|skin: Omit "rendered with" phrase when the message is disabled (T398616)]] 2320680 wikitext text/x-wiki 8kv83kov0yoquwkj9el1d36i3zkv4ca 2320681 2320680 2025-07-03T20:29:33Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1166206|skin: Omit "rendered with" phrase when the message is disabled (T398616)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2320681 wikitext text/x-wiki esog1tqwyoarahcthejadg32ij7g8ec 2320682 2320681 2025-07-03T20:30:31Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with sync 2320682 wikitext text/x-wiki fhxlqeig40wr35fqa1d4q8km5wbz9a9 2320683 2320682 2025-07-03T20:36:04Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1166206|skin: Omit "rendered with" phrase when the message is disabled (T398616)]] (duration: 08m 30s) 2320683 wikitext text/x-wiki 1smxrt2rgmct9f93sl67v2pfu82pm41 2320684 2320683 2025-07-03T20:38:49Z Stashbot 7414 arlolra@deploy1003: Started scap sync-world: Backport for [[gerrit:1166236|Use FallbackContentHandler for undeployed JsonConfig content handlers (T124748)]], [[gerrit:1166012|ExtensionDistributor: Mark 1.44 as stable; remove 1.42 as EOL (T390798 T389313)]] 2320684 wikitext text/x-wiki ib7xwd6dj2320aamq0ctc8zp26rur83 2320685 2320684 2025-07-03T20:40:45Z Stashbot 7414 arlolra@deploy1003: arlolra, matmarex: Backport for [[gerrit:1166236|Use FallbackContentHandler for undeployed JsonConfig content handlers (T124748)]], [[gerrit:1166012|ExtensionDistributor: Mark 1.44 as stable; remove 1.42 as EOL (T390798 T389313)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2320685 wikitext text/x-wiki fjctlm9ktvealtuyh4vhh0ulxrkufyc 2320686 2320685 2025-07-03T20:41:33Z Stashbot 7414 arlolra@deploy1003: arlolra, matmarex: Continuing with sync 2320686 wikitext text/x-wiki g8e9lbl6afjur2w6wmolnh14j1twset 2320687 2320686 2025-07-03T20:47:16Z Stashbot 7414 arlolra@deploy1003: Finished scap sync-world: Backport for [[gerrit:1166236|Use FallbackContentHandler for undeployed JsonConfig content handlers (T124748)]], [[gerrit:1166012|ExtensionDistributor: Mark 1.44 as stable; remove 1.42 as EOL (T390798 T389313)]] (duration: 08m 27s) 2320687 wikitext text/x-wiki dus58j9tkl8jwmna1rb49chw3yashle 2320688 2320687 2025-07-03T20:51:50Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host bast1003.wikimedia.org 2320688 wikitext text/x-wiki cc3x28y5r2gmj7rb8eb6goafgjz8xab 2320689 2320688 2025-07-03T20:55:56Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of bast6003.wikimedia.org to drbd 2320689 wikitext text/x-wiki 0phh2npr3zndiaj54bvicznapqr4c3j 2320690 2320689 2025-07-03T20:58:17Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast1003.wikimedia.org 2320690 wikitext text/x-wiki k413ceqwc7x6n7z3lu1f47vrj0dshc6 2320691 2320690 2025-07-03T21:08:04Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1166178|special: Do not throw ErrorPageError from getRedirect() (T398167)]], [[gerrit:1166264|Set categorylinks to read new on small wikis (T397912)]] 2320691 wikitext text/x-wiki 98isjg8nqjcp01u81olf8frkjqgvonf 2320692 2320691 2025-07-03T21:09:56Z Stashbot 7414 zabe@deploy1003: kharlan, zabe: Backport for [[gerrit:1166178|special: Do not throw ErrorPageError from getRedirect() (T398167)]], [[gerrit:1166264|Set categorylinks to read new on small wikis (T397912)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2320692 wikitext text/x-wiki t3n6d4qshjs4qt48zv39mece5p331sw 2320693 2320692 2025-07-03T21:11:13Z Stashbot 7414 zabe@deploy1003: kharlan, zabe: Continuing with sync 2320693 wikitext text/x-wiki ign2gtdchwwtxysiygrmpygir2h8gfj 2320694 2320693 2025-07-03T21:16:42Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1166178|special: Do not throw ErrorPageError from getRedirect() (T398167)]], [[gerrit:1166264|Set categorylinks to read new on small wikis (T397912)]] (duration: 08m 37s) 2320694 wikitext text/x-wiki pnjbzfxlxkwxor29ppd20yh6ynm09w6 2320695 2320694 2025-07-03T21:16:45Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of bast6003.wikimedia.org to drbd 2320695 wikitext text/x-wiki 99wn7quxh60b7m7sni0w4nozev57ph8 2320696 2320695 2025-07-03T21:17:51Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti6001.drmrs.wmnet 2320696 wikitext text/x-wiki 5tfxfmo09p1xnnhaswmlldavx9kjqc2 2320697 2320696 2025-07-03T21:18:53Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti6001.drmrs.wmnet 2320697 wikitext text/x-wiki hzrgo96qzmbwsshvfbjkzwh6b45z9h4 2320698 2320697 2025-07-03T21:19:36Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of bast6003.wikimedia.org to plain 2320698 wikitext text/x-wiki tted7kghrgvc86ioplz2nf6yhejekqn 2320699 2320698 2025-07-03T21:21:14Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of bast6003.wikimedia.org to plain 2320699 wikitext text/x-wiki 4ofergvdbelxza7eucb00i7nf5dp93u 2320702 2320699 2025-07-04T03:15:37Z Stashbot 7414 vriley@cumin1002: START - Cookbook sre.dns.netbox 2320702 wikitext text/x-wiki pl8e643kv267tiihp7ul1uqh36vb80g 2320703 2320702 2025-07-04T03:19:21Z Stashbot 7414 vriley@cumin1002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [cloudcephosd1042] - vriley@cumin1002" 2320703 wikitext text/x-wiki hnm6m6issdenkf5liirlak2t8c3f5e5 2320704 2320703 2025-07-04T03:19:26Z Stashbot 7414 vriley@cumin1002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [cloudcephosd1042] - vriley@cumin1002" 2320704 wikitext text/x-wiki i8p0gzu89u8a4skgnzs9lf3aftyootd 2320705 2320704 2025-07-04T03:19:26Z Stashbot 7414 vriley@cumin1002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2320705 wikitext text/x-wiki d99h3723p59ko86fkd0uhfi0zcqxsla 2320706 2320705 2025-07-04T03:20:51Z Stashbot 7414 vriley@cumin1002: START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1042 2320706 wikitext text/x-wiki 40t9v78bsouw2bbfg76pt4yshzwat3i 2320707 2320706 2025-07-04T03:21:28Z Stashbot 7414 vriley@cumin1002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd1042 2320707 wikitext text/x-wiki 4f275f9dvota8k1sntcgwk84ovb4szl 2320708 2320707 2025-07-04T03:22:52Z Stashbot 7414 vriley@cumin1002: START - Cookbook sre.hosts.provision for host cloudcephosd1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2320708 wikitext text/x-wiki s6p4ceu8m61wwqzor87sm99zqdqgnbo 2320709 2320708 2025-07-04T03:44:30Z Stashbot 7414 vriley@cumin1002: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2320709 wikitext text/x-wiki ho8yrtft5jfv79qkx8ogh7e2iiyxhjq 2320710 2320709 2025-07-04T03:44:54Z Stashbot 7414 vriley@cumin1002: START - Cookbook sre.hosts.provision for host cloudcephosd1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2320710 wikitext text/x-wiki ffhsz11khz6hczildgyxg2t8gtfb5tb 2320711 2320710 2025-07-04T03:46:34Z Stashbot 7414 vriley@cumin1002: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2320711 wikitext text/x-wiki 8bdc6l3maeyj4lvz1bhvdxfygz555g1 2320712 2320711 2025-07-04T03:50:07Z Stashbot 7414 vriley@cumin1002: START - Cookbook sre.hosts.provision for host cloudcephosd1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2320712 wikitext text/x-wiki 3y411uagpvrokybrch6u6m2ti5iu8o2 2320713 2320712 2025-07-04T03:51:34Z Stashbot 7414 vriley@cumin1002: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2320713 wikitext text/x-wiki d70lwwjobzyl2kvwq448dgxkkltnp29 2320714 2320713 2025-07-04T03:52:59Z Stashbot 7414 vriley@cumin1002: START - Cookbook sre.hosts.provision for host cloudcephosd1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2320714 wikitext text/x-wiki rk1e1lyhvdk0oxlvm9zmi0q832u9bke 2320715 2320714 2025-07-04T04:25:07Z Stashbot 7414 vriley@cumin1002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudcephosd1042.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2320715 wikitext text/x-wiki hman28f7qghlaa8n02yc9xnqfg2ehw7 2320716 2320715 2025-07-04T04:32:16Z Stashbot 7414 vriley@cumin1002: START - Cookbook sre.hosts.reimage for host cloudcephosd1042.eqiad.wmnet with OS bullseye 2320716 wikitext text/x-wiki 0ta18n58hfmn3bw5iueqon6az5eskrs 2320718 2320716 2025-07-04T06:12:32Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host bast3007.wikimedia.org 2320718 wikitext text/x-wiki b4zpu85wf7n064b3lx60urx0ebhgtmq 2320719 2320718 2025-07-04T06:16:14Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast3007.wikimedia.org 2320719 wikitext text/x-wiki m4m39yo7pe1w39fhyzxiu5hkf7nxjaz 2320720 2320719 2025-07-04T06:20:52Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host mc-misc1001.eqiad.wmnet 2320720 wikitext text/x-wiki ofsbw07xkszkfwm1a9xay1t9bwdpfwa 2320721 2320720 2025-07-04T06:24:04Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of install6002.wikimedia.org to plain 2320721 wikitext text/x-wiki kxzte2z0wn0pp5w2yaa8jq3wqf3myed 2320722 2320721 2025-07-04T06:25:11Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of install6002.wikimedia.org to plain 2320722 wikitext text/x-wiki eigi7ajuvzjh7pc3yguveeoyfrhobee 2320723 2320722 2025-07-04T06:26:00Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-misc1001.eqiad.wmnet 2320723 wikitext text/x-wiki tbc6fl4eu0uk3k2nyjlmotneybwyrnt 2320724 2320723 2025-07-04T06:26:12Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of ncredir6001.drmrs.wmnet to plain 2320724 wikitext text/x-wiki g30k7dtx1ql6inir08a0ny3tgx54ft7 2320725 2320724 2025-07-04T06:28:34Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ncredir6001.drmrs.wmnet to plain 2320725 wikitext text/x-wiki kmvd3xj6byt6jaf4iccsw2cylre8xo3 2320726 2320725 2025-07-04T06:29:39Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of doh6001.wikimedia.org to plain 2320726 wikitext text/x-wiki o6mmdw4jk2a6f32anvl7dr73i5wy6l7 2320727 2320726 2025-07-04T06:30:27Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of doh6001.wikimedia.org to plain 2320727 wikitext text/x-wiki ee394fayz7fu4k47teuzpfwpx7zbpkm 2320728 2320727 2025-07-04T06:30:47Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of durum6001.drmrs.wmnet to plain 2320728 wikitext text/x-wiki pvwi0vq3x9qvziqp1qpogwe1uidou9d 2320729 2320728 2025-07-04T06:31:35Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of durum6001.drmrs.wmnet to plain 2320729 wikitext text/x-wiki o1vbsr0xzu87ij42k7o6cw3g7fss873 2320730 2320729 2025-07-04T06:32:09Z Stashbot 7414 moritzm: failover Ganeti master in drmrs01 to ganeti6003 T382513 2320730 wikitext text/x-wiki 3kgpunerf5ouebuiyyavscvcbt8xssa 2320731 2320730 2025-07-04T06:34:17Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host mc-misc1002.eqiad.wmnet 2320731 wikitext text/x-wiki mbugqz0s8z4mgkg001jhteciima8ybw 2320732 2320731 2025-07-04T06:39:50Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-misc1002.eqiad.wmnet 2320732 wikitext text/x-wiki 8itqrs5e0q8svjdfs9ngytdtyrn2k1v 2320733 2320732 2025-07-04T07:10:01Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host puppetserver2003.codfw.wmnet 2320733 wikitext text/x-wiki asjsl6mb1p1jkeezqbg7iot8obqkz98 2320734 2320733 2025-07-04T07:17:00Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetserver2003.codfw.wmnet 2320734 wikitext text/x-wiki f3me6tauo6d4ina3kgvivz98nj4f1w6 2320735 2320734 2025-07-04T07:19:44Z Stashbot 7414 jmm@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on ganeti6001.drmrs.wmnet with reason: reimage 2320735 wikitext text/x-wiki 4vq4v7zswsjjza2ci15a1en51cc812s 2320736 2320735 2025-07-04T07:21:59Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reimage for host ganeti6001.drmrs.wmnet with OS bookworm 2320736 wikitext text/x-wiki dceyjlknvoxddklg10tf4xbtmhp9f2k 2320737 2320736 2025-07-04T07:36:15Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.hosts.decommission for hosts ganeti2019.codfw.wmnet 2320737 wikitext text/x-wiki f9t66dtfij0tihzh6nc2vr94nut4st6 2320738 2320737 2025-07-04T07:39:48Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti6001.drmrs.wmnet with reason: host reimage 2320738 wikitext text/x-wiki rdkc0aj0vf6xkd020mtsx3231x7ku1h 2320739 2320738 2025-07-04T07:42:42Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.dns.netbox 2320739 wikitext text/x-wiki k9s0zcnnhm6r9bdoseymxpnr7yr6a03 2320740 2320739 2025-07-04T07:42:57Z Stashbot 7414 vgutierrez: depooling cp7006 for testing purposes 2320740 wikitext text/x-wiki 8ep34g3gio3q0ojzjt3k8sgeyrsamn2 2320741 2320740 2025-07-04T07:43:24Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti6001.drmrs.wmnet with reason: host reimage 2320741 wikitext text/x-wiki sez81dqt1hyu5x8sa3no3sj5ght24yd 2320742 2320741 2025-07-04T07:53:03Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ganeti2019.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin1003" 2320742 wikitext text/x-wiki ivqrl76lrciltdosn6em9k3wmd3u3mp 2320743 2320742 2025-07-04T07:53:21Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ganeti2019.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin1003" 2320743 wikitext text/x-wiki kpf4o0zcwgwy0ml9pydq065oroe8ojz 2320744 2320743 2025-07-04T07:53:23Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2320744 wikitext text/x-wiki 40lirphsz8xsv7j2m41cvxayspwzrgs 2320745 2320744 2025-07-04T07:53:24Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts ganeti2019.codfw.wmnet 2320745 wikitext text/x-wiki a3p7ufodmmz52x5r2ppj29pazrp1yue 2320746 2320745 2025-07-04T07:53:52Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.hosts.decommission for hosts ganeti2020.codfw.wmnet 2320746 wikitext text/x-wiki 3lrlryo9hhkl165pvyq2pkzry4018z5 2320747 2320746 2025-07-04T07:56:28Z Stashbot 7414 vgutierrez@cumin1002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on cp7006.magru.wmnet with reason: testing 2320747 wikitext text/x-wiki od5418ah94fz0rqedw1qmne2aau9mu0 2320748 2320747 2025-07-04T07:58:20Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.dns.netbox 2320748 wikitext text/x-wiki 8u6ke9wbj4ul4nduw8pxie8zh990b2s 2320749 2320748 2025-07-04T08:03:13Z Stashbot 7414 jmm@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ganeti2020.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin1003" 2320749 wikitext text/x-wiki iocllolwke38dlqi8rozc4rk65tj4lg 2320750 2320749 2025-07-04T08:03:30Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti6001.drmrs.wmnet with OS bookworm 2320750 wikitext text/x-wiki con32knj9knn2h6ukpthtw1m8ptm6k8 2320751 2320750 2025-07-04T08:04:12Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: ganeti2020.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin1003" 2320751 wikitext text/x-wiki q0wslfetzw6pzdg7p5kqxw1b8o3m3e7 2320752 2320751 2025-07-04T08:04:13Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2320752 wikitext text/x-wiki nmuwoc3axgrv2ss5s2yl7ob4pvgptvt 2320753 2320752 2025-07-04T08:04:14Z Stashbot 7414 jmm@cumin1003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts ganeti2020.codfw.wmnet 2320753 wikitext text/x-wiki 442nbj9tifw6v99zy7mg8olv3l00auh 2320754 2320753 2025-07-04T08:16:05Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host ganeti6001.drmrs.wmnet 2320754 wikitext text/x-wiki 61z1melbp8x60uoxz0wclaqacy4dar5 2320755 2320754 2025-07-04T08:25:59Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti6001.drmrs.wmnet 2320755 wikitext text/x-wiki nobdp58hdk6relp8lxh057tv6mu5bws 2320756 2320755 2025-07-04T08:32:11Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.addnode for new host ganeti6001.drmrs.wmnet to cluster drmrs01 and group B12 2320756 wikitext text/x-wiki 7le49n979exi5f0fdkdp00f8e1k1v0c 2320757 2320756 2025-07-04T08:33:08Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti6001.drmrs.wmnet to cluster drmrs01 and group B12 2320757 wikitext text/x-wiki foj19kamqp4pzqr5mwekqzllui3la4k 2320758 2320757 2025-07-04T08:37:03Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.reboot-single for host ms-be2077.codfw.wmnet 2320758 wikitext text/x-wiki 1u2fccuyxijw8ha0xqwqbgtqp7wf2us 2320759 2320758 2025-07-04T08:48:20Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of ncredir6001.drmrs.wmnet to drbd 2320759 wikitext text/x-wiki 5bm63dpdzg27ua0nrtub3m7bxjplujl 2320760 2320759 2025-07-04T08:48:37Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ms-be2077.codfw.wmnet 2320760 wikitext text/x-wiki jwnodv477q5k6az07g60ipfcwono8ng 2320761 2320760 2025-07-04T08:58:22Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ncredir6001.drmrs.wmnet to drbd 2320761 wikitext text/x-wiki cavpnawpgs7rwao79vec63lyjj3rghd 2320763 2320761 2025-07-04T08:59:02Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of install6002.wikimedia.org to drbd 2320763 wikitext text/x-wiki 55rrfgp9wdg84cybs7vuoyyw5t10hhw 2320766 2320763 2025-07-04T09:07:04Z Stashbot 7414 jynus@cumin1002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on backupmon1001.eqiad.wmnet with reason: Maintenance and reboot 2320766 wikitext text/x-wiki 07so2fi3jxsfnp80l2cfzwlxm1n58j3 2320767 2320766 2025-07-04T09:16:18Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of install6002.wikimedia.org to drbd 2320767 wikitext text/x-wiki 4r1byi0ovh4dor5x42xfrytui5ijbbw 2320769 2320767 2025-07-04T10:01:36Z Stashbot 7414 jynus@cumin1002: DONE (PASS) - Cookbook sre.puppet.renew-cert (exit_code=0) for backupmon1001.eqiad.wmnet: Renew puppet certificate - jynus@cumin1002 2320769 wikitext text/x-wiki gcvavunqv6wy79iuyofgqxrtvqw91m9 2320770 2320769 2025-07-04T10:13:07Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-ml: apply 2320770 wikitext text/x-wiki lcfkg1aexczob8l9w4xsvur0y0pin0z 2320771 2320770 2025-07-04T10:13:41Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-ml: apply 2320771 wikitext text/x-wiki jdudehf8awmxrk24yhmzurcle951tkm 2320772 2320771 2025-07-04T10:18:13Z Stashbot 7414 cgoubert@deploy1003: Locking from deployment [ALL REPOSITORIES]: Dragonfly supernodes reboot 2320772 wikitext text/x-wiki rdswkc6nzfhtourdwtz2kn0e70feegm 2320774 2320772 2025-07-04T10:18:55Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.reboot-single for host dragonfly-supernode2001.codfw.wmnet 2320774 wikitext text/x-wiki t4vtnsz6c1pulegxyt71tl02o5m21p8 2320776 2320774 2025-07-04T10:22:44Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dragonfly-supernode2001.codfw.wmnet 2320776 wikitext text/x-wiki i7baa15ml1ec4tx4uydiq76dzd27pfl 2320777 2320776 2025-07-04T10:23:16Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.reboot-single for host dragonfly-supernode1001.eqiad.wmnet 2320777 wikitext text/x-wiki mcj9aurvczexmzxb639l68envrmh12z 2320779 2320777 2025-07-04T10:26:59Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dragonfly-supernode1001.eqiad.wmnet 2320779 wikitext text/x-wiki lj36z8hdc46g1x2sfs1twpin1qy6wek 2320780 2320779 2025-07-04T10:27:20Z Stashbot 7414 cgoubert@deploy1003: Unlocked for deployment [ALL REPOSITORIES]: Dragonfly supernodes reboot (duration: 09m 07s) 2320780 wikitext text/x-wiki arxpav7sy1i4mzironjqxpqmj1oo0e4 2320782 2320780 2025-07-04T10:41:23Z Stashbot 7414 elukey@cumin2002: START - Cookbook sre.hosts.reimage for host sretest2006.codfw.wmnet with OS bookworm 2320782 wikitext text/x-wiki j76xgvkep6yl70afsnnjaufmwyc0r3h 2320783 2320782 2025-07-04T10:43:00Z Stashbot 7414 marostegui@cumin1002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db[2203,2212].codfw.wmnet with reason: Maintenance 2320783 wikitext text/x-wiki 0jrdv4795d6xxv51tpng1nxirl5qfs9 2320785 2320783 2025-07-04T10:51:05Z Stashbot 7414 elukey@cumin2002: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest2006.codfw.wmnet with OS bookworm 2320785 wikitext text/x-wiki 2nfxhw239ncvlfdd4f6ksdas2sstj0f 2320786 2320785 2025-07-04T10:56:11Z Stashbot 7414 marostegui@cumin1002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on 32 hosts with reason: maintenance 2320786 wikitext text/x-wiki q6vqs7fhd2yy80lt3429quszfftjqgo 2320788 2320786 2025-07-04T11:05:42Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin[1002-1003].eqiad.wmnet with reason: Release v10.0.2 with ibgp function in plugin - cmooney@cumin1003 2320788 wikitext text/x-wiki fgiv83zr6qyvmyargdnn462xs4zotjo 2320789 2320788 2025-07-04T11:08:07Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin[1002-1003].eqiad.wmnet with reason: Release v10.0.2 with ibgp function in plugin - cmooney@cumin1003 2320789 wikitext text/x-wiki l6zfyc10sfshg5nz2o4461ctw0mr4u6 Ganeti 0 22777 2320762 2306106 2025-07-04T08:58:30Z JCrespo (WMF) 5427 /* Get a console for a VM */ Alternative way 2320762 wikitext text/x-wiki dhcpnhj92xsh8kh4x0fpx7gyreukmty 2320764 2320762 2025-07-04T08:59:42Z JCrespo (WMF) 5427 /* If network or SSH between ganeti nodes is unavailable */ missing sudo 2320764 wikitext text/x-wiki 03qf6dzfovbxttvyv68a0jny804gsl2 2320765 2320764 2025-07-04T09:01:20Z JCrespo (WMF) 5427 /* If network or SSH between ganeti nodes is unavailable */ prompt to leave clear where they should be ran from 2320765 wikitext text/x-wiki aaeufo09lmwu8d06pcxgklwht9slrke Nova Resource:Admin/SAL 498 30942 2320555 2320323 2025-07-03T13:16:03Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudnet2006-dev.codfw.wmnet' 2320555 wikitext text/x-wiki 8iumikdasij79eu107v1pirxl9cll8g 2320565 2320555 2025-07-03T13:24:19Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudnet2006-dev.codfw.wmnet' 2320565 wikitext text/x-wiki an58jcoiublm2utxork57gp8qho2ada 2320568 2320565 2025-07-03T13:27:13Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudnet2005-dev.codfw.wmnet' 2320568 wikitext text/x-wiki 63t7ifjnqntt7fsdq2xcle8tywu1g3d 2320575 2320568 2025-07-03T13:36:07Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudnet2005-dev.codfw.wmnet' 2320575 wikitext text/x-wiki 5j718swkbqpv759u02jwtghxjzji34g 2320582 2320575 2025-07-03T13:41:45Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudnet2006-dev.codfw.wmnet' 2320582 wikitext text/x-wiki ltwawg3b1w636t1ajvqolmrnjtlzwtd 2320587 2320582 2025-07-03T13:49:03Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudnet2006-dev.codfw.wmnet' 2320587 wikitext text/x-wiki 14mcaxjkeqvgpok18bzkvvwujnhp677 2320593 2320587 2025-07-03T14:04:16Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2005-dev.codfw.wmnet' 2320593 wikitext text/x-wiki 2f5k4uqwmwicbhhhb28dykdz4ypu8m0 2320599 2320593 2025-07-03T14:15:44Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol2005-dev.codfw.wmnet' 2320599 wikitext text/x-wiki t8mpba3un679omtshku7fs1gw2mt9ny 2320606 2320599 2025-07-03T14:41:33Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for service: project,designate 2320606 wikitext text/x-wiki rryhnrtc3kk8ff79sb96k84r4f2rnib 2320608 2320606 2025-07-03T14:42:02Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment eqiad1 for service: project,designate 2320608 wikitext text/x-wiki mx9h24xeeg9vpxkv25yjlhexb0t8w41 Service restarts 0 33560 2320787 2319026 2025-07-04T11:02:06Z CGoubert-WMF 32775 Remove deprecated section about appservers 2320787 wikitext text/x-wiki 9kl54pels43vpzoj2e9ivz9235msbn9 2320795 2320787 2025-07-04T11:46:53Z HNowlan (WMF) 15760 /* Pool counters */ 2320795 wikitext text/x-wiki o5h5d5vx6hdyqqalsxtn7vqlnabbada Nova Resource:Paws/SAL 498 55577 2320545 2318964 2025-07-03T12:53:01Z Stashbot 7414 andrewbogott: moved all notebooks with Android binaries to /srv/paws/files-to-remove/ 2320545 wikitext text/x-wiki 3odwupxqij36p65v3akxsa6hvaruduf Data Platform/Data Lake/Edits/MediaWiki history 0 253925 2320784 2311288 2025-07-04T10:45:25Z GGoncalves-WMF 42848 Add link to MediaWiki replicas. 2320784 wikitext text/x-wiki a9mfvvi5ldlwvglg98lb3ctgax6x6mz Data Platform/Systems/Edit data loading 0 255558 2320773 2201876 2025-07-04T10:18:43Z BTullis (WMF) 25295 /* Sqooping data */ Moved ipblocks to private 2320773 wikitext text/x-wiki ggozq4qvba9862cqjzt4a98mnqb59sg Data Platform/Data Lake/Edits 0 440701 2320791 2201788 2025-07-04T11:14:06Z BTullis (WMF) 25295 /* Raw Mediawiki data */ Referenced the fact that ipblocks are now private. 2320791 wikitext text/x-wiki t88uhb8y7eh0rn8659drmeqyd434c54 SRE/Clinic Duty/Access requests 0 442028 2320768 2318236 2025-07-04T09:28:07Z CGoubert-WMF 32775 Switch to using ldap-maint hosts instead of the soon to be decommissioned mwmaint 2320768 wikitext text/x-wiki h8zcevbulq2dg6qvct90aso0m2gosd4 DebMonitor 0 442974 2320625 2145622 2025-07-03T14:59:51Z RCoccioli (WMF) 7416 Add small section for making a new release 2320625 wikitext text/x-wiki 3gegxx2yjequuh19kji26pwohq707a1 Wmf-laptop 0 445828 2320792 2200727 2025-07-04T11:21:04Z MMuhlenhoff (WMF) 5268 Mention renamed repository 2320792 wikitext text/x-wiki axds279mfppnkta3qoxvwgqrn2jbvpv PAWS/Admin 0 446215 2320607 2308796 2025-07-03T14:41:43Z DCaro (WMF) 18271 /* Common administrative actions */ 2320607 wikitext text/x-wiki 6r3e6cmm59u9qx0fwm3wkylnw83vyed 2320620 2320607 2025-07-03T14:50:16Z Andrewbogott 33 /* Translate from PAWS uuid to SUL account name */ 2320620 wikitext text/x-wiki 49fta0fmopjg6bsx4dtm6gz7y3ef51g GitLab/Gitlab Runner/Shared Runners 0 449080 2320572 2318574 2025-07-03T13:33:39Z JWodstrcil (WMF) 24826 2320572 wikitext text/x-wiki 1gb1ayjpn1mu7p0lv7nsiy15rvl8zmi Map of database maintenance 0 449160 2320605 2320480 2025-07-03T14:40:45Z Dexbot 30554 Bot: Updating the report 2320605 wikitext text/x-wiki rl2mhbp30lfv1w5eedctslvcn7waiur 2320700 2320605 2025-07-04T00:01:59Z Dexbot 30554 Bot: Updating the report 2320700 wikitext text/x-wiki kexhl66hftwhfbjfynneaci332uxw9q Tool talk:Versions 117 450705 2320781 1981533 2025-07-04T10:34:28Z Novem Linguae 23682 /* Feature request: add links to mediawiki release notes for that week */ new section 2320781 wikitext text/x-wiki eafolkfl6htqap2a8cezefda254rdhb MediaWiki On Kubernetes 0 451719 2320717 2315386 2025-07-04T05:33:17Z Novem Linguae 23682 /* External traffic */ remove dead link 2320717 wikitext text/x-wiki bi0tuisxqj1t01jrx8061f23ln6a00t SRE/Service Operations/Documentation/Reboots 0 453463 2320775 2316673 2025-07-04T10:21:46Z CGoubert-WMF 32775 Add dragonfly-supernode reboot doc 2320775 wikitext text/x-wiki l6z2na45m861bne307emr2satlfldvh 2320778 2320775 2025-07-04T10:24:09Z CGoubert-WMF 32775 /* Dragonfly supernodes */ 2320778 wikitext text/x-wiki ggeh9zehya1uv1grj1la72flb14c9b7 2320793 2320778 2025-07-04T11:32:08Z CGoubert-WMF 32775 Add poolcounter reboot doc 2320793 wikitext text/x-wiki 7ar4ki9cc5gnhq6hethl9jjmcvi3rf5 2320794 2320793 2025-07-04T11:33:12Z CGoubert-WMF 32775 /* Poolcounter */ 2320794 wikitext text/x-wiki rieo6mkreplqweuy8fbknu44rbmqd4g Portal:Toolforge/Changelog 0 453597 2320612 2319936 2025-07-03T14:44:58Z DCaro (WMF) 18271 /* 2025 */ 2320612 wikitext text/x-wiki 5vksrr3xx33hba4hucbhlfh4ol8w84l Tool:Gitlab-account-approval/Log 116 453906 2320701 2320013 2025-07-04T03:15:30Z Gitlabaccountapprovalbot 37332 @galstar was approved. 2320701 wikitext text/x-wiki c99ugeuzerf0iuv4wfbe80r2cz5bf6d Help:Project puppetserver 12 454293 2320573 2318567 2025-07-03T13:34:06Z JWodstrcil (WMF) 24826 2320573 wikitext text/x-wiki c46ogzgrpm0uu32d17g019trlet64k6 SLO/Template instructions/Service level indicators 0 455348 2320616 2206961 2025-07-03T14:46:29Z LToscano (WMF) 7191 Add some words about the relevant context that SLIs should have. 2320616 wikitext text/x-wiki aln0oyft8iayaaumzxtceuud6tlen0o Data Platform/Systems/Airflow/Kubernetes 0 455675 2320790 2315505 2025-07-04T11:09:15Z BRouberol-WMF 39141 /* I'm getting paged */ 2320790 wikitext text/x-wiki fj5crg83b3si8w241e6xjfpe3azfpsi Help:Toolforge/Deploy your tool 12 458860 2320611 2320273 2025-07-03T14:44:31Z DCaro (WMF) 18271 Added cancel help 2320611 wikitext text/x-wiki qc94vtbwuoyiebfcroyl745kmyxsdxm MediaWiki Engineering/Guides 0 459027 2320645 2025-07-03T15:47:01Z Krinkle 44 Redirected page to [[MediaWiki Engineering#Guides]] 2320645 wikitext text/x-wiki owvy0wbfzi8qmhoofk2bj4i81n9sogw