[07:21] Can someone give the archive publisher a good kick? Binaries over a day old are not getting published === ChanServ changed the topic of #launchpad to: Help contact: jugmac00 (07:30-15:30 UTC) | Launchpad is an open source project: https://documentation.ubuntu.com/launchpad/en/latest/ | This channel is logged: http://irclogs.ubuntu.com/ | User Guide https://help.launchpad.net/ | Support and spam reporting: https://answers.launchpad.net/launchpad [07:40] jugmac00: morning. the archive publisher is not publishing some binaries that built more than 24 hrs ago [07:41] some that are part of a big transition in plucky [07:42] https://launchpad.net/ubuntu/+source/yakuake/24.08.2-1ubuntu1 [07:42] https://launchpad.net/ubuntu/+source/kate/4:24.08.2-2ubuntu1 [07:42] https://launchpad.net/ubuntu/+source/okular/4:24.08.2-1ubuntu1 [07:43] https://launchpad.net/ubuntu/+source/qtcreator/15.0.0~beta2-2 [07:46] and others [07:47] @RikMills Thanks for the ping. I just started working and we are aware already looking into the issue. I will update the channel header. [07:48] jugmac00: appreciated. thanks === ChanServ changed the topic of #launchpad to: We currently experience issues with publishing - we are already investigating. Help contact: jugmac00 (07:30-15:30 UTC) | Launchpad is an open source project: https://documentation.ubuntu.com/launchpad/en/latest/ | This channel is logged: http://irclogs.ubuntu.com/ | User Guide https://help.launchpad.net/ | Support and spam reporting: https://answers.launchpad.net/launchpad === graber1 is now known as graber === JanC is now known as Guest4421 === JanC_ is now known as JanC [09:50] Are the LP git issues also affecting autoimports from github? Our project hasn't imported automatically for a few days now https://code.launchpad.net/~ubuntubudgie-dev/budgie-welcome/+git/budgie-welcome === graber1 is now known as graber [11:07] @fossfreedom: It looks like all our code import workers are down. I reached out to our IS department to investigate. Thanks for the ping. [11:12] Update: only some are down, not all. Some color highlighting would be useful. We are investigating. [11:15] jugmac00: I'm pretty sure I made all the production code import workers be directly accessible by the LP team before I left - you shouldn't need IS unless it's a cloud outage [11:15] Launchpad/Instances should have details [11:17] And see RT#156756 (starting from the message in which I said "production devops service") [11:22] cjwatson: That is def. a surprise that we have access to production machines. Thanks for the hint! I will have a look. And fwiw... I was able to make a case that all our services will be documented this cycle :-) [11:23] jugmac00: It was a good trade-off in this case because the production code import workers have no access to any private data. [11:23] (code imports are always public) [12:33] fossfreedom: There were a couple of stale lockfiles. I already cleared them up on the first couple of machines and will continue to process with the remaining instances. We have quite a huge backlog, but things will be processed eventually. Thanks for the ping again! And thanks @Colin for the hint. I will create some documentation to make it easier for the next one on support. [12:34] It usually clears up pretty quickly once all six are operational. [12:34] (two is usually not quite enough, six is comfortably overprovisioned, IIRC) [13:03] jugmac00: many thanks! [14:59] fossfreedom: I think we celebrated to early... all but one importer stopped importing again :-/ === ChanServ changed the topic of #launchpad to: We currently experience issues with publishing - we are already investigating. We also experience issues with the code importers. Help contact: jugmac00 (07:30-15:30 UTC) | Launchpad is an open source project: https://documentation.ubuntu.com/launchpad/en/latest/ | This channel is logged: http://irclogs.ubuntu.com/ | User Guide https://help.launchpad.net/ | Support and spam reporting: ht === ChanServ changed the topic of #launchpad to: We currently experience issues with publishing - we are already investigating. Help contact: jugmac00 (07:30-15:30 UTC) | Launchpad is an open source project: https://documentation.ubuntu.com/launchpad/en/latest/ | This channel is logged: http://irclogs.ubuntu.com/ | User Guide https://help.launchpad.net/ | Support and spam reporting: https://answers.launchpad.net/launchpad [15:57] fossfreedom: The code import works again - the reporting of the "pending imports" on https://code.launchpad.net/+code-imports/+machines is broken. We will look into this tomorrow. === ChanServ changed the topic of #launchpad to: Help contact: jugmac00 (07:30-15:30 UTC) | Launchpad is an open source project: https://documentation.ubuntu.com/launchpad/en/latest/ | This channel is logged: http://irclogs.ubuntu.com/ | User Guide https://help.launchpad.net/ | Support and spam reporting: https://answers.launchpad.net/launchpad [18:49] jugmac00: Hey, looks like there are still some leftover/stuck builds, e.g. https://launchpad.net/~mir-team/+snap/ubuntu-frame-24-edge/+build/2631087 https://launchpad.net/~mozilla-snaps/firefox/+snap/firefox-snap-stable/+build/2636794 https://launchpad.net/~ubuntu-cdimage/+livefs/ubuntu/noble/ubuntu-budgie/+build/704273 [18:49] https://launchpad.net/~ubuntu-cdimage/+livefs/ubuntu/noble/ubuntu-mate/+build/704122 - could those be cancelled and retried? [19:44] @tsimonq2 amd64 builders seem to be sad. I'm getting this resolved [19:51] Ok each of the builds you mentioned has been nudged and are now running on other builders [20:15] clinton-fung: Thank you :)