/srv/irclogs.ubuntu.com/2022/07/28/#launchpad.txt

LocutusOfBorghello, timeout during upload and syncpackage...07:15
jugmac00LocutusOfBorg: Looks like there is a major infrastructure issue. IS is aware of it.07:19
=== ChanServ changed the topic of #launchpad to: Major infrastructure issues - Help contact: guruprasad (04:00-13:00 UTC Mon-Fri) | Launchpad is an open source project: https://dev.launchpad.net/ | This channel is logged: http://irclogs.ubuntu.com/ | User Guide https://help.launchpad.net/ | Support and spam reporting: https://answers.launchpad.net/launchpad
LocutusOfBorgack thanks07:59
LocutusOfBorgI'll check for topic changes then :)08:12
=== guruprasad changed the topic of #launchpad to: Help contact: guruprasad (04:00-13:00 UTC Mon-Fri) | Launchpad is an open source project: https://dev.launchpad.net/ | This channel is logged: http://irclogs.ubuntu.com/ | User Guide https://help.launchpad.net/ | Support and spam reporting: https://answers.launchpad.net/launchpad
maprericjwatson: https://launchpadlibrarian.net/615051648/buildlog.txt.gz - is this a LP problem?  "Could not open file /home/buildd/work/apt/./Sources - open (13: Permission denied)" and then just fails to build the source in that ppa recipe11:20
LocutusOfBorgand s390x is taking a rest again?11:27
cjwatsonmapreri: I guess it must be - file a launchpad-buildd bug if there isn't one already please?11:31
cjwatsonLocutusOfBorg: One of the two compute nodes is broken again.  I've reported it internally.11:38
LocutusOfBorgI hope such reports are useful, otherwise let me know, and I'll stop reporting them, maybe you already have tools to understand in advance if something breaks, other than "waiting for me to report here" :)11:40
cjwatsonIn principle we have alerts for this but they happen to be broken right now, IIRC following a Grafana migration11:56
cjwatsonNeed to sort that out ...11:56
maprericjwatson: couldn't easily find one already filed, so https://bugs.launchpad.net/launchpad-buildd/+bug/198302112:19
ubottuLaunchpad bug 1983021 in launchpad-buildd "fails to build ppa recipe: Could not open file /home/buildd/work/apt/./Sources - open (13: Permission denied)" [Undecided, New]12:19
mapreriguruprasad: sev=low? :(15:28
guruprasadmapreri, I don't know much about the details of this issue and marked it as low mostly as a rough guess. But I have already asked cjwatson, if I should bump it up.15:59
tedHowdy, I think the Inkscape snaps are timing out at 2 hours. Is there a way to request a longer timeout?22:04
tedhttps://launchpad.net/~ted/inkscape/+snap/inkscape-1.2.x/+build/182590122:04
cjwatsonted: That's not a timeout LP is imposing, it's ... something else.  Some kind of LXD failure?22:07
cjwatsonNot something we're in control of, anyway.22:08
cjwatsonIt might not be deterministic?22:08
tedHmm, not sure. I figured it was LP keeping me from mining crypto 😆22:08
cjwatsonHeh, no, that timeout is longer.22:09
cjwatsonAnd you're not being timed out by the proxy here anyway.22:09
tedIs there a way to get more entries? It started breaking a week or two ago, but I'm not sure when.22:09
cjwatsonI dunno, this is a couple of levels down from us.22:09
cjwatsonMaybe?  It's a bit hard to tell22:10
cjwatsonI don't really know what lxd means when it says "Error: websocket: close 1006 (abnormal closure): unexpected EOF"22:10
cjwatsonThough that "Killed" there looks like maybe the OOM killer got involved?22:10
cjwatsonsnapcraft really shouldn't be running into the OOM killer, so maybe something is spiralling out of control?22:11
tedYeah, was just thinking about that.22:11
tedThe snapcraft output there is usually when I think it is handling things over to snap to build the actual squashfs.22:12
tedWhich really shouldn't run out of memory more than for instance gcc.22:12
cjwatsonQuite22:13
tedBut, then, not seeing the actual compile in the log. So, feels like the log isn't complete.22:14
tedJust grabbing the packages shouldn't take 1h15m.22:15
cjwatsonThe last timestamped thing in the log is about five minutes after the build started.22:16
cjwatsonThe log's as complete as LP had available to it.22:16
cjwatsonReally looks like it got to "Initializing parts lifecycle" and then sat there churning for an hour and change before the OOM killer killed it.22:17
cjwatsonOh, this is core22, so you'll also be running into latest snapcraft being inappropriately quiet22:18
cjwatsonhttps://bugs.launchpad.net/snapcraft/+bug/198107222:18
ubottuLaunchpad bug 1981072 in Snapcraft "Core22 Snap builds don't output error logs" [Undecided, New]22:18
cjwatsonThat's a snapcraft regression and I think they're working on it22:19
tedOh, I bet this broken when snapcraft 7.x came out...22:19
cjwatsonYeah, very plausible22:19
cjwatsonIf you dig back you'll probably find the snapcraft version in successful/failing build logs22:19
tedTrying a build with 6.x snapcraft22:20
cjwatsonhttps://launchpad.net/~ted/inkscape/+snap/inkscape-1.2.x/+build/1788763 was the last successful build, https://launchpad.net/~ted/inkscape/+snap/inkscape-1.2.x/+build/1796416 the first failing one22:21
cjwatsonSuccess was with snapcraft 6.1, failure was with snapcraft 7.0.722:21
cjwatsonj'accuse22:21
sarnold:)22:30
tedcjwatson, thanks, definitely looks like the cause.22:31
tedSorry for the delay conference Wifi :-)22:31
nomadzhi, i'm taking a look at the launchpad installation instructions on dev.launchpad.net, it is still true everything above 18.04 is not supported/working as the instructions states?22:44
nomadzor is just outdated?22:44
nomadzhttps://launchpad.readthedocs.io/en/latest/how-to/running.html22:44
tedK, just confirming. A build with the snapcraft channel set to "6.x/stable" works.23:04

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!