[00:59] <sdhd-sascha> ok, copy & paste of snap building was fine: https://github.com/sd-hd/termite-snap/runs/407725965?check_suite_focus=true
[01:00] <sdhd-sascha> hmm, thanks
[11:06] <zyga> uh 18C in the office
[11:08]  * zyga debugs lxd issue
[11:21] <zyga> and now it obviously doesn't fail
[11:21] <zyga> WTF
[14:24] <zyga> waaat
[14:24] <zyga> stgraber: hey
[14:24] <zyga> stgraber: not sure if you are traveling now
[14:25] <zyga> stgraber: on an amd64 system, "lxc launch ubuntu:xenial" launches ... i386 container
[14:26] <zyga> er "lxc launch ubuntu:18.04"
[14:26] <ogra> doesnt here
[14:26] <zyga> ogra: it does here once in a few runs
[14:26] <zyga> ogra: it's super weird
[14:26] <zyga> it started yesterday
[14:26] <zyga> https://www.irccloud.com/pastebin/FmxUFgc1/
[14:26] <ogra> very strange
[14:27] <zyga> is there a way to pick the architecture explicitly
[14:27] <ogra> must be new indeed
[14:27] <zyga> lxc
[14:30] <stgraber> zyga: I'm still in Cape Town
[14:30] <zyga> stgraber: aha
[14:30] <zyga> stgraber: was there a release of lxd into candidate lately?
[14:31] <zyga> stgraber: we're pulling candidate in all our tests
[14:31] <stgraber> zyga: I know what change could have caused this, but it's not happening on my system here using master so it's unlikely to be something that hits every time
[14:31] <zyga> stgraber: it's random
[14:32] <zyga> hits every few times
[14:32] <zyga> maybe dictionary ordering
[14:32] <zyga> or something like that
[14:32] <stgraber> zyga: what does `lxc image info ubuntu:xenial` get you?
[14:32] <stgraber> the logic specifically sorts by arch, starting by primary before going to secondary, so shouldn't be random
[14:32] <zyga> checking
[14:33] <zyga> https://www.irccloud.com/pastebin/RRCUeVqC/
[14:33] <zyga> architecture looks correct here
[14:34] <stgraber> zyga: hit it here just now
[14:34] <stgraber> well, on a remote server, CPT internet is too slow to do a test loop :)
[14:34] <zyga> :)
[14:34] <zyga> yeah
[14:36] <zyga> stgraber: if there's a chance to tweak it and patch candidate we'd love that
[14:36] <stgraber> root@buildd01:~# for i in $(seq 20); do lxc image info ubuntu:xenial | grep Architecture; done | sort | uniq -c
[14:36] <zyga> stgraber: otherwise please give me a signal and I'll mask LXD tests for now
[14:36] <stgraber>       5 Architecture: i686
[14:36] <stgraber>      15 Architecture: x86_64
[14:36] <mup> PR snapd#8047 opened: tests: detect LXD launching i386 containers <Created by zyga> <https://github.com/snapcore/snapd/pull/8047>
[14:36] <stgraber> zyga: yes, it's a fix we had to rollout to fix all foreign arch (say armhf on arm64) that was broken, so we'll fix the fix and push it through quickly
[14:36] <zyga> haha, thank you :)
[14:36] <stgraber> zyga: we obviously don't want folks to accidentally run their foreign arch instead of native :)
[14:37] <zyga> I hope I didn't ruin your weekend
[14:37] <ogra> just call it an easter egg !
[15:25] <stgraber> testing a fix now
[15:25] <stgraber> zyga: nah, I'm at the company meetings this weekend
[15:35] <stgraber> zyga: I think my fix is working, just finishing a test loop
[15:35] <stgraber> yep, ran 1000 times and all x86_64
[15:35] <stgraber> sending upstream
[15:37] <stgraber> zyga: https://github.com/lxc/lxd/pull/6773
[15:37] <mup> PR lxc/lxd#6773: shared/simplestreams: Fix inconsistent sorting <Created by stgraber> <https://github.com/lxc/lxd/pull/6773>
[17:27] <zyga> stgraber: super, looking
[17:28] <stgraber> zyga: it's in candidate now
[17:28] <zyga> stgraber: yep, I just checked
[17:28] <zyga> re-starting our tests
[17:28] <zyga> thank you!
[17:28] <stgraber> Will promote to stable after dinner once Jenkins is happy
[18:18] <zyga> stgraber: hmmm, I just reproduced it again... from candidate
[18:18] <zyga> ah, no sorry
[18:18] <zyga> hmm
[18:18] <zyga> actually
[18:18] <zyga> yeah
[18:18] <zyga> https://www.irccloud.com/pastebin/D0mfZLII/
[18:18] <zyga> This was two hours ago
[18:19] <stgraber> Right so on the old rev still
[18:19] <stgraber> I ran a for loop trying it 1000 times so pretty sure this code path isn't racy anymore
[18:19] <zyga> ok
[18:20] <zyga> re-started
[19:27] <zyga> stgraber: did you publish to candidate?
[19:27] <zyga> it failed again at 18:57 CET
[19:28] <zyga> stgraber: so either I'm running unfixed revision or it is still broken
[19:28] <zyga> lxd (candidate) 3.19 from Canonical* installed
[19:36] <stgraber> Do you know the revision?
[20:31] <zyga> stgraber: no, the test doesn't show it
[20:32] <zyga> I'll change it to do so
[20:35] <zyga> stgraber: https://github.com/snapcore/snapd/pull/8047 will show it soon
[20:35] <mup> PR #8047: tests: detect LXD launching i386 containers <Test Robustness> <⚠ Critical> <Created by zyga> <https://github.com/snapcore/snapd/pull/8047>
[20:53] <zyga> stgraber: installed revision 13113
[20:54] <zyga> stgraber: version 3.19 from latest/candidate
[20:54] <stgraber> zyga: 13113 isn't an amd64 revision
[20:54] <zyga> stgraber: note that latest/edge is 13119
[20:54] <stgraber> zyga: 13115 is the amd64 one
[20:54] <zyga> doh!
[20:54] <zyga> indeed
[20:55] <stgraber> so yeah, if testing on 32bit, you'll get i386
[20:55] <zyga> we still run -32 version
[20:55] <stgraber> if you weren't, that'd be a bug :)
[21:15] <zyga> corrected my checks, let's see
[21:25] <mup> PR snapcraft#2893 opened: [legacy] meta: include environment in hook wrappers <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/2893>
[21:40] <mup> PR snapcraft#2894 opened: Fix issue with multipass mount on win32 <Created by NickZ> <https://github.com/snapcore/snapcraft/pull/2894>
[22:12] <zyga> stgraber: all good