[01:09] <mwhudson> uh it seems you can use the snapd api to switch a snap to the '' channel
[05:39] <zyga> mwhudson: I will tell John
[06:32] <mborzecki> morning
[06:54] <mborzecki> hmm 2019-03-28 22:17:21 Error preparing google:ubuntu-18.04-64:tests/main/ :
[06:54] <mborzecki> core                       6673  stable    canonical*         broken
[07:37] <mborzecki> mvo: morning
[07:39] <mborzecki> mvo: master seems broken now
[07:39] <mvo> mborzecki: hey, morning
[07:39] <mborzecki> mvo: for some reason there are no mount units for the snaps
[07:39] <mvo> mborzecki: what is the error?
[07:40] <mvo> mborzecki: woah
[07:40] <mborzecki> mvo: https://paste.ubuntu.com/p/3Kqjg7j76W/
[07:42] <mvo> mborzecki: the core18 snap changed since yesterday
[07:42] <mborzecki> mvo: snapd log https://paste.ubuntu.com/p/fNmpTNYMFj/
[07:42] <mvo> http://people.canonical.com/~mvo/core18-changes/html/edge/unknownr828_unknownr834.html
[07:43] <mvo> but nothing that would explain why mount units are missing
[07:43] <mvo> mborzecki: what do you see in ls /etc/systemd/system/snap* ?
[07:44] <mborzecki> mvo: no mount units, only snapd.{service,socket} overrides
[07:44] <mvo> mborzecki: woah
[07:45] <mvo> mborzecki: according to travis it started with the most recent master merge but that was just enabling suse again
[07:45] <mvo> mborzecki: so that does not make much sense
[07:45] <mvo> mborzecki: is it just ubuntu-18.04?
[07:45] <mborzecki> mvo: yes, but sa the same on 18.10
[07:45] <mborzecki> s/sa/saw/
[07:46] <mvo> mborzecki: but not older ubuntus or other distros?
[07:46]  * mvo scratches head
[07:46] <mborzecki> mvo: come to think of it, i only saw 18.*
[07:47] <mvo> mborzecki: it does not make much sense, does it :)
[07:47] <mvo> mborzecki: the joy of debugging things
[07:47] <mvo> mborzecki: I will try to reproduce and look for clues
[07:49] <mborzecki> mvo: checked 4 PRs, only 18.04
[07:55] <zyga> good morning!
[07:56] <zyga> mvo: hey, I found some odd things last night
[07:56] <zyga> I came to check on my tests and found that core18 failed
[07:57] <zyga> while it passed (though I ran the test in isolation) earlier that day
[07:57] <mborzecki> zyga: hey
[07:57] <mborzecki> mvo: installing hello-world actually works (?!)
[07:58] <zyga> mborzecki: because snapd thinks core is there
[07:58] <mborzecki> and refreshing core from --edge worked too, thereis a mount unit now and all
[08:07] <pstolowski> morning
[08:09] <mborzecki> heh ausearch -m AVC --checkpoint <file> doesn't work on centos :/
[08:10] <zyga> pstolowski: fusion update today
[08:11] <mvo> mborzecki: very strange, anyway, qemu running here, I'm curious about the results. maybe one of our scripts goes wild?
[08:11] <mvo> mborzecki: in the tests restore/prepare
[08:11] <zyga> pstolowski: I'm just installing it
[08:11] <mvo> mborzecki: but then we did not change those in a while
[08:11] <zyga> pstolowski: word of caution, it restarts session apps
[08:11] <mvo> iirc
[08:11] <pstolowski> zyga: ah, thanks for hint, indeed. installing as well
[08:11] <zyga> pstolowski: it will restart browser / etc
[08:11] <zyga> careful :)
[08:12] <pstolowski> zyga: ha.. ok
[08:12] <zyga> https://docs.vmware.com/en/VMware-Fusion/11/rn/fusion-1103-release-notes.html just fixes
[08:23] <zyga> https://www.bing.com/th?id=OHR.AurovilleIndia_ROW0132522166_1920x1080.jpg <- amazing wallpaper of the day
[08:26] <mborzecki> lxd from snaps doesn't work on centos :/
[08:45] <zyga> rm: cannot remove '/var/cache/snapd/aux': Is a directory
[08:45] <zyga> what is aux?
[08:45] <zyga> is that the auxiliary store stuff?
[08:46] <mvo> yeah
[08:47] <zyga> so, public service announcement: I'm off today
[08:47] <zyga> perhaps I should look at why the world is so red today
[08:53] <mborzecki> zyga: do you want to take a last look at https://github.com/snapcore/snapd/pull/6634 or can i land it?
[08:53] <mup> PR #6634: snap: add validation of gadget.yaml <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6634>
[08:54] <zyga> mborzecki: looking
[08:54] <zyga> let me just page through quickly
[08:55] <mborzecki> ok
[08:59] <mborzecki> zyga: i see you're wodnering too about the name/label thing in gadget.yaml
[08:59] <zyga> yeah
[08:59] <zyga> I didn't notice it before
[09:00] <zyga> because of go fmt's reshuffling of the whole blog
[09:00] <zyga> block
[09:00] <mborzecki> heh
[09:00] <mborzecki> maybe renaming it to FilesystemLabel would be useful
[09:01] <mborzecki> zyga: though, a follow up mabye? i'd like to avoid the full ci cycle again, given that it's fragile today
[09:01] <zyga> but what is the difference?
[09:02] <zyga> sure
[09:19] <pedronis> mborzecki: hi, name is also used in relative offsets, no?
[09:20] <zyga> mborzecki: almose done
[09:24] <zyga> mborzecki: reviewed
[09:25] <zyga> mborzecki: can you help me get https://github.com/snapcore/snapd/pull/6597 landed
[09:25] <mup> PR #6597: cmd/snap-update-ns: refactor of profile application (1/N) <Created by zyga> <https://github.com/snapcore/snapd/pull/6597>
[09:25] <zyga> it needs a 2nd review
[09:26] <zyga> alterenatively https://github.com/snapcore/snapd/pull/6502
[09:27] <mup> PR #6502: dirs,overlord/snapstate: add Soft and Hard refresh checks <Created by zyga> <https://github.com/snapcore/snapd/pull/6502>
[09:27] <zyga> mvo can  you review https://github.com/snapcore/snapd/pull/6410 please
[09:27] <mup> PR #6410: release-tools: add debian-package-builder <Created by zyga> <https://github.com/snapcore/snapd/pull/6410>
[09:32] <mvo> zyga: sure
[09:32] <zyga> thank you
[09:32] <mvo> mborzecki: hm, strange, "spread qemu:ubuntu-18.04-64" works here with master, thats odd
[09:33] <mvo> zyga: I looked at 6583, it fails to build right now but I can take care of this if you want
[09:34] <zyga> looking
[09:35] <zyga> mvo: hmm
[09:35] <zyga> hmm
[09:35] <zyga> odd
[09:35] <zyga> please let me dig at this
[09:35] <zyga> I have a few PRs that need a 2nd  review
[09:36] <zyga> those would be good to land instead :)
[09:36] <mborzecki> pedronis: yes, name is also used for refrring to structures in relative addressing
[09:36] <mup> PR snapd#6410 closed: release-tools: add debian-package-builder <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/6410>
[09:36] <zyga> \o/ thanks mvo
[09:38] <zyga> mvo: perhaps  this one https://github.com/snapcore/snapd/pull/6502 <- it's not that long
[09:38] <mup> PR #6502: dirs,overlord/snapstate: add Soft and Hard refresh checks <Created by zyga> <https://github.com/snapcore/snapd/pull/6502>
[09:39] <mborzecki> haha revolut is preparing for no-deal brexit :P
[09:41] <zyga> what are they doing?
[09:43] <mborzecki> zyga: need to verify your identity again if you previously used a driver's license for verification
[09:44] <zyga> odd
[09:44] <zyga> how is that related?
[09:45] <mborzecki> zyga: because they'd apparently need to migrade to a seaprate legal entity taht's in the eu (right now it's uk based)
[09:45] <zyga> lol
[09:45] <zyga> I feel sorry for people in the UK
[09:45] <zyga> monty python live show
[10:03]  * Chipaca notes he isn't working today
[10:11]  * mvo hugs Chipaca and shushes him away
[10:14] <mup> PR snapd#6665 opened: overlord/ifacestate: implement String() method of HotplugDeviceInfo for better logs/messages <Hotplug 🔌> <Created by stolowski> <https://github.com/snapcore/snapd/pull/6665>
[10:16] <zyga> brb, need some food
[10:16] <zyga> mborzecki: I'll review  in a m oment
[10:17] <pstolowski> zyga: can you finish the review of https://github.com/snapcore/snapd/pull/6629 when you have a moment (needs second +1)
[10:17] <mup> PR #6629: overlord/snapshotstate: helpers for dealing with snapshot expirations (automatic snapshots 2/N) <Created by stolowski> <https://github.com/snapcore/snapd/pull/6629>
[10:17] <pstolowski> ?
[10:22] <zyga> pstolowski: sure
[10:28] <zyga> pstolowski: looking now
[10:28] <pstolowski> zyga: ty!
[10:34] <zyga> pstolowski: done
[10:35] <zyga> pstolowski: you resolved https://github.com/snapcore/snapd/pull/6629#discussion_r270354045 without  commenting
[10:35] <mup> PR #6629: overlord/snapshotstate: helpers for dealing with snapshot expirations (automatic snapshots 2/N) <Created by stolowski> <https://github.com/snapcore/snapd/pull/6629>
[10:35] <zyga> ah, sorry, wrong link
[10:35] <zyga> https://github.com/snapcore/snapd/pull/6629/files#r268534384
[10:35] <zyga> this one
[10:40] <pstolowski> zyga: hmm it shows me entire PR. do you mean the discussion where you proposed having "snapshots" key defined at the global level to avoid typos?
[10:40] <zyga> pstolowski: cutoff  vs cut-off
[10:41] <zyga> line 130 of snapshotstate.go
[10:44] <pstolowski> zyga: yes, sorry about that, i thought i added it to the batch of github commits but didn't. should be fixed now
[10:44] <pstolowski> zyga: thanks for the review!
[10:44] <zyga> no worries, it's a bikeshed comment so you can always contend that :)
[10:59] <zyga> pstolowski: reviewed https://github.com/snapcore/snapd/pull/6665#pullrequestreview-220472935
[10:59] <mup> PR #6665: overlord/ifacestate: implement String() method of HotplugDeviceInfo for better logs/messages <Hotplug 🔌> <Created by stolowski> <https://github.com/snapcore/snapd/pull/6665>
[11:00]  * zyga watches https://www.theguardian.com/politics/blog/live/2019/mar/29/brexit-debate-latest-developments-live-news-may-at-risk-of-fresh-defeat-as-mps-debate-withdrawal-agreement-for-third-time-live-news
[11:00] <zyga> any more reviews I can do
[11:01] <zyga> please shoot URLs at me
[11:08] <zyga> anyone
[11:20] <zyga> pstolowski: does hotplug help here? https://forum.snapcraft.io/t/snapd-interfaces-dev-tty-0-9-read-write/10645
[11:25] <mup> PR snapd#6666 opened: Change file names that are breaking go modules <Created by slimjim777> <https://github.com/snapcore/snapd/pull/6666>
[11:38] <pstolowski> zyga: sorry, i had 1-1, will take a look in a moment
[11:38] <zyga> sure
[11:41] <mborzecki> hm trying to track down one selinux denial, idk why it happens, but snap is poking /proc/<pid>/stat of some process
[11:41] <mborzecki> i have a hunch that it's hooks and go runtime related
[11:42] <zyga> what does the denial look like?
[11:42]  * cachio afk
[11:46] <mborzecki> zyga: https://paste.ubuntu.com/p/SMP6VzNR6r/
[11:47] <zyga> oh, from snapd itself
[11:47] <zyga> interesting
[11:47] <mborzecki> yeah
[11:47] <mborzecki> my bet is go runtime doing something funny
[11:47] <zyga> yes
[11:47] <zyga> what is that pid?
[11:48] <zyga> is 5612 still running
[11:48] <mborzecki> no
[11:48] <mborzecki> and it isn't the pid of the shell tha ran snap install|remove
[11:48] <mborzecki> on top, it's centos, can't perf record what's starting :/
[11:48] <zyga> maybe it is related to snapctl and peers over sockets somehow
[11:48] <zyga> mborzecki: I'm doing some IO so I cannot search now
[11:49] <zyga> but perhaps check for "proc" and "stat" in golang tree?
[11:51] <zyga> looking gnow
[11:54] <mborzecki> hmmmm
[11:54] <mborzecki> switched the policy to non-permissive, and, calling systemctl daemon-reload failed :/
[11:55] <pstolowski> zyga: yes, i think we could have a new tty interface that utilizes hotplug and creates single slot for every ttyN
[11:55] <zyga> mborzecki: funn
[11:55] <zyga> mborzecki: I cannot find anything in the tree that does this
[11:55] <zyga> perhaps in our vendor tree?
[11:56] <zyga> mborzecki: polkit
[11:56] <zyga> ./polkit/pid_start_time.go:     filename := fmt.Sprintf("/proc/%d/stat", pid)
[11:56] <zyga> it must be polkit
[11:57] <zyga> pstolowski: can you update the thread please?
[11:57] <mborzecki> omg
[11:59] <pstolowski> zyga: will do
[12:17]  * pstolowski lunch
[12:20] <mvo> zyga, mborzecki I have a theory about why ubuntu-18.04 is now failing - I suspect we started seeding cloud-sdk
[12:20] <mvo> in the official images
[12:20] <zyga> oh
[12:20] <zyga> can you tell me moree
[12:20] <zyga> so ubuntu 18.04 in the cloud has  changed?
[12:21] <zyga> and what does cloud-sdk do?
[12:21] <mborzecki> interesting
[12:21] <mborzecki> that's google cloud sdk?
[12:32]  * zyga afk
[12:55] <mborzecki> ok, so disabling dontaudit and disabling permissive mode is actually enlightening
[12:56] <mborzecki> i can now install remove lxd snap with selinux in enforcing and without permissive flags in our policy
[13:16] <zyga> Wooot
[13:16] <zyga> That is a great milestone mborzecki
[13:27] <ijohnson> mborzecki: nice \o/
[14:48] <cachio> mvo, 18.04 error should be fixed once the new image is generated
[14:49] <cachio> it could take 20/30 minutes
[14:54] <mvo> cachio: yeah, I think I found the issue, the snapd purge does not work
[14:54] <mvo> cachio: because /var/cache/snapd/aux cannot be removed
[14:55] <mvo> cachio: and new images will fix that so yay!
[14:56] <cachio> mvo, I think so, so far all the tests are passing, also I added some checks to validate the imgae
[14:56] <mvo> cachio: yeah
[14:56] <mvo> cachio: thanks
[14:57] <cachio> mvo, yaw
[15:17] <Saviq> zyga: one for you: https://github.com/CanonicalLtd/multipass/pull/702#issuecomment-478036255
[15:18] <mup> PR CanonicalLtd/multipass#702: [snap] add libssl1.1 from bionic for Qt's consumption <Created by Saviq> <https://github.com/CanonicalLtd/multipass/pull/702>
[15:18] <Saviq> zyga: I'll trade you for https://forum.snapcraft.io/t/chaining-dependencies/10581 ;)
[15:31]  * cachio lunch
[15:32] <zyga> Saviq: looking
[15:32] <zyga> nice, thank you :)
[15:32] <zyga> I'm looking at that in relation to another mount namespace behavior
[15:32] <zyga> but I'm off today so not much progress
[15:34] <Saviq> slacker ;)
[15:43] <zyga> Saviq: that last year's quota has to burn :)
[15:48] <alan_g> mvo, we've encountered a problem with mir-kiosk starting on core18. With ogra's help I've traced it to "vt.handoff=2" in system-boot/cmdline.txt. Could you remove that please? https://github.com/MirServer/mir/issues/779
[15:53] <mvo> alan_g: could you please add a github issue against https://github.com/snapcore/pc-amd64-gadget ?
[15:53] <mvo> alan_g: and/or provide a patch there :) technically this is the foundations team now (sil2100 is the main contact currently)
[15:53] <mvo> alan_g: but we still like to help
[15:54] <alan_g> mvo, sure. (I get into this so seldom I don't know who to ask)
[15:55] <ogra> mvo, thats a pi issue, not amd64 ;)
[15:57] <alan_g> mvo, that should be https://github.com/mvo5/pi-gadget/blob/master/configs/cmdline.txt
[15:57] <alan_g> I think
[15:58] <ogra> https://github.com/snapcore/pi-gadget
[15:58] <ogra> that one (i think :) )
[15:59] <alan_g> Ah yeah, too many repos,
[15:59] <ogra> yup
[16:03] <mvo> ogra: oh, sorry
[16:03] <alan_g> Hm that one doesn't have any issues.
[16:04] <mvo> alan_g: so you can be the first one!
[16:04] <ogra> and wint a price !
[16:04] <mvo> alan_g: thanks for raising this btw and no worries, we are here to help
[16:04] <ogra> *win
[16:04] <alan_g> mvo, as in nowhere to put them
[16:05] <ogra> send a postcard to sil2100 then
[16:05] <mvo> alan_g: oh, let me look
[16:05] <alan_g> It has PRs, so I'll do that
[16:05] <alan_g> (after tea break)
[16:06] <mvo> alan_g: \o/ and I will investigate why there are no issues enabled
[16:09] <mvo> alan_g: I actually think this was deliberate that they are disabled. LP seems to be the bugtracker. however it also seems like we need to communicate this better. I will sync with lukasz about this
[16:38] <alan_g> mvo, ogra FYI https://github.com/snapcore/pi-gadget/pull/12
[16:38] <mup> PR pi-gadget#12: Enable mir-kiosk to start on Ubuntu Core 18/RPi 3 <Created by AlanGriffiths> <https://github.com/snapcore/pi-gadget/pull/12>
[16:40] <mvo> alan_g: \o/
[16:41] <mvo> alan_g: thank you
[16:41] <alan_g> mvo, np - the hard part was tracking down where.
[16:50] <mup> PR # closed: core-build#11, core-build#22, core-build#26, core-build#37
[16:51] <mup> PR # opened: core-build#11, core-build#22, core-build#26, core-build#37
[20:09] <mup> PR snapcraft#2506 closed: schema, tests: add more detail wrt numeric version errors <Created by adanhawth> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2506>
[20:42]  * cachio afk
[20:54] <mup> PR snapcraft#2519 opened: packaging: use local patchelf <Created by cmatsuoka> <https://github.com/snapcore/snapcraft/pull/2519>