/srv/irclogs.ubuntu.com/2017/11/20/#snappy.txt

mborzeckimorning guys06:03
zyga-ubuntugood morning06:12
zyga-ubuntuit's snowing!!!06:12
zyga-ubuntuman, I haven't seen snow in years06:12
mborzeckizyga-ubuntu: hey06:14
mborzeckiyeah, splendid weather06:15
zyga-ubuntumborzecki: just like I remember it my whole childhood :)06:19
zyga-ubuntumborzecki: it will be white by the time my kids go to school today06:19
mborzeckizyga-ubuntu: https://forum.snapcraft.io/t/core-snap-fails-auto-review-in-the-store-since-friday/289706:21
zyga-ubuntumborzecki: yep, I know :/06:21
zyga-ubuntuthough, let me read about new developments06:21
zyga-ubuntumborzecki: the store review code diff was one character06:22
zyga-ubuntumborzecki, ogra_: commented06:28
zyga-ubuntuman it's whiter every second06:28
zyga-ubuntuthe roof is now fully white06:28
zyga-ubuntuand my wife's car too (poor her!)06:28
zyga-ubuntuI only wish it was colder so the snow would not melt away so quickly06:28
zyga-ubuntuso, today, I have a few branches to iterate on06:29
zyga-ubuntubut I'd like to fix the other LXD issue once and for all06:29
zyga-ubuntuto have that boulder off my back06:29
mborzeckiwell, it's raining right here, there's still some spots of snow that apparently fell over the night, but it's ugly as hell (i.e. typical november)06:30
zyga-ubuntumvo: hello06:35
zyga-ubuntumvo: SNOW! :D06:36
zyga-ubuntumvo: some unhappy store news06:36
zyga-ubuntumvo: new review tools not deployed yet (it seems), jdstrand sent us email over weekend06:36
zyga-ubuntumvo: not sure if there are things he said we could do06:36
mvohey zyga-ubuntu ! good morning06:40
mvozyga-ubuntu: looking at my mail now. any other unhappy news?06:40
mvozyga-ubuntu: snow is nice06:40
zyga-ubuntumvo: no, nothing other than that06:42
zyga-ubuntumvo: but I haven't checked much yet06:42
zyga-ubuntumvo: waking kids up now06:42
mborzeckimvo: morning06:42
mvohey mborzecki - good morning06:43
zyga-ubuntu(I don't like when they don't go to school at 8AM)06:43
stgraberzyga-ubuntu: FYI, https://bugs.launchpad.net/snapd/+bug/173321107:02
mupBug #1733211: lxd snap fails to install w/apparmor "permission denied" error <snapd:New> <https://launchpad.net/bugs/1733211>07:02
stgraberzyga-ubuntu: going to bed now, but I expect we'll have more people run into this one as we've pushed a deprecation warning to all our PPA users on Friday telling them to move to the snap or backports07:03
zyga-ubuntustgraber: thank you for the note, reading07:03
zyga-ubuntustgraber: that looks like a new bug right?07:04
zyga-ubuntustgraber: or a regression technically07:04
zyga-ubuntubut this is weird, we have the rule to read that:07:05
zyga-ubuntu        @{PROC}/@{pid}/cmdline r,07:05
zyga-ubuntustgraber: if this is about privileged containers that don't stack apparmor then this is ECANNOTFIX07:06
zyga-ubuntustgraber: I sincerely hope it's not, let me read the bug carefully07:06
stgraberzyga-ubuntu: no, I hit this outside of a container07:06
stgraberzyga-ubuntu: usually on machines that are already running other snaps07:06
zyga-ubuntustgraber: aha!07:06
zyga-ubuntustgraber: thank you, I'll investigate07:07
zyga-ubuntusince you said that rebooting helped it smells like apparmor cache bug we ran into before07:07
stgraberzyga-ubuntu: the fact that rebooting the system fixes the issue is somewhat puzzling07:07
zyga-ubuntuI'll try to reproduce now07:07
stgraberoh, yeah, could be the apparmor cache07:07
stgrabernot sure why I didn't think of that, I could have dumped the content of the cache and profile before rebooting the system (though to be fair, they were broken production systems, so didn't have much time for debugging :))07:08
stgraberwhich makes me wonder, I have that backup host that may actually have the same issue and would let me check this quickly without risk07:08
stgraberand nope, no such luck, that system installs the lxd snap without any problem...07:09
* stgraber tries a few other random systems in his basement real quick07:09
zyga-ubuntustgraber: no worries, enjoy your evening and let us investigate07:09
jibelgood morning07:19
jibelthere is a recent increase of this problem on errors.u.c https://errors.ubuntu.com/problem/cf07c2fa3f39a98f0b52aaf20ff82faab796912907:19
zyga-ubuntujibel: good morning07:19
jibelit started around Nov. 14th07:19
zyga-ubuntujibel: thank you for the notice07:19
stgraberthat sounds surprisingly similar to that issue we were just discussing, also permission denied, also for a path that should be allowed and also in the configure hook07:21
zyga-ubuntujibel: oh, interesting, this is a yet another issue07:22
zyga-ubuntustgraber: yes, we ran into this one a while ago ~1 month07:22
zyga-ubuntustgraber: it was a bug in apparmor then07:22
zyga-ubuntustgraber: and we included a workaround for that07:22
zyga-ubuntusomething we need to look into, apparently07:22
jibelzyga-ubuntu, yeah other crash are with specific snaps, but this one is with the core snap07:22
jibelon 17.10 and 18.0407:22
zyga-ubuntumvo: so we have more "news" apparently07:23
zyga-ubuntu2.29.3 is very worrying, it should have been fixed before07:23
mvozyga-ubuntu: the configure script error is probably not 2.29.3 itself, just the fact that we have an update, no?07:28
mvozyga-ubuntu: I mean, the mass update of core triggered this I presume? triggered the apparmor bug07:28
mvozyga-ubuntu: do you remember the details for the previous workaround? that was part of 2.28.X, right?07:29
mvozyga-ubuntu: I don't see a mail from jamie about the script in my inbox, maybe it just went to you?07:31
zyga-ubuntumvo: let me check07:33
mupPR snapd#4249 opened: release: snapd 2.29.4 <Created by mvo5> <https://github.com/snapcore/snapd/pull/4249>07:34
zyga-ubuntumvo: the previous bug we did something (AFAIR you did after talking to tyhicks) that casuses cache to be purged on core updates on core07:34
zyga-ubuntumvo: ok, I should eat something before jumping into the fray07:35
zyga-ubuntumvo: I see that we have three issues: LXD + remove bug (close to being fixed, oldest), bug reported by stgraber above (mysteriously fixes itself on reboot) and the bug form errors.u.c from 14th Nov07:36
zyga-ubuntumvo: the other two may be related but not sure if they are yet07:36
zyga-ubuntumvo: let's split work in 20 minutes, I need to eat something07:36
mvozyga-ubuntu: sure, eat07:37
mvozyga-ubuntu: ssee you then07:37
mborzeckizyga-ubuntu mvo anything I can help with?08:07
zyga-ubuntumvo: ok properly back now08:12
* zyga-ubuntu made _warm_ breakfast for a change08:12
zyga-ubuntumborzecki: definitely!08:17
mvozyga-ubuntu, mborzecki I created http://pad.ubuntu.com/Wkp2bPRAnI so that we have a scratchpad, please add all you know there for now and once we have a bit more we can make that three forum topics08:19
mvozyga-ubuntu: I'm especially interessted in "lxd-+remove bug", is that the one you were chasing for some time ?08:19
mvozyga-ubuntu: i.e. the one where the rshared is not set correctly on /snap ?08:20
zyga-ubuntumvo: yes08:20
zyga-ubuntumvo: yes08:20
mvozyga-ubuntu: and if it is this one, why is it on the list? its not something new in 2.29.4, or is it?08:20
mborzeckimvo: can you paste the bug report from errors.ubuntu.com in the pad? I've only requested access there08:21
zyga-ubuntumvo: no, nothin new08:21
mvozyga-ubuntu: ok, if its nothing new, lets move it down the priorites just for now to figure out if 2 and 3 are regressions and what we can do about them (?)08:22
zyga-ubuntumvo: +108:22
zyga-ubuntudone08:23
mvomborzecki: I added some more data, unfortunately its not much, I guess we need a reproducer, might be as simple as going from an old core to the new core on 17.10, but then I do that all the time and have not seen it :/08:23
zyga-ubuntuI added some ideas on what might happen08:23
mvozyga-ubuntu: ta08:24
zyga-ubuntumvo: is issue 2 (renumbered) affecting those as LXD guest or host?08:30
zyga-ubuntumvo: (those releases)08:30
mvozyga-ubuntu: yeah, I wonder the same, I just tried it on a normal system in 17.10 and did not see the error08:32
zyga-ubuntumvo: I don't see 2.29.3 in the archive08:33
zyga-ubuntuon 17.1008:33
mborzeckiit's 2.28.5 iirc08:33
zyga-ubuntuyes, that's what I see08:33
mvozyga-ubuntu: not even in -proposed?08:33
zyga-ubuntumvo: ah, I didn't look there (not a default setup)08:33
zyga-ubuntudo you think people affected by 2nd bug used proposed?08:34
mvozyga-ubuntu: maybe but its strange08:34
mvozyga-ubuntu: because I can't reproduce it on a regular system08:35
mvozyga-ubuntu: with 2.29.3 from the debs on 17.1008:35
mvozyga-ubuntu: but maybe I need to try harder08:35
zyga-ubuntumvo: same result with stable debs + core08:36
mvothanks jibel btw for raising this issue!08:36
mvozyga-ubuntu: worth exploring if its happening inside lxd only, but then - the amount of users(17.10) & users(lxd) & users(snapd) are producing a relative high number of errror reports08:39
jibelmvo, yw08:47
kalikianao/08:49
mupPR snapd#4250 opened: packaging: fix typo <Created by mvo5> <https://github.com/snapcore/snapd/pull/4250>08:54
zyga-ubuntubrb09:18
zyga-ubunture09:38
zyga-ubuntumvo: do we retry core configure failures/09:39
mvozyga-ubuntu: no, I we just ignore failures on them09:41
zyga-ubuntumvo: that's curious09:41
zyga-ubuntumvo: look at those:09:41
zyga-ubuntuhttps://errors.ubuntu.com/oops/c8ec99fe-cdd2-11e7-919f-fa163ef911dc09:41
zyga-ubuntuhttps://errors.ubuntu.com/oops/7fecbe46-cdd2-11e7-9435-fa163ebeb28a09:41
zyga-ubuntumvo: that's one system09:42
zyga-ubunturight?09:42
mvozyga-ubuntu: yeah, thats strange indeed09:43
mvozyga-ubuntu: it looks almost like the install fails and it is retrying09:43
zyga-ubuntumvo: could it be a fresh install?09:43
zyga-ubuntumvo: after restarting into new snapd09:43
zyga-ubuntumvo: maybe another LXD cluster with privileged containers for that cloud certification?09:44
mvozyga-ubuntu: it has DidRexec set to 009:44
zyga-ubuntumvo: ah, I see09:44
zyga-ubuntupuzzlin09:44
mvozyga-ubuntu: yeah09:44
zyga-ubuntumvo: so ... proposed testing?09:44
zyga-ubuntumvo: maybe this is some adt machine?09:44
zyga-ubuntumvo: running off proposed?09:44
mvozyga-ubuntu: that sounds like a good theory09:45
mvozyga-ubuntu: and its a 16.04 one09:45
zyga-ubuntudid you have any luck in reproducing this?09:47
mupPR snapd#4251 opened: timeutil: include test input in error message in TestParseSchedule() <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4251>09:48
=== mup_ is now known as mup
Shibeguys is there any nightly for snappy?10:16
Shibefor ubuntu10:16
zyga-ubuntuShibe: we have the edge channel which is just like that10:17
Shibezyga-ubuntu: how do I enable it on ubuntu?10:17
zyga-ubuntuShibe: install snapd, install core snap (if you don't have one already) and snap refresh core --edge10:17
zyga-ubuntumvo: no idea how to reproduce this, I tried in various containers with and without proposed10:31
mvozyga-ubuntu: yeah, I am also clueless so far, I think we need to move it to the forum and see if we can find someone who actually hits this or can give us other clues10:34
zyga-ubuntuhmm10:35
zyga-ubuntuhttp://pad.ubuntu.com/ep/pad/reconnect - forbidden10:35
zyga-ubuntuhow i "love" etherpad10:36
mvozyga-ubuntu: http://pad.ubuntu.com/Wkp2bPRAnI ?10:39
mvozyga-ubuntu: and yeah, its very annoying10:39
zyga-ubuntumvo: connected back, thanks10:39
mvoyw10:40
zyga-ubuntupull requests are kind of red10:40
zyga-ubuntu+ snap refresh10:41
zyga-ubuntuerror: cannot refresh []: cannot query the store for updates: got unexpected10:41
zyga-ubuntu       HTTP status code 500 via POST to10:41
zyga-ubuntu       "http://localhost:11028/api/v1/snaps/metadata"10:41
mvozyga-ubuntu: yeah, I have a look in a tiny bit. but this sounds much like a problem for our friends in #snapstore :)10:41
zyga-ubuntuthat's interesting, why are we refreshing a list of no snaps?10:41
zyga-ubuntuman10:43
zyga-ubuntuI *HATE* travis moronic log output behavior10:43
zyga-ubuntuwhy does clicking on any line closes the fold?10:44
zyga-ubuntuNov 20 09:09:04 li157-129 snapd[31385]: 2017/11/20 09:09:04.824015 logger.go:76: DEBUG: < "HTTP/1.1 500 Internal Server Error\r\nContent-Length: 111\r\nContent-Type: text/plain; charset=utf-8\r\nDate: Mon, 20 Nov 2017 09:09:04 GMT\r\nX-Content-Type-Options: nosniff\r\n\r\ninternal error collecting snaps: open /tmp/read-file456639681/unpack/meta/snap.yaml: no such file or directory\n"10:44
zyga-ubuntumvo: is that us or the store is sending that?10:44
zyga-ubuntuah, that's fakestore10:45
pedroniszyga-ubuntu: that's our fakestore10:45
mvozyga-ubuntu: uhhh, which PR is thisß10:45
mvo?10:45
mupPR snapd#4252 opened: store: fix download caching and add integration test <Created by mvo5> <https://github.com/snapcore/snapd/pull/4252>10:46
zyga-ubuntuthis was 4242 but I just hit restart10:46
zyga-ubuntuit looks like timing / race in fakestore10:46
mvozyga-ubuntu: ok, no worries, I try to reproduce10:46
mupPR snapd#4251 closed: timeutil: include test input in error message in TestParseSchedule() <Created by bboozzoo> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4251>10:47
mvozyga-ubuntu: hm, not all is terrible, 4251 was green for example. there is a silver lining :)10:47
mupPR snapd#4250 closed: packaging: fix typo <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4250>10:48
mupPR snapd#4247 closed: interfaces: allow /bin/chown and fchownat to root:root <Created by jdstrand> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4247>10:50
mvoif someone could do a second review on 4242 that would be great, looks like an easy win10:50
zyga-ubuntumvo: that 4247 one had a question10:52
mvozyga-ubuntu: yes, I'm 99% sure the answer is "its fine", let me write that in the PR10:53
zyga-ubuntumvo: done10:53
mvozyga-ubuntu: ha! even better, thank you :)10:53
zyga-ubuntumvo: I mean 4242 :)10:53
mupPR snapd#4235 closed: cmd: pretend we're running on Ubuntu in TestExecInCoreSnapUnsetsDidRe… <Created by bboozzoo> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4235>10:54
mvozyga-ubuntu: let me check10:54
mvozyga-ubuntu: aha, sorry, async communication is hard ;)10:54
mvozyga-ubuntu: comment and I also looked at the source and my confidence is at 99.9 now10:57
zyga-ubuntumvo: thank you, I shared that but wanted to check just in case10:58
zyga-ubuntumvo: the BPF code just ingores those arguments10:58
mvozyga-ubuntu: yeah10:58
mvozyga-ubuntu: some PRs in flight, once there tests are green we can merge and will be below 25 again :)11:05
mupPR snapd#4253 opened: task tunner: extended task runner test <Created by stolowski> <https://github.com/snapcore/snapd/pull/4253>11:09
zyga-ubuntumvo: yeah I'll merge them as soon as we can, I restarted a few random failures today11:11
zyga-ubuntuthough way too more for my liking11:11
mvozyga-ubuntu: yeah, its too fragile currently11:12
mvozyga-ubuntu: the did-rexec in the error reports is a red-herring :/ the problem is that we unset SNAP_DID_REEXEC to not confuse classic confinement snaps. and that is the env that the err tracker picks up11:27
zyga-ubuntumvo: are you saying that we should set a new flag SNAPD_WE_ACTUALLY_DID=reexec11:28
zyga-ubuntupstolowski: hey, do you have a moment for 2nd look on https://github.com/snapcore/snapd/pull/422411:31
mupPR #4224: cmd/snap-update-ns: teach update logic to handle synthetic changes <Created by zyga> <https://github.com/snapcore/snapd/pull/4224>11:31
zyga-ubuntupstolowski: I changed the approach slightly after your comment11:31
mvozyga-ubuntu: maybe, I look into this right now11:31
zyga-ubuntumvo: I kind of feel that the set of constraints is lost11:32
zyga-ubuntumvo: we have some super ancient versions of snapd that put them11:32
zyga-ubuntumvo: but they have now escaped me11:32
zyga-ubuntumvo: maybe you could write this down in some reegex.go extented comment?11:32
zyga-ubuntuha, and I said "regeexec" instead of reexec :)11:32
mupPR snapd#4242 closed: asserts/sysdb: panic early if pointed to staging but staging keys are not compiled-in <Created by pedronis> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4242>11:33
pstolowskizyga-ubuntu, will do in a few moments11:39
niemeyerHello hello11:46
zyga-ubuntuniemeyer: hello11:47
mborzeckiniemeyer: hi there11:52
niemeyero/11:52
mvohey niemeyer ! welcome back11:54
mborzeckiis there a way to have check do a pretty print of unequal values like spew does?11:54
niemeyermvo: Thanks!11:55
niemeyermborzecki: Not a pretty print, yet at least12:04
mariogripjdstrand: ok got ubports-installer to work pretty nice in devmode now :) now the confined part, how do i handle the usb-raw part? post-install connect thing?12:15
mupPR snapd#4254 opened: cmd, errtracker: get rid of SNAP_DID_REEXEC environment <Created by mvo5> <https://github.com/snapcore/snapd/pull/4254>12:15
zyga-ubuntumvo: ^ you have a conflict there12:17
mupPR snapd#4245 closed: interfaces/screen-inhibit-control: handle ScreenSaver/Screensaver in DBus API <Created by jdstrand> <Closed by jdstrand> <https://github.com/snapcore/snapd/pull/4245>12:46
zyga-ubuntufg13:00
ogra_full grin ?13:00
ogra_:P13:00
mupPR snapd#4255 opened: interfaces/screen-inhibit-control: fix case in screen inhibit control <Created by jdstrand> <https://github.com/snapcore/snapd/pull/4255>13:04
kalikianayikes,  my /var/lib/snapd/hostfs is empty!?13:11
kalikianano wonder I'm getting strange failures13:11
ogra_you mean from inside a "snap run --shell" ?13:11
kalikianano, from outside as well13:12
jdstrandkalikiana: just passing by, but note it is only populated inside the snap13:12
jdstrandit is supposed to be empty on the host13:12
ogra_kalikiana, thats normal,13:12
ogra_only snap-confine mounts sumething there at runtime13:12
kalikianahmmm so it's "only" an issue in the snap13:12
kalikianaI got a file not found error13:12
kalikianaI can't "--shell" since this is a classic snap... (snapcraft)13:14
kalikianaI'm pretty sure the relevant code hasn't changed13:14
niemeyerIs it me or hangouts just broke?13:15
zyga-ubuntuniemeyer: you13:15
niemeyer"There is a problem connecting to this video call. Try again in a few minutes."13:15
zyga-ubuntuniemeyer: you froze after "guys"13:15
kalikianaoh, actually --shell does something, but it looks like my real shell13:16
mvoniemeyer: some more investigation (quite raw) http://pad.ubuntu.com/Wkp2bPRAnI13:16
kalikianajdstrand: ogra_ : so hostfs is empty within `snapcraft run --shell snapcraft` as well13:17
kalikianafeels like snapd changed something here13:17
jdstrandkalikiana: is snapcraft classic?13:17
kalikianajdstrand: yes13:18
jdstrandiirc, is is only populated for non-classic13:18
zyga-ubuntujdstrand: correct13:19
zyga-ubuntuhostfs on classic is /13:19
zyga-ubuntuso we don't do anything13:19
zyga-ubuntuperhaps we could use a trick13:19
zyga-ubuntuso in classic distros hostfs is a symlink to /13:19
zyga-ubuntuand for confined apps it is a directory and we pivot root there as we do13:20
kalikianajdstrand, zyga-ubuntu: the code in snapcraft hasn't changed, though...13:20
kalikianahrm, lemme debug this a bit13:22
kalikianait's weird actually the fact that hosts even shows up as a path here. the code isn't doing that..13:24
kalikianahrmpf, now it works again, no change...13:33
diddledanhttps://forum.snapcraft.io/t/corebird-1-7-3-release-with-added-emoji/290613:42
diddledan\o/13:42
mupPR snapd#4256 opened: snap-confine: add workaround for snap-confine on 4.13/upstream <Created by mvo5> <https://github.com/snapcore/snapd/pull/4256>13:51
zyga-ubuntumvo: +113:52
zyga-ubuntujdstrand: ^^13:52
mvozyga-ubuntu: I'm running the test in my manual created sid spread image now, will take a little bit13:54
zyga-ubuntumvo: mvo thank you13:56
zyga-ubuntumvo: my fix didn't work, I probably broke something just a moment ago as it was in a better shape last fix, digging13:56
mvozyga-ubuntu: thank *you*, you came up with the right apparmor line13:56
zyga-ubuntumvo: no, that was jdstrand :)13:57
mvozyga-ubuntu: oh? the fix for the lxd remove? or a different fix that does not work?13:57
zyga-ubuntumvo: for the remove13:57
mvozyga-ubuntu: aha, ok. still, I think you put it in the forum, I'm sure there is plenty of reason to thank you :)13:57
zyga-ubuntu:D13:57
* jdstrand reviewed 425613:57
* zyga-ubuntu tries -shell-before to see what's wrong13:57
mvozyga-ubuntu: testing on debian-sid shows some other issues, I will expand this pr a little bit, just fyi14:19
zyga-ubuntumvo: ack14:21
jdstrandroadmr: hi! hope you had a nice weekend. not sure you read email yet, but can you update the review tools for r945?14:26
jdstrandpopey: hey, do you have a moment to talk about snapcrafters?14:27
roadmrjdstrand: hey!14:33
roadmrjdstrand: I hadn't, but I'll get the ball rolling14:33
kalikianasergiusens: just to double-check, we have our weekly tomorrow/ Tuesday again?14:34
jdstrandroadmr: thanks!14:34
roadmrjdstrand: I was aware of the situation on Friday but there was not much we could do then :(14:34
kalikianasergiusens: I see it in the calendar, just at the back of my head someone said it would be Monday again14:34
jdstrandroadmr: yeah. r944 and r945 came in at an unfortunate time14:34
mborzeckineed to finish for today, enjoy the rest of the day guys, cu14:36
zyga-ubuntumvo: hey, I _think_ found the issue now (removed one line of apparmor by vim mistake probably)14:39
zyga-ubuntumvo: running again to see14:39
zyga-ubuntumvo: how are your stuff?14:39
zyga-ubuntu(debian)14:39
* kalikiana going out for lunch shortly, will be back in ~hour or so14:40
mvozyga-ubuntu: debian is running, a bit slow but running. it was net-tools missing that broke it earlier, I added it to the PR14:41
mvozyga-ubuntu: looking forward for the removal fix PR :)14:41
kalikianazyga-ubuntu: hrm, seems I'm still seeing the weird hostfs issue, it only went away since I tried straight from git, not from the snap... it seems the lxd snap/ lxc command is receiving a path starting with /var/lib/snapd/hostfs/ and that's what I see in the error14:42
zyga-ubuntumvo: once this run goes green I'll drop the unrelated changes and test again14:42
zyga-ubuntumvo: and publush14:42
zyga-ubuntu*publish14:42
zyga-ubuntukalikiana: can you please refresh my memory?14:42
kalikianazyga-ubuntu: what I just described above14:52
kalikianazyga-ubuntu: error: open /var/lib/snapd/hostfs/home/cris/snap/lxd/common/snapcrafts3h6q44p/core_3440.assert: no such file or directory from subprocess.CalledProcessError: Command '['lxc', 'file', 'push', '/home/cris/snap/lxd/common/snapcrafts3h6q44p/core_3440.assert', 'helga:snapcraft-oman/run/core_3440.assert']' returned non-zero exit status 1.14:53
kalikianawhen the file exists in the folder14:53
kalikianaon the host14:53
kalikianazyga-ubuntu: Wondering what could cause this... the path from snapcraft is the real one14:54
mupPR snapd#4257 opened: interfaces/opengl: also allow read on 'revision' in /sys/devices/pci <Created by jdstrand> <https://github.com/snapcore/snapd/pull/4257>14:59
mupPR snapd#4249 closed: release: snapd 2.29.4 <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4249>15:03
zyga-ubunture15:06
zyga-ubuntukalikiana: sorry, no (immediate) idea, trying to wrap up one issue, then will switch context to this if you need help15:07
kalikianazyga-ubuntu: aye, will have my lunch break first, no rush15:08
kalikianawell, late lunch haha15:08
mvojdstrand: silly question, I get an apparmor denial in snap-confine/debina-sid http://paste.ubuntu.com/26005784/ but the rule looks valid to me, how can I check how @multiarch is expanded?15:09
* jdstrand looks15:10
mvojdstrand: I have the VM in front of me if you need more info, its slightly puzzling15:10
jdstrandmvo: the rule looks right15:12
jdstrandmvo: is this a reexec situation?15:12
jdstrand(or lack thereof)15:12
mvojdstrand: no, re-exec is disabled on debian-sid right now15:13
mvojdstrand: its also happening when I directly run snap-confine in the shell15:13
jdstrandmvo: so /etc/apparmor.d/usr.lib.snapd.snap-confine.real has the rule you pasted?15:13
* jdstrand isn't sure .real is used in Debian...15:14
mvojdstrand: *cough* the file is 0 bytes long15:14
jdstrandah15:14
mvojdstrand: so something is fishy here15:14
jdstrandwell, that might have a consequence or two15:14
jdstrandsounds like the cache file is being used15:14
mvojdstrand: indeed, looks like the debian packaging is broken :/ the deb is also zero bytes15:15
jdstrandyikes15:15
zyga-ubuntudeb is zero byts?!15:15
zyga-ubuntuhmmm15:16
zyga-ubuntusomething fishy here:15:16
zyga-ubuntuumount: /snap/core/3495 unmounted15:16
zyga-ubuntu+ unsquashfs '/var/lib/snapd/snaps/core_3495.snap15:16
zyga-ubuntu/var/lib/snapd/snaps/core_3495.snap'15:16
zyga-ubuntuCould not open /var/lib/snapd/snaps/core_3495.snap15:16
zyga-ubuntu/var/lib/snapd/snaps/core_3495.snap, because No such file or directory15:16
zyga-ubuntuthere's a newline in that filename15:17
mvozyga-ubuntu: the snap-confine.real in the deb is zero byte15:17
zyga-ubuntumvo: I dropped junk from my branch, trying again15:21
zyga-ubuntumvo: it passed :D15:30
zyga-ubuntumvo: man, I just had to throw the garbage out15:30
mvozyga-ubuntu: yay15:30
zyga-ubuntumvo: I'll run a bit more of main to see one more test that broke on me earlier15:31
zyga-ubuntumvo: any luck with that @multiarch thing?15:31
mvozyga-ubuntu: zero size snap-confine.real apparmor in the package in debina15:33
mvozyga-ubuntu: thats the culprit, I still try to understand why15:33
zyga-ubuntumvo: kk15:33
stgraberzyga-ubuntu: did you find the source of that permission denied thing?15:35
zyga-ubuntustgraber: yes, it was regular permission in the end15:35
zyga-ubuntustgraber: that issue is fixed now snap-confine is now setgid root15:35
zyga-ubuntustgraber: thank you :)15:35
zyga-ubuntustgraber: also chasing (and almost fixed) the bug where snaps don't get removed in LXD15:35
stgraberzyga-ubuntu: oh, any idea why rebooting would solve it?15:35
zyga-ubuntustgraber: ah, no, not that one15:36
zyga-ubuntustgraber: sorry, no idea what caused that15:36
zyga-ubuntustgraber: we tried to reproduce it in the morning without much luck, there's an etherpad with some details: http://pad.ubuntu.com/Wkp2bPRAnI15:36
zyga-ubuntumvo: tentative, probably something I need to discuss with jdstrand https://github.com/snapcore/snapd/compare/master...zyga:fix/lxd-remove-bug?expand=115:37
zyga-ubuntuactually15:37
zyga-ubuntuthe commit message is stale, one sec15:37
mvozyga-ubuntu: so I think the problem is that we disable apparmor in debian, this leads to the zero byte file. do you think we should unconditionally enable apparor in debian now? or just install the apparmor profile for snapd and leave the rest as is? (cc jdstrand )15:45
stgraberzyga-ubuntu: left a comment in the pad about setup but yeah, it's certainly not trivial to reproduce as I tried a dozen other systems here and none of them are affected despite all of them also being 16.04 with live patch15:46
jdstrandmvo: I think the idea was that we would enable 'partial' support in Debian, which would mean all the policy is in place. zyga-ubuntu was working towards that15:50
mvojdstrand: ok, I will go with that then15:51
jdstrandzyga-ubuntu: this is a short week for me. I have 4170 and 4109 on my list for reviews this week. is there anything else pressing?15:52
jdstrand(reviews for you that is)15:52
jdstrandzyga-ubuntu: are both of those ready for me to review?15:52
zyga-ubuntumvo: yes, we should enable apparmor in debian now16:02
zyga-ubuntustgraber: thank you, I'll check in a moment16:02
zyga-ubuntujdstrand: yes, I think we can use partial policy16:03
zyga-ubuntujdstrand: 4170 is good, as is 422416:04
zyga-ubuntujdstrand: 4109 is optional, we can close it if you want; I can just take a small refactoring patch and propose it separately16:04
zyga-ubuntu*separately16:04
zyga-ubuntujdstrand: if we focus on this we could do most or all of layouts this week, if we get to a quick feedback cycle for PRs each dayt16:05
zyga-ubuntu*day16:05
zyga-ubuntujdstrand: we are just a few PRs short of this now, most of the code is in, just some glue is left16:05
zyga-ubuntujdstrand: all my PRs are ready to review, except for the one that's marked as "blocked"16:05
jdstrandzyga-ubuntu: so, 4170 and 4224 require reviews from me (and optionally 4109). correct?16:07
zyga-ubuntujdstrand: yes16:07
* jdstrand adds 422416:08
jdstrandthanks16:08
flexiondotorgelopio: Hi16:15
flexiondotorgI'm working on (just about finished) a language guide for creating snaps of Rust apps.16:16
flexiondotorgI've use Parity as the example yaml.16:16
flexiondotorgelopio: Can you explain why you are staging libc in the upstream parity yaml?16:16
kyrofaelopio, I'm seeing a number of adt test failures that only include the autoremove output in the error string: https://pastebin.ubuntu.com/26006225/16:26
kyrofaSo they fail, but it doesn't say why16:26
kennylogginspopey 's off today - hope all is cool with him & his cat Sky.16:28
kyrofaHey zyga-ubuntu, any progress on that other lxd issue?16:32
zyga-ubuntukyrofa: which one? (we have >> 1 now)16:33
zyga-ubuntukyrofa: the oldest remove bug?16:33
kyrofazyga-ubuntu, indeed16:33
zyga-ubuntukyrofa: yes, running main tests now, I'll work with mvo and jdstrand on reviewing this quickly16:33
kyrofazyga-ubuntu, wonderful, thank you!16:34
elopiokyrofa: that's executing the command. We need something that will capture stderr for all those executions, and puts it in the test details.16:35
elopiomaybe an assertCommandOutput, or something.16:35
kalikianakyrofa: that looks like the binary couldn't be run - although I could be mistaken16:36
magicaltroutanyone tried jdbc connections with that mysql snap part from nextcloud?16:36
mupPR snapd#4255 closed: interfaces/screen-inhibit-control: fix case in screen inhibit control <Created by jdstrand> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4255>16:39
kyrofaelopio, ah, okay16:41
elopioI upgraded to bionic and you will never guess what happened next...16:48
elopiono wifi disconnections the whole morning!16:48
kyrofaelopio, ah! Amazing!16:48
kyrofaelopio, so I see you haven't learned your lesson :P16:48
kalikianaelopio: I would've recommended trying from a USB stick first... which is funny because our risk aversity is reversed in non-digital life, like cross streets16:51
elopioI haven't been trained for non-digital life.16:54
=== petevg_afk is now known as petevg
zyga-ubuntukyrofa: https://github.com/snapcore/snapd/pull/425817:01
mupPR #4258: cmd/snap-confine,tests: fix unmounting on systems without rshared / <Created by zyga> <https://github.com/snapcore/snapd/pull/4258>17:01
mupPR snapd#4258 opened: cmd/snap-confine,tests: fix unmounting on systems without rshared / <Created by zyga> <https://github.com/snapcore/snapd/pull/4258>17:01
zyga-ubuntujdstrand: please look at that PR briefly to see if it's on the right track17:04
kyrofaNice work zyga-ubuntu, thanks for hacking on that17:04
kalikianaelopio: your parents raised you through a webcam?17:04
elopiokalikiana: no, but that's not a bad idea. Maybe I can take some coursera classes to learn how to deal with the city :)17:25
zyga-ubuntuhmm17:35
zyga-ubuntusnapd fails on 4.1417:35
zyga-ubuntuin bionic17:36
niemeyerWeird.. I thought we had discussed and agreed not to release the progress bar making use of ASCII background color17:39
niemeyerBut stable apparently has it17:39
gsilvapthello all17:47
gsilvaptAnyone with experience writing tests for snapcraft?17:47
pstolowskiniemeyer, ok, i've found the problem with taskrunner17:48
niemeyerpstolowski: Oh! Tell us!17:48
zyga-ubuntupstolowski: I'm curious now17:48
gsilvaptkyrofa, maybe you could help finish this issue :p17:50
gsilvaptMaybe I'm using click framework poorly but I am not 100% sure17:50
pstolowskiniemeyer, zyga-ubuntu so my hunch about run-hook not having undo handler was correct, but I missed the fact that fixing this in hookmgr doesn't affect the tests (because test register own handler with undo=nil). so yes, when taskrunner sees undo handler == nil, it immediately transitions from UndoStatus -> DoneStatus, disregarding any other tasks. so if the hook task was a prerequistite of some other task, that other task gets unblocked immediately17:51
pstolowskiso the culprit is in the block of code marked with // Cannot undo. Revert to done status.17:55
kalikianagsilvapt: what're you up to? I have more experience with tests than I ever asked for :-P17:56
gsilvaptkalikiana, basically I'm implementing a method to retrieve snapcraft's version by calling a command snapcraft version17:56
gsilvaptUsing click, I think I have properly defined this implementation.17:56
kalikianaah, nice17:56
niemeyerpstolowski: I still don't see how that's a problem17:57
gsilvaptBut, when I wrote the test, I can see the exit_code = 2, which I cannot find in that definition so I have no idea what that means and/or if the method is implemented properly17:57
gsilvaptthe method = mine17:57
niemeyerpstolowski: In particular, your last statement about unblocking immediately sounds like exactly what we want17:57
kalikianagsilvapt: is the code you're talking about in a branch? I think I need some more context to be helpful17:58
gsilvaptkalikiana, well, I created my own branch to write my own code but I can send you a pastebin or something17:58
pstolowskiniemeyer, the hook task is part of the chain where every task waits for the next one; so suddenly a task in the middle of the chain is considered Done, regardless of the tasks following it17:58
kalikianagsilvapt: sure, pastebin is fine, whichever is convenient17:58
niemeyerpstolowski: Again, that's exactly what we want17:59
niemeyerpstolowski: Tasks *following* it will *follow* it17:59
gsilvaptkalikiana, https://gist.github.com/anonymous/4064b69dbd96ac9fcea88747fc0d178d18:00
niemeyerpstolowski: Which doesn't mean you are wrong.. I just don't see what the actual issue is yet18:00
pstolowskiniemeyer, adding non-nil undo handler (that does nothing) to run-hook in the test immediately fixes the out-of-order tasks. this cannot be right18:00
gsilvaptkalikiana, if you need some help reading my code, let me know. I'm new around and only started learning how to code properly in September or so - please be patient :D18:01
niemeyerpstolowski: Which out of order tasks?18:01
niemeyerpstolowski: Again.. it all sounds quite vague18:01
magicaltroutso..... is there a size limit on snaps?18:01
kyrofagsilvapt, that looks good, but does not look complete18:01
niemeyerpstolowski: If a task B has A ordered before it, and A is done, B is immediately unblocked18:01
niemeyerThat's what we want18:01
kyrofagsilvapt, you need to actually _use_ it in cli/__init__.y18:01
gsilvaptHum, can you say what is missing in abstract terms? Maybe I can think of something to complete it18:02
pstolowskiniemeyer, http://pastebin.ubuntu.com/26006783/18:02
niemeyerpstolowski: Ok, what should I look at there?18:02
gsilvaptkyrofa, so I need to change the @click.version() bit?18:02
pstolowskiniemeyer, HO?18:02
kyrofagsilvapt, go into the cli directory, and grep around for "help"18:02
niemeyerpstolowski: Sure18:02
kyrofagsilvapt, no, you need to actually hook your new subcommand into snapcraft18:02
kyrofagsilvapt, look for how the help command is done18:03
niemeyerpstolowski: Waiting in the standup18:03
kyrofaYou can grep for "helpcli" as well18:03
kalikianagsilvapt: one thing I notice is the except ImportError - maybe not the issue you were asking about, but I'd say if you are running this code, snapcraft is installed... so you shouldn't need that at all18:03
gsilvaptkalikiana, what if the user does not have snapcraft installed?18:04
gsilvaptkyrofa, thank you, I'll look at the example and see if I can figure this out18:04
kalikianagsilvapt: think about it. the code is part of snapcraft18:04
kalikianaunless I misunderstood what you're trying to do18:05
kyrofagsilvapt, sure. Sorry for letting you pound your head on this, but it really is the best way to learn things sometimes! Let me know if you need another hint18:05
gsilvaptkyrofa, please do not apologise for that! This helps me understand what is going on and learn how to do stuff so yes, this is actually better!18:06
gsilvaptkalikiana, all packages will return no package found 'package-name' so I think this command should return the exception it could not find snapcraft installed in the system18:07
gsilvaptPerhaps the Exception is poorly designed and thus is confusing you but maybe we can work it out too18:07
kalikianagsilvapt: just to be clear: will this code be part of snapcraft?18:07
kalikianaor another tool?18:08
* kalikiana needs to change location, will be back in a few minutes18:08
gsilvaptkalikiana, I did not follow entirely18:08
kalikianagsilvapt: will version.py be part of snapcraft or a different project?18:08
gsilvaptkyrofa, it worked.Thank you!18:09
kyrofaAwesome!18:09
gsilvaptpart of snapcraft, under cli18:09
gsilvaptDid not know we had to import things and tell cli which to consider. Makes sense though!18:09
kennylogginselopio: What channel is this on, again in #freenode ? https://twitter.com/d3fc0n3/status/93264981309036953618:12
magicaltroutkyrofa: niemeyer whats the snap upload limit?18:13
kyrofamagicaltrout, I don't know that there is one18:14
magicaltroutwell i get internal server error and proxy error on snap push18:14
magicaltroutwhich is reminicent of the juju resource upload issue18:14
magicaltrouthttps://gist.github.com/buggtb/2a5ebbb7f779a1e35a6329306c85c18c18:16
elopiokennyloggins: there are many ubuntu channels, it depends on who you want to thank :)18:16
gsilvaptkalikiana, any suggestion? I want to understand your point before submitting the push and the consequent PR18:16
kennylogginselopio, I just thought it was an ubuntu - with a rallying point, my mistake (again).18:17
kennyloggins**ubuntu-day18:17
elopiokennyloggins: the rallying point is the hub, https://ubu.one/ucaday18:17
kalikianagsilvapt: Right. So what I'm saying is, the code will only be executed if snapcraft is installed, or you run it from git - so you don't need to handle the case where the import fails, because other code makes sure it works18:25
gsilvaptkalikiana, so I should remove the try and except bit and just leave the command?18:26
kalikianagsilvapt: Yup18:27
gsilvaptOk, I will submit the push + PR now18:27
gsilvaptThank you, kalikiana and kyrofa18:27
niemeyermagicaltrout: That's a pretty big snap indeed.. I suggest asking in the forum about what the limit is18:28
niemeyermagicaltrout: #store category18:28
magicaltroutthanks18:28
gsilvaptWell, now comes the tricky part. I also included a test but should I run something else aside from this, kyrofa?18:29
kyrofagsilvapt, I suppose that depends on the test you wrote. Can I see it?18:30
gsilvaptBasically, it is a repetition of the one already there for --version. As mentioned in LP it should return the same.18:31
gsilvaptBut, here's a gist: https://gist.github.com/gsilvapt/41de75a1a920e0ec93163091f1960a0518:31
kyrofaelopio, can I get a review on snapraft#1743 when you're able?18:31
kyrofaUh. snapcraft#174318:32
mupPR snapcraft#1743: catkin plugin: support building entire workspace <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/1743>18:32
kyrofagsilvapt, no need to print. That seems fine to me18:32
kyrofagsilvapt, propose it!18:32
gsilvaptThank you!18:32
kyrofagsilvapt, you'll get more feedback in the pull request18:33
gsilvaptYes, I'm expecting that. Hopefully nothing too diminishing, hehe :-)18:33
gsilvaptIs there a way to check if I've signed the CLA? I'm pretty sure I did but I want to check first18:34
kyrofagsilvapt, make sure the commit message looks like this: https://pastebin.ubuntu.com/26007003/18:34
kyrofagsilvapt, make a PR and it'll check to ensure you've signed18:35
kyrofaAssuming the email address under which you're committing is also in your LP account18:35
pstolowskiniemeyer, ha, so the fix we discussed is correct and we have 2 test checks in snapstate_test built around wrong assumption ;). PR is coming18:35
gsilvaptRight, thank you remembering that kyrofa18:37
mupPR snapcraft#1746 opened: Implemented method to get snapcraft version <Created by gsilvapt> <https://github.com/snapcore/snapcraft/pull/1746>18:37
kalikianagsilvapt: I added a comment on the test - instead of the print I think it'd be better to compare the value to the expected version with Equals or Contains18:45
gsilvaptBah, I'm an idiot. That was not suppose to be there -.-18:46
gsilvaptThank you for letting me know. Lets see if I don't screw this up while trying to squash commits18:46
zyga-ubuntudrat18:47
mupPR snapd#4259 opened: snapd: fix handling of undo in the taskrunner <Created by stolowski> <https://github.com/snapcore/snapd/pull/4259>18:47
pstolowskiniemeyer, ^18:47
gsilvaptkalikiana, you prefer your method instead of just assertThat()?18:49
gsilvaptThe print statement is obviously a mistake. On Saturday night I was working on this and the exit_code = 2 was driving me nuts. This was a desperate attempt to try to see what value the method was returning18:49
gsilvapthow do you squash commits though? Rebase?18:54
* zyga-ubuntu considers EODing18:55
mupPR snapd#4258 closed: cmd/snap-confine,tests: fix unmounting on systems without rshared / <Created by zyga> <Closed by zyga> <https://github.com/snapcore/snapd/pull/4258>18:56
zyga-ubuntujdstrand: I closed 4258 as it doesn't seem to work in linode, I need to look at that (doing so now) but it's not worth reviewing until I do18:58
kyrofazyga-ubuntu, how sad18:59
kyrofagsilvapt, yeah, run `git fetch` and then run `git rebase -i origin/master`19:00
kyrofaAssuming `origin` is the remote name for upstream19:00
gsilvaptkyrofa, so do changes, add/commit, fetch, rebase and force push to my repo?19:00
gsilvaptI think I have to do force push after rebase, not sure19:00
kyrofagsilvapt, assuming you've already pushed, yes, you'll need to force19:01
gsilvaptWhat do you mean assuming I have pushed?19:01
kyrofagsilvapt, if you haven't pushed, then you don't need to force in order to push19:01
kyrofa(since there's nothing up there for it to conflict with19:01
gsilvaptOk, let me give that a try19:01
kyrofa)19:01
gsilvaptkyrofa, I think I have to force because it now says by branch is behind its remote counterpart19:04
kyrofagsilvapt, which means you pushed it19:04
kyrofaSo yes, you need to force19:04
gsilvaptNo, I was holding for instructions19:04
gsilvaptI pushed before when I wanted to submit the PR, not after19:05
gsilvaptWell, it worked I think19:06
jdstrandzyga-ubuntu: I provided some feedback19:07
zyga-ubuntujdstrand: thank you19:20
gsilvaptkyrofa, one question: Can you help me understand this? https://travis-ci.org/snapcore/snapcraft/builds/304902240?utm_source=github_status&utm_medium=notification19:21
gsilvaptI know what CI is but I never worked with it more closely19:22
zyga-ubuntujdstrand: I replied on some of the feedback, thank you for looking19:24
zyga-ubuntujdstrand: the problem is that snapd is too late and cannot be the one fixing this, it must be genuinely something in the distro package19:24
zyga-ubuntujdstrand: (or snapd before reexec, perhaps)19:24
zyga-ubuntujdstrand: but really it must happen before apps start running19:24
kyrofagsilvapt, yeah, you need to run ./runtests.sh static19:25
gsilvaptbut I did :o19:25
zyga-ubuntujdstrand: I tried several other approaches, including a .mount unit (so that systemd would do it) but systmed is insufficient19:25
kyrofagsilvapt, take a look: https://travis-ci.org/snapcore/snapcraft/jobs/304902243#L109419:25
gsilvaptHum, weird. Lets give that another look19:26
zyga-ubuntujdstrand: ideas (any, I will gladly investigate their viabilty are welcome)19:26
gsilvaptThanks kyrofa19:27
kyrofaelopio, where is the bot?19:27
kyrofaelopio, I can't run adt19:27
gsilvaptkyrofa, is it possible to run Travis for every commit pushed to a given repo? This is not entirely related with Travis but a personal curiosity19:40
kyrofagsilvapt, yes19:40
gsilvaptWithout needing PRs, I meant19:40
kyrofagsilvapt, right, still yes :)19:41
gsilvaptOk, thank you :)19:42
jdstrandzyga-ubuntu: I gave several ideas to look into with: https://github.com/snapcore/snapd/pull/4258#pullrequestreview-7788525519:42
mupPR #4258: cmd/snap-confine,tests: fix unmounting on systems without rshared / <Created by zyga> <Closed by zyga> <https://github.com/snapcore/snapd/pull/4258>19:42
jdstrandzyga-ubuntu: the thrust of each idea is that snapd in lxd can detect if it is running in a container and do something. what that something is needs investigating. maybe it creates different .mount files for the snaps. maybe different .service files. maybe it performs an operation on /, maybe something else19:43
elopiokyrofa: ^21:30
zyga-ubuntujdstrand: if we can start from clean slate then we might do something else21:34
zyga-ubuntujdstrand: iff we can have control before snap units are mounted, we can do one operation (bind mount /snap over)21:34
zyga-ubuntujdstrand: I did succeed in doing that with a mount unit but it was _not_ rshared at that stage21:34
zyga-ubuntujdstrand: but systemd cannot both bind mount and rshare21:35
zyga-ubuntujdstrand: perhaps my earlier approach, with a /snap mount unit (just bind mount) and snap-confine that just does equivalent of mount --make-rshared /snap will do21:35
zyga-ubuntujdstrand: the key is that we must do this before 1st snap runs and unshares a mount namespace21:35
zyga-ubuntujdstrand: think about this and let me know, I'll iterate tomorrow21:36
jdstrandzyga-ubuntu: that is what I was thinking. this is all within lxd, no? if so, you have to run the snap command to install anything, therefore, you have an opportunity to do what you need. rather than make systemd do bind mount with rshared, just have a teensy tiny helper that does that, put that in a service file that you conditionally use if in a container21:45
zyga-ubuntujdstrand: this also affects 14.0421:45
jdstrandthe helper could be in the upstart job or whatever too21:45
zyga-ubuntujdstrand: we have that helper but it's not working21:45
zyga-ubuntujdstrand: because it runs after snap units are mounted21:46
zyga-ubuntujdstrand: and then there are two entries21:46
zyga-ubuntujdstrand: and that causes the bug21:46
zyga-ubuntujdstrand: one before bind+rshare, one after21:46
zyga-ubuntujdstrand: this also confuses systemd so stopping mount units doesn't work21:46
zyga-ubuntu(it hangs)21:46
jdstrandI don't claim to have all the details, but in my head: sudo snap install foo -> am I in a container? -> yes, add unit file with helper to bind/rshared /snap -> start unit -> proceed with install21:47
zyga-ubuntujdstrand: but I think the approach can be made to work with a combination of mount units (those have dependencies so we could get correct ordering) and a bit of code in snap-confine (easy guarantee to run before we construct snap namespace)21:47
jdstrandthere are certainly details to be worked through21:47
zyga-ubuntujdstrand: that won't work after reboot21:47
jdstrandyou can make it work21:47
zyga-ubuntujdstrand: again, the order of mount operations (either via systemd or helpers) is crucial21:47
zyga-ubuntujdstrand: but yes, the /snap mount unit is a trick we should use here21:48
jdstrandmake that service file a noop for the default case and all mount units start after it. if in container, then tweak the unit to run the helper21:48
zyga-ubuntujdstrand: then we need to tweak all mount units to have before/after stanazas to order themselves21:48
jdstrandor similar21:48
zyga-ubuntujdstrand: I think it's all solvable21:49
jdstrandwe are the ones writing the mount units, no?21:49
jdstrandI see, yes21:49
jdstrandyou were saying what needs to be done, not objecting21:49
zyga-ubuntujdstrand: yes but curretly snapd has no facility to correct the mount units (we have another bug pending on tihs)21:49
zyga-ubuntujdstrand: again, I agree, it's just steps to get there21:49
jdstrand2 bug fixes for the price of one! :)21:49
zyga-ubuntujdstrand: and some bugs in systemd that cause this to be harder than it has ot21:50
zyga-ubuntu*to21:50
zyga-ubuntujdstrand: (the other bug is 14.04 mount ordering)21:50
zyga-ubuntujdstrand: offtopic, did you have a chance to look at the two PRs for snap-update-ns?21:51
jdstrandzyga-ubuntu: I'm looking at 4170 now. I already gave a quick comment you may want to consider21:52
zyga-ubuntulooking21:52
zyga-ubuntuman, that PR will never land21:52
zyga-ubuntuI restarted tests >> 20 times on it21:53
zyga-ubuntusomething always fails21:53
zyga-ubuntustore hicckup, some racy test here or there ://21:53
jdstrandzyga-ubuntu: the good thing is that when it does, no other PR will land :P21:53
jdstrand*sigh*21:53
jdstrandI had a racy test that had a similar issue21:53
jdstrandso I feel your pain21:54
zyga-ubuntujdstrand: master is super super unreliable recently21:54
* jdstrand nods21:54
zyga-ubuntujdstrand: and we are playing the game of "flip a coin N times, ensuring it's heads each time" while incrementing N21:54
zyga-ubuntujdstrand: so I maybe agree if your proposal is undo-safe21:55
zyga-ubuntujdstrand: note that we may be asked to completely undo any of this21:56
zyga-ubuntujdstrand: and that the typical situation, nothing is hidden under the tmpfs mount21:56
gsilvaptkyrofa, I saw your comment. I'll try to see what can I do. I already did a test that checks if both commands' outputs are the same. Now I have to see what you meant with duplicating click's template21:56
zyga-ubuntujdstrand: (apart from a fragment of a squashfs mount)21:56
zyga-ubuntujdstrand: the simple approach I took guarantees (I hope, prove me wrong please) that I can always undo21:56
zyga-ubuntujdstrand: and create another layout21:56
jdstrandzyga-ubuntu: that might be a case for needing the contents of the mounted over directory21:58
kyrofagsilvapt, just run `snapcraft --version` and compare the output to `snapcraft version` and you'll see what I mean21:58
kyrofagsilvapt, what timezone are you in, by the way?21:58
zyga-ubuntujdstrand: I also toyed with one more ideqa22:00
zyga-ubuntu*idea22:00
zyga-ubuntujdstrand: iff it's a good assumption that we can look at hostfs, we can fish the snap mounts there22:00
zyga-ubuntujdstrand: but it's not generic as the same code should be useful for poking holes in various places that are not just /snap22:00
zyga-ubuntujdstrand: and while it's possible to find the same place in hostfs it may have been changed by the hardcoded mount commands in snap-confine22:01
gsilvaptkyrofa, GMT22:06
gsilvaptkyrofa, I have to learn how to setup a testing environment for this. The last time I tried I ended up deleting most stuff andsuch22:07
gsilvaptI understand the outputs are different, the test is being rejected currently. I just am not too comfortable with Click yet :P22:07
kyrofagsilvapt, yeah you don't need to change click, just `click.echo` something that makes the `version` command echo the same thing as what you see `--version` doing22:12
gsilvaptkyrofa, this might take too much time. I'm having issues with python and pip again...22:42
kyrofagsilvapt, what's up?22:42
gsilvaptI can't use pip3 and I only want to use python322:43
gsilvaptEvery command I run using pip3 gives a common _NameSpace Attribute Error which was previously solved by updating setuptools, wheel and/or pip. None of those work22:43
kyrofaOuch22:44
gsilvaptI messed this up badly. And this is something I can't just uninstall and reinstall22:46
zyga-ubu1tujdstrand: I was thinking about the writable aspect of the mimic, perhaps we should actually bind mount without "ro"22:48
zyga-ubu1tuif the substrate is read only, it doesn't change anything22:48
zyga-ubu1tuif for whatever reason it is not, we should mount as writable22:48
zyga-ubu1tuas for rbind vs bind, if we rbind we must understand what we did or we cannot undo this22:49
zyga-ubu1tuso that feels like "bind now, rbind and be smarter about undo later"22:49
jdstrandzyga-ubu1tu: that works for me (both)22:49
jdstrandjust update the comment on rbind to not be a question and be either a TODO or Note22:50
jdstrandzyga-ubu1tu: if you make non-comment changes, happy to review tomorrow22:51
zyga-ubu1tuyes, I'll make all the changes and iterate, thank you for the insight!22:51
jdstrandthanks for the PR :)22:51
zyga-ubu1tujdstrand: btw, one more thing to think about -- once we do full layouts I only expect to tweak confinement (allow more things) and add blacklists (to prevent known unsafe ops), I hope nothing else has to change (in a major way)22:53
jdstrandthat's going to be the tricky part22:54
zyga-ubu1tujdstrand: I think the trick (ha) is the tmp bind mount22:54
jdstrandmaking sure we don't accidentally allow /etc/shadow into the app's area22:54
gsilvaptkyrofa, regarding the feature, could you tell me some pointers I could look at? While this thing updates and reinstalls stuff, I'm trying to figure out a solution but I confess I am not seeing where the return string is built22:55
jdstrandI'm not sure a blacklist is the way to go, but also don't know what you are thinking about. we can discuss that in the PR22:55
zyga-ubu1tujdstrand: yes, we need deny rules in the profile, deny mounts for /etc and /{run/}media, for special places /{proc,sys,dev}22:55
kyrofagsilvapt, did you run `snapcraft --version`?22:55
zyga-ubu1tujdstrand: ok22:55
gsilvaptyes22:55
kyrofagsilvapt, what was its output?22:58
gsilvaptsnapcraft, version ***23:00
gsilvaptin this case, 2.3523:01
kyrofagsilvapt, and `snapcraft version` prints what?23:01
gsilvapt2.3523:01
mupPR snapd#4260 opened: Stop various JSON field from being sent with null values <Created by robert-ancell> <https://github.com/snapcore/snapd/pull/4260>23:36
mupPR snapd#4257 closed: interfaces/opengl: also allow read on 'revision' in /sys/devices/pci <Created by jdstrand> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4257>23:48
kyrofagsilvapt, so instead of making `snapcraft version` print just the number, make it print "snapcraft, version 2.35"23:49
gsilvaptkyrofa, guide me on this one: How do I compile snapcraft 2.35?23:51
gsilvaptI'm going around in circles here. I've tried branching to 2.35 and then running the requirement install phase but always get this Can't install 'snapcraft'. No files were found to uninstall. error23:52
gsilvaptNote: pip, wheels, setuptools and virtualenv are up-to-date23:53
gsilvaptkyrofa, it seems that running pip install wheel and python setup.py bdist-wheel has solved the issue23:56
gsilvaptOr not. Can't compile Snapcraft: https://pastebin.com/HgjMwDSx23:57

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!