/srv/irclogs.ubuntu.com/2018/09/12/#snappy.txt

kyrofaNickZ, yeah that's a question for jdstrand00:09
mupPR snapcraft#2263 opened: project: catch parent YAML exceptions <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/2263>00:10
NickZjdstrand: any progress on that feature since the last update?00:18
mupPR snapd#5819 opened: tests: fix for nested test suite <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/5819>04:22
mupPR snapcraft#2264 opened: Fix issue where cross compile target is ignored <Created by eberkund> <https://github.com/snapcore/snapcraft/pull/2264>04:40
=== cpaelzer_ is now known as cpaelzer
mborzeckimorning05:06
zygaGood morning06:18
zygaIs github working now?06:18
mvozyga: good morning06:19
mvozyga: it looks like it, I see a lot of green today06:19
zyga:-)06:19
zygaGreat06:19
mupPR snapd#5816 closed: overlord/assertstate: propagate TaskSnapSetup error <Simple> <Created by stolowski> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/5816>06:20
mborzeckizyga: mvo: hey06:23
mvomborzecki: good morning06:24
mupPR snapd#5808 closed: snapd-env-generator: fix when PATH is empty or unset <Critical> <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/5808>06:29
mvopedronis: 5765 may be something you like, it splits bits of the store tests into their own file06:35
mborzecki#5777 triggers one annoying bug in wrappers and map iteration order06:38
mupPR #5777: wrappers/services.go: don't start disabled services <Created by anonymouse64> <https://github.com/snapcore/snapd/pull/5777>06:38
mupPR snapd#5820 opened: wrappers: fix snap services order in tests <Simple> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/5820>06:49
mborzeckisuper simple ^^06:49
mvomborzecki: I'm curious about 5820 - I ran this test with -count 1000 and got no failure. is that a go 1.11 thing?07:05
mborzeckimvo: i was doing some changes on top of 5777 and it failed like this https://paste.ubuntu.com/p/6T3JVzK7fj/07:06
mupPR snapd#5803 closed: ifacestate: fix hang when retrying content providers <Critical> <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/5803>07:06
=== pstolowski|afk is now known as pstolowski
pstolowskimornings07:06
mborzeckimvo: it's a bug nonetheless. info.Apps is a map, so the order of iteration is random-ish07:07
mborzeckipstolowski: hey07:07
mupPR snapd#5804 closed: ifacestate: fix hang when retrying content providers (2.35) <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/5804>07:07
mvomborzecki: yes, I'm just surprised we don't see it more often07:07
mborzeckimvo: wouldn't be surprised if changing some strings or order of operations in the test would be enough to trigger it07:08
mvozyga: whats the status of 179181407:16
mvozyga: do we need a fix for the interfaces issue in 2.35.2?07:16
pedronismvo: hi, I see, I need to finish something I was trying to finish yesterday before doing new reviews07:29
mvopedronis: no problem, this was just a fyi07:29
Chipacamorning all07:40
Chipacawas up stupid late last night, so I might zonk off at some point (but y'all woke up to a lot more green PRs, so that's ok i guess)07:41
zygamvo: re07:47
zygamvo: sorry for the lag07:47
zygamvo: there's a small PR but it's not critical07:47
mvozyga: ok, I release 2.35.2 without that, we can always do a .307:48
zygathat's fie07:48
zygafine07:48
pstolowskipedronis: hey, my plan for solving yesterday's issue is to check the wait-chain (using the helper mvo just landed) and not retry if i see setup-profiles ahead, wdyt?07:49
pedronispstolowski: ?07:50
pedronispstolowski: didn't you say this was setup-profiles of gopkg07:51
pedronisyou shouldn't need to follow the chain to know that07:52
pedronispstolowski: also it should be possible to write a test, right?07:52
pedronispstolowski: also  I remember why we put auto-connect where we put it, because setup-profiles phase2 is a nop anyway in the new world07:59
pedronispstolowski: another approach would be to check if setup-profiles has the phase2 flag and ignore it07:59
pedroniseither way, I hope we don't need to follow the chain08:00
pedronispstolowski: you basically need an installingSnap like for the disconnect check?  then the two are the same again?08:01
pstolowskipedronis: yes, it was setup-profiles of gopkg, but rather than checking if we have setup-profiles for same snap (which would also need to check if it's from same change i think), we would check if setup-profiles is waiting on us.08:01
pstolowskipedronis: but you're right about setup-profiles phase 2 being noop, i forgot that08:02
pstolowskipedronis: yeah, looking at if corePhase2 -> do nothing... seems to be most straightforward to ignore setup-profiles conflict in such case08:04
pstolowskipedronis: and of course test is possible and a must08:05
pedronisthx08:06
pedronispstolowski: the tricky bit is that it needs to be a spread test with an old snapd, or we need to manually construct what an old InstallPath would build08:08
pedronisin terms of tasks08:08
pstolowskipedronis: should be possible to have a spread test for just 16.04 system with snapd from distro, don't we do that already to test upgrades somewhere?08:10
pedronispstolowski: we do but  I don't know which  snapd we want,   desktop images  and cloud images vs archive have different versions08:11
pstolowskiah08:11
pedroniswe sru snapd into 16.0408:11
pstolowskiright08:11
mupPR snapd#5821 opened: release: 2.35.2 <Simple> <Created by mvo5> <https://github.com/snapcore/snapd/pull/5821>08:14
pedronispstolowski: mvo maybe can help navigate that08:16
pstolowskithx08:16
mupPR snapd#5770 closed: many: provide salt for generating instance-key in store requests <Parallel installs> <Created by bboozzoo> <Merged by bboozzoo> <https://github.com/snapcore/snapd/pull/5770>08:24
zygais jdstrand back today?08:27
pedronishe should be08:29
mupPR snapd#5820 closed: wrappers: fix snap services order in tests <Simple> <Created by bboozzoo> <Merged by zyga> <https://github.com/snapcore/snapd/pull/5820>08:48
zygahttps://twitter.com/ismonkeyuser/status/1039392972339523586 ;)09:03
zygamvo: may 2.35.2 live long and prosper09:04
mupPR snapd#5812 closed: snapstate: refactor tests to use SetModel* <Created by mvo5> <Merged by zyga> <https://github.com/snapcore/snapd/pull/5812>09:06
mupPR snapd#5814 closed: daemon: fix snap list --all with parallel snap instances <Parallel installs> <Simple> <Created by bboozzoo> <Merged by zyga> <https://github.com/snapcore/snapd/pull/5814>09:06
zyga pstolowski hey, there's a small conflict here: https://github.com/snapcore/snapd/pull/549709:15
mupPR #5497: overlord/patch: patch for static plug/slot attributes <Created by stolowski> <https://github.com/snapcore/snapd/pull/5497>09:15
pstolowskizyga: thanks! will fix in a bit09:16
zygapstolowski: is this https://github.com/snapcore/snapd/pull/5680 something we ought to review?09:17
mupPR #5680: [RFC] hotplug: handling of simple add/remove scenario <Blocked> <Hotplug> <Created by stolowski> <https://github.com/snapcore/snapd/pull/5680>09:17
zygaI need a 2nd review for https://github.com/snapcore/snapd/pull/580209:18
mupPR #5802: cmd/snap-update-ns: introduce trespassing state tracking <Created by zyga> <https://github.com/snapcore/snapd/pull/5802>09:18
pstolowskizyga: this is RFC brach for high-level comments, i'm chopping smaller pieces from there into separate PRs09:19
zygaah, ok09:19
pstolowskizyga: and it needs updating after existing hotplug PRs land09:20
mborzeckizyga: so the last decision is system/core fix goes to the `snap interfaces` command but the API stays right?09:24
zygamborzecki: please land https://github.com/snapcore/snapd/pull/5713 once jdstrand ack's it09:24
zygamborzecki: yes09:24
mupPR #5713: many: mount namespace mapping for parallel installs of snaps <Parallel installs> <Squash-merge> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/5713>09:24
zygamborzecki: I implemented that here: https://github.com/snapcore/snapd/pull/581809:24
mupPR #5818: cmd/snap: handle "snap interfaces core" better <Created by zyga> <https://github.com/snapcore/snapd/pull/5818>09:24
mborzeckizyga: yeah, i'm looking it now09:24
zygamborzecki: I think we will need one more change09:25
zygamborzecki: once snapd is the holder09:25
zygamborzecki: the mapper needs to keep translating "core" and "system" to "snapd"09:25
zygamborzecki: right?09:25
zygamborzecki: I will make a PR for that09:25
mborzeckizyga: probably, iirc the slots will appear on snapd now (pstolowski added the change?) but i'd expect the api to return 'system' there nonetheless09:29
pstolowskimborzecki: i haven't changed that, i think the initial bits come from zyga09:33
zygamborzecki: the api does return "system" when "snapd" holds implicit slots09:33
pstolowskimvo: hey, yt?09:36
mborzeckizyga: you think you could extort a review from someone and land #5802 ?09:38
mupPR #5802: cmd/snap-update-ns: introduce trespassing state tracking <Created by zyga> <https://github.com/snapcore/snapd/pull/5802>09:38
mupPR snapd#5822 opened: wrappers: allow user mode systemd daemons <Created by jhenstridge> <https://github.com/snapcore/snapd/pull/5822>09:39
mvopstolowski: yes09:41
mvopstolowski: s'up?09:41
pstolowskimvo: hey, i was discussing writing a spread test for yesterday's issue with pedronis (see above ~1h ago); i'd need a spread test for 16.04 running an old snapd binary (the one from desktop image i think)09:43
pstolowskimvo: do you know if we do anything like that already?09:44
pstolowskimvo: i basically need to run from an "old" state into new snapd09:45
mvopstolowski: we have a upgrade test already09:46
mvopstolowski: I have not looked into the details in a long time09:46
mvopstolowski: there is also the option to use the snapd from the released 16.04 version09:46
mvopstolowski: but thats 2.0.2 which is pretty ancient09:47
mvopstolowski: tests/upgrade/basic/task.yaml - let me refresh my memory on this one09:48
mupPR snapd#5823 opened: snapcraft.yaml: add workaround for LP:#1791871 <Created by mvo5> <https://github.com/snapcore/snapd/pull/5823>09:55
pstolowskimvo: looking09:57
zygamborzecki: I'd love to :)10:00
zygamvo: can you have a look at 5802 perhaps?10:01
pstolowskimvo: right. the question is how to enforce a well known old version, not a newer one after SRUs10:02
mvopstolowski: that is hard10:03
mvopstolowski: what is the version we need?10:03
zygamvo: some failures on https://github.com/snapcore/core18/pull/7010:03
mupPR core18#70: hooks: add rfkill <Created by mvo5> <https://github.com/snapcore/core18/pull/70>10:03
zygamvo: https://github.com/systemd/systemd/issues/10068 :)10:04
pstolowskimvo: i need to find out yet; it needs to be a version that creates setup-profiles tasks with core-phase-2=true; Gustavo had it with a fresh install of 16.0410:05
mvook10:06
mvozyga: aha, nice. /me hugs xnox10:06
zygamborzecki: added test to https://github.com/snapcore/snapd/pull/581810:07
mupPR #5818: cmd/snap: handle "snap interfaces core" better <Created by zyga> <https://github.com/snapcore/snapd/pull/5818>10:07
xnoxmvo, hm? =) are people stalking me on github or something?10:07
xnoxi just filed it.10:07
cjwatsonmvo: Hi - does https://bugs.launchpad.net/launchpad-buildd/+bug/1791907 ring any bells with you?10:07
mupBug #1791907: Cannot build base snaps <launchpad-buildd:New> <https://launchpad.net/bugs/1791907>10:07
cjwatsonIt's pretty weird and I don't see how it can be launchpad-buildd's fault, but don't know where to reassign it10:08
pstolowskimvo: looking at debian changelog, it would need to be snapd <= 2.3310:18
mvopstolowski: hm, the best option is probably to download it from https://launchpad.net/ubuntu/+source/snapd/2.32.910:29
mvopstolowski: i.e. "curl https://launchpad.net/ubuntu/+source/snapd/2.32.9/+build/14895451/+files/snapd_2.32.9_amd64.deb ; sudo apt install -y ./snapd_2.32.9_amd64.deb"10:29
pstolowskimvo: nice, is this something we can rely on to stay there for the lifetime of 16.04?10:32
mvopstolowski:10:33
mvopstolowski: yes10:33
pstolowskimvo: great, thank you!10:33
mvopstolowski: yw10:34
zygaxnox: I'm following systemd on github10:38
mupPR snapd#5821 closed: release: 2.35.2 <Simple> <Created by mvo5> <Merged by zyga> <https://github.com/snapcore/snapd/pull/5821>10:40
mupPR snapd#5819 closed: tests: fix for nested test suite <Created by sergiocazzolato> <Merged by zyga> <https://github.com/snapcore/snapd/pull/5819>10:47
zygapstolowski: some comments on https://github.com/snapcore/snapd/pull/580711:12
mupPR #5807: interfaces: extra argument for static attrs in NewConnectedPlug/NewConnectedSlot <Created by stolowski> <https://github.com/snapcore/snapd/pull/5807>11:12
zygayou wanted to land it quickly for conflict avoidance11:12
pstolowskizyga: yes, thank you, yesterday's issue caught all my attention11:15
zygapstolowski: also some small feedback on the racy append fix: https://github.com/snapcore/snapd/pull/581711:15
mupPR #5817: snapstate/tests: serialize all appeneds in fake backend <Created by stolowski> <https://github.com/snapcore/snapd/pull/5817>11:15
zygaSep 12 10:54:56 sep121046-033697 snapd[27140]: helpers.go:174: cannot regenerate seccomp profile for snap "core": signal: terminated11:19
zygahmm11:19
mupPR snapd#5824 opened: [WIP] fetch store assertions together and in the context of interpreting snap-declarations <Created by pedronis> <https://github.com/snapcore/snapd/pull/5824>11:33
jameshzyga: thanks for the initial review of my branch.  If you've got any ideas about how to wrangle a spread test for this kind of thing, I'm all ears.  I haven't had any luck so far.11:40
zygajamesh: I think that's tricky, we'd have to start systemd as a user session manager in tests somehow11:41
zygajamesh: I don't have any ideas, perhaps it's doable, perhaps it's doable but requires extensive work11:41
zygaI fixed formatting and pushed to your branch to unbreak unit tests11:41
mupPR snapd#5799 closed: Install snap-failure binary on Fedora <Created by eyusupov> <Merged by zyga> <https://github.com/snapcore/snapd/pull/5799>11:41
jameshzyga: sorry about that.  I pushed the branch up just before going out for a walk (wanted to get out of the house before it was dark)11:42
zygano need to be sorry :)11:42
jameshIt was nice to see how little I needed to change11:43
=== pstolowski is now known as pstolowski|lunch
jameshand I think some of the changes might be able to go away or be minimised further w.r.t. enable/disable11:43
mupPR snapd#5806 closed: tests: fix install snaps test by adding link to /snap <Created by sergiocazzolato> <Merged by zyga> <https://github.com/snapcore/snapd/pull/5806>11:48
om26erHow to get a snap publisher "verified" ?11:49
zygaom26er: not sure, is there anything about it on the forum?11:49
om26erhttps://forum.snapcraft.io/t/verified-developers/200511:51
popeyWe haven't published details of that internal process om26er11:52
popeyWe're not planning on verifying everyone.11:53
zygajamesh: some tweaks for tests are probably needed to mock presence of a browser11:56
zygahttps://api.travis-ci.org/v3/job/425653825/log.txt11:56
mupPR snapd#5785 closed: tests,interfaces: run interfaces-account-control on UC18 <Created by mvo5> <Merged by zyga> <https://github.com/snapcore/snapd/pull/5785>11:58
om26erpopey: we'd like to verify our company account at least.11:59
zygaoh, I could verify my own company too12:02
zygaoh man, time flies today12:33
kravietzhello, I'm building a Python snap and getting this12:33
kravietzThe linker version '2.23' used by the base 'core' is incompatible with files in this snap:12:33
kravietzAt the priming stage12:33
kravietzAny idea how to debug this?12:33
zygaif you are building natively then your host must match the base snap of the applications in your snap12:34
zygain practice, if you don't say "base: core18" and build on ubuntu 18.04 you will see issues like this12:34
kravietzExactly, I'm using 18.04 as host12:35
zygathe universal remedy is to build in a container/vm but I'll defer to kyrofa or sergiusens for details12:35
zygakravietz: just add "base: core18"12:35
kravietzLet me try12:35
zygathis will make your snap execute against the ubuntu 18.04 runtime12:35
zygaso newer libraries and everything12:35
zygaand compatible linker :)12:35
=== pstolowski|lunch is now known as pstolowski
kravietzzyga: it worked, thanks!12:53
=== mborzeck1 is now known as mborzecki
zygakravietz: that's great, good luck :)12:53
mborzeckipstolowski: some conflicts in https://github.com/snapcore/snapd/pull/581712:58
mupPR #5817: snapstate/tests: serialize all appends in fake backend <Created by stolowski> <https://github.com/snapcore/snapd/pull/5817>12:58
pstolowskimborzecki: thanks, will fix in a moment13:01
zygaChipaca: standup?13:03
zygaijohnson: some responses on your branch13:19
zygathank you for pushing it13:19
sergiusensmvo: remeber when you told me interpreter symlinks would be relative? :-)13:37
sergiusens(snapcraft) ubuntu@snapcraft-xenial-dev:~/source/keepalived$ ls /snap/core18/current/lib64/ld-linux-x86-64.so.2 -l13:38
sergiusenslrwxrwxrwx 1 root root 32 Apr  2 21:07 /snap/core18/current/lib64/ld-linux-x86-64.so.2 -> /lib/x86_64-linux-gnu/ld-2.27.so13:38
mvosergiusens: uh, let me fix this13:53
mvosergiusens: this sounds like a regression from core18 vs core13:53
mvosergiusens: while i have you here - my snapd builds are failing in LP currently with"The source has changed on disk." and "Build failed" in https://launchpadlibrarian.net/387957761/buildlog_snap_ubuntu_xenial_arm64_snapd-2.35_BUILDING.txt.gz13:54
mvosergiusens: I tried to workaround with source-type: git13:54
mvosergiusens: but no luck13:55
mvosergiusens: I'm currently trying to trigger the build using the beta snapcraft (once I manage to convince lp-shell)13:55
mvosergiusens: but that is only good for a one-off build :/13:55
mvosergiusens: any ideas what I can try?13:55
sergiusensmvo: can you try with edge?14:10
sergiusensmvo: this is something kyrofa has been working on, mind waiting an hour until he comes on?14:11
sergiusensmvo: or give me the source where snapcraft.yaml lives on14:11
mvosergiusens: this comes from https://github.com/snapcore/snapd14:12
mvosergiusens: and the build is https://code.launchpad.net/~mvo/+snap/snapd-2.3514:12
ijohnsonzyga: I refreshed the branch again, do you have any recommendations on a concise snap name for the test?14:14
sergiusensmvo: you probably do not need that plugin anymore as you can script most of that in override-build14:15
sergiusensmvo: but this is your issue https://github.com/snapcore/snapd/blob/master/parts/plugins/x_builddeb.py#L2114:15
sergiusensmvo: if you want to continue that hack you will have to do more to not trigger "change detection"14:16
mvosergiusens: hm, I added that because of lp: #177258414:17
mupBug #1772584: Having a "snap" directory with actual content causes build failures <Snapcraft:Triaged> <https://launchpad.net/bugs/1772584>14:17
mvosergiusens: I can play with override-build but last I worked on this having a populated "snap/" dir was a no-go and snapcraft would simply not work. but maybe that has changed? any hints welcome :)14:18
sergiusensmvo: yeah, snap directory is special in snapcraft as things in there trigger special behavior14:18
sergiusensjust like debian/conrol means something14:19
sergiusensmvo: I'll let kyrofa go over that with you to find a good path forward14:20
ppisatiuhm, i thought snapcraft's advanced grammar was transparent, and i could exploit it whenever i expected a string, but i guess i was wrong:14:20
ppisatihttp://paste.ubuntu.com/p/hHvJXvghR5/14:20
ppisatiwhen i try this:14:20
sergiusensdebian/conrol means nothing though as I managed to typo my point14:20
mvosergiusens: ok, I understand that the naming of the dir is unfortunate - but at the same time, refactoring our code to call it notsnap would be unfortunate as well14:20
ppisatihttp://paste.ubuntu.com/p/cpcnxm9Ttt/14:20
mvosergiusens: heh, no worries, I got your point14:20
zygaijohnson: test-snapd-... not sure :)14:20
* zyga gets dinner 14:20
sergiusensmvo: you could always do your packaging out of tree, that might be cleaner14:21
ppisatisergiusens: any idea? ^14:21
mvosergiusens: a separate repo you mean? one nice benefit from the current approach is that we get a new LP build every time our repo changes, not sure if that would be possible with an extra repo?14:22
ppisatikyrofa: ^14:22
sergiusensppisati: that grammar thing needs to be enabled for that key, it is not for everything14:22
sergiusensmvo: LP has tracking for that for "source" entries in parts14:22
sergiusensbuild.snapcraft.io does at least, which means LP does too, just need to figure out where14:23
sergiusensif it is not automatic14:23
ppisatisergiusens: uhm, ok, so i need to patch the kernel plugin to accept it - any example of plugin / key that was patched to accept it? so i can read it and learn what i have to do?14:23
mvosergiusens: ok14:23
mvosergiusens: I like that the snapcraft.yaml is git right now, but maybe I just need to get used to the idea to move it out14:24
cjwatsondebian/control is a bad example anyway, since it's perfectly permissible and quite common practice to drop extra packaging-related helper files into debian/14:27
* mvo nods14:29
cjwatsonsergiusens: no, LP has no such tracking.  BSI handles this itself by having a poller script that parses snapcraft.yaml and looks for other parts to poll14:30
sergiusenscjwatson: it is, our problem is that we gave meaning to so many paths... and what you say is true as long as you do not squat ones that do have meaning14:30
mvothis is unfortunate for us because it blocks the snapd 2.35.2 snap release so having some agreement on the way forward would be good14:30
sergiusenscjwatson: thanks for confirming that14:30
mupPR # closed: snapd#5170, snapd#5234, snapd#5271, snapd#5346, snapd#5395, snapd#5451, snapd#5469, snapd#5497, snapd#5583, snapd#5596, snapd#5623, snapd#5644, snapd#5672, snapd#5680, snapd#5696, snapd#5712, snapd#5713, snapd#5714, snapd#5717, snapd#5724, snapd#5727, snapd#5739, snapd#5758,14:30
mupsnapd#5759, snapd#5762, snapd#5765, snapd#5768, snapd#5771, snapd#5777, snapd#5782, snapd#5789, snapd#5791, snapd#5792, snapd#5802, snapd#5805, snapd#5807, snapd#5809, snapd#5811, snapd#5813, snapd#5817, snapd#5818, snapd#5822, snapd#5823, snapd#582414:30
cjwatsonperhaps you should define something under snap/ that snapcraft won't touch14:30
cjwatsonfor instance, I often put things under debian/local/14:30
sergiusenscjwatson: in the case of mvo, it is an entire source tree14:31
cjwatsonlast I checked directories could contain directories :)14:31
mupPR # opened: snapd#5170, snapd#5234, snapd#5271, snapd#5346, snapd#5395, snapd#5451, snapd#5469, snapd#5497, snapd#5583, snapd#5596, snapd#5623, snapd#5644, snapd#5672, snapd#5680, snapd#5696, snapd#5712, snapd#5713, snapd#5714, snapd#5717, snapd#5724, snapd#5727, snapd#5739, snapd#5758,14:31
mupsnapd#5759, snapd#5762, snapd#5765, snapd#5768, snapd#5771, snapd#5777, snapd#5782, snapd#5789, snapd#5791, snapd#5792, snapd#5802, snapd#5805, snapd#5807, snapd#5809, snapd#5811, snapd#5813, snapd#5817, snapd#5818, snapd#5822, snapd#5823, snapd#582414:31
sergiusenscjwatson: yeah, but in go, that would change the import path14:31
cjwatsonthat sort of approach would allow people to keep things that are essentially part of snap-specific packaging somewhere under snap/, which would be tidy, while not interfering14:31
mvosergiusens: could we have logic like if os.path.exists(".snap"): ignore("snap") or something?14:31
cjwatsonsurely you could set GOPATH14:31
mvosergiusens: or snap/.i-own-this-really or something?14:32
sergiusensmvo: so kyrofa is the person to talk to as he is taking care of this thing14:32
mvosergiusens: ok, sorry, I thought it would need your architectural blessing  or something. if not thats fine I will talk to him14:33
sergiusenscjwatson: snap dir lives next to another source dir they have that does "import <>/snap"14:33
mvosergiusens: thanks for your help in any case!14:33
sergiusensmvo: no, it does not need my architectural blessing14:33
cjwatsonah, that's a bit different from the sort of thing I was thinking of14:34
cjwatsonI do generally think that a subdir reserved for use by the packaging as opposed to snapcraft would be helpful14:35
sergiusenscjwatson: yes, this is a ver special snowflake case where they got around it by monkey patching our code base through an external plugin :-)14:35
sergiusenscjwatson: the snap/local seems like a very good idea we could move forward on that14:35
sergiusenskyrofa: ^14:36
mvokyrofa: so once you are around I would love to talk to you about 1772584 (after having pestered sergiusens way too long about it)14:36
cjwatson(It's true that name collisions in debian/ are possible, but in practice I've never run into them because they're basically always hidden behind debhelper compatibility level changes, at least if they're something that it's remotely plausible people might collide with by accident)14:37
cjwatson(and the debhelper maintainer tends to do test rebuilds to spot problems with major changes AIUI)14:38
cjwatsonsnapcraft has nothing like http://manpages.ubuntu.com/manpages/cosmic/en/man7/debhelper.7.html#compatibility%20levels AIUI ...14:39
sergiusensno, our plan was to introduce that with build environments but that item got killed off high above14:40
sergiusenscjwatson: speaking of testing, I switched some test jobs to use the snap and it seems they still use the deb (https://launchpad.net/~sergiusens/+snap/multipass-test). Are there any obvious mistakes here?14:41
cjwatsonbuild environments would be kind of orthogonal I thought - this kind of thing in packaging toolchains is more about the semantics of the packaging14:41
cjwatsonsergiusens: there's a bug where you have to request the builds using the API - the UI currently disregards auto_build_channels14:42
sergiusensbuild environment is not the vm thing14:42
sergiusenswe were redesigning the yaml to be versioned, so you subscribe to certain semantics14:42
cjwatsoncombination of https://bugs.launchpad.net/launchpad/+bug/1791265, https://bugs.launchpad.net/launchpad/+bug/1791269, and https://bugs.launchpad.net/launchpad/+bug/179127214:42
mupBug #1791265: Manual snap builds don't allow for snapcraft/snapd channel selection <Launchpad itself:New> <https://launchpad.net/bugs/1791265>14:43
mupBug #1791269: Options for automatic builds could be defaults for all builds in a snap <Launchpad itself:New> <https://launchpad.net/bugs/1791269>14:43
mupBug #1791272: Manual snap builds could use a target channel override <Launchpad itself:New> <https://launchpad.net/bugs/1791272>14:43
cjwatsonah, OK, well if it ever comes up again maybe you can get a less confusing name while you're there :)14:43
sergiusenswe are planning on bring that versioning piece back, but next cycle14:43
cjwatsonin the meantime, you should be able to use https://launchpad.net/+apidoc/devel.html#snap-requestBuilds14:44
sergiusensthanks for the bug pointers14:44
cjwatsonexplicitly passing the desired channels14:44
cjwatsonor https://launchpad.net/+apidoc/devel.html#snap-requestAutoBuilds should work too14:44
sergiusensthanks14:45
cjwatsonI'll try to get at least the worst of those bugs fixed soon - they are absolutely confusing14:47
sergiusenscjwatson: btw, someone proposed snap/x- as an ignore pattern14:47
cjwatsonsame idea but x- seems cumbersome compared to a subdirectory.  I think you use x- in situations where you don't have other kinds of structure available14:50
cjwatsonbut it's your project :)14:50
sergiusenscjwatson: I wanted your opinion actually :-) and it is good14:51
cjwatsonI don't think exact choice of name is super-important, but structure is nice14:52
ijohnsonzyga: what about test-snapd-svcs-disable-install-hook as the name?14:54
zygaYeah that sounds good14:55
ijohnsoncool14:56
kyrofappisati, I'm afraid it's not just generically used for all strings, whatever is responsible for processing it needs to actually call a function to make it happen15:02
ppisatikyrofa: do you happen to remember what's the name of this function?15:05
kyrofappisati, yeah let me show you, one sec15:06
kyrofappisati, this may not be quite as simple as you were hoping, but here's how it works today: https://github.com/snapcore/snapcraft/blob/master/snapcraft/internal/project_loader/_parts_config.py#L21915:08
kyrofaThere are two processors, one for global/root properties, one for part properties15:08
ppisatikyrofa: /me scratches his head15:11
kyrofamvo, I'm looking at what you've got now, see if we can get you unblocked short-term and come up with something better long-term15:11
ppisatikyrofa: ok, let me play around with it, let's see if i can bend my mind around it15:12
kyrofappisati, let me know if you have any questions15:13
kyrofamvo, your monkey patch still works, have you tried building on edge? bug #1791871 is fixed there15:31
mupBug #1791871: 2.43 breaks when you run "snapcraft pull" first <Snapcraft:Fix Committed by kyrofa> <https://launchpad.net/bugs/1791871>15:31
kyrofaMight be able to patch around the bug too... let's see15:32
mvokyrofa: thanks, I have not tried in lp with edge yet15:33
* cachio lunch15:34
kyrofamvo, try this, no edge required: https://paste.ubuntu.com/p/DXhkWMJbpD/15:35
kyrofaObviously a hack, essentially disables change detection15:35
mvokyrofa: cool, will do in a tiny bit (in a meeting right now). thanks a lot15:36
mvokyrofa: getting us unblocked for now is great, we can talk in brussels about a longer term solution15:36
pstolowskiniemeyer: you said in the standup you had some new feedback for one of my PRs, but i haven't received anything; have you saved/submitted?15:43
niemeyerpstolowski: No, I've just been looking at a camera and microphone for that many hours15:44
pstolowskiniemeyer: ah, sure, understood; didn't mean to push you, just got worried for it get lost15:53
niemeyerpstolowski: Oh, no worries.. I was indeed hoping to get more reviews finished, but didn't manage to15:54
mupPR snapcraft#2259 closed: cli: show trace if no tty <Created by kyrofa> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2259>16:21
threshhmm,  using qt 5.11 it seems statx syscall is now being used16:23
threshwhich is caught with apparmor it seems and results in "[28964.168141] audit: type=1326 audit(1536769071.191:214): auid=1000 uid=1000 gid=1000 ses=3 pid=4815 comm="vlc-qt-check" exe="/snap/vlc/x4/usr/libexec/vlc/vlc-qt-check" sig=0 arch=c000003e syscall=332 compat=0 ip=0x7f12e1428839 code=0x50000"16:23
threshno denials though16:25
mupPR snapcraft#2255 closed: catkin plugin: use SnapcraftException <Created by kyrofa> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2255>16:27
threshhow would I go about whitelisting that syscall for my snap?16:39
threshlooks like popey already hit that with Neon repos as well, in https://forum.snapcraft.io/t/unknown-syscall-when-running-an-18-04-built-snap/7094/816:41
sergiusensthresh: best to get either jdstrand or zyga on that thread16:45
=== pstolowski is now known as pstolowski|afk
sergiusensmvo, kyrofa: now that the urgency on that is gone, we should checkpoint on this in Brussels16:45
kyrofaAgreed16:46
threshthanks sergiusens!16:47
zygathresh: I’ll read that now16:49
zygaThat is interesting16:50
zygaI think statx should be allowed by default16:50
zygajdstrand: ^ if you agree I can prepare the PR16:50
zygaI’ll prepare the PR and we can discuss it there16:52
jdstrandzyga: how do we know that 332 corresponds to statx?16:52
zyga I dont know yet, if this is not statx then my suggestion is moot16:54
zygaI’m walking to my desk now16:54
om26erif snapd becomes a snap, how will you install it in the first place ?16:58
om26erI just found there is a snapd snap available as well.16:59
zygare17:01
zygaom26er: that's a great question :)17:01
zygaom26er: it will be installed with a imaging tool17:01
zygaon classic systems deb/rpm package will be used to install snapd which can then install snapd snap17:01
Chipacapopey: on the laptop that becomes unusable on resume, do you have SNAPD_DEBUG enabled?17:02
Chipacapopey: is it actually unusable, or is it hogging the network?17:02
om26erzyga: so once my deb based snapd installs the snap based snapd, will I then be able to remove the deb based snapd ? (That would be a tongue twister if spoken)17:03
zygajdstrand: scmp_sys_resolver claims that it is statx17:03
zygaom26er: I suspect so but we are not planning on removing the deb17:05
zygaom26er: though maybe eventually that will be supported17:05
zygaom26er: snapd as a snap is required in the multi-base world we are going towards17:05
zygaom26er: where core16, core18 and future core20 will be co-installed to support diverse apps on a single system17:06
om26ercool stuff!17:06
zygaom26er: indeed :)17:07
cjwatsonom26er: Note that snapd already re-execs snapd inside the core snap, and has done for some time; moving that bit to a dedicated snapd snap is a refactoring, AIUI17:09
Chipacacjwatson: re-exec is a distro choice, though17:10
Chipaca(ubuntu does)17:10
cjwatsonTrue17:10
jdstrandzyga: interesting. are you on cosmic?17:10
om26ercjwatson: I guess making that a separate snap will make updating snapd on a UbuntuCore system quicker17:10
zygajdstrand: indeed17:10
zygaom26er: yes, it will no longer require a reboot17:13
ahayzenjdstrand, thresh, BTW i think that this is related to Qt apps not running with core18 https://bugs.launchpad.net/ubuntu/+source/qtbase-opensource-src/+bug/1774739  and this https://github.com/snapcore/core18/issues/417:19
mupBug #1774739: Running Qt apps inside a 18.04 container crashes <qtbase-opensource-src (Ubuntu):New> <https://launchpad.net/bugs/1774739>17:19
mvosergiusens: I added it to https://forum.snapcraft.io/t/developer-sprint-sep-17th-2018/733617:36
mupPR snapd#5825 opened: tests: add snap install hook with base: core18 <Created by mvo5> <https://github.com/snapcore/snapd/pull/5825>17:38
jdstrandahayzen: yes, for sure. zyga, if you are doing a PR, can you reference that bug ^17:39
zygathanks, will do17:40
jocwhat's the simplest method to check in a shell script if a device has a serial assertion? would `snap known serial` exit with an error code if there wasnt one?17:41
ahayzenzyga, thanks ! do you know if a fix would also help out docker containers ? Or would it be specific to snapd ?17:43
zygaahayzen: I'm not sure I understand17:43
zygaunless those containers are inside snapd17:43
zygathe change will allow all snap applications to use the new system call17:43
jdstrandahayzen: it is possible that docker is missing the statx syscall17:44
ahayzenone bug was about running Qt applications under a straight docker container (no snapd), one was about running Qt apps with core18 snap17:44
jdstrandahayzen: I don't know how to adjust docker's policy to allow extra syscalls, but that is certainly possible17:44
ahayzenapparently it works on debian sid, so i wondered if it was a general missing syscall for $container related things17:45
threshahayzen, for docker, you need 18.04 docker engine and libseccomp 2.3.3 on a host17:45
threshthat works17:45
thresh18.04 or later that is17:45
ahayzenthresh, ah! So 17.12.1-0ubuntu1 from the archive is "too old" :-) ... i should use the snap ;-)17:45
jdstrand18.04 only has 2.3.1 of libseccomp17:45
jdstrandwhich is why it shows up as unknown17:45
ahayzenyeah i'm using 17.12.1-0ubuntu1 docker + 2.3.1-2.1ubuntu4 libseccomp17:46
jdstrandzyga: note that golang seccomp might need to be adjusted to find statx17:47
threshmaybe upstream docker wont use the systems libseccomp17:48
zygayeah, I suspect this will be a bit annoying to release17:48
mupPR snapcraft#2265 opened: build providers: allow snapcraft channel selection <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/2265>17:48
jdstrandzyga: or rather, to resolve it. you might want to create a test case for this to make sure it is covered everywhere17:48
zygafor sure17:48
ahayzenyeah so debian testing has 2.3.3 seccomp and a newer docker.io, so makes sense it works. Thanks for the info!17:49
Chipacaok, EOD for me. Tomorrow: tests.18:46
* cachio afk19:05
kyrofajdstrand, I suddenly had a few PRs fail the review tools tests that pull from edge, did something odd happen?19:16
kyrofaThere didn't seem to be an actual error, just an exit 1. I'm re-running one now19:19
kyrofa(I just got a pass locally)19:20
kyrofaWonder if it has something to do with trusty, I'll try it out on there19:25
kyrofaOh nevermind, this runs in a bionic lxd19:25
jdstrandkyrofa: I'm neverminding20:34
kyrofajdstrand, found the issue. Running a bionic lxd: cannot perform operation: mount --rbind /lib/modules /tmp/snap.rootfs_cJIipS//lib/modules: No such file or directory20:45
kyrofastable core, edge review tools20:46
kyrofaWorks fine on bionic (without lxd)20:46
kyrofaI'm able to reproduce simply by running review tools in a bionic lxd container on a bionic host20:53
kyrofajdstrand, we'll need to skip those tests for now20:53
jdstrandkyrofa: that is something outside of the review-tools. they run as non-root and don't do anything like that21:01
kyrofajdstrand, https://forum.snapcraft.io/t/snaps-are-broken-in-bionic-lxd-container/733921:01
kyrofaIndeed, all snaps are broken in lxd bionic21:01
kyrofaWhich makes me want to scream "why don't we have tests for this yet?" again after the last LXD fiasco21:02
NickZwell that's no good21:02
jdstrandI thought they were added. maybe only for core 16 since core18 wasn't a thing?21:02
kyrofacore16 is fine, and things still seem to work in xenial containers. But not bionic (still core, not core18)21:03
NickZi was just about to start looking into deploying the snaps in an lxd container, too :P21:04
sergiusensjdstrand: this is lxd launch ubuntu:bionic and installing and running snaps in there21:06
jdstrandkyrofa, sergiusens: https://github.com/snapcore/snapd/blob/master/cmd/snap-confine/mount-support.c#L64521:09
jdstrandkyrofa, sergiusens: it sounds like the container doesn't ship /lib/modules?21:09
kyrofaNickZ, worth the investigation, but leave yourself options. It seems not many people do that21:09
jdstrandkyrofa: if so, what happens if you 'mkdir /lib/modules' in the container?21:10
kyrofajdstrand, it works21:10
kyrofaI'll add that to the forum21:10
jdstrandkyrofa: maybe changing the aforementioned line to '{"/lib/modules",.is_optional = true},' would be a viable fix21:11
kyrofajdstrand, perhaps so. Not sure what side effects that might have21:14
kyrofaHopefully the snapd folks see that tomorrow21:14
mupPR snapcraft#2266 opened: integration tests: disable tests using bionic container <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/2266>21:15
kyrofasergiusens, ^ there you go21:15
NickZkyrofa: yeah, but we kind of have to if we want to test juju deployment on a local server21:18
kyrofaNickZ, this took roughly a year to fix: https://forum.snapcraft.io/t/lxc-snaps-dont-update/78621:23
NickZhaha welp21:24
NickZits not a huge issue, we can test deployment on xenial21:24
kyrofaYeah I can't wholeheartedly recommend it until the spread suite includes relevant releases of lxd21:25
mupPR snapcraft#2128 closed: project_loader: stop setting LD_LIBRARY_PATH <Created by kyrofa> <Closed by kyrofa> <https://github.com/snapcore/snapcraft/pull/2128>21:39
mupPR snapcraft#2267 opened: build providers: refresh packages on bring up <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/2267>21:45
mupPR snapcraft#2250 closed: project_loader: add preflight check <Created by kyrofa> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2250>21:54
mupPR snapcraft#2265 closed: build providers: allow snapcraft channel selection <Created by sergiusens> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2265>22:03
mupPR snapcraft#2263 closed: project: catch parent YAML exceptions <Created by kyrofa> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2263>22:12
mupPR snapcraft#2268 opened: sanity checks: allow snap/local dir <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/2268>22:15
mupPR snapcraft#2269 opened: Provider decides on the image <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/2269>23:36

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!