/srv/irclogs.ubuntu.com/2018/02/02/#snappy.txt

mupPR snapcraft#1907 closed: tests: setup the correct environment for adt <bug> <Created by sergiusens> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1907>00:56
kyrofacprov, any chance you're around?01:13
cprovkyrofa: hey, how can I help ?01:17
kyrofaSomething interesting has come up and I'd like your advice. You're familiar with the format of the snapcraft credentials file?01:19
kyrofaTurns out there are two ways to utilize export-login, one anticipated, and one not01:19
cprovkyrofa: not by heart, go on01:20
kyrofaOne way is to encrypt the credentials file, save the decryption key in CI, and use it to decrypt the file, then use the file to log in01:20
kyrofa(it's an ini file basically)01:20
kyrofaThat ^ is the anticipated usage01:20
cprovRight01:20
kyrofaHowever, some folks here are building tooling that actually saves the individual macaroons out of the credentials file, putting THOSE into the CI environment, and then reconstructing the file itself in order to login01:21
kyrofaThis works of course, but is quite fragile. What if we change the login URL, or any part of that file format01:21
kyrofaSo I'm trying to think of a way to make it more... token-ish01:22
mupPR snapcraft#1908 opened: tests: update tests to work in adt <bug> <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/1908>01:23
kyrofaBut it's weird because we have a root macaroon and a discharge01:24
kyrofa(or however that works)01:24
kyrofaI dunno, I guess I just wanted your thoughts01:24
kyrofaIt would be cool if people could just paste the entire creds into an environment variable instead of needing to encrypt a file01:25
cprovkyrofa: we can serialize/discharge it  and have the authorization token01:26
kyrofaSo is the discharged one the only one we need?01:27
cprovBut i am not sure it is that easier to use01:27
kyrofacprov, here's another use-case for something like that: https://pastebin.ubuntu.com/26503341/01:29
elopiosnappy-m-o autopkgtest 1908 xenial:armhf xenial:arm6401:29
kyrofaI'm writing a Travis deployer01:29
snappy-m-oComputer says nooo. See logs for details:01:29
snappy-m-o Command '['/tmp/tmpb03l5uir/retry_autopkgtest.sh', '1908', 'xenial:armhf', 'xenial:arm64']' returned non-zero exit status 101:29
kyrofacprov, that's an example of AWS, note how they handle the access keys01:29
cprovkyrofa: i guess we snacraft can consume the a env var with the final secret01:34
kyrofacprov, what would that final secret be, though? The unbound_discharge that we have in the config file now?01:35
kyrofacprov, sorry, still pretty dense on macaroons :D01:36
cprovkyrofa: no, we have to bind it01:36
elopiosnappy-m-o autopkgtest 1908 xenial:armhf01:37
snappy-m-oComputer says nooo. See logs for details:01:37
snappy-m-o Command '['/tmp/tmp1bapez85/retry_autopkgtest.sh', '1908', 'xenial:armhf']' returned non-zero exit status 101:37
cprovIt is called serialize_for_request(), iirc01:37
kyrofadeserialize_macaroon, maybe?01:38
cprovLet me find it, one sec01:38
kyrofaAh, no: root_macaroon.prepare_for_request01:38
cprovkyrofa: yup, https://github.com/cprov/surl/blob/master/surl.py#L13001:39
kyrofaOkay so if I save that `bound` value then, that's all I need?01:40
kyrofaDoes that have the same expiration time as the macaroon?01:40
cprovkyrofa: not only the bound discharge, you also need the root to build an 'Authorization' header the store can validate01:41
cprovkyrofa: 'Macaroon root={}, discharge={}', then we can probably hex encode the text and pass it in as a ready to use secret01:42
kyrofacprov, ah, okay gotcha01:45
kyrofacprov, I think that's a good idea. And `login --with -` will read from stdin01:46
kyrofacprov, thank you for letting me borrow your brain :)01:47
cprovkyrofa: good idea about allowing stdin for pipe-ing evn vars01:48
cprovenv, even01:48
kyrofaYeah that already works01:49
cprovkyrofa: the b64 encoded auth is about 4k, a bit too long to be a secret. That's the only problem I can see.01:54
mupPR snapcraft#1909 opened: Add dotnet command to path and enable developer scenario for  snap  <Created by rakeshsinghranchi> <https://github.com/snapcore/snapcraft/pull/1909>03:06
mupPR snapcraft#1910 opened: tests: expect in-snap unsquashfs when using docker <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/1910>04:09
mupPR snapd#4591 opened: interfaces/desktop-legacy,unity7: support gtk2/gvfs gtk_show_uri() <Created by jdstrand> <https://github.com/snapcore/snapd/pull/4591>04:13
mupPR snapd#4592 opened: interfaces/desktop-legacy,unity7: support gtk2/gvfs gtk_show_uri() for 2.31 <Created by jdstrand> <https://github.com/snapcore/snapd/pull/4592>04:17
mupPR snapcraft#1911 opened: Add support enable configurable runtime version for .NET Core applications <Created by rakeshsinghranchi> <https://github.com/snapcore/snapcraft/pull/1911>04:36
zygao/05:58
* zyga preps breakfast for kids05:58
mborzeckimorning06:12
zygahey06:16
mborzeckizyga: o/06:17
mborzeckizyga: on the same note as this https://forum.snapcraft.io/t/spotify-cannot-create-tmpfs-target/3805/7 do we create /var/lib/snapd/lib/gl automatically?06:18
zygamborzecki: no, we need to do that06:40
zygaI think we create one of those06:40
zygabut not all perhaps06:40
zygaand this needs to be rc3 IMO06:40
zygaI'm going to take a shower, let's discuss soon06:40
zygalook at snap-confine's tree that handles that06:40
mborzeckiok06:40
zygalet's add the mkdir's there06:41
mborzeckizyga: we should cover lib/gl, lib/gl32 and lib/vulkan then06:43
zygaall of the variants enumerated from the regular expressions in the apparmor profile06:47
zygawell06:47
zygaI assume there are variables for that06:47
zygaand that on any given system there's a fixed amount06:48
mborzeckiright06:57
mborzeckizyga: will you be looking into this?06:57
zygamborzecki: mmm, maybe, depends on timing07:00
zygaI need to discuss with mvo first07:00
zygamvo: good morning07:29
zygamvo: I have great news and bad news07:29
zygamvo: pick :)07:29
mvohey zyga07:29
mvozyga: bad first07:29
zygamvo: we need to add some code that creates new directories in /var/lib/snapd/lib/{gl,vulkan,...}07:29
zygamvo: people are running into this if they use rc2 and have nvidia and reexec07:30
mvozyga: *nod*07:30
zygamvo: it's small but a little annoying that we found out this late07:30
zygamvo: ikey can help I'm sure, with his array of hardware07:30
zygamvo: the good news is that if we wait for monday (jdstrand is off today) we can get fully functional layouts tooo07:31
zygathough that is more complex than we initially discussed because of confinement07:31
zygain any case, it will be ready today and it's an option07:32
zyga(maybe "layouts beta"07:32
zygaanyway, that's the news, how are you feeling today?07:32
mvozyga: hm, we want to be in candidate by monday07:32
mvoso thats a tough one07:32
zygaso let's fix the bad news and play safe07:33
zygawe can be in edge with layouts07:33
mvoyeah07:33
zygaI'd love 2.31 but I agree that this is an added risk07:33
zygamvo: perhaps we should disable layouts for 2.3107:33
mvohe will also not be able to review before .eu evening, right?07:33
zyga(entirely with some early return)07:33
zygaI think he will, he is just traveling today07:33
zygahe was super exited about what we did last night07:33
zygamaybe over weekend, we'll see07:34
zygawe just realized we need per-snap snap-update-ns profiles07:34
zygabecause otherwise snap-confine becomes unconfined07:34
zygawe discussed the details already and implementation is straightforward07:34
zygamy plan today is to get layous ready in master, do the per-snap snap-update-ns profiles done, write spread tests and merge that07:35
zygaif you want I can help with missing directories07:35
mvozyga: help> would be great, just catching up with mails and stuff07:41
zygasame here :)07:41
zygahey spineau07:58
spineaumorning zyga07:59
kalikianagood morning everyone08:07
pstolowskimornings!08:08
zygahey pstolowski08:09
zygasorry I didn't finish that review yesterday, I wasn't feeling good and ended up being unproductive for first half of the day08:10
zygapstolowski: I read the code and it was OK so far, I wanted to see if there's anything missing by checking the non-diff parts and stopped there08:10
pstolowskizyga, 4551?08:11
zygayes08:11
pstolowskizyga, ok, thanks for looking at it. Gustavo had objections against not reusing "conns" in the state for that, but perhaps I explained my reasoning purely in the standup (and he didn't look at the code yet afaict)08:13
pstolowskizyga, feeling better today?08:15
zygayes08:16
zygamy back is okay, not sure why it hurt so much yesterday08:16
zygait's not like broken bones that hurt when weather changes08:17
zygathank you :)08:17
pstolowskiglad to hear!08:17
ikeygrats on skype08:18
mupPR snapd#4593 opened: advisor: ensure commands.db has mode 0644 and add test <Created by mvo5> <https://github.com/snapcore/snapd/pull/4593>08:19
zygahey ikey08:30
zyga:)08:30
zygasnaps are starting to get popular :)08:30
zygaikey: any issues on solus, I cannot wait to get skype off from classic confinement08:30
ikeyzyga, not tried the one in the store yet08:38
ikeygot back home late yesterday08:38
mupPR snapd#4594 opened: systemd, wrappers: start all snap services in one systemctl call <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4594>08:38
mborzecki^^ more thinking than coding :/08:39
mborzeckizyga: about those lib/gl[32], lib/vulkan directories, shall i look into it?08:39
* ikey perks up ears at mention of the one domain he looks at08:40
mborzeckimvo: pstolowski: ikey: morning guys08:40
ikeymorning08:40
pstolowskio/08:40
ikeymborzecki, might i query whats changing in gl/vulkan land?08:42
mborzeckiikey: https://forum.snapcraft.io/t/spotify-cannot-create-tmpfs-target/380508:42
mvohey mborzecki08:42
ikeyis there some missing stuff on the hostside?08:42
ikeyi.e missing host dir08:43
mborzeckiikey: yup08:43
ikeyso packaging fixes, gotcha08:43
ikeythought the dirs were changing :D08:43
mvomborzecki: thanks for the PR08:43
ikeytechnically the vulkan stuff would be my fault, sorry guys08:43
mborzeckimvo: i'll try to check it with that guy's snaps, but i'm missing some of the stuff he added in his snapd fork (btw. it'd be great if he opened an PR :P)08:44
zygamborzecki: mmm, yeah go for it please, I'm working on new profile generation08:50
zygathank you for taking care of that08:51
mupPR snapd#4595 opened: snap: improve validation of snap layouts <Created by zyga> <https://github.com/snapcore/snapd/pull/4595>08:59
zygamvo: this one is for 2.31, it will ensure 2.32 won't reject snaps accepted by 2.31 (layouts)08:59
Chipacamoin09:10
mvohey Chipaca ! good morning09:12
mborzeckiChipaca: morning09:15
pstolowskiChipaca, o/09:16
zygahey Chipaca09:16
mborzeckihm no luck with syncloud's platform snap either https://paste.ubuntu.com/26504652/09:16
zygamborzecki: you could try with layouts soon :)09:19
zyga*today*09:20
zygayou can remap /opt/disk to $SNAP_DATA/opt/disk09:20
zyga(or to snap common)09:20
zygamborzecki: try with my branch from last night09:20
mborzeckifyi https://www.reddit.com/r/linux/comments/7ukrbq/microsoft_releases_skype_as_a_snap_for_linux/09:23
kalikianayay for skype snap ^_^09:24
mborzeckibtw there was a post on slashdot too09:26
mborzeckidon't know if anyone visits the site still, but here it is https://linux.slashdot.org/story/18/02/01/1644250/microsoft-releases-skype-as-a-snap-for-linux09:26
mborzeckithe year of linux desktop is upon us :P09:27
pstolowski:)09:27
* zyga reads slashdot09:31
zygamborzecki: haha, yes09:31
mborzeckinow that we've had at 's' with releases we'll probably never get to see photoshop as snap, and i can't really think of any interesting application that starts with 't'09:31
zygamborzecki: total commander ;-)09:33
zygamborzecki: we'll wrap around and 'a' will come with adobe busyware09:33
mborzeckitotal commander - the 'ever' shareware09:33
Chipacamborzecki: thunderbird :-p09:34
mborzeckizyga: i'd swap adobe for autodesk, see their A* suite running on linux09:34
zygamborzecki: yeah, I remember using *commander style programs since forever essentially09:35
zygawhen I was 9 and we got a 386 at home09:35
mborzeckihaha, remember 'dos navigator'?09:36
* zyga googles09:36
zygamaybe not by name09:36
zygaI didn't speak english back then09:36
zygaso things were "magic"09:36
zygaso the name doesn't ring any bells but 1st screenshot I see is "yep, used that"09:36
pstolowskimborzecki, mvo thanks for you comments to 4584, i've implemented your suggestions (and the aspects we discussed yesterday during standup)09:43
mvopstolowski: nice, thank you09:46
mborzeckihmm so a friend of mine tried installing skype on 17.10: https://paste.ubuntu.com/26504804/09:50
mvomborzecki: server side overload? we see a lot of failures in spread as well09:51
mborzeckihe got: 2018/02/02 10:39:47.590935 backend.go:152: cannot create host snap-confine apparmor configuration: cannot replace snap-confine apparmor profile: AppArmor parser error for /etc/apparmor.d/snap.core.3887.usr.lib.snapd.snap-confine in /etc/apparmor.d/snap.core.3887.usr.lib.snapd.snap-confine at line 11: Could not open '/var/lib/snapd/apparmor/snap-confine09:52
zygais /var/lib/snapd/apparmor/snap-confine a directory?09:54
zygait should be09:54
mvoogra_: quick question about the gadget defaults for core> you say this worked for 2.30? are you sure? then I will check the diff between the 2.30->2.31, so far I have not found a smoking gun (but adding a test case right now :)09:54
ogra_mvo, not 100% ... i have definitely checked it a week or two ago and there it was behaving09:55
ogra_i'm not 100% sure about the exact version though09:55
mvoogra_: how much work is it for you to run this again with stable (2.30)? if trivial it would be nice to double check09:56
ogra_i currently have the system completely messed up (trying out grub-uboot atm) ... it would take a bit09:57
zygahmm, tests are sad today09:59
pedronisChipaca: snapshots it's big,  usually indeed we would split overlord, daemon/client and cmd/snap bits in different PRs10:15
Chipacapedronis: yep, thus the commits10:16
Chipacapedronis: having 4-5 RFC PRs didn't seem to me to be something that'd progress10:16
ChipacaI'm not expecting a deep nitpicky review of this, just a "yeah that's what it should look like" / "WTF are you on can i have some" thing10:17
zygaChipaca: can I have some10:18
zygait must be good :)10:18
Chipacazyga: diclofenac + pridinol (but not too often)10:19
mvoogra_: re 1746714> there seems to be  typo there, in your gadget it should read "rsyslog:\n  disable: true" - your gadget has disable*d*10:19
ogra_oh man10:19
* Chipaca ~> physio10:20
zygaogra_: no validation?10:23
ogra_zyga, obviously not10:23
mvozyga: config schemas is on the roadmap for some time10:23
mvofor core we could (nowdays) probably "emulate" them10:24
* mvo thinks a bit10:24
ogra_well10:24
* zyga feels like having a hangover, needs more water10:25
ogra_even an error when it is attempted to be set would already help here10:25
zyga(weather is terrible lately)10:25
kalikianazyga: you realize you just said you want to have a hangover? ;-)10:26
mborzeckizyga: should't the vulkan code be outside of nvidia specific pieces?10:26
zygakalikiana: oh yes10:30
zygait came out wront10:30
zygawrong10:30
zygasee!10:30
zygaI feel like I have a hangover, not like I would like to have one10:31
kalikiana:-D10:31
zygamborzecki: not sure, good question10:31
* kalikiana coffee break, back in a bit10:31
zygamborzecki: I think not10:31
zygamborzecki: it's not about nvidia but about external drivers10:32
pstolowskioh the tests are very unhappy today, indeed10:35
mvoogra_: I wrote a testcase and I think once the typo is fixed this will work10:46
pedronismvo: I don't know if we can error, but we could at least  log a warning if we see core configs that we don't know about10:48
mvoniemeyer: quick question - we just had this issue that an invalid core config option was used, for core itself we could validate if its a supported option, do you think that is worth persuing? probably not hard, we just need to expose something like config.Transaction.ChangesKeys() or something10:48
mvopedronis: yeah, that was what I was thinking10:49
mvopedronis: also it kind of buged me a bit that we do not test setting core options right now in spread, unfortunately because core has no snap-id its not easy to test (I hacked a bit and with https://paste.ubuntu.com/26505078/ it works)10:50
pedronisbecause of nesting is not super obvious what it means though10:50
pedronismvo: I wonder if we should have a special key for   that could be used there  and would work also for non store core10:50
pedronismvo:  like $core or something10:50
mvopedronis: oh, nice10:51
mvopedronis: I like that idea10:51
pedronisit also would solve the issue that core doesn't have the same id in prod and staging (not super important but it's an issue for testing)10:51
pedronisanyway just an idea10:52
mvopedronis: I can prepare the pastebin as a proper PR with $core10:53
pedronisthe other option would be to invent a general syntax to use name instead of id, it's a bit a pity if we go there because then it would have been saner to have a special syntax for ids instead10:54
pedroniswe will have the same issues with the connect functionality10:54
pedronisbtw10:54
pedronismvo: anyway $core is also interesting because is a bit unclear what should happen when we split core  vs base or have core-16 etc10:56
mvopedronis: excellent point11:00
mvopedronis: could we use heuristics? i.e. is the snap-id longer than the allowed snap names?11:01
pedronisI don't remember what are the rules11:01
pedronisids are fixed lentgh11:01
pedronisI think11:01
pedroniswe don't have a size limit in snapd for names11:02
mvopedronis: yeah, that is what I remember too, might be worth looking at. anyway, I make this $core thing and will ask about validation in the standup, nested values will be a bit nasty but iirc we don't use those for the core config11:02
pedronisbut I think there is one in the store11:02
mvopedronis: yeah, thats what I remember, I had to shorten some test snaps11:02
mvobecause the store was unhappy :)11:03
pedronisI can check that11:03
pedronis(in a bit)11:03
mvopedronis: no rush. it looks like snap-id is 32char, I think snap names can be larger so a heuristic may not be easily possible11:05
* mvo is slightly sad about this11:05
pedronisanyway using ids was quite intentional I think, just a bit annoying11:06
pedronisbut core is a bit special because reasons11:06
pedronisanyway something to discuss with Gustavo11:06
* mvo nods11:07
pedronismvo: snap name max length is 4011:10
pedronis(in the store)11:10
mvopedronis: ta11:12
zygamvo: does this fail on your machine?11:43
zyga----------------------------------------------------------------------11:43
zygaFAIL: cmd_userd_test.go:62: userdSuite.TestUserd11:43
zygacmd_userd_test.go:84:11:43
zyga    c.Assert(err, IsNil)11:43
zyga... value *errors.errorString = &errors.errorString{s:"cannot obtain bus name 'io.snapcraft.Launcher'"} ("cannot obtain bus name 'io.snapcraft.Launcher'")11:43
mupPR snapd#4596 opened: osutil: allow using many globs in EnsureDirState <Created by zyga> <https://github.com/snapcore/snapd/pull/4596>11:45
zygaChipaca: ^ perhaps for you, it's pretty short and I need it badly11:57
* Chipaca looks12:00
ikeyso, question12:01
ikeyare the /etc/apparmor.d files meant to include /var/lib/snapd/apparmor/profiles ?12:01
ikeybecause it seems those guys will only be loaded when i start snapd12:01
ikeybut if i snap run something, those profiles don't exist yet12:02
ikeyi.e. AVC apparmor="DENIED" operation="change_onexec" info="label not found"12:02
zygaikey: I think that the thing that loads profiles on boot looks at /var/lib/snapd/apparmor/profiles12:06
ikeyyeah thats kinda the thing here12:06
zygaikey: we reload them in snapd if needed but it should happen during boot to let services start without starting snapd12:06
ikey"the thing" is slow as ass12:06
ikeyand massively regresses boot time12:07
zygaikey: that's orthogonal, I'm explaining how it functions, not why it is slow12:07
ikeyand the only "solution" is private to the debuntu packaging world12:07
zygaoh?12:07
zygawhat solution is that?12:07
ikeyyour package hooks for apparmor12:07
zygamaybe I'm missing the point somewhere12:07
ikeyand the boot load service12:07
ikeythe /var/lib/apparmor/profiles path isnt referenced in the /etc/apparmor.d/* files12:07
ikeyso they won't be compiled in with a boot time service12:07
ikeyuntil snapd is started and does the reload you mentioned12:08
ikeybut with socket activation, snapd.service itself wont be started12:08
zygait should be referenced by the arcane /etc/init.d/apparmor script12:08
ikeyand a snap run of some snap will fail12:08
ikeyi use systemd. :)12:08
zyga/etc/apparmor.d is more like a /usr/lib/apparmor.d12:08
zygayes, we too12:08
ikey/etc/init.d is a banned path in solus12:08
ikeyso i know we dont have it12:08
zygait's a shell script and runs with sysv compat generator AFAIK12:08
ikeyso are nasty shell scripts during boot12:08
ikeylol12:08
zygaand that's what makes it slow for you perhaps12:09
zygaso12:09
ikeyim adding a workaround12:09
zygaI think you want to write a small tool (that would go upstream)12:09
zygathat 1) loads and 2) caches profiles12:09
ikeyby including the private apparmor profiles directory into our aot portion12:09
ikeyya ive done that12:09
zygaloading cached profile is very fast12:09
ikeyway ahead of ya12:09
zygacool,12:09
zygabut please share that with jdstrand and upstream,12:09
ikeyhttps://github.com/solus-project/aa-lsm-hook12:09
zygathat script has some reason for not being a systemd job sadly12:09
zygaand it's probably some messy complexity12:09
zygamaybe it's just legacy complexity that can die12:09
zygabut maybe there's some genuine thing to care about and you'd just run into it all over again12:10
ikeyworking out the kinks with this in solus atm12:10
zygajdstrand is off today (traveling) but next week we can sync on that12:10
ikeyso we have a -compile and a -load binary12:10
ikey-compile is called during package operations12:10
ikeyand -load at boot12:10
ikeywhich if it fails to load, will recompile12:10
ikeyto handle kernel abi changes and such12:10
ikeywhich takes my whopping 1.3s regression to to 32ms12:10
ikeyin my VM over half the boot time /was/ spent in apparmor.service ^^12:11
ikeybut now im doing the AoT/cache approach and making sure it doesn't bust snapd :P12:12
zygayeah, it also doesn't help that that is a shell script and it wasn't a one liner12:12
zygalook at how it gets invalidated12:12
zygaone of the things that the old code cared for was apparmor base things gettingchanged12:12
zygaso all the #include files12:12
zygathis sucks IMO12:12
ikeyright12:12
zygaand it could be nice to even ship _precompiled_ profiles and build-depend on the include files12:12
ikeyso this is why our AoT is called by usysconf during package changes12:12
zygabut that's not how it's done in ubuntu12:12
ikeyonly if /etc/apparmor.d changes12:12
zygayes12:13
ikeyand then the boot uses the cache12:13
zygaand really /etc/apparmod.d is a messy zoo that should live in /usr/lib12:13
ikeyyeah12:13
zygaand not in /etc for the vast majority of content12:13
zygait's just in dire need of a gardener12:13
ikey/usr being shipped, /etc being local vendor/etc12:13
zygayeah, exactly12:13
* zyga wrote https://disqus.com/home/discussion/omgubuntu/it_just_got_a_lot_easier_to_install_skype_on_ubuntu/#comment-373865004112:13
ikeypeople still raging about getting the stuff they want? ..12:14
zygayeah, but I think that unless we put accurate comments and explanations people will run off with the wildest conspiracy theory they can come up with12:14
ikeyyeah true12:15
zygasnaps are from SATAN or whatever12:15
ikey             8ms aa-lsm-hook.service12:15
ikeythats more like it12:15
zygawooot12:15
zygathank you12:15
zygaI actually think that's something we could adopt in base1812:15
zygamvo: ^^12:15
zygawe want empty /ec12:15
ikeyhttps://hastebin.com/mukeneheha.coffeescript12:15
zyga_empty_ /etc12:15
ikeyall loaded properly12:16
zygaoh12:16
zygaminecraft!!!12:16
ikeyso for now we load /from/ etc path, *but*12:16
* zyga snap installs it12:16
ikeywe support optional paths12:16
zygaman snaps are really a double-edged sword12:16
ikeyi mean my eventual thinking is we'd merge the hook into apparmor userspace after discussion12:16
ikeyzyga, productivity12:16
zygahow do you stay focused when you can install cool software and use it :)12:16
ikeyxD12:16
zygayes, that sounds good to me12:16
zygasoooooo... I have a new computer now12:17
ikeywe have some path magic here: https://github.com/solus-project/aa-lsm-hook/blob/master/src/lib/hook.c#L2412:17
ikeyoh?12:17
zygafeeling very tempted to open it ^_^12:17
ikeyit was popeys snap not sure how far he got with it12:17
zygaoh neat, proper compiled language12:17
* zyga hugs ikey for being this cool dude that writes in C12:18
ikey:D12:18
ikeywe had to for the boot time regressions12:18
ikeywe just did the same with solus-hardware-config12:19
zygaand in other news, I now have per-snap apparmor profiles for snap-update-ns if a given snap uses layouts12:19
ikeyoh very nice12:19
zygaso ... layouts not only work but are safe and won't weaken snap-conifne12:19
zygaman, I'm so exited about that one :)12:19
zygaI'll break for some more tea and convert my hand-made layout snap to a spread test12:19
ikey:D12:21
zygabtw will layouts benefit solus in any immediate way?12:22
ikeyidk but i mean we can probably invent some use cases12:22
ikeytotally up for that12:22
zygalayous, let you put, for instance $SNAP_DATA/stuff in /var/lib/whatever12:22
ikeyyeah12:22
zygaor $SNAP/usr/share/foo in /usr/shre/foo12:22
ikeyseems good in terms of bolt-ons12:23
ikeyor hell even themes12:23
ikeyif they were content layouts12:23
zygammm,12:23
zygaso themes are a separate topic but they already benefit from this12:23
ikeyoh ok12:23
zygabecause as a prereuquisite we can now *spool* content interface12:23
zygaso you can create $SNAP/plugin and connect any number of things there12:23
zygaand they will show up as $SNAP/plugin/{foo,bar,froz}12:24
zyga(even deconflict on name clash to foo, foo_212:24
zygaand the same idea is that we can now stick a theme snap up12:24
zygaand connect it via a theme interface (or just one of the desktop interfaces)12:24
zygaand use the right content tags to ship various variants and connect the right one12:24
zyga(so you get all themes but the right ABIs)12:25
zygaand one fat theme snap can cover common themes12:25
zygaand other theme snaps can complement that freely12:25
zygaall of that is possible, just not used yet12:25
zygaand the ubuntu desktop team is looking at adopting it now12:25
zygathe single fat theme snap is just a 1st step before snapd knows which theme you use and which ABI it needs for a particular snap and pulls that from the store automatically12:26
zygaI'm so so so looking forward to that12:26
zygaas it will unbreak theming in a major way12:26
ikeytrue12:26
ikeyi think folks will be a lot happier when they land12:26
zygabut first12:27
zygacoffee12:27
zygaI can slow down and plan what's needed for layouts to land on monday12:28
ikeyyeah i gotta run to town and get a new shirt for myself12:29
zygaoh? wedding?12:30
mborzeckizyga: what kind of rig do you have now?12:30
zygamborzecki: I have this x250 laptop12:30
ikeyzyga, nah just heading out to a mates place for pizza + beer12:30
pstolowskimvo, 4579 looks great to me; and what's the plan re seccomp features?12:30
zygaand I'm selling my hand-built PC wit amd x4 845 cpu12:30
zygawith two r9's 280x12:30
zygaikey: man, I miss pizza12:31
* zyga had breakfast12:31
ikey:D12:31
mborzecki 13:17 <zyga>soooooo... I have a new computer now   <--- i mean this :)12:31
zygahahaha12:31
zygathat's still in a box :) maybe it's a bag of bricks12:31
* Chipaca -> lunch12:32
Chipacazyga: maybe it's a mini pdp812:32
jdstrandzyga: I have 30 seconds before leaving for a plane, but I woke up thinking *maybe* it isn't so bad if snap-update-ns has wide write access. the idea is, snapd writes the fstab entries, snap-confine can't write them or modify/load apparmor policy, snap-confine calls snap-update-ns, snap-update-ns can't write fstab files or modify/load apparmor policy (ie, use explicit deny rules)12:55
zygajdstrand: hey12:55
jdstrandzyga: but I would need to study the existing profile to convince myself this is ok12:56
zygajdstrand: I wrote the per-snap policy now12:56
jdstrandheh12:56
zygajdstrand: it will be ready for review over weekend12:56
zygajdstrand: :)12:56
zygajdstrand: it's super sweet, I did the optimization we talked about12:56
jdstrandyou're too fast. I mean, I didn't even sleep that long!12:56
zygajdstrand: so that we have fewer profiles and it's less of an impact for non-layout snaps12:56
zygajdstrand: haha :)12:56
zygajdstrand: I'm super keen to see this fly :)12:56
jdstrandok12:56
jdstrandwell, I gotta run12:57
jdstrandhave a nice day!12:57
* jdstrand -> travel12:57
zygasafe travels!12:57
jdstrandthanks :)12:57
mupPR snapd#4597 opened: snapstate: allow core config via $core <Created by mvo5> <https://github.com/snapcore/snapd/pull/4597>13:11
mupPR snapd#4598 opened: packaging: create /var/lib/snapd/lib/{gl,gl32,vulkan} as part of packaging <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4598>13:19
mvomborzecki: \o/13:20
* kalikiana heading out for lunch, back in a bit13:33
pstolowskiniemeyer, can you take a look at #4584?14:03
mupPR #4584: hooks/osutil: limit the number of data read from the hooks to avoid oom <Created by stolowski> <https://github.com/snapcore/snapd/pull/4584>14:03
niemeyerpstolowski: Reading14:04
mupPR snapd#4594 closed: systemd, wrappers: start all snap services in one systemctl call <Created by bboozzoo> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4594>14:06
mupPR snapd#4591 closed: interfaces/desktop-legacy,unity7: support gtk2/gvfs gtk_show_uri() <Created by jdstrand> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4591>14:07
mupPR snapd#4580 closed: tests: ensure disabled services are masked <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4580>14:13
zygamvo: https://github.com/snapcore/snapd/pull/4595 needs review for 2.3114:14
mupPR #4595: snap: improve validation of snap layouts <Created by zyga> <https://github.com/snapcore/snapd/pull/4595>14:14
mupPR snapd#4599 opened: many: send  new Snap-CDN header with none or with cloud instance placement info as needed <Created by pedronis> <https://github.com/snapcore/snapd/pull/4599>14:14
mvozyga: looking14:14
* pstolowski lunch14:20
zygasmall break to handle kids14:29
kalikianare14:35
zygathank you14:37
mupPR snapd#4595 closed: snap: improve validation of snap layouts <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4595>14:37
zygawe'll probably do some tweaks but this should be very much like what we want to have in edge week14:37
niemeyerpstolowski: ALright,14:45
niemeyerpstolowski: I sent a review.. which actually suggests a slightly different route that does not involve killing the process14:46
niemeyerpstolowski: I'm sorry for the late suggestion, but it seems worth it.. have a look at the rationale there and let me know what you think please14:46
zygawow14:55
zygahttp://lkml.iu.edu/hypermail/linux/kernel/1802.0/00454.html14:55
zygasearch for "snap"14:55
cachio__mvo, hey14:58
cachio__mvo, I see a bug in arm64 for the test prepare-image-uboot14:59
cachio__mvo, after snap prepare-image ....14:59
cachio__it downloads all the snapd14:59
cachio__snaps14:59
cachio__but kernel.img is not in $IMAGE/boot/uboot/pi2-kernel_*.snap14:59
cachio__initrd.img it is there15:00
cachio__not sure if there is any log where I could get more info15:00
cachio__nothing in journalctl and dmesg15:00
pstolowskiniemeyer, thank you. yes I agree killing completely innocent hooks that happen to produce too much output is valid concern. I'll redo this15:17
* zyga breaks for some time to unpack15:25
mupPR snapd#4600 opened: configstate: validate known core.* options <Created by mvo5> <https://github.com/snapcore/snapd/pull/4600>15:29
mvo4593 needs a second review15:32
mvo(should be pretty trivial)15:32
mupPR snapd#4592 closed: interfaces/desktop-legacy,unity7: support gtk2/gvfs gtk_show_uri() for 2.31 <Created by jdstrand> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4592>15:33
ogra_cjwatson, do you happen to have any clue about grub-uboot ? (i have it working fine, chainloaded from a vendor u-boot and am at the grub prompt, but i cant find out how to actually access a disk (hd0/hd1 apparently do not work)15:33
cachio__mvo, review done on 459315:34
cjwatsonogra_: I know that it exists but not a whole lot more.  You might be able to tab-complete disks if you start with a (15:35
cjwatsonogra_: sounds like you either have a wrong prefix or haven't built in the necessary modules to get at /boot/grub15:36
ogra_yeah, i cant see mmc or sdhc modules in the grub-core/ dir of my build15:36
ogra_i'd expect something like that to be there15:37
ogra_(the fun part is that i just loaded core.img from the MMC with u-boot ... so it is initialized and all)15:40
* cachio__ launch15:41
* cachio__ lunch15:41
ogra_launching lunch :)15:41
cachio__ogra_, :)15:43
mupPR snapcraft#1912 opened: lxd: unset SNAP to work-around LXD deb thinking it's a snap <Created by kalikiana> <https://github.com/snapcore/snapcraft/pull/1912>15:47
kalikianakyrofa: have a look at this one, please. This is a work-around for the broken container builds with LXD v2.2115:48
mborzeckiEOW for me, enjoy the weekend guys15:50
mborzeckithere's FOSDEM this weekend, be sure to watch the live streams15:50
niemeyerpstolowski: Thank you, and again sorry for figuring this a bit too late..15:55
mupPR snapd#4593 closed: advisor: ensure commands.db has mode 0644 and add test <Created by mvo5> <Merged by stolowski> <https://github.com/snapcore/snapd/pull/4593>15:56
pstolowskiniemeyer, no worries. i've visited a few dark corners by doing this, was a nice learning excercise anyway15:58
cjwatsonogra_: it *looks* like grub-core/disk/uboot/ubootdisk.c is supposed to be built into the GRUB kernel and deal with disks enumerated by u-boot init16:24
cjwatsonogra_: did tab-completion after ( say anything?16:24
ogra_cjwatson, yeah, but it seems to need a devicetree, i suspect thats what i'm doing wrong here16:24
ogra_nope16:25
cjwatsonah, at this point I know nothing16:25
mvocachio__: what is the revno of the pi2-kernel snap that is downloaded? I wonder why this test is only failing on arm6416:51
mvocachio__: thanks for the review, I have a look16:51
cachio__mvo, rev 4916:55
cachio__mvo, I did unsquash and everything seems to be good16:55
cachio__mvo, }kernel.img is there16:55
cachio__-rw-------  1 sergio sergio 5722584 ene  7 10:07 kernel.img16:55
mvocachio__: so if you manually download and unsquash it is good but it fails on the arm64 test? or am I misunderstanding?16:56
Chipacapstolowski: I have this round robin thing here if you're interested btw16:56
pstolowskiChipaca, ?16:58
cachio__mvo, in a debug session I did > su -c "SNAPPY_USE_STAGING_STORE=$SNAPPY_USE_STAGING_STORE snap prepare-image --channel edge --extra-snaps snapweb $ROOT/model.assertion $ROOT" test16:58
* kalikiana going to wrap up shortly16:58
Chipacapstolowski: suddenly remembered you were working on making the limit writer a round robin thing?16:58
cachio__and then I unsquash the downloaded kernel snap16:58
Chipacapstolowski: and that i had one16:58
Chipacapstolowski: https://gist.github.com/chipaca/d292f8f29110d5ab72bc675ca1c5d0e6 fwiw16:59
mvocachio__: so in the debug session you could not reproduce the failure, is that what you say?16:59
cachio__mvo, yes17:00
mvocachio__: :(17:00
mvocachio__: thats mysterious17:00
cachio__mvo, https://paste.ubuntu.com/26506616/17:00
cachio__mvo, that's what I see after run the snap prepare-image command17:00
mvocachio__: hm, kernel.img is a symlink - I wonder if that is the problem17:03
mvocachio__: still - why only on arm64 :(17:03
mvocachio__: btw, do you have more test fixes that we should merge into 2.31?17:04
pstolowskiChipaca, ah, that! thaank you. i haven't yet go deep into the details of what Gustavo suggested in the review comment (currently adressing some other PR's comments), but thanks, it be good for inspiration17:04
cachio__mvo, no, just this is remaining17:04
mvocachio__: great to hear17:04
cachio__the othe fixes were in the test tools that I have for the boards17:05
pstolowski/ grr my wireless keyboard is eating characters17:05
Chipacapstolowski: np! there are a couple of tweaks I'd do if it was something or production use, fwiw, but otherwise it worked17:05
Chipacas/or/for/17:05
cachio__mvo, this is the snap content https://paste.ubuntu.com/26506641/17:05
pstolowskiChipaca, ack17:06
* kalikiana going off into the weekend17:12
mvocachio__: of what rev number? I see kernel.img as a symlink in r4917:12
cachio__mvo, the kernel snap is rev 4917:15
cachio__mvo, pi2-kernel_49.snap17:15
pstolowskieow o/17:18
smoserhi.17:26
smoseri walk through https://developer.ubuntu.com/core/get-started/kvm17:26
smoserand i get http://paste.ubuntu.com/26506699/17:26
smoseris that known? i basically can't get through the consoleconf17:26
mvocachio__: strange, when I unsquash -ls I see kernel.img as a symlink and in your output it is a real file17:27
smoserso i think the issue above occurs if i attach a 'nocloud' config disk.17:49
smoserprobably because cloud-init enables itself and writes network config, that throws fits for console-conf.17:49
Chipacasmoser: in what part of that walk does it say "attach a 'nocloud' config disk"?17:54
smoserChipaca: you're right, it does not.18:00
Chipacaphew18:01
Chipacamvo: I'm EOWing, which means you should've EOWed already18:02
Chipacamvo: have a great weekend (starting now)18:02
Chipaca:-)18:03
* Chipaca waves18:03
cachio__mvo, could we add a new pr for rc3?18:04
cachio__mvo: #460118:12
mupPR #4601: tests: update kill-timeout focused on making tests pass on boards <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/4601>18:12
mvocachio__: sure18:12
cachio__mvo, it is really small18:12
mupPR snapd#4601 opened: tests: update kill-timeout focused on making tests pass on boards <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/4601>18:13
mvocachio__: ta18:13
=== jkridner|pd is now known as jkridner
cachio__mvo, just the prepate-image-uboot test missing18:14
cachio__mvo, still chasing the problem18:15
mvocachio__: yeah, a mystery, sorry that I am not useful right now in solving this puzzle :(18:16
mvocachio__: I gtg, but I will read scrollback!18:16
cachio__mvo, np, I0ll try to see which is the problem18:18
cachio__enjoy your weekend18:18
* zyga-ubuntu moved his files onto the new machine19:13
kyrofazyga-ubuntu, hey, you got a sec?19:14
zyga-ubuntuyes19:14
zyga-ubuntuwhat's up?19:14
kyrofazyga-ubuntu, take a look at this: https://pastebin.ubuntu.com/26508980/19:15
kyrofazyga-ubuntu, note that the hook is present, and is executable19:15
zyga-ubuntucannot find19:15
zyga-ubuntuhmm19:15
zyga-ubuntucan you nsenter into the namespace19:15
zyga-ubuntuand see if it's really there?19:15
kyrofazyga-ubuntu, it's not my machine I'm afraid, but I'll pass that on. Note that this snap actually works fine on my machine, same version of core/snapd19:16
zyga-ubuntuis that iside a container?19:18
kyrofazyga-ubuntu, Tyriar is the one having this issue, would you mind repeating what you said above?19:19
zyga-ubuntukyrofa: I don't know what that may be caused by, if it says it cannot find it then it's probably not mounted19:19
zyga-ubuntuthe hook runs inside the namespace19:19
zyga-ubuntuso it's probably just not there (probably the mount event didn't propagate inside)19:20
kyrofazyga-ubuntu, indeed, this is actually parallels19:20
kyrofaRight Tyriar?19:21
TyriarYeah parallels19:21
zyga-ubuntuTyriar: interesting19:21
Tyriarthere are other issues with parallels I've noticed (cannot launch the snap from inside the snap)19:21
zyga-ubuntuTyriar: what does "snap version" say?19:21
zyga-ubuntuTyriar: thats normal, it's not allowed19:22
zyga-ubuntuparallels as in that virtualization software, right?19:22
TyriarIt works normally though?19:22
zyga-ubuntuno, it shouldn't19:22
zyga-ubuntuthough19:22
zyga-ubuntuI wonder what parallels does19:22
TyriarBy running inside the snap, I mean a pty is launched from the snap which launches another window19:22
TyriarParallels is mac only VM software yeah19:22
Tyriarsnap version: snap    2.30 snapd   2.30 series  16 ubuntu  16.04 kernel  4.4.0-104-generic19:23
zyga-ubuntuTyriar: can you give me the output of "cat /proc/self/mountinfo" (tip: use pastebinit)19:23
zyga-ubuntuTyriar: in any case, can you please drop a topic on the forum, give some information about how to reproduce the problem19:24
zyga-ubuntuI can try (no promises though)19:24
Tyriarhttps://pastebin.com/iFEKBUyq19:24
zyga-ubuntuthis looks normal19:25
zyga-ubuntuwhich snap failed?19:25
zyga-ubuntuah, my-snap19:25
zyga-ubuntuactually19:25
zyga-ubuntumaybe it's a bug :)19:25
zyga-ubuntuTyriar: can you please switch core to the beta channel19:25
zyga-ubuntuthere's a new release of snapd there19:26
zyga-ubuntucan you see if that also has the same issue19:26
Tyriarwhat do I run to switch the channel again?19:26
kyrofazyga-ubuntu, I used my-snap in the pastebin, but it's actually the one at the very bottom of Tyriar's paste19:26
zyga-ubuntucode-insiders?19:26
kyrofaIndeed19:27
zyga-ubuntuso it's correctly shared:96OC19:27
kyrofazyga-ubuntu, note also that the one that failed probably won't be there as it's the post-refresh hooks that's dying, thus rolling it back19:27
zyga-ubuntuit should be mounted inside the snap mount namespace19:27
zyga-ubuntukyrofa: ah, noted19:27
kyrofaThe ones you see there have no hooks19:27
zyga-ubuntuTyriar: so when it failed, you were refreshing a snap?19:27
zyga-ubuntuwere you refreshing from a store revision to a local revision?19:27
kyrofazyga-ubuntu, just installing --dangerous over the top.19:28
TyriarI was installing a local snap with --dangerous, over a store revision yes19:28
kyrofaAh, wonder if that has something to do with it19:28
kyrofaI didn't try that19:28
Tyriarkyrofa, it's a private snap on the store which I think you have access to19:30
zyga-ubuntukyrofa, Tyriar: this is something for pstolowski on monday19:31
zyga-ubuntuit may be a bug where we think a hook exists19:31
zyga-ubuntubut it doesn't in the right revision19:31
zyga-ubuntubut that's just a theory, no idea what's wrong for real19:31
kyrofazyga-ubuntu, that sounds accurate given the symptoms19:32
Tyriarthe store revision definitely doesn't have a post-refresh hook, if that matters19:32
kyrofazyga-ubuntu, I'll try to install from the store and see if I can reproduce19:32
zyga-ubuntuyeah, looks like a bug there19:35
* zyga-ubuntu looks at ubuntu in high-dpi and is amazed19:36
noise][FYI, having some API slowness + elevated error rates on snap store19:37
noise][investigating19:37
kyrofanoise][, I was just about to ping you, thank you :)19:38
noise][updated the status page but there seems to be a rendering delay there or something19:38
mupPR snapcraft#1913 opened: Use pyelftools to parse ELF files rather than using readelf <Created by jhenstridge> <https://github.com/snapcore/snapcraft/pull/1913>20:00
marosghi, is something wong with snapcraft.io? snap info takes 40 seconds and snap refresh times out20:07
marosgs/wong/wrong/20:07
Odd_Blokemarosg: There is an issue with the snap store ATM; the team are working to address it.20:09
kyrofanoise][, I can't refresh anything either, but status.snapcraft.io shows green for everything except search20:14
noise][site24x7 status page won't reflect my outage notif :(20:14
noise][anyway, working the problem20:14
mupPR snapd#4602 opened: tests: use root path to /home/test/tmp to avoid lack of space issue <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/4602>21:38
cachio__mvo, please could you add the PR #4602 to the rc3 too? tx22:17
mupPR #4602: tests: use root path to /home/test/tmp to avoid lack of space issue <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/4602>22:17
zygaare you guys still working on the release?22:17
cachio__zyga, I just left the comment for mvo22:17
cachio__I am almost done today22:18
cachio__zyga, you should be too :)22:18
zygayeah, though I'm not working anymore, just exploring my book collection22:18
kyrofajdstrand, you around by any chance?23:22

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!