/srv/irclogs.ubuntu.com/2018/08/30/#snappy.txt

vivusHello all.02:02
vivusAre snaps basically LXC containers running different applications?02:03
xnoxvivus, and so much more. some of the underlying security and confinment technology is similar, but that's only the basic building blocks. Cause there is a lot of mediation and support around installing/updating/upgrading snaps, allowing/disallowing snaps to do things on the host OS, and to/with other snaps to connect to each other. and the core systems, ship everything as the snap including bootloaders and kernel.03:46
xnoxvivus, and that's definately so much more than just "containers" and "applications"03:47
vivusxnox: so how do I make my snap-installed IDE see my development environment such that I get code auto-complete, etc. ?03:47
xnoxvivus, usually i would expect it to connect with a home plug to access user's home.03:49
xnoxvivus, are you creating the IDE snap? or are you just using some IDE snap created by somebody else?03:49
vivusxnox: so I still need to install lots of dependencies on the main system then?03:49
xnoxno, none.03:49
xnoxwell depends what you build.03:49
vivusits mostly hypothetical at this stage. Im seeing if I should switch from LXC to snaps03:50
xnoxvivus, play around with examples to understand what snaps are. they are more like android/iphone apps then chroots/containers/vms.03:50
xnoxsince the snap app itself is read-only typically, but can have data in strict ways on the host system.03:51
xnoxso e.g. there is golang provided as a snap, which gives one compiler.03:51
vivusxnox: by lots of dependencies I mean dev-environment deps. For example, let's say I install PyCharm. Now I want to use PyCharm with autocomplete for my Python environments. Where do I install the Python environment stuff?03:51
xnoxtypically in a pyenv in like ~/code03:52
vivusis the pyenv a snap also?03:52
xnoxno03:52
vivusso that's on the host?03:52
xnoxyeah... cause you'd need it read-write, don't you?03:52
vivusthat seems like going a bit backwards for me then. all my dev stuff are isolated in LXC containers, because of the bloat they create on the host.03:53
vivuscan i attach and modify a snap container?03:53
xnoxright but pycharm itself could be a snap. and all of its dependencies would be inside the snap and do not leak on the host at all.03:54
xnoxand you can have multiple things co-installed which use same deps, but different versions, without any conflicts on the host.03:54
vivusyeah but say I want to install a python package that has lots of system dependencies, like Pillow, then my host would still accumulate system-deps just for Pillow03:54
xnoxthis is generic development stuff. you would not be installing those as snaps typically, no. you would use some form of confinement.03:55
xnoxbut you would not need to install it on the host into /usr03:55
xnoxvivus, and e.g. Pillow -> i'd be installing that in a virtual env, in project directory in a reproducible way. https://docs.python.org/3/tutorial/venv.html03:56
xnoxcause with python, one typically creates a virtual-env which contains this project dependencies only, and develops / runs / tests code there.03:57
vivusxnox: yeah, but Pillow and some other Py packages will sometimes need system-deps to compile03:57
xnoxtrue03:57
vivusnow say you have to do this for Python, and then maybe Node too. Creates lots of bloat03:58
vivusThe other day I had to install mono and I used isolation to specifically avoid the bloat03:58
xnoxmaybe you want to look at snapcraft03:58
vivus*on the host03:59
xnoxthat's tooling to build snaps, with isolation, which has a lot of tooling to use lxd containers to build all the layers/dependenices of your app, including your app, and bundle everything as a snap.03:59
vivusPerhaps I can create the snaps myself. but they are immutable right? I cannot `sudo lxc-attach -n snapcontainer` right?03:59
xnoxbut that's mostly for "from scratch build & deploy" scenario. not meant for interactive coding/iterations.04:00
xnoxvivus, snap filesystem structure, is a bind-mounted squashfs -> so no, attaching into its mountspace will not gain you much.04:00
xnoxand paths and prefixes may look odd to you04:00
xnoxvivus, what's your actual problem and why did you start looking at snaps? =)04:01
xnoxvivus, are lxd containers not working out for you? (i find $ lxc launch ubuntu:cosmic etc so much nicer than old lxc-* commands)04:02
xnoxvivus, have you used lxd already?04:02
vivusxnox: ill reply in 5. just afk04:08
vivusxnox: the distro I use doesn't have first-class support for LXD, but I've been using LXC for a few years now, so that's not the pain-point. I was hoping I'd get to use some type of containerized desktop IDEs that can help me do code auto-complete, etc.04:14
vivusright now what I use is Vim04:15
vivusand I kind of prefer mouse interaction at times04:15
Doctor_Nickif anyone could help me out with this in this post, i would greatly appreciate it, I need to kick this out the door soon: https://forum.snapcraft.io/t/getting-a-part-build-artifact-into-another-parts-build-before-pull/708204:19
mborzeckimorning05:04
zygao/05:40
zygagood morning05:40
mvohey zyga05:44
zygahey, how are you doing?05:44
mvozyga: doing well, thank you05:48
mvozyga: how are you?05:48
mborzeckizyga: mvo: hey05:52
mvomborzecki: hey hey05:58
mborzeckizyga: pushed the changes to https://github.com/snapcore/snapd/pull/571306:22
zygalooking06:23
zygathere is a conflict with your other patch in master now06:24
mborzeckizyga: i'm really bad at naming things, feel free to suggest something different than ExpandSnapMountVariables()06:24
zygaExpandSnapVariables(perspectiveHost,perspectiveSnap) # maybe?06:24
zygathat is maybe a flag rather than a new function06:24
zygabecause then anyone using it must face the fact that perspective matters06:25
zygabut I didn't read all so just quick reaction06:25
mborzeckiidk, i'm open for alternatives06:25
zygalet's use the word perspective for that across the tree06:26
zygathough not sure if it is sufficient:06:26
zygathere's the outside perspective (host perspective?)06:27
zygathere is the inside perspective for strictly and devmode confined snaps06:27
zyga(perhaps for classic snaps the inside perspective should just error or be the same as outside perspective)06:27
zygamvo: btw: did we decide to do something about "snap install classic"06:27
zygamvo: I had some ideas on that06:27
zygamborzecki: but then there's the inside perspective of instance snaps, what should is say for $SNAP - /snap/foo/42 or /snap/foo_bar/4206:28
mborzeckizyga: hm that sounds good06:28
zygamborzecki: if the instance aware path is rare we could do ExpandSnapVariables(innerPerspective | instanceAware)06:28
mvozyga: snap install classic is on my todo06:28
zygamborzecki: but normally just pass innerPerspective06:29
mvozyga: funny enough it will work, it will just be the wrong classic06:29
zygamborzecki: from what I guess there's just three places that need to be instanceAware06:29
mborzeckizyga: and it has an upside that i could push this as a pr outside of 571306:29
mvozyga: it will pull in "core"06:29
zygamvo: right :)06:29
zygamvo: remember that on core18 all the snaps use pivot_root06:29
zygaso yeah :)06:29
mborzeckizyga: naming aside, please take a look at the rest of the changes and the spread test and i'll start looking into this change with perspective flag06:33
zygaI06:36
zygaOK06:36
zygathe instance layout test is very nice06:50
mborzeckizyga: do you think i could add something to the content interface test?06:56
zygareading it now06:56
abeatomvo, hey, would it be possible to make sure https://forum.snapcraft.io/t/pulling-network-online-target-as-prerequisite-target-slows-down-starting-services/6063 does not happen on UC18?06:58
mborzeckizyga: omg, found some bad merge07:00
mvoabeato: indeed, sorry, it is still on my TODO let me move it up07:01
zygammm? where?07:01
mvomborzecki: yeah, tell us more07:01
mborzeckimvo: my code :) no worries07:01
mvopuhhh :)07:01
abeatomvo, awesome, thanks a lot07:01
mborzeckizyga: in info.go, ExpandSnapMountVariables, around SNAP_DATA07:01
zygaI'm not there yet07:02
mborzeckihm wonder why it was picked up by vet on travis, but not locally, iirc go test is supposed to run vet now too?07:02
zygais it? I was never using go vet automatically, it's always manual07:04
mborzeckizyga: https://golang.org/doc/go1.10#test-vet07:06
zygaah,go 1.10!07:06
zygaso I was using it without being aware of it07:07
mborzeckithey mention high confidence checks though, idk how unreachable code is not among those07:07
zygaI'd love unused code detector07:08
mborzeckizyga: try gometalinter07:08
zygae.g. public functions that are not used07:08
mborzeckithere's deadcode checker07:08
zygayeah but $standard vs $toolbox07:09
zygaI agree I'm just lamenting it is not a standard issue feature07:09
mborzeckibtw. deadcode actually picks up some stuff in the project, just didn't open any PRs yet07:10
=== pstolowski|afk is now known as pstolowski
pstolowskimorning07:14
zygamborzecki: https://github.com/snapcore/snapd/pull/5713/files#r21392502507:15
zygathe path discussion summarized07:15
zygahey pawel07:15
mvohey pstolowski07:15
mborzeckipstolowski: cześć07:15
mborzeckizyga: wonder if that's a bit too many flags07:19
zygamborzecki: four?07:19
zygareally we need the two flags for perspective + one flag that "flips" the natural instance awareness07:19
zygaso three07:19
zygabut the reality is that I think we just need it07:20
mborzeckizyga: i'm taking yagni angle here, all the use cases are inside mount ns now https://paste.ubuntu.com/p/RZF98hg8hd/07:25
zygasnapshots need the outside path07:26
zygainside you need both the instance and non-instance paths07:26
zyga(or we can just craft the instance paths with instance key manually07:26
zyga+1 on yagni though, if you can get it to work07:26
zygawe can add the override flag if needed07:26
mborzeckizyga: i'd expect snapshots to use snap.Info methods, those do instance-specific paths07:28
zygainteresting07:28
zygayeah07:28
mborzeckizyga: to recap, the snap.Info.SomeSuchDir() return all instance path, then the package level helpers snap.MountDir() et al take a snapName, so you can do snap.MountDir(info.SnapName(), info.Revision)07:30
mborzeckizyga: hm need to update that symlink path in layouts test08:10
zygaah, right08:10
zyga+108:10
mborzeckizyga: actually something broke there with /etc/demo, i'm looking into this right now, will ping you if i need a hand08:15
zygaok08:15
zygawhat was the error?08:15
mborzecki/etc/demo/writable is not created in $SNAP_COMMON for some reason08:16
mborzeckizyga: the fstab looks ok to me https://paste.ubuntu.com/p/wMw8hrWZmq/08:16
zygammm08:17
zygaok08:17
mborzeckizyga: i can see /etc/demo/writable inside snap mount ns, but it's not in $SNAP_COMMON/etc/demo for some reason (and not in /var/snap/test-snapd-layout_foo/common either)08:18
zygais it because /etc is the real /etc and it is writable and then you don't get a private-namespace copy?08:18
zygaaka, trespassing bug08:18
zygamaybe we can revive my branch for that08:19
mborzeckizyga: mountinfo inside, https://paste.ubuntu.com/p/FXrp8Cmymc/08:19
mborzeckizyga: hm it worked before fwiw08:19
zyga894 737 8:1 /var/snap/test-snapd-layout/common/etc/demo /etc/demo rw,relatime master:1 - ext4 /dev/sda1 rw,data=ordered08:20
zygaso /etc/demo is /var/snap/test-snapd-layout/common/etc/demo08:20
zygaanyway, I'll revive it08:22
zygaI need to land htat08:22
mborzeckizyga: hmm https://paste.ubuntu.com/p/3MXW6fz5RC/ what if it's not? :)08:23
zygaand on the host :D08:24
zygabecause this really tells you what happens08:24
zygaext4 filesystem on /dev/sds1, the slice at /var/snap/test-snapd-layout/common/etc/demo is at /etc/demo08:24
zyga977 764 8:1 /var/snap/test-snapd-layout_foo /var/snap/test-snapd-layout rw,relatime master:1 - ext4 /dev/sda1 rw,data=ordered08:25
zygathis hides it from your namespace (it's later in the sequence)08:25
zyga(sequence matters)08:25
zygabut just check on the host08:25
zygaam I right?08:25
mborzeckihm on the host, /etc/demo is there, /var/snap/test-snapd-layout_foo/common/etc/demo/writable is not, but /var/snap/test-snapd-layout/common/etc/demo/writable is and contains what was written by the _foo instance :/08:27
mborzeckizyga: ^^08:27
zygaright08:27
zygathat's what I expected08:27
zygaI mean, mountinfo doesn't lie08:27
zygait's just non-obvious what the outcome is08:27
mborzeckizyga: heh, ok, i'll just leave a comment in the test that this part blows up too08:29
zygamborzecki: I'm looking at my trespassing fix onw08:39
zygathe part I got stuck on is something you could help me with08:39
zygaif you want we can HO today and I'll walk you through it08:39
zygamaybe the solution will become obvious as we d oit08:39
MattJIs there a way I could grant a snap read-only access to /etc/ssl without going all the way and changing it to a classic one? Is there an interface I'm missing? If not, is there a potential for one to be added?08:39
zygaMattJ: let me look08:40
mborzeckizyga: ok, sure08:40
zygaso08:41
zygaMattJ: the network interface does that08:41
zygabut you need to know that /etc/ssl is not from the host08:42
zygait is the one from the base snap of your app08:42
zygaso you cannot add ssl certs by adding them to your host08:42
MattJAh, ok :/08:43
MattJThanks - do you see any easy way around this or should I give up and switch to classic confinement?08:44
zygait depends on what you want to do08:44
zygayou can add ssl certs from your snap to your snap's runtime08:44
zygathat is08:44
MattJAnother thing I thought was if I could just run one command without confinement to import the certs to the data path or something08:44
zygaany given snap can add certs for itself08:44
MattJWell it's a server process, but it needs valid certificates for the domain it is serving08:45
MattJMost people these days will already have these via Let's Encrypt/etc.08:45
zygammm08:45
zygawhere do you need that cert to be exactly?08:45
MattJI need it anywhere that can be read by the server process launched in the snap08:46
zygacopy it to $SNAP_COMMON08:46
zygaand have your snap read it from there08:46
MattJI guess I could provide a script in the snap that does this, and the user could execute it manually08:46
MattJThanks for the thoughts :)08:48
ChipacaMattJ: a script can detect if it's being run or being sourced, and error if it's being run, with an error along the lines of 'you need to source this'08:50
ChipacaMattJ: in bash, that is: check whether ${BASH_SOURCE[0]} is $008:51
MattJThis would probably need to be actually run as root, from cron08:51
MattJBut thanks for the tip08:51
ChipacaMattJ: systemd timers ftw08:51
MattJSure, though that can't be installed by the snap... but I guess it could be installed by this script, hmm :)08:53
ChipacaMattJ: OTOH you're not the only person asking us to be able to add certificates08:56
MattJI think it's easier for web-based apps that may be the only thing on the system, they can bind to port 80 and include certbot in the snap08:57
Chipacaso maybe we need to think about a more general solution08:57
ChipacaMattJ: if your snap was installed on a core device, where /etc/ssl is readonly, what would your users do?08:58
MattJProbably install some Let's Encrypt/certbot snap08:59
MattJ(I would like the snap to work on a core device for sure, so I would also like a solution for that - but I haven't got that far yet)09:00
ChipacaMattJ: so from your POV getting the cert is never your snap's concern, it always needs to come from outside09:01
ChipacaMattJ: why would the copying need to be put on a timer? because presumably the certs get updated periodically in some other place and the whole tree needs to be in sync?09:02
t1mpshould the app version number always be "hard-coded" in the snapcraft.yaml file?09:03
t1mpI'd like to get it from my_python_package.__version__ instead09:03
mborzeckizyga: i'm looking at the log from test-snapd-layout_foo, https://paste.ubuntu.com/p/j5WSWJtyJH/ if the mount changes are pefroemd in the order they are logged in line 178 then this will be incorrect, won't it?09:04
mborzeckizyga: i mean i see it's doing all the layout stuff before parallel instance setup, although fstab lists parallel instance pieces first09:04
zygahmmm09:05
mborzeckizyga: before it worked because layouts used instance-specific paths and the instance -> snap bind mount would not confclit09:05
* zyga looks09:05
zygaaha09:06
zygainteresting09:06
zygahmmm09:06
zygaright09:06
zygawe sort them in a specific way09:06
* zyga thinks09:07
mborzeckihm parallel-instance then should come first?09:07
Chipacat1mp: you can tell snapcraft to grab the version from elsewhere09:07
zygalines 162-190 of the log09:07
zyganot sure if that's correct09:07
mborzeckizyga: we have x-snapd-origin we could use09:07
MattJChipaca, Let's Encrypt certificates are only valid for 3 months, and are typically updated more often than that09:07
zygayes but it's super super tricky what happens09:07
* mborzecki looking09:07
zygathe rationale for the ordering is specific09:08
zygaI was thinking if we need to do batching09:08
MattJChipaca, so either the snap needs constant access to them, or they need to be imported periodically by something with access to them09:08
Chipacat1mp: look up "snapcraftctl set-version", i think that'll lead you to the how09:08
mborzeckizyga: like parallel instances first, then layouts, then the rest (if needed?)09:08
zygaperhaps09:09
ChipacaMattJ: yeah, that's what i thought09:09
zygabut it's all non-trivial09:09
mborzeckizyga: computing changes would be tricky09:09
zyganot sure if this remains correct09:09
t1mpChipaca: thanks, reading.09:09
zygamborzecki: what if we do a stable sort09:11
zygaand sort by (target, source)09:11
zyganot just by target09:11
zygaI think what is happening that is wrong is09:11
zygawe order things by where they appear09:12
mborzeckizyga:  i can try that09:12
zygaignoring the what they bring aspect09:12
zygaand what they bring is also relevant09:12
zygawe need to correctly order the desired state09:12
zygabut then the question becomes;09:12
zygais this breaking any invariants the current code has09:12
zygawill it undo correctly09:13
mborzeckizyga: i'll do some experimentation and we can later meet in HO09:13
mborzeckizyga: heh, finny that it worked before by accident :)09:15
mborzeckiand i was like, 'oh hey it works, so nice' ;)09:15
zygamborzecki: I need to go to the post office09:19
zygamborzecki: we can HO after that09:19
zygaok?09:19
mborzeckisure09:19
zygabrb09:19
mborzeckiniemeyer: hi, when you're around could you take a look at https://github.com/snapcore/snapd/pull/5735 ?09:21
niemeyermborzecki: Looking09:22
mborzeckiniemeyer: thanks09:23
niemeyermborzecki: Reviewed, np09:29
Chipacat1mp: this: https://forum.snapcraft.io/t/extracting-information-from-sources-in-snapcraft-parts/464209:34
t1mpChipaca: thanks.09:42
t1mpI see there is also a version-script property in the yaml file, but not a lot of docs on that yet.09:42
zygare09:45
mborzeckizyga: i'm playing with this naiive change https://paste.ubuntu.com/p/K54npKZzFg/09:47
zygasure but think about the consequences as well09:49
mvozyga: do you think 5307 needs another look by jamie ? or can we squash it?09:50
mborzeckizyga: just verifying that moving those mounts to be firs fixes the issue at hand09:50
zygamvo: looking09:58
zygamvo: ideally jamie would look but he's been busy09:59
zygaalso gustavo asked for +1 from jamie09:59
mborzeckizyga: the tests are passing now (expectedly)10:10
t1mpChipaca: version-script looks like it will do what I want, but still the 'version' property is required. I assume that version-script will override that (but it is not documented what will happen). I guess I'll have to try it10:18
niemeyerWOAH10:18
niemeyerThere's no a "Resolve conversation" button in GH..10:18
niemeyerSo simple and so useful10:18
pstolowskipedronis: hey, wrt your comment about revert & Sequence after currentIndex, what're the semantics of Sequence?10:19
niemeyerAnd "Show resolved" and "Hide resolved".. OMG.. my day just got better10:19
Chipacaniemeyer: nice10:21
niemeyerhttps://usercontent.irccloud-cdn.com/file/uMovdf2m/image.png10:22
mvoxnox: that reminds me, can I do an sru for https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1778936 or do you plan to do one anyway where you could include this change?10:24
ogramvo, hmm, you said SNAP_ARCH_TRIPLET was not implemented ... this one is very curious though ... :10:29
ogra$ snap run --shell qemu-virgil -c "/usr/bin/env"|grep SNAPCRAFT10:29
ograSNAPCRAFT_ARCH_TRIPLET=x86_64-linux-gnu10:29
ograseems the snapcraft var is actually inside the installed snap10:29
ogra(whihc is great but smells like it should not be like that)10:29
mvoogra: I did not follow what snapcraft was doing there10:31
ogramvo, well, somehow SNAPCRAFT_ARCH_TRIPLET ends up in my runtime env10:31
ograthat snap has no wrappers or anything so this is very curious10:32
ograi mean, i appreciate that ... but it doesnt feel right that a SNAPCRAFT var ends up in my installed snap package10:33
=== chihchun_afk is now known as chihchun
ogra$ grep SNAPCRAFT /snap/qemu-virgil/current/command-qemu-virgil.wrapper10:34
ogra$10:34
ograit is definitely not in the default wrapper10:34
ograso i wonder where it comes from10:34
ogragar10:34
ograignore that ... somthing exported it into the shell i'm in10:35
ogra(which is also curious ... should snap run --shell not wipe my env ? )10:35
Chipacaogra: nope, only remove some of it10:42
ograah10:51
mborzeckipstolowski: left you some comments on #568010:53
pstolowskimborzecki: ty!10:54
zygahmm, if a test panics the panic breaks the test11:37
zygabut if a test panics and teardown uses c.Assert() that fails then the assertion error is show but the panic is gone11:37
zygais this expected?11:38
Chipacagrr grr grr integration tests grr11:58
* Chipaca ~> lunch11:58
=== pstolowski is now known as pstolowski|lunch
zygamborzecki: hey12:11
zygado you want to HO?12:11
mborzeckisec12:11
zygaI'm progressing on the trespassing fix, I rebased it and solved a blocker I had the last time12:11
zyganow going through tests that ... well, need some love since syscalls changed12:11
zygabut it's mostly inserting a syscall in a chain and going on12:12
mborzeckizyga: ok, ready12:12
zygastandup?12:12
pedronismvo: can #5583 be reviewed again?  I might not get to it today tough12:37
=== pstolowski|lunch is now known as pstolowski
ograhmm, an install hook should also run on upgrades, right ?12:46
mvopedronis: yes, I updated it ~1h ago12:47
pedronisok12:48
mvopedronis: it has a minimal wait and tracks the idle connections now12:48
mvos/tracks/checks/12:48
pedronismvo: likely I will look at it tomorrow, trying to getting started with something today (but had a bit of a cut up day by errands so far)12:49
pstolowskiogra: no12:49
mvopedronis: no worries, its not urgent12:49
pstolowskiogra: on upgrades we run pre-refresh and post-refresh hook sinstead12:49
pstolowski*instead12:49
ograpstolowski, hmm, so i need two scripts if i want something to work on install as well as on upgrades ?12:52
ograhooks/install and hooks/*-refresh ?12:52
zygajdstrand: hey, there's a pr that is blocked on you (the one about /mnt)12:53
zygajdstrand: do you think you will have time to review it today12:53
pstolowskiogra: yes12:53
jdstrandI got through some yesterday. will try to get to that one12:53
ograboo12:53
ograok12:54
zygajdstrand: thank you!12:54
pstolowskiogra: if the logic is the same you can move it to a helper.. or maybe a symlink will work (not sure)12:54
ograwell, i#ll just cp it ...12:54
zygaI must say I love our standups13:33
mborzeckiguys, any clue why i'm not able to edit https://forum.snapcraft.io/t/security-policy-and-sandboxing/554 ?13:33
zygait's not a wiki13:34
zygathe irony there hurts ;)13:34
zygaoh boy!!13:35
zygaI used 1TB of data this month13:36
zygaand I actually hit my cap13:36
zygawow13:36
zyga(LTE cap)13:36
zygaI need better visibility into this, who is using this data ....13:36
mborzeckinasty neighbours :)13:37
mborzeckizyga: hm i can edit this https://forum.snapcraft.io/t/the-snap-format/698 but not the other one13:38
=== chihchun is now known as chihchun_afk
axinohi14:33
axinoI have a snap containing some rust code, it compiles fine on amd64/i386 but not on arm64/armhf14:33
axinoerror is "error[E0658]: non-reference pattern used to match a reference (see issue #42640)"14:34
axinohas anyone seen this ?14:34
axinohttps://launchpad.net/~build.snapcraft.io/+snap/17fc91e19f932bd8a75175923b533019-xenial builds are here14:34
Chipacaaxino: is this specific to the snap?14:39
axinoChipaca: I can't answer that14:40
Chipacaaxino: why not?14:41
axinoChipaca: I haven't tried to build sentry outside of the snap context14:41
axinoChipaca: or maybe I misunderstood your question14:41
Chipacaaxino: the error does not seem to be about snaps at all14:42
Chipacaaxino: I'm not sure how we could help14:43
axinoChipaca: maintainers of multi-arch rust snaps might have seen this behaviour14:43
axinoI guess I'll try #rust14:46
=== chrisccoulson_ is now known as chrisccoulson
Chipacaaxino: if you don't have luck there, try a topic on the forum14:56
axinoChipaca: yup I will - thanks14:56
Chipacamup: ping15:17
Chipacamup: how much chug would a moose chug … wait15:17
=== chihchun_afk is now known as chihchun
popeyjdstrand: I'm getting a snap suddenly getting rejected by the store, which was fine previously15:41
popeyjdstrand: https://dashboard.snapcraft.io/snaps/scummvm/revisions/466/15:41
popey"unknown keys in snap/manifest.yaml: snapcraft-os-release-id,snapcraft-os-release-version-id,snapcraft-version lint-snap-v2_snap_manifest "15:42
jdstrandpopey: tools needs an update. thanks!15:43
jdstrandpopey: can you request a manual review?15:43
jdstrandpopey: we'll get that fixed fast15:43
popeydone, thanks15:43
* zyga goes for a bike for 1..2 hours15:48
jdstrandpopey: can you do the same for 466 (i386)?15:48
popeyjdstrand: done15:49
zygajdstrand: I'm making good progress on the trespassing bug (it was unblocked today), I'll bug you about that tomorrow15:49
jdstrandzyga: great. fyi, I'm off tomorrow/Monday (will send email later)15:49
zygaah15:50
zygaok, then on Tuesday15:50
zygacan you try to look at https://github.com/snapcore/snapd/pull/5307 - you're the last +1 needed :)15:50
zyga(regardless, I'm heading out)15:50
jdstrandzyga: yes, we talked about that already today :P15:51
zygaI know, sorry :|15:51
diddledansnapd 2.35 is installing the .snap files as root:root 600 - previous snapds installed root:root 64415:53
diddledancaused an error that I've documented in the cft for snapcraft 2.43: https://forum.snapcraft.io/t/call-for-testing-snapcraft-2-43/7024/515:53
popeyi had this the other day too15:53
Chipacadiddledan: popey: that is known and fixed on master fwiw16:00
Chipacamaster of snapcraft that is16:01
diddledanhow can snapcraft, running as me, decide to override root-only access?16:01
* diddledan eyes it suspiciously16:05
Chipacadiddledan: say again?16:11
Chipacadiddledan: it doesn't16:11
Chipacadiddledan: it no longer tries to copy those files into the container16:11
diddledanyou said it was fixed in snapcraft, but snapcraft can't override the root-only access16:12
diddledanaah16:12
diddledangotcha16:12
* diddledan removes suspicious eyes16:12
Chipacadiddledan: in the future we'll bring the caching back by adding api to snapd to stream the snaps16:12
* diddledan inserts googley eyes instead16:12
* Chipaca whacks diddledan over the head just watch the googley eyes bobble16:12
* ogra steals diddledan's goggley eyes and replaces them with xeyes for nostalgic reasons16:13
diddledanhttps://www.youtube.com/watch?v=BBFqGHgCFiY16:13
* popey runs wayland on diddledan to break the xeyes16:13
diddledanhaha16:13
* ogra secretly shoves XWayland underneath popey's injection ... just to notice the xeyes became stills due to securit reasons16:14
ogra+y16:14
Chipacaclearly the way to have it  work again is to make diddledan be all eyes16:15
jdstrandroadmr: hi! can you pull r1123 of the review-tools. this should be considered fairly urgent since anything using a new snapcraft will end up in manual review16:15
jdstrandroadmr: ideally done today since I'm off tomorrow/Monday16:16
ograhttp://www.davidmelling.co.uk/blog/wp-content/uploads/2012/05/monster5-e1337951522979-1024x602.jpg16:16
jdstrandroadmr: fyi, https://paste.ubuntu.com/p/553Jg578yF/16:16
jdstrandroadmr: (r1123 changed sr_common.py)16:17
jdstrandpopey: that has your fix ^16:17
popeyyay16:17
popeyta16:17
Chipacafair warning, a lot of our argentine colleagues might be a bit distracted these days16:19
ograwe should just pay them in euros then16:19
ogra(or is there more than the crazy inflation ?)16:20
Chipacaogra: it's the chaos and turmoil that with this16:20
ograyeah16:21
=== chihchun is now known as chihchun_afk
Chipacacould I get a review or two of https://github.com/snapcore/snapd/pull/5744 ? reasonably straightforward (might even qualify as Simple)16:38
Chipacatests are green despite what github says (at least  here)16:39
sergiusensniemeyer, kyrofa: wrt out conversation from Monday, are we good on s/templates/extensions/ ?16:39
niemeyerSo far it sounds good16:40
sergiusensniemeyer: great, we will rename them16:45
roadmrjdstrand: hi! I'll put it in the pipeline16:52
popeyjdstrand: i take it you've seen the review tools themselves got rejected? :)17:10
popey(also, lol)17:11
roadmrhaha17:11
mvoheh17:11
zygaReturned17:17
zygaTIL police does not arrive even after 25 minutes of waiting17:17
=== pstolowski is now known as pstolowski|afk
ograoh gosh ... thats a lot of additional apt sources in that "16.04 snap missing" thread !17:26
ogra... what could possibly go wrong ...17:26
roadmrzyga: why did you call police? 😱17:34
zygaroadmr: some drunk assholes were harassing a young couple17:54
roadmroh not nice :(17:54
ograjdstrand, hmm ... i just had three weird rejects of a plain package rebuild ... " unknown keys in snap/manifest.yaml: snapcraft-os-release-id,snapcraft-os-release-version-id,snapcraft-version lint-snap-v2_snap_manifest"18:04
ograjdstrand, https://dashboard.snapcraft.io/snaps/qemu-virgil/revisions/30/ (and 31, 32) in case you want to take a look ... it is built using build.snapcraft.io and there were no fancy changes or anything ... the former build went through for all arches18:06
ograjdstrand, oh, ignore me, just saw the backlog ... i guess it will magically fix itself18:08
Caelumzyga: I'm getting that exact fail on my tw server with 'osc build'18:12
zygaCaelum: hey18:12
zygaCaelum: I talked to some golang people from suse18:12
zygaCaelum: apart from some issues in test suite (unicode vs ascii output) I'm re-working the use of golang helpers18:13
zygaCaelum: tl;dr; version is that people that make golang helpers recommend not to use golang helpers18:13
Caelumzyga: so you found the issue, was it a segfault or something like that?18:13
Caelumzyga: yeah figures18:14
zygaCaelum: ish, I have not confirmed it on pure i586 system18:14
Caelumzyga: the go build stuff is very weird to be honest18:14
zyga"go build" is very nice but %go_build is horrible18:14
Caelumzyga: honestly I've never yet built snapd with the regular tools, the patches I ran through osc18:29
Caelumzyga: but I'm going to try again now18:29
zygaCaelum: actually it's pretty easy, just go build :)18:39
zygaCaelum: anyway, I'm reading now, but I will push updates to my home branch18:39
Caelumzyga: looks like ./run-checks is all I really need18:42
Caelumzyga: looks like fixing things for gentoo is going to be non-trivial, already ran into a needed dependency that gentoo doesn't have18:49
jdstrandroadmr: thanks for putting it in the pipeline-- do you have an eta?19:14
roadmrjdstrand: I'll do my best to roll out today but no promises; if not, it'd be until Monday/Tuesday19:16
jdstrandroadmr: ok, thanks19:16
jdstrandroadmr: Monday/Tuesday is going to be a problem. basically, all snapcraft.io/LP builds are getting blocked19:17
jdstrandroadmr: I apologize for this. I wasn't aware of the changes19:18
roadmr:(19:19
roadmrI'll do my best to get this out today19:19
popeysorry, but +1 to getting this fixed asap. We're already getting mails about stuff failing19:19
cjwatsonDo we need to revert LP's snapcraft?19:35
cjwatson(Is it a snapcraft change that caused this?  I have no idea TBH.)19:35
jdstrandcjwatson: yes, snapcraft19:58
jdstrandcjwatson: but lets hold off on the revert and see what roadmr can do19:58
roadmrjdstrand, cjwatson : if it's easyish to revert, it might be faster than what I can do :(19:59
jdstrandI don't personally have a preference, but I don't know what snapcraft is fixing19:59
roadmrjdstrand: at this point the store release pipeline involves a CI run which might take 2 hours, then requesting the rollout which, assuming someone from IS is around to process and I nag them hard enough, might take another hour. But it's already 4 PM for me so that puts me past EOD (my son is very strict in enforcing EOD)20:00
roadmrjdstrand: we put a veto on Friday releases since last Friday's broke the world :D so if not done today, that's why it would have to wait for Monday. Monday is Labor Day in some countries so coverage will be low as well20:00
roadmr(I'm off on Monday for one, and so are you :D)20:00
cjwatsonroadmr: unless I'm missing a quicker way, we'd do it by building a reverted version with a higher version number and put it in the snappy-dev/ubuntu/tools PPA20:00
jdstrandcjwatson: would it be possible to revert until next Monday/Tuseday when roadmr pings us that the fix is in place?20:01
cjwatsonThat doesn't require (or even really benefit from) an LP person being available, which is a good thing since I'm about to walk out the door20:01
cjwatsonAnyone in ~snappy-dev could do it20:01
jdstrandI'm in snappy-dev20:01
cjwatsonThis works because LP puts "deb http://ppa.launchpad.net/snappy-dev/tools/ubuntu %(series)s main" (with the appropriate series substituted for "%(series)s", but it's usually xenial and in particular it's xenial for all build.snapcraft.io builds) in the sources.list for every snap build20:02
cjwatsonFor exactly this sort of reason20:02
pedronishow did this snapcraft got throught anyway? should have it broken some store integration tests?20:02
jdstrandcjwatson: https://launchpad.net/~snappy-dev/+archive/ubuntu/tools seems to have ancient stuff...20:03
cjwatsonYes, it hasn't been actively used for a while20:03
cjwatsonBut it's still in sources.list20:03
jdstrandcjwatson: oh, you're saying take the last xenial from -updates and shove it there20:03
jdstrand(with proper versioning, etc)20:04
cjwatsonIt needs to have a higher version number than anything else in the snap build's sources.list, but yes20:04
jdstrandsure20:04
cjwatsonI mean you should probably alert the snapcraft team that you're doing this20:04
cjwatsono hai20:04
roadmronce that thing is in the PPA, how does Launchpad pick it up? magic?20:04
jdstrandpedronis: that will be my next question. snapcraft should definitely have some tests that run snaps it produces through the review tools20:05
sergiusenscjwatson, roadmr: what's up?20:05
cjwatsonroadmr: snap builds are dispatched to builders with a sources.list that includes that PPA20:05
cjwatsonso not particularly magic20:05
roadmrcjwatson: it is magic! https://www.youtube.com/watch?v=tYh94XTJTDU20:05
cjwatsonsergiusens: latest snapcraft apparently breaks the store until a new click-reviewers-tools is rolled out, which may not be until Monday depending on how things go.  we were planning to have jdstrand drop a reverted version into ppa:snappy-dev/ubuntu/tools until such time as that happens, so that e.g. BSI users don't suffer in the meantime20:06
jdstrandsergiusens: the review-tools got grumpy over some added manifest.yaml keys. I've added them (and one could argue they shouldn't do that) but atm LP/build.s.io builds are failing review20:06
sergiusensjdstrand: heh, those are the manifest keys you asked for :-) the irony :-P20:06
jdstrandsergiusens: the problem is even though they are fixed, they can't get to prod fast enough20:06
jdstrandsergiusens: indeed. I seem to be paying the price for that request20:07
pedronissomething seems still broken process wise20:07
jdstrandpedronis: I mentioned that20:07
sergiusensthis hassle just also proves that my calls for testing are useless20:07
sergiusensshould probably just stop doing them20:07
jdstrand15:05 < jdstrand> pedronis: that will be my next question. snapcraft should definitely have some tests that run snaps it produces through the review-tools20:07
cjwatsonjdstrand: anyway, as mentioned, I'm about to go out.  all clear on what needs to be done if you do go the revert route?20:08
jdstrandthat could be part of SRU, autopkgtest, travis, whatever20:08
roadmrthanks cjwatson20:08
pedronissergiusens: this would have broken any  good enough integration test with the store, unless I'm missing something, or those don't run making a manifest20:08
pedronisso we are missing that20:08
jdstrandcjwatson: yes. you said xenial is all I need to fix?20:08
cjwatsonjdstrand: I'll have my phone with me so feel free to SMS the number in the directory if you get stuck20:08
sergiusenspedronis: we use the staging store20:08
sergiusenspedronis: explicitly told not to use the prod store for any testing20:08
cjwatsonjdstrand: for BSI, yes.  for other LP builds, that'll still catch nearly everything so it should be fine20:08
jdstrandcjwatson: I'll be fine. thanks for the offer20:08
roadmrsergiusens, pedronis : this should have broken even with the staging store, since the reviewer-tools that support this only landed on staging today after jdstrand brought the problem up20:09
pedronisindeed, still not understanding20:09
pedronisare we not checking enough? not testing the manifest case?20:09
roadmrI wonder if the store pre-release tests  would have caught them; but we don't run those when snapcraft changes, only when we're about to do a prod release20:10
sergiusensroadmr: it should of broken all your travis runs too fwiw, as this functionality is in since late May20:10
jdstrandcjwatson: on monday/whenever, I guess we could simply remove the packages from the ppa, then all is good cause builders are ephemeral?20:10
cjwatsonjdstrand: yes20:10
roadmrsergiusens: oh! and it hasn't broken anything!20:10
jdstrandcool20:10
* jdstrand updates the ppa20:10
jdstrandcjwatson: thanks20:10
pedronisroadmr: sounds either that we don't check that the test go past review tools or the tests are generating manifests20:10
sergiusensroadmr: oh, this is missing coverage about generating manifests for those tests.20:10
jdstrandcjwatson: enjoy your evening :)20:10
cjwatsonI plan to.  thanks20:10
jdstrandhehe20:11
cjwatsongood luck20:11
roadmrthanks!20:11
* roadmr needs to step out for a bit but will read backscroll later20:11
* cachio afk20:16
hunterkok, reading the scrollback, I'm not the only person with the 'unknown keys' build failure, and that's something the snapcraft folks will sort out on their end?20:50
ograyes20:50
hunterkkk, thanks :)21:04
LargePrimehi,  can i get a link or keyword to enable write areas in a snap?21:06
LargePrimeam tryint to have a snap packager to fix his snap21:06
LargePrimeplease ping21:06
=== sergiusens_ is now known as sergiusens
popeyLargePrime: snaps have writable areas. $SNAP_USER_DATA and $SNAP_USER_COMMON - see https://docs.snapcraft.io/reference/env  for details21:09
popeyLargePrime: which snap out of interest?21:09
LargePrimepopey, https://github.com/diddlesnaps/starruler2/issues/221:09
LargePrimestar ruler 2 has lots of mods and modability.  and they seem mostly borked with current ackage21:10
popeyone possibility that i don't know if diddledan has tried, is you can copy the moddable stuff out to a writable area on first launch21:11
popeyI did this with one or two snaps21:12
popeycan end up wasting space though21:12
popeythe other option is to patch upstream to look in multiple places21:12
diddledanI've not had a change to look into it yet21:12
diddledanchance*21:12
LargePrimepopey, would it be a small ask for you to reply to the issue?21:12
LargePrimether he is21:12
LargePrimehaha21:13
diddledanafaict it requires shoving stuff into the binaries directory21:13
popeyahh21:13
popeythat's unfortunate21:13
diddledanaye21:13
popeyhow big is the binaries directory?21:13
LargePrimediddledan, also we cannot add portraits21:13
popeycan that be copied out and then launched?21:13
* diddledan goes looksee21:14
diddledan858MB21:15
diddledanmost of that in ./data which is probably one of the places that people want to fiddle21:16
diddledanthere's also ./maps, and ./mods21:16
diddledan./mods we can probably sync across, and put a symlink in place instead21:17
popeythat might work21:20
popeywhat happens when they have traditionally packaged ones21:20
popeylike, if you install from a deb (is there a deb?)?21:23
diddledanthere is no deb that I know of21:23
popeyis there a mac dmg or somehting21:25
popeyOr do you just unpack a zip and run it in place?21:25
diddledanfor the snap it's compiled from sauce21:26
diddledanI know not how it's distributed elsewhere :-)21:26
jdstrandroadmr (cc cjwatson): I uploaded 2.43+0really2.42.1 to the ppa. it's building21:38
roadmrjdstrand: I love the version number :)21:38
jdstrandroadmr: yeah, Sergio is uploaded 2.43.1 on Monday, so it should all be good21:38
jdstranduploading*21:38
roadmrnice21:39
roadmrjdstrand: meanwhile the dashboard rollout process toils along :/ I'm still waiting for the CI run to complete.21:39
roadmrshould finish in the next 40 minutes or so \o/ *sob*21:39
diddledanif a snap with layouts passes manual review can anybody install it? i.e. do users still need to opt-into layouts experiment for a manually approved store snap?22:23
jdstrandjeez it takes snapcraft two hours to build22:41
* jdstrand taps fingers22:41
jdstrand(in LP)22:41
jdstrandGet:11 http://ppa.launchpad.net/snappy-dev/tools/ubuntu xenial/main ppc64el snapcraft all 2.43+0really2.42.1 [199 kB]23:23
cjwatsongood good23:30
jdstrandfyi, things should start passing again23:30
jdstrandsee https://forum.snapcraft.io/t/builds-failing-automated-review/7112/323:30
jdstrandmy review-tools upload grabbed the downgraded snapcraft, built and reviewed successfully23:30
jdstrandcjwatson: thanks for the tip :)23:30
cjwatsonnp23:34

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!