/srv/irclogs.ubuntu.com/2017/09/21/#snappy.txt

mwhudsoner spread just says this to me:00:16
mwhudsonerror: invalid project name: ""00:16
mwhudsonoh is this because my gopath is not in $HOME00:18
mwhudsonyes00:22
mwhudsongrumble00:22
sergiusenselopio please check my last comment on snapcraft#155201:22
mupPR snapcraft#1552: tests: replace the first batch of demo tests with snapd integration tests <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1552>01:22
mupPR snapcraft#1559 opened: static: fix flake8 errors in setup.py <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/1559>01:37
sergiusenselopio or kyrofa easy one ^01:38
mupPR snapcraft#1560 opened: ci: use travis conditionals <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1560>02:16
=== JoshStrobl|AFK is now known as JoshStrobl
mupPR snapcraft#1561 opened: rust plugin: record the Cargo.lock file <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1561>04:23
kyrofaelopio, are you still around?04:24
kyrofaNah, nevermind, it's too late04:26
mupPR snapcraft#1562 opened: Record rust versions <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1562>04:56
elopiokyrofa: I'm here. But yes, I'll EOD, I'll continue meditating about your PR tomorrow :)05:35
mupPR snapcraft#1563 opened: tests: simplify a little the data in nodejs unit tests <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1563>05:35
zyga-ubuntubrr06:10
mupPR snapd#3950 closed: cmd/snap-repair: prefer leaking unmanaged fds on test failure over closing random ones  <Created by pedronis> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3950>06:22
mupPR snapd#3951 opened:  snap: add new `snap fold` and use in tests  <Created by mvo5> <https://github.com/snapcore/snapd/pull/3951>06:46
mupPR snapd#3949 closed: cmd/snap-repair: skip disabled repairs <Created by pedronis> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/3949>07:07
=== chihchun_afk is now known as chihchun
* zyga-ubuntu wonders if the rain will stop07:17
zyga-ubuntuor will it just switch to snow07:18
mupPR snapd#3939 closed: interfaces: add Connection type <Created by stolowski> <Merged by stolowski> <https://github.com/snapcore/snapd/pull/3939>09:22
* zyga-ubuntu -> cold :/09:32
* ogra_ hands zyga-ubuntu a campfire09:37
* Chipaca helps zyga-ubuntu warm up by running the test suite on all his lab machines09:58
* Chipaca is lying09:58
* Chipaca always lies, even now09:58
Chipacahuh, just got a unit test dying because of my webcam10:01
* Chipaca squints10:01
Chipacalooks like i'm missing a .h10:05
* Chipaca hugs “apt build-dep ./”10:06
* zyga-ubuntu fights with nfs10:10
pedronisseems we have again linode -> github issues10:12
* Chipaca ponders nfs-aware snapds10:13
Chipacae.g. grab snaps off other snapds, query other snapds acking10:14
Chipaca(fear not, only pondering this because waiting for unit tests)10:14
* zyga-ubuntu has small progress :)10:20
Son_Gokuzyga-ubuntu: I wonder if we could have a box set up running the latest Fedora to run through the latest snapd with setroubleshoot installed and active, and collect all the denials10:36
Son_Gokufrom the spread test10:36
Son_Gokusetroubleshoot has an API, so you could use that to collect all the denials related to snappy policy domain10:38
zyga-ubuntummm10:44
zyga-ubuntuSon_Goku: we could just adjust the spread test run for fedora and somehow collect the results10:45
zyga-ubuntuSon_Goku: spread has a "residue" system where it could collect a file from the tested system10:45
Son_Gokuis setroubleshoot-server installed and running when the fedora vm is booted?10:45
Son_Gokuwithout setroubleshoot, you just get shitty AVC denial messages like you do with AppArmor10:45
zyga-ubuntuSon_Goku: we could bake it into the image10:46
Son_Gokuthen the next question is, how do we get the data10:47
Son_GokuI know it spews messages into the journal10:47
zyga-ubuntuwe'd run it manually on linode and collect it via the resudue10:47
Son_Gokubut I don't know if there's another location too10:47
zyga-ubuntuwe'd have to script things so that there's a file to collect10:47
Son_Gokuright10:47
pedronismvo: so good news, preliminary testing again staging worked as expected,  otoh I think we should disable the snap-repair timers during spread tests or it might get confusing when we start having some?10:48
mvopedronis: agreed10:49
mvopedronis: having said that, we could do it when we get the first repair10:49
pedronisas you prefer10:50
zyga-ubuntuok, I have working NFS support in snapd11:07
zyga-ubuntulet's propose it piece by piece and let's work on a spread test11:07
mupPR snapd#3952 opened: cmd: update "make hack" <Created by zyga> <https://github.com/snapcore/snapd/pull/3952>11:08
zyga-ubuntuChipaca: ^ trivial11:08
mupPR snapcraft#1563 closed: tests: simplify a little the data in nodejs unit tests <Created by elopio> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1563>11:33
mupPR snapcraft#1559 closed: static: fix flake8 errors in setup.py <Created by sergiusens> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1559>11:39
pedronismvo: sample runs (with staging):  http://pastebin.ubuntu.com/25585711/11:51
=== ikey is now known as ikey|zzz
=== JoshStrobl is now known as JoshStrobl|Store
ppisati$ snapcraft cleanbuild --output12:05
ppisatiError: no such option: --output12:05
ppisati$ snapcraft cleanbuild12:06
ppisati[cpu stuck at 100% but no output, and apparently nothing happens]12:06
ppisatisergiusens: ^12:06
ppisatielopio: ^12:11
ppisatikyrofa: ^12:11
popeyjdstrand: i just uploaded an app (pulsemixer) which got stuck in review because it has no desktop file (I use the x11 interface). It is a CLI app - no GUI. But the x11 interface is required for pulse to work!12:12
popey(known bug?)12:12
jdstrandpopey: it isn't a bug in the tools. I can add an exception for it12:15
zyga-ubuntujdstrand: hey12:15
zyga-ubuntujdstrand: I have a POC for nfs support, do you want to have a quick look?12:15
jdstrandhey zyga-ubuntu12:16
popeyjdstrand: I mean a bug in the pulseaudio interface..?12:16
pedronismvo: #3934  spreads runs seems to be plagued by networking issues :/12:17
mupPR #3934: snap-repair: implement `snap-repair {list,show}` <Created by mvo5> <https://github.com/snapcore/snapd/pull/3934>12:17
mvopedronis: yeah, I noticed as well, super annoying, so close12:18
jdstrandpopey: no. pulse uses x11 window properties to find the server. something that is doing that should declare the x11 interface12:19
popeyahh12:19
jdstrand(ie, we don't want to add X access to the pulseaudio interface)12:19
jdstrandzyga-ubuntu: where is it?12:22
zyga-ubuntujdstrand: I just pushed it to feature/nfs-support branch12:23
zyga-ubuntujdstrand: I tested it successfully on my artful system, I'm working on spread test12:23
zyga-ubuntujdstrand: have a look at each patch, I tried to make it logically follow one another12:24
zyga-ubuntujdstrand: I was thinking about also parsing etc/fstab and looking for NFS there12:31
zyga-ubuntujdstrand: and enabling the workaround if _either_ NFS is actually mounted or fstab says it may be mounted12:31
jdstrandzyga-ubuntu: I made a couple of comments. I think the direction is fine and who it is implemented makes sense12:38
zyga-ubuntujdstrand: thank you, looking12:40
jdstrandzyga-ubuntu: I was initially thinking only nfs home. I guess its possible some of the other policy might allow access to nfs directories depending on the setup, so I guess checking the mount table for anything is ok12:40
jdstrandmaybe it makes sense to start with only home, and expand if people are affected...12:41
jdstrandprobably need more people to discuss, but that can happen in PR review12:41
mupPR snapcraft#1560 closed: ci: use travis conditionals <Created by elopio> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1560>12:42
zyga-ubuntujdstrand: anything that is a subdir of home is a good test as this will let us test this easily and will be constrained how you explained12:42
zyga-ubuntujdstrand: as for reexec, that will work automatically thanks to the way the apparmor imports are handled12:43
zyga-ubuntujdstrand: I think it makes sense to extend filesystem type to handle samba but I haven't tested that so I'd like to do it as a separate step12:44
zyga-ubuntujdstrand: thank you for the quick look, I think this will work fine shortly12:44
sergiusensppisati I don't think we ever supported --output in `cleanbuild`12:45
jdstrandzyga-ubuntu: it isn't the imports I was worried about, it was loading the older snap-confine policy when we are reexecing12:45
* sergiusens waves hello12:46
jdstrandzyga-ubuntu: re samba> sounds fine12:46
zyga-ubuntujdstrand: older policy?12:48
zyga-ubuntujdstrand: when we are re-execing the newer snapd will run snap-confine from core and we already have support for managing that dedicated profile12:49
zyga-ubuntujdstrand: and that profile is a derivative of the profile stored in the core snap12:49
jdstrandzyga-ubuntu: there is /etc/apparmor.d/usr.lib.snapd.snap-confine.real, but we also end up with usr.lib.snapd.snap-confine.real.rev (or something)12:49
zyga-ubuntujdstrand: so it will source the system-wide policy extension for snap-confine12:49
zyga-ubuntujdstrand: right but see above, those all source one place12:49
zyga-ubuntujdstrand: and we already have setup code that ensures those are reloaded12:50
jdstrandit isn't /var/lib/snapd/apparmor/snap-confine.d I am worried about12:50
jdstrandthat directory is fine (indeed, I suggested it)12:50
jdstrandit is that you are hardcoding to apparmor_parser -r /etc/apparmor.d/usr.lib.snapd.snap-confine.real, not accoutning for usr.lib.snapd.snap-confine.real.rev12:50
zyga-ubunturight12:51
zyga-ubuntuI assume by .rev you mean the core revision12:51
jdstrandyes12:51
jdstrandI forgot what it looked like for real12:51
zyga-ubuntuI was trying to explain that IMO this is not needed because the code that manages the per-rev profile is already doing everything we need12:51
jdstrandsnap.core.2898.usr.lib.snapd.snap-confine12:52
jdstrandthat's an example ^12:52
zyga-ubuntuas it will derive the contents of the .rev file from the profile stored in the core snap12:52
zyga-ubuntuand then load it12:52
zyga-ubuntuis there more that we need to manage for per-revision profiles?12:52
cachioniemeyer, mvo i am taking my son to the hospital to make a bone scan12:52
mvocachio: uh, good luck!12:53
cachiomvo, TX, should be back soon12:53
nessitasergiusens, hi! unsure if you saw but the bug from yesterday was fix released last night12:54
pedronismvo: aftering having played a bit with "snap repair", do you think it would make sense to print as field the mtime of the log file do have an idea one things have run?12:54
pedroniss/do have/to have/12:54
zyga-ubuntujdstrand: does my explanation make sense?12:54
niemeyerThanks for the note, and good luck there!12:54
jdstrandzyga-ubuntu: looking at the above profile, and reminding myself what shows up in aa-status, I think there may not be a bug. but it seems weird that that code is only loading .real. doesn't that mean we might load .real when we don't have to?12:54
zyga-ubuntujdstrand: aha, interesting question; yes, when we are rexeced we don't need to reload the .real profile12:55
pedronismvo:  mmh, s/idea one/idea when/12:55
zyga-ubuntujdstrand: just write the policy and wait for the setup code to reload the right file12:55
jdstrandzyga-ubuntu: like, when we are execing the snapd in /snap/core/..., it is going to reload .real12:55
zyga-ubuntujdstrand: right, I agree12:56
zyga-ubuntuoh, standup time12:56
zyga-ubuntubrb12:56
mvopedronis: yeah, I think this is very nice12:58
mvopedronis: we should also include it in the log in case of fs corruption12:58
mvopedronis: I can add that after the meeting12:58
pedronisthanks12:59
pedronisI'll also rework my branch with some details, so it's ready when review/spread tests are back to being helpful12:59
=== ShalokShalom_ is now known as ShalokShalom
ppisatisergiusens: ok, but do you happen to know why my 'snapcraft cleanbuild' doesn't do anything? is it normal that i don't get any output?13:05
sergiusensppisati that is not normal, no13:05
sergiusensppisati can you add --debug?13:05
sergiusensppisati also check ps and see that we are not stuck on a lxc call13:06
sergiusensnessita thank you13:06
davidcalleogra_: just so you know, we now have this page https://developer.ubuntu.com/target-platforms/boards giving an overview of available images/boards, it's not core exclusive, so if you have others in mind I don't know of (only requirement is to have flashing steps somewhere on the web and a somewhat official image working), let me know13:06
davidcalle(also, you can pass the search term through the url, eg https://developer.ubuntu.com/target-platforms/boards#arm64 to have a filtered view)13:08
ppisatisergiusens: root     17092  0.0  0.0 160904  1396 ?        Ssl  14:00   0:00 /usr/bin/lxcfs /var/lib/lxcfs/13:10
ppisatiroot     18245  0.0  0.0  95016  5472 ?        Ss   14:02   0:00 [lxc monitor] /var/lib/lxd/containers first13:10
ppisatiflag     19422 97.2  0.5 346624 89224 pts/19   R+   15:07   2:21 /usr/bin/python3 /usr/bin/snapcraft -d cleanbuild --debug13:10
ppisatiflag     19634  0.0  0.0 130284   980 pts/20   R+   15:09   0:00 grep --color=auto -e lxc -e snapcr13:10
ppisatiops13:10
ppisatisorry13:10
ppisatisergiusens: http://pastebin.ubuntu.com/25586157/13:10
sergiusensppisati strange that no name for the assigned container is being shown. Can you `lxc list` and figure it out and then `lxc exec <container> -- ps -auxww`13:20
ogra_davidcalle, i have five "community" images too ... not sure if we want to mention them (for nanopi, nanopi-air, beaglebone, hummingboard and sabrelite)13:26
ogra_(and three more boards for "community" images in the pipe)13:27
ppisatisergiusens: http://pastebin.ubuntu.com/25586244/13:27
sergiusensppisati there is no snapcraft running in that one :-/13:31
sergiusensppisati and it is not named after the petname triplet we use for those containers13:32
sergiusensppisati oh wait, have you ever used cleanbuild to build kernels?13:32
matteoppisati: watch your step!13:32
sergiusensppisati we tar up everything in the source and only then create a container13:32
sergiusensand push that tarball into the container13:33
sergiusensif you want a somewhat more streamlined version of this try to do `SNAPCRAFT_CONTAINER_BUILDS=1 snapcraft`13:33
ppisatisergiusens: never used cleanbuild, first time13:39
* ogra_ has never seen cleanbuild fail before :)13:40
davidcalleogra_: it would be a good idea to give them more visibility, where can I learn more about these images? Do you have repos for each or maybe a wiki page?13:40
davidcalleogra_: (I've noticed your forum posts on images, but wondering about other places you might have)13:41
ogra_davidcalle, a wiki is still on my TOD (just didnt get to that yet) ... images are in my people.u.c home at http://people.canonical.com/~ogra/snappy/all-snaps/daily/current/ ... gadgt source is at my GH account, kernels are scattered around between GH and launchpad13:42
ogra_i need to do some cleanu for the kernels ... and eventually give ppisati a patch for the allwinner support13:42
ogra_davidcalle, i'll try to get to the wikipage over the NYC week and then we can look how/if we link it from some official place13:43
ogra_are you at the rally ?13:43
davidcalleogra_: I think the boards page can be the right place for these (with an official/community images distinction)13:44
davidcalleogra_: no, I won't be in NYC13:44
sergiusensogra_ ppisati so my suspicion is that it feels stuck given the size of the source, we need a nice spinner to show it is not stuck, if you go the envvar path and using a local lxd remote (default), then you get nice bind mounts instead which would speed things up and not pollute your environment and if it is the first run it would feel as close as a13:46
sergiusens cleanbuild can feel13:46
pedronisniemeyer: do you have time for a quick chat today? I'm writing some notes for a topic for next week and I would like a sanity check that I'm not thinking not useful stuff13:50
niemeyerpedronis: Definitely13:50
pedronisniemeyer: now? or in a bit?13:51
niemeyerpedronis: My calendar is quite open today13:51
niemeyerpedronis: Now works13:51
pedronislet's do now13:51
pedronisthen13:51
niemeyerpedronis: Ok, coming back to the standup13:51
ppisatisergiusens: ah, if i wait long enough, the builds finally start - sorry for the noise... :|14:00
sergiusensno worries, ppisati if you want, feel free to log a bug that it feels stuck and we will sort it with proper feedback14:01
* zyga-ubuntu checks 14.04 support 14:05
zyga-ubuntua few more tweaks and unit tests and I'll propse NFS14:06
bladernrHow does one get aliases defined in snapcraft.yaml to work?14:06
bladernrfor example, if I have this: usb-only:14:07
bladernr    command: bin/usb-only14:07
bladernr    plugs: *standard14:07
bladernr    aliases: [usb-only]14:07
pedronisbladernr: that's a deprecated approach, next version of snapcraft will say as much14:07
bladernrOK, but I'm not developing on the enxt version of snapcraft, I'm using the snapcraft available today.14:08
bladernre.g. 2.3414:08
pedronisbladernr: that's not relevant, since snapd from 2.26 will ignore that field14:09
pedronisbladernr: the new world is described here:  https://forum.snapcraft.io/t/improving-the-aliases-implementation/1814:09
pedronisbladernr: automatic aliases are something now only controlled through the store14:09
pedronisbladernr: you'll just need to make a forum request about the aliases you need14:09
pedronisbladernr: see the last session in that forum topic14:10
pedronissorry14:10
pedronissection14:10
bladernrand what If I don't want to distribute via the ubuntu snap store?  For developpment purposes, I want to distribute the snap from a local store on my MAAS server.14:10
bladernrbecause uploading a snap to the ubuntu tore takes me upwards of 30 minutes each upload14:11
bladernror 5 seconds locally14:11
roadmrbladernr: even with delta uploads?14:11
pedronisbladernr: what's a local store?14:11
bladernrroadmr - no idea what that is.14:11
roadmrbladernr: snapcraft should automagically upload just the delta between your last upload and the current one14:11
mupPR snapd#3953 opened: snap-confine: fix base snaps on core <Created by mvo5> <https://github.com/snapcore/snapd/pull/3953>14:11
bladernrpedronis, I want to serve snaps locally for my maas server (this is orthogonal to the alias question).  I just want to push a snap to my maas server and then on a node, snap install from my maas server14:12
bladernrI work around that nowy with a bunch of scp14:12
pedronisbladernr: well if it's supported local store it will still use the same mechanisms14:12
roadmrbladernr: you do that in a script presumably?14:12
roadmryou'd have to "it's possible for the user the setup manual aliases under their control:"14:12
bladernrsigh...14:12
pedronisthere will be a store level decclaration14:12
pedroniscoming from the main store14:13
pedronisor local (but that is not designed yet at all)14:13
bladernrOk, it seems maybe my expectations are too high.14:13
bladernrLet me start from the beginning... I have a snap, I want ot put that snap on a node behind my MAAS.  What is the way to do that? Do I upload to the ubuntu sture and dhen download it locally?14:14
bladernrerr... by download, I mean snap install blah on my node.14:14
pedroniswe are working on proxy store that can be setup localy14:15
pedronisbut yes for a while all snaps will go through the main store14:15
bladernrSo in the future, assuming I start using snaps exclusively for my work, a local, standalone distribution point is a hard requirement.  I CAN NOT depend on some internet based snap store.14:16
bladernrwill that proxy store replace the stuff that's documented now for local hosting but doesn't work anylonger?14:16
pedronisyes14:16
bladernre.g. the stuff at the bottom of https://snapcraft.io/docs/core/store14:16
bladernrahhh ok14:16
bladernrthat will help then14:16
pedronisfirst version will do proxying/caching  and some local control14:17
bladernrunfortunately, most of my customers are in segregated environments that likely have zero internet connectivity.14:17
pedronisbut it will grow more features over time14:17
pedronisbladernr: you probably want to talk to people driving that about your requirements14:17
bladernrpedronis, ahh thanks.14:19
cachiois it possible to create a branch on snapd with the same content we have on edge channel?14:23
cachiomvo, ~14:24
roadmrcachio: a branch on snapd? (I think it's possible but I may be unclear about what you want)14:24
cachioroadmr, I need a branch with the same content than the core snap on edge channel14:25
roadmrcachio: ah, the *core* snap.14:26
roadmrcachio: do you know which revision of the core snap that is? (as in, that sequential revision/upload number you get)14:26
mvocachio: that should be lp:snapd-vendor14:26
mvocachio: well, roughly, let me double check14:26
roadmrcachio: (does mvo's answer work for you? I may be talking about different kind of branch here haha)14:27
cachioroadmr, yes, mvo has the solution :)14:28
roadmrawesome! disregard me then :)14:28
zyga-ubuntu+ exportfs -r14:30
zyga-ubuntuexportfs: localhost:/srv/nfs: Function not implemented14:30
zyga-ubuntuhmmm14:30
* zyga-ubuntu fires up 14.04 to experiment with nfs14:30
cachiomvo, I got it, I'll implement the change to clone that repo instead of the github one14:33
cachiomvo, that, when we run on edge14:34
mupPR snapd#3954 opened: snap: introduce structured epochs <Created by chipaca> <https://github.com/snapcore/snapd/pull/3954>14:38
Chipaca^^ tadaa ^^14:38
Chipacanow to take a break, have some tea, and then fix some tests14:38
zyga-ubuntuenjoy :)14:38
=== JanC_ is now known as JanC
=== JoshStrobl|Store is now known as JoshStrobl
=== chihchun is now known as chihchun_afk
ondramzanetti ping14:59
=== chihchun_afk is now known as chihchun
mvomzanetti: re the ipv6 problem that ondra told me about, I wonder if it makes a difference if you set "GODEBUG=netdns=cgo" in /etc/environment, i.e. if that changes the behaviour15:05
pstolowskimvo, hey, i'm getting http://pastebin.ubuntu.com/25586715/ with master, do we have a new dependency or something?15:13
naccso i have a rather urgent, but perhaps obvious, classic snap question. We are building git-ubuntu on LP usingn artful. However, the core snap is (aiui) still 16. The python3 in artful is now linnked against the new glibc in artful, and (looking at unsquashfs -l), even though it's a dependency, the artful glibc is not in my snap. How isthis supposed to work on xenial, e.g. Even on artful, potentially.15:17
nacci get messages like: /snap/git-ubuntu/x1/usr/bin/python3: relocation error: /snap/git-ubuntu/x1/lib/x86_64-linux-gnu/libdl.so.2: symbol _dl_catch_error, version GLIBC_PRIVATE not defined in file libc.so.6 with link time reference15:17
nacci'm 'faking' PATH/LD_LIBRARY_PATH confinement in my snap15:18
naccalso what's odd is that if I have the CORE_SNAP default library paths first in LD_LIBRARY_PATH, it works fine, but then stuff I've installed in my snap (e.g., xz) fail, because the xz from the core snap is a different version than the one in artful15:18
naccconfusingly, right now, the snap segfaults on artful hosts! ... i think this is all tied together, but i'm not sure15:20
mvopstolowski: hm, with master - strange. what machine is failing? 14.04?15:21
abeatomvo, hi, is it possible to explicitly define the writable partition in gadget.yaml? it is not usually defined: http://paste.ubuntu.com/25586755/15:21
Chipacanacc: why are you building on artful?15:22
naccChipaca: i need newer dependencies than are on artful15:23
nacc*that* are15:23
nacc(e.g., git from artful, etc.)15:24
pstolowskimvo, 16.04, it's my xenial system15:24
Chipacanacc: can't you pull them from git or something like that?15:24
naccChipaca: i'm trying to make sure what we build (e.g., dpkg) is built exactly like the debs, this is for working on source package uploads to Ubunut15:25
nacc*Ubuntu15:25
naccChipaca: if the answer is that I shouldn't be using the Artful option, I really think it should be disabled in LP15:25
Chipacanacc: if the libc in artful diverges, then yes, I don't think you should be building on artful15:26
Chipacanacc: but … maybe i'm wrong, maybe there's a trick to it that sergiusens or mvo know about?15:26
naccChipaca: that seems ... horribly broke15:27
naccChipaca: right? that it's even an optio?15:28
naccI don't see how it can work :)15:28
naccI'm also very confused why LD_LIBRARY_PATH's order (core snap libs then my snap's libs) works but the other order (with the same contents!) fails15:28
Chipacanacc: wrt it being an option, you could be building a snap that doesn't use the libc, for example15:29
naccChipaca: unless you recurse and ensure that nothing you depend on uses libc, it doesn't work15:30
ogra_nacc, if you reallly are artful i'd suggest to go artfull all the way and simply drop the core snaps LD_LIBRARY_PATH completely15:30
naccChipaca: e.g., i'm using the python3 from artful (apparnetly, even though it's a dependency of my stage-packages, not explicitly listed)15:31
ogra_(and indeed ship *all* yu need in your snap)15:31
naccogra_: doesn't work15:31
naccogra_: there's *no* libc in my sap15:31
nacc*snap15:31
ogra_ship one ;)15:31
naccogra_: so i have to explicitly list every dependency?15:31
ogra_(might need some hacking since snapcraft willl ty to strip it out)15:31
naccand every depdendency of every dependency15:31
Chipacanacc: it sounds to me like your issue is more with snapcraft that snapd15:31
Chipacanacc: may i suggest you try the rocketchat?15:31
naccChipaca: i have non idea where it is :)15:32
Chipacanacc: rocket.ubuntu.com/channel/snapcraft15:32
Chipacamore snapcrafters there15:32
naccChipaca: ok15:32
Chipacanacc: wrt recursing and ensuring, yes, you are responsible for all your dependencies15:32
naccChipaca: i feel like htat's pretty false advertising :)15:33
naccChipaca: as obviously if i'm installing python3-keyring from artful, i want python3 from artful which wants libc from artful15:33
Chipacanacc: what part is false advertising?15:33
naccChipaca: what I just said -- i'm asking for a package to be staged, which obviously means its dependencies15:34
Chipacanacc: right, you're talking about what you tell snapcraft and what it does15:34
Chipacanacc: i'm saying, it's your responsibility to get all the dependencies into the snap15:34
naccyeah, that's the false part (to me). i'll ask in rocket15:35
naccChipaca: yep, i get that15:35
naccI thought I was! :)15:35
Chipacanacc: yeah15:35
Chipacanacc: snapcraft might not support doing that, or there might be a flag for "ship all of libc" that defaults to 'no'15:35
ogra_yeah15:35
ogra_snapcraft has a blacklist for some packages15:35
Chipacain the early days there was a long list of what is libc, that was skipped for packing15:35
* zyga-ubuntu scratches head with nfs on trusty15:35
ogra_libc is ne of them iirc15:36
naccChipaca: yeah, i can see that15:36
Chipacabut i haven't kept up; it might be smarter today15:36
naccbut the LP builder needs to be smarter, it feels like15:36
Chipacaat least a flag should be doable :-D15:36
naccor somethingn does :)15:36
Chipacanacc: snapcraft, probably15:36
naccyeah15:36
Chipacaif we want this to work at least15:36
naccI guess that's true15:36
ogra_but using artful packages is a bad idea in general ... and in classic even wrse15:36
Chipacanacc: of course, the promise-the-sky answer is that what you want is an artful _base_15:36
Chipaca:-)15:36
naccChipaca: right exactly15:37
naccand honnestly, at first, that's what i thought i was goingn to get15:37
naccbuild o artful, use artful as your base15:37
Chipacanacc: bases aren't there that15:37
Chipacathere yet*15:37
ogra_yea15:37
naccChipaca: ok15:37
ogra_thats still a bit out15:37
mvo2.28 will have basic support! 2.29 will be better15:37
ogra_but we wont have usable base snaps yet15:38
Chipacawoo!15:38
Chipaca10 GOTO 1015:38
* Chipaca snaps that15:38
ogra_even idf snapd can handle them15:38
Chipacamvo: i'll leak that bit of info to whoever it was said we supported android os15:38
ogra_(and my bet is also that we wont look into having an artful base as first thing)15:38
naccyeah15:38
naccwell, it was just surprising, this all worked just until libc moved15:39
nacc(in artful)15:39
mvoChipaca: *cough*15:39
naccso i hadn't considered any of this :)15:39
zyga-ubuntudarn, that was easy, nfs was just disabled on startup15:39
Chipacamvo: <mvo> 2.28 will have basic support!15:39
Chipacamvo: you can't take it back now15:39
Chipacanacc: sorry :-( good thing artful's release is ages away still right?15:39
ogra_Chipaca, 10 print hello; 20 goto 1015:39
naccChipaca: well, the snap is already published :)15:40
naccChipaca: and was working until yesterday15:40
naccwhen it happened to rebuild with the new libc15:40
nacci think, at least15:40
Chipacai wonder how many other (classic) snaps are now dead15:40
naccyeah15:40
ogra_blame infinity !15:40
naccwell, i don't know if anyone was 'clever' like me :)15:40
* ogra_ bets many people were 15:40
Chipacawell, 1. classic snap, 2. built on artful15:41
nacccjwatson: may be able to tell us if it's searchable15:41
nacc(from a LP admin view, that is)15:41
* ogra_ just had a discussion this week about LP offering artful builds ... 15:41
naccogra_: as in, it shouldn't? :) or what was the discussion?15:42
ogra_seems you are the first one being hit by it :)15:42
cjwatsonnot easily searchable15:42
nacccjwatson: ok, thakns15:42
ogra_nacc, yeah, my pinion was that it shouldnt15:42
naccor it should't until bases are available that correspond, i guess15:42
ogra_but in the end the thing we discussed was a test build... nothing to be released (who would do that anyway :) )15:42
nacclol15:43
ogra_Chipaca, given that cllassic will also mix-mesh with the actual host rootfs i wnde if artful classic snaps woulldnt even be broken when theer are base snaps available15:44
ogra_*wonder15:44
naccogra_: yeah i had to write my own wrappers (expected) so that everythingn was in my snap or the core snap15:44
nacclibs and binaries15:44
ogra_yeah15:44
nacca few other classic snappers have blogged the same (incl. didrocks)15:45
ogra_well, you can always use some wget and dpkg -x to actually squeeze the artful libc in from a scriptlet ... not sure what the outcome would be thouogh15:45
naccheh15:45
naccyeah15:46
ogra_most likely i gigantic snapcraft.yaml but perhaps a working snap in the end15:46
ogra_s/i/a/15:46
ogra_might end up like a multi page novel15:46
pstolowskimvo, weird. I had to install libc6-dev-i386 and it works again. did anything change?15:48
mvoChipaca: lol15:48
mvopstolowski: yeah, but that is part of the new build-depends15:48
naccogra_: yeah, that's what i'm worried about :)15:48
mvopstolowski: we build a i386 syscall test runner now on amd64 to test secondary arch syscall support15:48
ogra_nacc, btw, did you try to drop things like xz from the snap to get around the difference you described initially ?15:49
pstolowskimvo, ok, makes sense. i should have looked at build-depends.. thanks15:49
naccogra_: if i do that, xz will fail (the versionin the core snap is too old for gbp)15:49
naccogra_: well, gbp will fail, rather15:49
naccogra_: the stuff i've added is stuff that is too old in the core snap15:50
naccogra_: so i could do that, and then the snap becomes less useful15:50
ogra_ah15:51
naccogra_: goes back to why i'm buildinng on artful in the first place :)15:51
Chipacapstolowski: that's what my going on about "apt build-dep ./" was15:55
Chipacabrb15:56
pedronismvo: I pushed some tweaks to #3935 , probaly merit a check/recheck15:57
mupPR #3935: cmd/snap-repair: implement the repair run loop <Created by pedronis> <https://github.com/snapcore/snapd/pull/3935>15:57
mvopedronis: great, I have a look15:57
=== chihchun is now known as chihchun_afk
naccsergiusens: how do you know the apt you are bulidig doesn't also need a newer dpkg in snapcraft's snapcraft.yaml ?16:10
naccbased upon what you said, you should also be building dpkg from src, no?16:10
naccit feels like that if one is make a classic snap, one should simply not use stage-packages at all, as those come from teh build env (or one should only build on the same build env as the core snap, which is not an explicit binding in the yaml)16:13
ogra_well, the latter is the expectation16:14
naccright, but that should be a hard rule then16:14
ogra_whioch is why you should always use cleanbuild ... because this makes sure to use the right env16:14
naccyeah16:14
kalikianaelopio: Could you give https://github.com/snapcore/snapcraft/pull/1382 another look? I apologize for the messy diff... branch is okay locally16:15
mupPR snapcraft#1382: rust plugin: make libc configurable <Created by kalikiana> <https://github.com/snapcore/snapcraft/pull/1382>16:15
ogra_(and by default LP as well as build.s.io both default to xenial only builds)16:15
naccogra_: yep, i get that -- this just makes our snap so cumbersome as to possibly make it not worth my time and I should just make a .deb instead16:15
* kalikiana really hates git sometimes when a simple thing in bzr becomes a huge mess in git16:15
ogra_kalikiana, you mean like *every freaking command* ?16:16
sergiusensnacc so, following in up here, the only reason this is a snapcraft problem is because snapd hasn't gone down the hard path of injecting library path through the linker and overriding the chosen linker to use to load (all hard things)16:17
naccsergiusens: i don't know, is that true?16:17
sergiusensnacc that said, zyga-ubuntu did most of the initial work on classic so should be aware of the limitations16:17
naccsergiusens: becuase afaict, there is no artful libc in either my snap or the core snap16:17
naccsergiusens: so even if the loader was updated, i have to somehow get libc from artful into my sap16:17
ogra_sergiusens, well, snapcraft would still prevent your snap from shipping another libc, wouldnt it ?16:17
kalikianaogra_: Yeah, kind of. Sometimes even typos in 'git add'. Rebase especially because there's no snaity checks or defaults16:18
sergiusensnacc and last but not least, we came up with the idea that all runnables should be compiled through snapcraft, it sort of doesn't matter where as we ensure the linker from the core snap gets picked and restrict library loading through rpath16:18
naccsergiusens: right, but your example (snapcraft itself) does't compile dpkg16:18
naccwhich apt runs16:18
ogra_kalikiana, i know what you mean ... after using git for a while i get along but it is still making me want to throw my laptop out of the window regulary16:18
naccso I don't have a good example yet16:18
nacckalikiana: i suggest usign `git add -i`16:19
sergiusensnacc ah, ic your point now16:19
nacckalikiana: less chance of typos16:19
naccsergiusens: and so i have to manually (it seems) recurse to the lowest level of every dep and build those all by hand? what's the pointn :)16:19
sergiusenskalikiana sometimes, if rebases get hard, from master: `git checkout -b new-branch; git merge --squash old-branch; git brand -D old-branch`16:20
ogra_or just convince upstream to use bzr :)16:20
sergiusensnacc I never said I liked classic, the work was dumped on me to get it working without even consulting with me ;-)16:21
ogra_classic is an ugly wart ...16:21
naccsergiusens: right but it's there, and either should work, or should have large alarms for stuff that's fundametnally broken, or should be disabled :)16:21
* sergiusens blames zyga-ubuntu16:21
elopiokalikiana: sure16:21
sergiusenshe said it was going to be easy ;-)16:21
ogra_it is the equivalent of slef containing tarballs you dump into /opt ... just with a proper update mechanism16:21
sergiusensnacc right, but we also only really support building on xenial16:21
nacckalikiana: are you sayign there aren't actually 136 commits between you and the target branch?16:21
naccogra_: yep, i agree16:22
kalikianasergiusens: I actually did that, well using 'git am', because rebase took an old copy of master, rebasing of which would've introduced conflicts in files I never touched16:22
naccogra_: really, i don't need to be a classic snap (although that wonn't solve this problem), I just ened to be able to write anywhere o the disk the user tells me to and have network16:22
ogra_so just make your "tarball" contain *everything* ;)16:22
kalikiananacc: 'git log' shows me 8 commits on top, which is my actual changes, and the diff affects 4 files16:23
zyga-ubuntusergiusens: what? :)16:23
nacckalikiana: oh i see what you did16:24
nacckalikiana: snapcraft:rust-musl is 128 commits behind master16:24
nacckalikiana: so you rebased onto master? which was definitely wrong16:24
nacckalikiana: you should have rebased onto snapcraft:rust-musl16:24
ogra_nacc, just make your snapcraft.yaml wget http://cdimage.ubuntu.com/ubuntu-base/daily/current/artful-base-amd64.tar.gz ... unpack it from a prepare scriptlet and do the rest on top ;)16:24
naccright, but *every* classic snap on artful shold be doing htat16:25
ogra_no16:25
naccif they use libc, that is16:25
ogra_not if it isnt *built* on artful16:25
naccsorry, that's what i meant by 'on artful'16:25
ogra_:)16:25
nacc*built on nartful16:25
nacc*artful16:25
ogra_nerdful :)16:25
naccor any non-xenial, really16:25
naccit should use the corresponding base image16:26
naccbut is that really sane to do?16:26
ogra_yes, but we dont have that yet ... the tarball above would be a workaround though16:26
naccyeah16:26
naccok, i'll try that first before going down the path of rebuilding everything16:26
ogra_well, it is as sane as the whole classic concept16:26
nacclol16:26
ogra_:)16:26
naccalso i find it frustrating that i have to use VMs to build artful snaps (cleanbuild just doesn't have any optio)?16:27
nacc(e.g., it should take a lxd-profile)16:27
ogra_well, you should simply not use artful until we have a base snap for it16:27
ogra_else ... there is the path through the hoops -> ...16:28
naccok16:28
kalikiananacc: I don't follow - this is rust-musl, and I wanted to rebase it onto master... I don't see how I rebase on the same branch...?16:28
naccI mean, I won't be able to convince anyone who has bought into snaps 100% that this is insane :) I know that16:28
ogra_the really really awesome thing is ... snapcraft will actually let you do this :)16:28
naccogra_: but yeah, that is nice16:28
naccat least there is a workaround16:28
ogra_you might end up with a giant snap and a 70page snapcraft.yaml ... but it will definitely be possible in the end16:29
nacckalikiana: https://github.com/snapcore/snapcraft/pull/1382 says you are merging from kalikian:rust-musl to snapcore:rust-musl16:29
mupPR snapcraft#1382: rust plugin: make libc configurable <Created by kalikiana> <https://github.com/snapcore/snapcraft/pull/1382>16:29
nacckalikiana: not snapcore:master16:29
nacckalikiana: also *your* rust-musl is not snapcore's rust-musl16:29
naccdistributed development ftw16:29
sergiusensmerge and rebase are different; if you look at the command I gave out, it is much easier to operate if you don't want to replay the commits on top of the new base and just squash instead16:30
kalikiananacc: Hmm interesting. How did that even get there. There's not supposed to be any branch like that - there's only master, and I proposed rust-musl, based on master... *scratches head*16:30
kalikiananacc: Ha, changing the base branch fixes it! Awesome that you pointed this out!16:32
kalikianaelopio: Mess fixed :-D ^^16:33
kalikianaOn a side note, this is working wonders for my headache, great distraction16:34
naccsergiusens: you can do that with interactive rebase16:35
naccsergiusens: which i would suggest over merge16:35
naccsergiusens: and 'merge' in github terminology can be FF16:35
nacc(well git terminology, but the PR/MP model)16:35
nacckalikiana: yw16:37
sergiusensnacc oh yeah, but replaying the first commit my make you scratch your head if the following ones are where you fixed things16:38
naccsergiusens: true, yeah, i don't know the details in this case16:38
naccsergiusens: i tend to do iterative development with wip commits (possibly with where they need to be squashed to), then innteractive rebase, squash appropriately16:38
sergiusensnacc from the name, it is a month old branch, so many things have changed :-)16:38
naccsergiusens: yeah :)16:38
* sergiusens gets started with lunch16:43
kalikianaelopio: wrt #1530 I really don't know what to make of your phrasing... you sound doubtful if it's worth it, and you had doubts before... how am I supposed to see value in it? :D16:44
mupPR #1530: asserts: add cross checks for snap asserts <Created by pedronis> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/1530>16:44
kalikianaerm that was supposed to be https://github.com/snapcore/snapcraft/pull/153016:45
mupPR snapcraft#1530: tests: share the cache dir in the integration suite <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1530>16:45
pedronismerging stuff today seems a bit hopeless16:51
=== chihchun_afk is now known as chihchun
Chipacaok, dinner etc17:25
* Chipaca goes17:25
kalikianaelopio: kyrofa https://github.com/snapcore/snapcraft/pull/1348 would appreciate another look17:26
mupPR snapcraft#1348: repo: setup a foreign arch and sources <Created by kalikiana> <https://github.com/snapcore/snapcraft/pull/1348>17:26
zyga-ubuntueh18:25
zyga-ubuntugithub18:25
* kalikiana concludes tonight, as headache gets too bad to work, and investigating why inside lxd 'fuser /var/lib/apt/lists/lock' doesn't seem to work as expected is proving tedious18:58
=== ikey|zzz is now known as ikey
kyrofaelopio, I have an odd request: any chance you have a fedora VM lying around?19:25
kyrofaOr really anyone: I could use SSH access to a fedora machine for a few minutes19:29
kyrofaStupid under-powered eeepc19:31
kyrofazyga-ubuntu, I saw a forum post from you about your setup. Any fedora installs on there?19:32
zyga-ubuntuyay, so tests pass19:32
kalikianakyrofa, wouldn't be surprised if Pharaoh_Atem had one for you19:33
zyga-ubuntukyrofa: hey, one but not wired (I use it for various things)19:33
zyga-ubuntukyrofa: what would you find useful?19:33
zyga-ubuntukyrofa: I can set something up and give you an account19:33
kyrofaArgh, Pharaoh_Atem you need a consistent handle :P19:33
kyrofazyga-ubuntu, I just want to try running a snap on it19:33
zyga-ubuntukyrofa: any arch will do?19:34
kyrofaamd64 if possible19:34
zyga-ubuntukyrofa: I need to find some ram sticks but I can prepare a machine for tomorrow19:34
zyga-ubuntukyrofa: that's easiest19:34
kyrofazyga-ubuntu, ah, I need it tonight. You know, now that I bring it up, I bet DigitalOcean has me covered19:36
zyga-ubuntukyrofa: do you have access to spread?19:36
kyrofazyga-ubuntu, thank you for being willing, though!19:36
kyrofaI do19:36
zyga-ubuntukyrofa: my pleasure, I'll try to set one up anyway, maybe over weekend19:36
zyga-ubuntukyrofa: just spawn our F25 box19:36
kyrofazyga-ubuntu, ah! It's been a while, what command would that be?19:37
zyga-ubuntukyrofa: hmm, copy spread.yaml from snapd19:40
zyga-ubuntukyrofa: yank everything but the fedora linode system19:41
zyga-ubuntukyrofa: remove all the prepare stuff, essentially gut it19:41
zyga-ubuntukyrofa: add foo/task.yaml with summary line19:41
zyga-ubuntukyrofa: and see what "spread -list" prints19:41
kyrofazyga-ubuntu, alright, good deal, thanks!19:42
zyga-ubuntukyrofa: then19:43
zyga-ubuntukyrofa: spread -shell linode:fedora-25-65:foo19:43
zyga-ubuntukyrofa: that *should* give you a shell quickly19:43
zyga-ubuntukyrofa: I can prepare a working spread.yaml if you want19:43
kyrofazyga-ubuntu, if you have a sec, that would be greatly appreciating, I have a meeting now19:44
kyrofaHuh. Grammar is not my skill today19:44
zyga-ubuntukyrofa: on it19:51
sergiusenskyrofa digital ocean ftw ;-)19:53
sergiusensthen you get to control all the toggles19:54
zyga-ubuntukyrofa: testing now19:56
zyga-ubuntukyrofa: niiiiiice19:59
zyga-ubuntukyrofa: let me test other systems and I'll give you a working gist20:01
zyga-ubuntuoooooh20:06
zyga-ubuntuf***********20:06
* zyga-ubuntu needs to restore from backup20:06
zyga-ubuntuI removed my snapd tree20:07
zyga-ubuntualong with all the code I was working on20:07
zyga-ubuntuDARN20:07
zyga-ubuntuI copied a symlink20:07
* zyga-ubuntu is pretty upset now20:09
zyga-ubuntudarn, I wonder if my backup worked20:10
zyga-ubuntuI suspect it's a few days old at least at a weekly schedule20:10
zyga-ubuntukyrofa: that's for you http://paste.ubuntu.com/25588274/20:13
* zyga-ubuntu needs to look at his backup20:13
sergiusenselopio mind taking a look at snapcraft#1564 ?20:40
mupPR snapcraft#1564: setup: changes to make installable from PyPI <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/1564>20:40
mupPR snapcraft#1564 opened: setup: changes to make installable from PyPI <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/1564>20:40
=== JoshStrobl is now known as JoshStrobl|zzz
sergiusenselopio also what mup will show in a bit please :-)21:13
mupPR snapcraft#1565 opened: cli: add the assemble command <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/1565>21:13
jdstrandroadmr: hi! can you sync r933 of the review tools? not urgent; only changes are additions to overrides.py21:40
roadmrjdstrand: sure! note it's unlikely to make it to prod until after next week's rally :/21:41
jdstrandroadmr: that's totally fine21:41
roadmrjdstrand: whee :) see you there I expect?21:41
jdstrandroadmr: you bet! :)21:44
Pharaoh_Atemkyrofa: ?22:12

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!