/srv/irclogs.ubuntu.com/2017/05/03/#snappy.txt

=== chihchun_afk is now known as chihchun
mupPR snapcraft#1295 opened: Record build packages <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1295>06:34
zygagood morning06:57
* zyga has reproduced the issue affecting debian06:57
zygalocally06:57
zyga(finally)06:57
zygamorphis: thanks for your help, I'll either contribute a debian-creation script to autopkgtest or vendorize it to build spread images in my repository06:58
morphiszyga: np, which issue did you reproduce exactly?06:58
morphisthe hanging configure hook?06:58
zygamorphis: yes07:01
zygamorphis: essentially I only got the image created late last night and I left it at the spread -debug prompt07:01
morphiszyga: that one happens on a regular debian installation with snapd installed from the archive07:01
zygayes, I'm replying on the forum07:01
morphiszyga: this really much looks like we miss something in 2.24 which was fixed in 2.23.607:02
zygamorphis: hmm07:06
morphiszyga: interesting, however we broke distros like debian with this which would validate a hotfix for 2.24 and again proves that we always have to release snapd and a core snap in sync07:06
zygamorphis: wait07:07
zygamorphis: I'm 100% sure mvo merged all of 2.23.x into 2.2407:07
zygamorphis: what this 2.24 sems to be lacking is a timeout on the hook07:07
zygamorphis: or a way to let it fail07:07
zygamorphis: this VM is up for 10 hours now07:07
morphisand the hook is still running?07:08
zygamorphis: and the hook is up for 10 yours still07:08
zygamorphis: yep07:08
zygamorphis: let's check the 2.24 tree to be sure we're not missing anything07:08
morphisok07:09
zygaspineau: good morning :)07:09
zygamorphis: I found one small bug btw07:10
spineauzyga: morning zyga07:10
zygain spread setup07:11
zygamorphis: PR coming up in a sec, just describing it07:12
zygamorphis: https://github.com/snapcore/snapd/pull/326407:15
mupPR snapd#3264: tests: remove quoting from [[ ]] when globs <Created by zyga> <https://github.com/snapcore/snapd/pull/3264>07:15
zygamorphis: and https://github.com/snapcore/snapd/pull/326507:15
mupPR snapd#3265: spread: add spread target qemu:debian-9-64 <Created by zyga> <https://github.com/snapcore/snapd/pull/3265>07:15
zygamorphis: now to investigate 2.2407:15
mupPR snapd#3264 opened: tests: remove quoting from [[ ]] when globs <Created by zyga> <https://github.com/snapcore/snapd/pull/3264>07:15
mupPR snapd#3265 opened: spread: add spread target qemu:debian-9-64 <Created by zyga> <https://github.com/snapcore/snapd/pull/3265>07:15
zygamorphis: signed off is a personal preference, I just think it is important as a declaration of intent, there is no formal requirement to use it07:29
morphiszyga: yeah it is, but what are you signing off?07:30
morphisfor the kernel its clear but for other projects its not unless explicitly stated somewhere07:31
zygamorphis: oh, right, I do use the same semantics07:31
zygamorphis: I think there is no other well-known semantics for that line07:31
morphisit normally refers to https://developercertificate.org/07:31
zygayep, (though I think I read that elsewhere, I wasn't aware of this domain before)07:32
morphiszyga: I think the linux foundation has its own copy of this07:34
morphisjust wasn't sure what this means in the context of snapd as we have the CLA too07:34
zygamorphis: I think it formally does nothing but I really wish we had it over the CLA :)07:35
zygamorphis: so 2.24 should have a timeout07:35
zygamorphis: so checking WTF07:35
morphiszyga: however, should we go in the meantime with https://github.com/snapcore/snapd/pull/3259 to get all other PRs unblocked?07:39
mupPR snapd#3259: tests/upgrade: force install core snap from beta for debian <Created by morphis> <https://github.com/snapcore/snapd/pull/3259>07:39
zygamorphis: yes07:39
zygaI'll merge it now07:40
morphisok07:40
morphisthanks07:40
mupPR snapd#3259 closed: tests/upgrade: force install core snap from beta for debian <Created by morphis> <Merged by zyga> <https://github.com/snapcore/snapd/pull/3259>07:40
zygaok, let's merge master into some PRs and get some breakfast :)07:41
morphis:-)07:41
zygaok, done07:47
zygamorphis: thank you, sorry for taking so long to merge this :)07:47
zygamorphis: I'll open a new thread to investigate the hook timeout issue07:47
morphiszyga: why not reusing the one we already have?07:47
zygahttps://forum.snapcraft.io/t/hook-timeout-mechanism-not-working-in-2-24/46407:49
zygamorphis: separate topic07:49
zygamorphis: I linked them though07:49
zygahmmm07:54
zygaso I removed overlord/hookstate/Context.timeout (field in the struct) and no test captured that, looking deeper07:54
zygaok, breaking this to really eat something...07:57
draglySorry for the basic question, but I am a bit confused after the folder structure changed:08:23
draglyIf I have "snapcraft.yaml" in a folder named "snap", should "setup/gui/app.desktop" be inside "snap" as well?08:23
draglyI moved most files into the "snap" folder after snapcraft told me "plugins" should reside there.08:24
mwhudsonhi so https://bugs.launchpad.net/ubuntu/+source/subiquity/+bug/165725408:33
mupBug #1657254: console-conf - unable to connect over proxy <subiquity (Ubuntu):Confirmed> <https://launchpad.net/bugs/1657254>08:33
mwhudsonso the ui side is pretty easy08:33
mwhudsonbut once the user has provided a proxy, the thing to do is stick it in /etc/environment and systemctl restart snapd?08:34
zygamwhudson: probably,yes08:34
Chipacazyga— o/08:38
Chipacazyga— you're feeling like finishing a review today? :-D08:38
Chipacazyga— snapd#3264 is gtg once green, but random tests are failing in debian?08:41
mupPR snapd#3264: tests: remove quoting from [[ ]] when globs <Created by zyga> <https://github.com/snapcore/snapd/pull/3264>08:41
zygaChipaca: hey08:47
zygaChipaca: wrt 3264 yes, I'll merge master to fix it but spread is already overloaded08:47
zygaChipaca: yes, I do feel like code reviews but I want to get to the bottom of hook timeout not working first08:48
zygaChipaca: how are you doing? :)08:48
Chipacajdstrand— snapd#2969 has conflicts08:50
mupPR snapd#2969: interfaces: mediate netlink sockets via seccomp <Created by jdstrand> <https://github.com/snapcore/snapd/pull/2969>08:50
Chipacazyga— doing alright i think08:50
Chipacafinally got an appointment with physio wrt my back (nhs physio takes ages)08:51
Chipacaso hopefully i'll have that fixed and be able to get back to running soonish :-)08:51
zygaChipaca: I hope you will08:53
Chipacazyga— what was the cause (and fix) for “hsearch_r failed for |S_IFREG: No such process”?08:58
zygaChipaca: snap-confine from distro used when profile was made by snapd from core snap09:03
zygaChipaca: where are you seeing tihs09:03
* mwhudson reads the code systemd uses to process EnvironmentFile= directives...09:04
* Chipaca hugs mwhudson 09:04
Chipacawhy would you do this to yourself09:04
mwhudsonthe documentation is lacking09:04
Chipacazyga— running snapd from master09:04
Chipacazyga— on my dev laptop09:04
zygaChipaca: hmm hmm09:04
zygaChipaca: self built deb?09:04
zygaChipaca: build&install snap-confine09:05
Chipacazyga— no deb09:05
zygaChipaca: it'll help09:05
zygaChipaca: tip: make hack09:05
Chipacaah09:05
zyga(in cmd/)09:05
Chipacazyga— you've probably got the autoconf invocation in your bash history; care to share?09:05
zygaChipaca: ./autogen.sh09:06
zygaChipaca: make hack :)09:06
zygaChipaca: that's all you need09:06
Chipacathat had a lot more options before09:06
Chipaca:-)09:06
Chipacawhoo. i like09:06
* Chipaca runs it again without -n09:06
zyga:D09:07
mupPR core-build#9 opened: Add writable boot for android-boot "bootloader" <Created by alfonsosanchezbeato> <https://github.com/snapcore/core-build/pull/9>09:07
Chipacazyga— that sorted it, thanks!09:08
mupPR snapd#3258 closed: cmd/snap-confine/tests: fix shellcheck on recently added files <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/3258>09:23
zygaChipaca: I found something fishy in 2.2409:40
zygaChipaca: can you look at (in master) overlord/hookmgr/context.go09:40
Chipacazyga— you want chips with that?09:40
zygaChipaca: ha, I wish :D09:40
zygaChipaca: the Context.timeout field is unused09:40
Chipacazyga— in master it's overlord/hookstate/context.go09:41
zygaChipaca: but Context.Timeout uses Context.setup.Timeout09:41
zygaah, right09:41
zygaso I know we have a test that checks hook timeouts09:42
zygabut I also see this reliably not time out in spread :/09:42
zygathe code there looks sane. I'll try to add debugging to see what really happens09:42
Chipacathe tests set Timeout on the setup also09:43
Chipacazyga— i reckon that timeout in the context is a leftover bugish09:46
zygayep09:47
Chipacazyga— do you have a snap that should time out and doesn't? for testing here09:47
zygaok, I'll start with 2.24 and focus on the test that checks it really works09:47
zygaChipaca: yes, upgrade/basic as of 07182f7b1b7f7679f9e32f1511cc1669179c90f809:48
zygaChipaca: but only on debian09:48
zygaChipaca: where we don't have apparmor09:48
zygaChipaca: if you look at 2eda8023ca28060e5a027822969399bfe89ee508 instead you can run this reliably in qemu09:48
zygaChipaca: though you need a qemu image09:49
zygaChipaca: (or via linode)09:50
Chipacazyga— what hook isn't timing out?09:50
Chipacaconfig? iface?09:50
Chipacadevice?09:50
zygaChipaca: the way I understand it, the upgrade/basic test installs 2.24 and upgrades to master09:51
zygaChipaca: so if 2.24 already had timeouts (and I think it does based on what I read) it should not hang with the hook there forever09:51
Chipacaifacestate does not set a timeout09:51
Chipacaneither does devicestate09:52
Chipacaonly config does09:52
Chipacaand it sets it to 5 minutes, overridable by SNAPD_CONFIGURE_HOOK_TIMEOUT environ09:52
Chipacaprepare.sh sets SNAPD_CONFIGURE_HOOK_TIMEOUT to 30s09:53
Chipacafor snapd09:53
zygaChipaca: configure on core09:53
zygaChipaca: and there is a timeout set, it's 5 minutes09:55
zygaChipaca: it hangs because seccomp is enabled and core-support is disconnected09:55
zygaChipaca: so seccomp kills part of snapctl09:55
zygaChipaca: that's all expected09:55
zygaChipaca: what is wrong is the timeout09:55
zygaChipaca: task logs does not show we even try to kill it09:55
Chipacahmm09:55
Chipacazyga— does it not timeout, or does the killemall or something after it hang?09:56
zyga_Chipaca: re, switched to mobile09:57
zyga_Chipaca: I'm uploading a debian spread image in case you want to try09:57
Chipacazyga— dunno if you saw my q about killemAll09:58
zyga_Chipaca: no, sorry09:59
zyga_Chipaca: lost in irc transition09:59
Chipaca<Chipaca> zyga— does it not timeout, or does the killemall or something after it hang?09:59
zyga_Chipaca: it does not, it just keeps waiting for it to run10:04
zyga_Chipaca: and according to my reading of the code, if it were timing it out the task log would say so10:05
zyga_Chipaca: look at...10:05
zyga_https://forum.snapcraft.io/t/tests-broken-in-master/457/1010:05
zyga_the tail of that10:05
zyga_Chipaca: the qemu image will be uploaded in 9 minutes10:05
Chipacai think it's all Son_Goku's fault10:11
* Chipaca hides10:11
zyga_Chipaca: https://www.dropbox.com/sh/7k7qdo82vjjscy7/AADu7UsMsYXd5NYExOysgSx9a?dl=010:13
=== zyga_ is now known as zyga
zygaChipaca: you can get that image there10:13
Chipacazyga— question: why not compressed?10:13
zygaChipaca: qcow210:14
Chipacai mean, i don't mind, my connection is fast enough :-)10:14
zygaChipaca: it is compressed :)10:14
Chipacabut your upload is slow10:14
zygaChipaca: I was just _uploading_ that :)10:14
zygaChipaca: yeah, I was sending it over 3G10:14
zygaChipaca: landline is sllooooow 0.1MB/s10:14
Chipacazyga— qcow2 isn't compressed by default, and if it is it's readonly10:14
zygaChipaca: over 3G I had 0.3MB/s outdoors and (I noticed by accident) 2.5MB/s while standing on the staircase inside the house10:15
zygaChipaca: aha, do you think I can make it smaller then?10:15
Chipacazyga— resonant cavities ftw10:15
zygayeah but I was surprised :)10:16
Chipacaagreed, it'd be surprising to me too :-)10:17
Chipacaa happy surprise10:17
Chipacaknowing the mechanism does not make it any less fortunate10:17
Son_Goku?10:19
zygaSon_Goku: I think chipaca was joking10:19
ChipacaSon_Goku— niemeyer isn't around to blame for everything, so it's your turn10:20
zygawe're trying to figure out what's going on wiht an apparently non-functional timeout on configure hooj10:20
zygahook10:20
Chipacazyga— bzip2 of the img would've saved 26%10:20
Chipacadebian-9-64.img:  1.351:1,  5.920 bits/byte, 26.00% saved, 789250048 in, 584078746 out.10:22
Chipacaanyway10:22
Chipacawhat was i doing?10:23
Chipacacoffee.10:23
Chipacazyga— how do you log in to the image you sent me?10:24
Chipacaah10:24
Chipacadebian/debian10:24
Chipaca:-)10:24
zygaChipaca: I added a readme file now10:27
zygaI'll re-compress it, drat :)10:28
zygathough I'll check xz10:28
zygaxz10:28
Chipacazyga— is xz threaded now?10:28
Chipacaactually, never mind. I was going to coffee.10:28
zygahaha, enjoy :)10:28
zygaI have no idea10:28
zygathe compressor seems not to be10:28
zygaI commented on https://forum.snapcraft.io/t/hook-timeout-mechanism-not-working-in-2-24/46410:35
zygaChipaca: downto 474MB10:38
zygaChipaca: so I made this https://spread.zygoon.pl/11:01
Chipacazyga— configure: error: xfs/xqm.h unavailable11:07
Chipacamorphis— ^11:07
Chipacalooks like build deps are wrong on debian11:08
morphisChipaca: where do you get that?11:08
zygaChipaca: hmm, odd, you may need xfsprogs-dev for this11:09
morphiszyga, Chipaca: we have xfslibs-dev in debian/control11:10
Chipacamorphis— i get this on debian after doing `sudo apt build-dep snapd` and then running autogen.sh from cmd/11:11
zygaChipaca: this gets you deps for what is in the distro11:11
Chipacaand that has not brought in xfslibs-dev11:11
zygaChipaca: not for what you have in the tree11:12
morphisChipaca: ah, on debian we have snapd 2.21 only11:12
Chipacaah11:12
Chipacai should've done build-dep ./11:12
morphisyeah11:12
Chipacayeah that brings it in11:12
Chipacasorry for the noise then :-)11:12
morphisnp :-)11:12
Chipacazyga— and 'make hack' falls over because no apparmor_parser11:13
Chipacaboo, etc11:13
morphisChipaca: did you configure with --disable-apparmor?11:15
Chipacamorphis: I ./autogen.sh --disable-apparmor11:16
Chipacamorphis: but I don't see that passing the option on to configure11:16
Chipacamorphis: but it does have debian-specific opts iin there11:17
Chipacamorphis: what should i do?11:17
morphisdebian-specific opts in the configure script?11:18
Chipacano, in autogen.sh11:18
Chipaca--libexecdir=/usr/lib/snapd11:18
morphisAFAIK autogen.sh checks for /etc/os-release and configures accordingly11:18
=== chihchun is now known as chihchun_afk
Chipacamorphis: yes, but all it does for debian is the above, no --disable-apparmor11:19
morphisChipaca: but for `make hack` it looks like the easiest way is to disable the apparmor profile installation manually in Makefile.am11:19
Chipacaand even with disable-apparmor, "make hack" tries to use apparmor_parser11:19
Chipacayeap11:20
morphisyeah seems to be a short coming of the Makefile.am implementation11:20
morphisChipaca: looks like we need a if WITH_APPARMOR in there11:22
Chipacaalso, would be extra neat if 'make hack' dtrt wrt the go binaries as well11:22
morphisChipaca: yes11:23
* zyga breaks for lunch11:24
Chipacazyga: I think I set things up to reproduce the thing, but it didn't work (or rather, it worked). After lunch can you walk me through this?11:36
zygare12:06
zygaChipaca: yes12:06
zygaChipaca: gladly!12:06
Chipacazyga: so, how do i repro? :-)12:06
morphiszyga: do we want to keep our sync meeting today or do we want to drop it with Alex and Jamie both being out?12:06
zygamorphis: let's drop it12:07
morphiszyga: ok12:07
zygamorphis: fyi, I'd like to collect more images on http://spread.zygoon.pl/12:07
morphiszyga: done12:07
zygamorphis: thanks12:07
morphiszyga: I can contribute a fedora-25-64 image12:08
zygamorphis: I can also start auto-building all the images and keeping them the web12:08
zygamorphis: great!12:08
zygamorphis: ideally you'd share something I can wget12:08
zygaChipaca: ok, let's try this together12:08
zygaChipaca: give me a sec for the current run to complete12:09
Chipacazyga: i'm on detached head 2eda8023c12:09
morphiszyga: let me compress and upload12:09
zygamorphis: great12:09
zygamorphis: perhaps you can upload to dropbox?12:09
Chipacazyga: built snap-confine, -exec, and d, running d with SNAP_REEXEC=0 et al12:09
morphisdon't really use dropbox12:09
zygamorphis: ok12:10
morphiszyga: but will upload to my server12:10
zygaChipaca: so, I didn't get that far, so far I can run it if I run the upgrade/basic test on debian-9-6412:10
zygaChipaca: this starts with 2.2412:10
zygaChipaca: and updates to master12:10
zyga(though the update fails)12:10
zygaChipaca: give me a few more minutes for the current run to fail12:10
zygaChipaca: so I think that what we need to try instead, if you want interactive session, is to get 2.2412:11
zygaChipaca: add some debugging if you like12:11
zygaChipaca: build the deb and install it on debian-912:11
zygaChipaca: and then snap install core12:11
zygaChipaca: (stable)12:11
zygaChipaca: and see what happens12:11
zygaChipaca: it should break because of seccomp12:11
zygaChipaca: but then we should time out the hook after 5 minutes12:11
zygaChipaca: do you agree?12:11
Chipacazyga: I'll try12:13
zygaChipaca: ok I will too12:15
jdstrandChipaca: re snapd#2969> ack, thanks. fixed12:17
mupPR snapd#2969: interfaces: mediate netlink sockets via seccomp <Created by jdstrand> <https://github.com/snapcore/snapd/pull/2969>12:17
Chipacazyga: you should review stuff ^ :-)12:19
mupPR snapd#3252 closed: tests,cmd/snap-confine: port older snapd-discard-ns tests <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/3252>12:19
zygaChipaca: aha, I guess so12:20
* zyga opens a new ta12:20
zyga*tab12:20
zygaah, it is this branch12:21
* zyga read it already12:21
draglyogra_: I tried the after: [desktop-qt5] step you recommended. Are there any requirements for it to work? Currently, it fails on a clean build with an error "No such file or directory: [...]/mypart/install/bin", where mypart is a completely different part in snapcraft.yml.12:22
draglyHowever, if I remove it, build again, then add it, and build once more, it works.12:22
draglySeems like it depends on other parts to create an install dir for some reason.12:22
morphiszyga: uploading ..12:24
draglyChecked the backgrace, and it happens in _file_collides.12:24
draglybacktrace*12:24
draglyMust be that _file_collides assumes other parts actually install something.12:25
zygagah, my network, what is going on :/12:36
=== petevg is now known as petevg_afk
Chipacaniemeyer: if you drop by, you requested changes on snapd#3026, zyga did as requested (on 14/03, ie 50 days ago), branch LGTM, is it OK to merge as is?12:43
mupPR snapd#3026: cmd/snap-confine: use defensive argument parser <Created by zyga> <https://github.com/snapcore/snapd/pull/3026>12:43
niemeyerChipaca: Heya12:44
niemeyerChipaca: That's not true.. I've looked at this PR last week and it wasn't fixed12:45
Chipacaniemeyer: git disagrees, but maybe he forgot to push12:45
niemeyerChipaca: Happy to have a look again when we have a break here12:45
Chipacaor maybe i'm misreading what github says12:45
Chipacaanyway, yeah, take a gander12:46
niemeyerChipaca: One of us is misreading.. I see "cmd/snap-confine: simplifiy error handling from argument parser" few days ago12:47
Chipaca¯\_(ツ)_/¯12:48
Chipacaniemeyer: yeah, github just said "added commits on 14 mar" here12:49
Chipacahad to look into commits to see that detail12:49
morphiszyga: https://mm.gravedo.de/files/fedora-25-64.img.xz12:56
morphisSon_Goku: any time to check https://bugzilla.redhat.com/show_bug.cgi?id=1444819 again?12:57
zygaChipaca: standp?13:03
zygamorphis: thanks!13:03
zygamorphis: thanks, I have it now13:04
mupPR snapd#3266 opened: interfaces: allow plugging DBus clients to introspect the slot service  <Created by jdstrand> <https://github.com/snapcore/snapd/pull/3266>13:07
Chipacahmmm13:26
Chipacazyga: with qemu-img we can create a local qcow2 image that used an http image as the backing file; this'd probably be faster than downloading the images13:26
Chipacazyga: (but you'd have to de-xz the .img for that)13:27
Chipacazyga: if you have ssh access to spread.zygoon.pl and can xunz -k, i can test this13:28
zygaChipaca: yes, sure13:30
zygaChipaca: it's my server13:30
Chipacazyga: there exist servers that only give you ftp access, to this day /o\13:30
zygaChipaca: decompressing13:31
zygaChipaca: FYI, my test is now doing this: [/] Run configure hook of "core" snap if present13:31
Chipacazyga: yeah, here as well (taking way too long at it)13:31
zygaChipaca: done13:32
zygaChipaca: how do you make those magic qemu images?13:32
zygaChipaca: and does qemu cache anything?13:32
ogra_if you use http you can easily decompress during download on the fly btw ...13:34
ogra_URL=http://cdimage.ubuntu.com/ubuntu-base/xenial/daily/current/xenial-base-amd64.tar.gz13:35
ogra_CHROOT=xenial-test-chroot13:35
ogra_wget -q -O - $URL | zcat - | sudo tar x -C $CHROOT13:35
Chipacazyga: qemu-img create -f qcow2 -b https://spread.zygoon.pl/debian-9-64.img debian-9-64.img13:35
ogra_that wont use any disk space and decompress during download13:35
ogra_(works fine with xzcat too)13:35
Chipacaogra_: my point is we don't use _most_of the image, so we can avoid downloading it13:35
zygaogra_: ooh13:36
zyganice13:36
ogra_ah,. completely, yeah13:36
zygalet's try that13:36
ogra_ wget -q -O - $URL | html2text | grep .... <- easy way to grep through website content ;)13:37
zygaogra_: .xz doesnt work13:37
zygabut plain does :)13:37
zygait boots13:37
cpaelzerogra_: worth a try for sure but is that fetching it in streaming still or will it use http range requests to read partially?13:37
zygapretty neat!!!13:37
ogra_cpaelzer, i think wget just streams ...13:37
cpaelzerogra_: in the use as qcow backing file I meant13:38
ogra_directly to stdout at lest ... so it depends whet the next command in the pipe does13:38
Chipacacpaelzer: the qemu-img approach does range requests afaik fwiw13:38
ogra_cpaelzer, well, i never used it in that context ...13:39
cpaelzerok that I expected, be careful then13:39
* ogra_ uses it mostly to stream tarballs to disk to avoid debootstrap13:39
zygaChipaca: ok, the test just failed for me!13:39
cpaelzerI'd assume something in the order of a few hundreds individual requests might take as long as the full image :-)13:39
zygaChipaca: no mention of restarts!13:39
Chipacayeah it never moves on from the hook13:40
Chipacaand yes it's snapd 2.2413:45
Chipacafrom core 168913:45
mupPR snapcraft#1292 closed: tests: fix the recording tests to work in multiple architectures <Created by elopio> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1292>13:46
Chipacawait no that core version is wrong (wrong terminal :-) )13:48
Chipacabut how do i then have snapd 2.2413:48
Chipacawith no core13:48
Chipacaooooohhhhh13:50
Chipacaalso: whaaaa13:50
Chipacathis is a nice bug13:50
Chipacazyga: snapd restarted into the new snapd, but if it fails afterwards it does not restart back into old when rolling back13:51
Chipacajdstrand: any reason not to land snapd#2969?13:56
mupPR snapd#2969: interfaces: mediate netlink sockets via seccomp <Created by jdstrand> <https://github.com/snapcore/snapd/pull/2969>13:56
mpontilloSo I have a snap with stage-packages including python2.7, and upstream code looking for 'python' on the path. Looks like it only installs the 'python2.7' binary. Anyone know the best way to just make a symlink from usr/bin/python2.7 -> usr/bin/python?13:56
zygaChipaca: what? :D14:00
Chipacazyga: you run that test with -debug, yes?14:01
zygaChipaca: wait, let me grok this14:01
zygaChipaca: but don't we disable reexec for that test?14:01
zygayes14:01
Chipacazyga: so when it fails you get a shell14:01
zygaI have the shell stull open14:01
Chipacazyga: in that shell, do 'snap version'14:01
zygait says 2.2414:01
Chipacazyga: and snap is 2.21-something, yes?14:01
zygayes14:02
zyga(ah, so we *do* reexec)14:02
Chipacazyga: ok, so 'snap abort 1'14:02
* zyga was confused by this then14:02
zygadone14:02
zyga2.2114:02
zyganow I get 2.2114:02
zygaof snap14:02
zygabut not snapd14:02
Chipacazyga: for snapd as well?14:02
zygaaaaaah14:02
Chipacaright14:02
zygaso snapd keeps being there14:02
Chipacazyga: now a 'systemctl restart snapd' gets you back the snapd 2.2114:02
zygayes14:03
Chipacazyga: unless the tests are doing something weird to get that snapd version14:03
Chipaca(which could be!)14:03
zygano, they don't14:03
zygathey just install it from the packge14:03
Chipacaso, yeah14:03
zygaso are we seeing two bugs now?14:03
Chipacasomething is awry14:03
zygafist of all, when it was stuck14:03
zygait was already 2.24?14:03
Chipacazyga: it's bugs all the way down14:03
zygaor was it sitll 2.21+b214:03
Chipacazyga: 'snap change 1' will tell you that14:03
zyga2017-05-03T15:22:34+02:00 INFO Requested daemon restart.14:04
zygaso 2.24 from the core snap14:04
zygaso, that version definitely has hook bug14:04
zygaI ran 2.24 directly on ubuntu and tried to get the spread test tha checks this to fail14:04
zygaand it didn't though14:04
zygaperhaps it's a combination of some factors that makes it hang14:04
Chipacazyga: what's probably happening14:06
Chipacaand I'm guessing here14:06
Chipacais that 2.21 did not set the timeout14:06
Chipacaand 2.24 gets it from state14:06
Chipaca... where it was put by 2.2114:06
Chipacaso the fix is: when you don't want a timeout, put a _negative_ duration as the timeout14:07
zygaoooh14:07
zygadefinitely!14:07
Chipacain the check to timeout, check for negative instead of > 014:07
Chipaca== 0 --> default timeout for the task (backwards compat etc)14:07
Chipaca< 0 --> no timeout14:08
zygaaha14:08
Chipaca> 0 --> go on holidays14:08
Chipaca\o/14:08
zygawell, we need some form of tri-state for sure14:08
zygathank you for solving that one!14:08
zygaI didn't think about pre 2.24 making the state14:08
Chipacawe need patches working again14:08
zygaso...14:08
Chipacais what we need14:08
zygayes :/14:08
zygacan we do a patch that fixes it?14:08
zygasets a timeout on confiugre hook if missing14:08
zygait's not the end of the world if we cannot undo it14:08
zygawtyt?14:08
zygawdyt?14:09
Chipacai think the rule is no patches until we fix them14:09
mpontilloFigured it out. Added python-minimal to stage-packages.14:09
zygaChipaca: can we fix it anywhere eles?14:09
zygaChipaca: I mean we did certainly a lot of patch-like things lately14:09
zygae.g. all the fixes for plug renames14:09
zygathose are exactly patches but not called that14:09
zyga :D14:09
Chipacazyga: we can do one of those patch-like things, because it's backwards-compatible14:09
zygagee, let me lock the state, change it and unlock here14:09
Chipacathat is, if the state has a timeout, the old snap just won't load it14:10
Chipacaso yes we can and should do that14:10
Chipacazyga: and yes, snapd being at the wrong version after that abort is another bug14:10
zygaChipaca: great find, thank you!14:10
jdstrandChipaca: from my perspective, no, but I was hoping morphis would glance at it since I touched a bunch of interfaces his team implemented14:10
zygaI was staring at it for so long without realizing it14:11
Chipacamorphis: can you look at snapd#2969 ?14:11
mupPR snapd#2969: interfaces: mediate netlink sockets via seccomp <Created by jdstrand> <https://github.com/snapcore/snapd/pull/2969>14:11
zygamorphis: I'll merge it when you give it +114:11
zygaChipaca: I'll start with the patch for the hook timeout14:11
Chipacamorphis: no pressure :-p14:11
Chipacazyga: ok14:11
zygaChipaca: as for reexec back14:11
zygaChipaca: do you mean that we need to figure out that something failed and we need to shutdown snapd?14:11
zygaChipaca: when undoing one of the tasks?14:12
=== bdx_ is now known as bdx
* zyga has built all the spread images for ubuntu now14:13
zygait was faster to spawn a VM, build them and reattach a disk than to upload from home14:13
Chipacazyga: i'm saying, doLinkSnap has maybeRestart(); there needs to be a maybeRestart on the undo path14:13
zygaaha, that does make sense!14:13
Chipacaand there is one in undoUnlinkCurrentSnap14:14
zygawell14:14
zygaI'm happy that it turned out to be double-plus-good :)14:14
zyganot a wasted day and no bugs found14:14
Chipacaso we need a test for this to figure out why it's not working :-)14:15
morphisChipaca, jdstrand: didn't I comment already? thought I did as I was looking at that PR14:15
Chipaca(an integrationy test, not a unit test which it does have i believe)14:15
zygaChipaca: aha14:16
morphisChipaca, jdstrand: however I would prefer to get that into edge soon so our CI can execute against it14:16
morphisthen we will see if anything for those interfaces is broken the best way14:16
Chipacamorphis: was that a "yes +1 land it plz"?14:20
* zyga reads the hook manager code closely14:21
morphisChipaca: yes14:21
morphislet me add a comment14:21
Chipacaboom, merged14:22
mupPR snapd#2969 closed: interfaces: mediate netlink sockets via seccomp <Created by jdstrand> <Merged by chipaca> <https://github.com/snapcore/snapd/pull/2969>14:22
Chipaca33 PRs. Bring it on!14:22
Chipacazyga: how's the tab completion review coming along?14:22
zygaChipaca: hmm, I could switch to it now14:23
zygaor look at the hook manager14:23
zygahmm14:23
zygapick :)14:23
Chipacazyga: serialise things dude :-)14:23
zygaChipaca: ok, let me look for 10 minutes14:24
zygawith hot context14:24
Chipacaah, pavel is away today14:24
Chipacaniemeyer: snapd#3119 is blocked waiting for a review from you, also (and it's old!)14:26
mupPR snapd#3119: interfaces: API additions for interface hooks <Created by stolowski> <https://github.com/snapcore/snapd/pull/3119>14:26
* zyga got small electric shock14:30
zygadarn uk adapters :/14:30
niemeyerChipaca: Thanks, I think there are several things in the queue which need love14:31
Chipacaniemeyer: need love from reviewers, or from writers?14:31
niemeyerI was hoping to have more time here, but turns out we're running from meeting to meeting as usual14:32
niemeyerChipaca: I suspect both, but I need to go back to our review board14:32
niemeyerWhich is out of date14:32
Chipaca:-) ok14:32
Chipacaniemeyer: i was just going through https://github.com/snapcore/snapd/pulls and poking people14:33
Chipacanot being particularly methodic as i was trying to repro the 2.21/2.24 debian issue above14:33
niemeyerChipaca: Thanks for pushing the reviews forward!14:52
Chipacaniemeyer: shut up and get reviewing!14:52
Chipaca:-D14:53
Chipacahow's the sprint btw14:53
niemeyerMore long plenaries than smaller decision meetings.. we need some more of the latter before the week is over14:54
niemeyerOn the bright side we got the +1 to move on with our development Sprint.. I need to push its organization forward14:55
Chipacaniemeyer: delegate (not that i'm offering)15:00
Chipacaniemeyer: you've got way too much on your plate15:00
niemeyerChipaca: Curiosity, I'm actually pretty hungry right now :P15:02
niemeyerCuriously15:02
zygaChipaca: can you pull master into 3150 please?15:03
zygaChipaca: or just let me...15:06
Chipacazyga: snapd#3150?15:06
mupPR snapd#3150: In-snap bash tab completion <Created by chipaca> <https://github.com/snapcore/snapd/pull/3150>15:06
zygaChipaca: yes15:06
zygaif you cna please do :)15:06
Chipacasure, give me a mo15:06
* zyga fetches --all15:06
zygathnx15:06
Chipacazyga: any reason for the merge?15:07
Chipacai ask because it'll trigger a retest, and i've been triggering a lot of those :-)15:09
mupPR snapcraft#1242 closed: kernel_plugin: use CROSS_COMPILE to override the default toolchain <Created by piso77> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1242>15:10
zygaChipaca: just to have a chance to pass all tests15:11
* zyga read the text above as GROSS_COMPILE15:11
Chipacazyga: merged and pushed15:12
zygaChipaca: thank you15:12
mupPR snapd#3265 closed: spread: add spread target qemu:debian-9-64 <Created by zyga> <Merged by chipaca> <https://github.com/snapcore/snapd/pull/3265>15:14
mupPR snapcraft#1204 closed: target-arch: decouple target arch from deb, and use a separate field … <Created by piso77> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1204>15:28
Son_Gokumorphis: I'll try to squeeze some time to check it today (at Red Hat Summit atm)15:29
Chipacazyga: can you answer jdstrand on snapd#3253?16:20
mupPR snapd#3253: cmd/snap-confine/spread-tests: discard useless --version test <Created by zyga> <https://github.com/snapcore/snapd/pull/3253>16:20
zygaChipaca: looking16:21
zygaChipaca: done16:23
Chipacazyga: 'ppreciated16:23
kyrofaHey ogra_, I thought the rpi3 had spi enabled (we talked about this before)?16:24
kyrofaogra_, https://askubuntu.com/questions/911510/ubuntu-core-on-raspberry-pi-3-spi-driver-isnt-available16:24
kyrofaogra_, any idea on that one?16:24
morphisPharaoh_Atem: sounds good16:31
Chipacazyga: snapd#3150 is now green again :-)16:33
mupPR snapd#3150: In-snap bash tab completion <Created by chipaca> <https://github.com/snapcore/snapd/pull/3150>16:33
zygaChipaca: let there be merge!16:34
* zyga does one _last_ read16:34
* Chipaca lifts his finger from the big green button16:34
* zyga notices lots of nice documentation!16:35
zygaChipaca: do we need a GPL header in the new shell script?16:35
* zyga will add comments from now16:36
Chipacazyga: ... maybe?16:36
Chipacazyga: i mean, yeah, we do :-/16:36
zygaChipaca: wait with the push as I also added small nitpick and we'll save one test slot16:37
Chipacawhy do some spread runs take nearly an hour (coming dangerously close to being killed)16:38
Chipacaand, killed :-(16:39
zygaChipaca: what is bounced?16:39
zygaChipaca: allocation contention?16:39
zygawe need to figoure out queing16:40
* zyga fetches coffee and gets right back up here16:40
Chipacazyga: bounced are things that the snap requests be tab completed, but that end up needing completing "outside" the snap16:40
Chipacazyga: variable names, shell aliases, shell functions, that sort of thing16:41
Chipacathey're bounced from the completion mechanism inside, back to the outside to be completed there16:41
zygaaha16:45
zygaChipaca: what is <( ... ) ?17:00
zygaapart from chicken head?17:00
Chipacazyga: <(o_o<)17:01
Chipacazyga: it's called process substitution17:01
naccis that ascii-kirby?17:01
Chipacazyga: man bash, look for that17:01
zygathanks!17:01
Chipacazyga: but basically you write foo <(bar), the shell runs bar, sends its output to a_file, and runs foo a_file17:03
zygaaha17:03
zygaright, I just read that17:03
zygaman,17:03
Chipacawhether a_file is an actual file or something more magic is system-dependent17:03
zygashell17:03
zygashell is insane :)17:03
Chipacazyga: no, man bash, man shell is something else17:03
zyga;-)17:04
Chipacaand then there's <( ᐛ )>17:05
mupPR snapcraft#1296 opened: rust snaps can now use source-subdir without failing on pull <Created by roxyd> <https://github.com/snapcore/snapcraft/pull/1296>17:07
Chipacaanyhow, EODish from me17:12
zygaChipaca: that's the chicken looking for food17:12
Chipacai'll be back to tend to these two spread runs but other than that, i'm out17:12
Chipacazyga: ᕕ( ᐛ )ᕗ17:12
zygad-d-dancing!17:13
zygajdstrand: question about https://github.com/snapcore/snapd/pull/326617:24
zygajdstrand: would it make sense to allow introspection on any object?17:24
zygajdstrand: or is that leaking stuff?17:24
jdstrandzyga: fyi, I don't know if you want to merge from trunk. https://github.com/snapcore/snapd/pull/3254 seems to keep taking too long17:24
zygaI cannot remember if we can read properties this way, I think not though)17:24
zygajdstrand: it should be fine, just needs to be re-triggered when spread is idle17:25
jdstrandzyga: it would leak stuff in my opinion. we should only allow introspecting the things that the interface allows access to. I don't think it should be part of default policy17:25
zygajdstrand: reading the diff now, I have more questions, what does it mean that path is not object specific for unconfined?17:25
jdstrandlook at the commented out rule and the description17:26
jdstrandI discussed it17:26
* zyga reads the rest17:26
jdstrandpath=/ peer=(label=unconfined)17:26
zygajdstrand: I still don't get one thing: what is being leaked exactly?17:27
jdstrandzyga: ok, well, I may have stepped on your toes cause I restarted the travis-ci tests17:27
zygajdstrand: hahe, no worries :) it will be OK17:27
mupPR snapd#3253 closed: cmd/snap-confine/spread-tests: discard useless --version test <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/3253>17:27
mupPR snapd#3266: interfaces: allow plugging DBus clients to introspect the slot service  <Created by jdstrand> <https://github.com/snapcore/snapd/pull/3266>17:27
mupPR snapd#3254: tests: re-enable and moderninze /media sharing test <Created by zyga> <https://github.com/snapcore/snapd/pull/3254>17:27
jdstrandzyga: imagine a system with ofono, avahi-observe and fwupd all as debs17:28
zygaok17:28
jdstrandzyga: allowing path=/ peer=(label=unconfined) means you can introspect all three17:28
zygaok17:28
jdstrandthere is nothing in the rule making it service-specific17:29
zygabut is the introspection data sensitive?17:29
jdstrand/org/freedesktop/systemd1 <-- that is service specific17:29
zygaAFAIR it is just XML that describes what the API is17:29
jdstrandzyga: it's a leak. is it a huge major world-ending leak? no17:29
zygawell, hardly a leak, it just lets you know something is there in the first place, is that right?17:30
jdstrandzyga: but for example in the network-manager api you can enumerate things just by looking at the introspected data17:30
* zyga tries to understand what is being exposed exactly, not how serious that is17:30
zygaaha!17:30
* zyga looks at dbus specs17:30
zygaI wrote some dbus code earlier and I did implement introspection support17:30
zygamaybe I'm missing something17:30
zygaI just want to be sure I understand what is going on17:31
jdstrandzyga: it depends on the api too. yes, it lets you enumerate services that are installed (avahi, ofono, fwupd, others, ...) but the api can put info in there. eg, org.foo is fine by itself. you hot plug baz and bar and the foo service updates the api to have org.foo.bar and org.foo.baz17:31
jdstrandnm does this sort of thing17:32
jdstrandbut, it is messy17:32
jdstrandwe have some leaky things already, sure, but we are going to be trying to fix those leaks, so I strongly prefer to not add new ones17:32
jdstrandzyga: really what is going on is that I am only adding new accessing and not taking anything away17:33
jdstrandaccesses*17:33
jdstrandand only adding ones that don't leak17:33
jdstrandif there is some super-critical use case for opening up more, we can perhaps reconsider17:34
zygaaha17:34
zygajdstrand: you are correct17:35
zygajdstrand: https://dbus.freedesktop.org/doc/dbus-specification.html#introspection-format17:35
jdstrandbut sborokov mentioned a bug with pydbus and org.freedesktop.login1, and I'm fixing that and being safely proactive with everything else17:35
zygajdstrand: the smoking-gun there is the full dump of what is there17:35
zygajdstrand: object paths and what not17:35
zygajdstrand: thanks for explaining that17:35
jdstrandnp17:36
zygajdstrand: btw, do you think we should open bugs on the projects that use / as the object path?17:36
jdstrandzyga: I thought about that. if it is a new service, yes. these ancient services we unfortuately can't cause clients would break17:37
zygajdstrand: ah, right17:38
zygawell boo17:38
zyga:/17:38
jdstrandyeah17:38
jdstrandgood news is lennart is doing the right thing today (he (presumably) wrote the avahi dbus api, but the systemd object paths are clean)17:38
zygajdstrand: I kind of wish someone made a dbus proxy with turing-complete processing built in17:38
zygajdstrand: that would be secure to run in a separate tight sandbox (old-style seccomp)17:39
* zyga EODs17:57
* zyga updates https://spread.zygoon.pl/images/18:10
mupPR snapd#3267 opened: cmd: make rst2man optional <Created by morphis> <https://github.com/snapcore/snapd/pull/3267>18:13
=== JanC is now known as Guest52042
=== JanC_ is now known as JanC
=== DedSec is now known as Hyperion
=== Hyperion is now known as Hyperion_
=== Hyperion_ is now known as DedSec
mupPR snapd#3268 opened: Browser support sys devices <Created by jdstrand> <https://github.com/snapcore/snapd/pull/3268>20:24
mupPR snapd#3261 closed: snap-confine: init the ENTRY variable, coverity is unhappy otherwise <Created by mvo5> <Merged by chipaca> <https://github.com/snapcore/snapd/pull/3261>20:34
mupPR snapd#2976 opened: support users and groups with seccomp <Created by jdstrand> <https://github.com/snapcore/snapd/pull/2976>21:32
mupPR snapd#2976 closed: support users and groups with seccomp <Created by jdstrand> <Closed by jdstrand> <https://github.com/snapcore/snapd/pull/2976>21:33
fede2I'm getting a coredump on a snap for a python (pyqt5) application called URH (universal radio hacker)22:03
fede2This is the snapcraft file https://github.com/fede2cr/snapcraft-sandbox/blob/master/limesdr-urh/snapcraft.yaml22:03
fede2And I'm actually getting the same error as in this post https://askubuntu.com/questions/783758/pyqt-snap-builds-successful-fails-to-run22:03
fede2I'm running on a freshly installed Ubuntu 16.04 with unity.22:04
fede2Any suggestions?22:04
=== sgclark_sleeping is now known as sgclark
=== mcphail_ is now known as mcphail

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!