/srv/irclogs.ubuntu.com/2016/01/15/#snappy.txt

elopiosergiusens: kyrofa: would it be ok to add the nodejs version to the yaml?00:32
elopioit seems to work to package bonescript with node 0.10.00:32
sergiusenselopio, in the schema?00:36
sergiusensit does if we have links, yeah00:36
sergiusensis this older or newer?00:36
elopiosergiusens: older.00:37
sergiusenselopio, ah, then maybe test; if it is location indep as the current one it may be all ok00:38
elopioyou are building the link from a constant. I think we can make that constant the default, and accept a variable from the conf.00:38
sergiusenselopio, as long as the semantics for installing are ok, we should be good00:38
sergiusenselopio, btw, for running the example tests, can we just download the image from mvo's pcc?00:39
elopiothe problem is that the only example I have requires beaglebone, and I can't test if the generated snap works because bbb is busted.00:39
elopiosergiusens: yes, download it, start it in kvm, and then call ./runtests.sh --ip localhost --port 802200:40
sergiusenselopio, ah, nice00:40
sergiusenselopio, I'm no sure about adding the example as an example; since the example is not complete; what do you say?00:52
elopiosergiusens: do you mean the one by andreas?00:54
sergiusenselopio, yeah00:54
elopiosergiusens: yeah, I wasn't thinking about everything he has in there.00:54
elopiosomething more simple that shows the issue.00:54
elopioyour unit tests are good, so this is not a blocker. But it would be nice to have.00:55
sergiusenselopio, something simple mean writing auto.*.ac and Makefile.am though and I am not profficient in that00:56
sergiusenslet me see if I can find something simple00:56
elopiosergiusens: I understood you requested that from andreas.00:56
fazerCan anyone take a look at this pull request: https://github.com/ubuntu-core/snapcraft/pull/233 and let me know why it thinks the coverage has decreased?01:21
fazernevermind, ignore my last comment.01:21
fazerelopio, kyrofa, sergiusens If possible can you take a look at this: https://github.com/ubuntu-core/snapcraft/pull/23301:22
=== chihchun_afk is now known as chihchun
=== chihchun is now known as chihchun_afk
raspberrypifanhow does deduplication work04:51
happyaronwhat dedup you mean?05:04
=== kickinz1|eod is now known as kickinz1
fgimenezgood morning08:03
JamesTaitGood morning all! Happy Friday, and happy Hat Day! 😃  ðŸŽ©10:00
liuxgChipaca, ping10:10
Chipacaliuxg: pong10:10
liuxgChipaca, I accidentally installed snapcraft by running "python3 setup.py install", now my snapcraft version is totally wrong. do you know if there is any method to remove the installation?10:11
Chipacaliuxg: you installed it at the system level, by hand?10:11
Chipacaliuxg: ie you actually did "sudo python3 setup.py install"?10:12
Chipacaliuxg: or did that install it in your home directory?10:12
liuxgChipaca, by hand, last time, snapcraft did not support the local source code, I reported a bug, and later on, sergiusens asked me to try it. I tried to install it by hand.10:13
liuxgChipaca, I tried the method at  https://stackoverflow.com/questions/1550226/python-setup-py-uninstall , since I pulled down the latest repository, and now my snapcraft version is 2.0. I think it should not be so right for me.10:14
Chipacaliuxg: I'm afraid I have no idea in what state you've managed to put your system10:14
liuxgChipaca, yes, I actually did "sudo python3 setup.py install" manually on my PC.10:14
Chipacaoh dear10:14
Chipacadon't do that10:14
Chipacaever10:14
Chipacayour system is now in an unknown state10:15
liuxgChipaca, I know it is too late. I really want to get it back. the snapcraft is totally wrong.10:15
Chipacayou have actively decided to take control of your system away from apt and do it manually10:16
Chipacaso you will have to clean it up manually10:16
Chipacaand hope that that is enough10:16
Chipacaliuxg: do you have a log of the installation process?10:16
Chipacaliuxg: to know exactly what that setup.py install actually installed?10:16
liuxgChipaca, now, the snapcraft info is like http://paste.ubuntu.com/14503790/ on my PC..10:16
liuxgChipaca, as said, I followed the link https://stackoverflow.com/questions/1550226/python-setup-py-uninstall, and now the files are http://paste.ubuntu.com/14503796/10:18
liuxgChipaca, I have removed the files already, however the snapcraft version still shows 2.010:19
Chipacaliuxg: do you have a log of the installation process?10:19
liuxgChipaca, I do not have that unfortunately, it happened  long time ago. Do you want me to try it again?10:20
liuxgChipaca, the help content is still for 1.0 http://paste.ubuntu.com/14503819/ though the version shows 2.010:21
Chipacano, do not try it again10:22
Chipacaliuxg: pastebin the output of: find /usr/local -ls10:23
liuxgChipaca, http://paste.ubuntu.com/14503836/10:25
Chipacaliuxg: ok, i can't guid you through that10:26
Chipacaliuxg: what you need to do is remove all traces of snapcraft from your system10:26
Chipacaliuxg: and all the dependencies that the manual install installed10:26
Chipacaliuxg: but you've got too much other cruft in /usr/local for me to help10:27
Chipacaliuxg: so10:27
Chipacaliuxg: first, sudo apt-get purge snapcraft && sudo apt-get --purge autoremove10:27
Chipacaliuxg: then, manually remove from /usr/local anything your manual install might've installed10:27
Chipacayou've got django and npm and who-knows-what-else in there, so good luck with that10:27
Chipacaalso given you've got npm, you've probably got your system in a screwy state anyway. You're on your own.10:28
Chipacanext time you feel the need to install something in your system without using apt-get, use a virtual machine10:28
liuxgChipaca, I have done  sudo apt-get purge snapcraft && sudo apt-get --purge autoremove the command, so I need to reinstall it?10:28
Chipacaor tell whatever tool you're using to install stuff to do so in a local environment and not in the system itself10:28
Chipacaliuxg: you reinstall *after* cleaning /usr/local10:29
liuxgChipaca, do I need to remove all of the snapcraft related directories manually?10:31
Chipacaliuxg: the ones you created manually? yes10:32
Chipacaby manually there i mean 'via python3 setup.py' also10:32
liuxgChipaca, in fact, I did not manually create the directories. after running your "remove" command, the directory is like http://paste.ubuntu.com/14503863/10:33
liuxgChipaca, may I just go ahead to manually remove those snapcraft related directoies?10:34
Chipacaliuxg: those are the ones you created via 'python3 setup.py'10:34
liuxgChipaca, I think so. I did not manually create those directories and files.10:35
Chipacaliuxg: apt-get did not create them; you created them yourself, using setup.py. You did not do 'mkdir', no, but you created them outside of the control of the packaging system10:36
liuxgChipaca, yes, I think the setup.py created them.10:36
liuxgChipaca, so, may I just remove them manually?10:37
Chipacaliuxg: I have told you yes twice already. This is the third time. Yes, remove manually those directories which you created using setup.py.10:37
Chipacaliuxg: as you have not kept a log of what you did with setup.py, I can't tell which those are. You're on your own.10:38
liuxgChipaca, OK. thanks! I just want to double confirm it :)10:38
liuxgChipaca, thanks for helping. now my snapcraft version become 1.0 :)10:42
sanongHelp guys. I just download snappy OVA and run it. But default user/pwd  not working10:43
sanonghttps://insights.ubuntu.com/2015/01/15/snappy-ubuntu-core-now-on-the-hypervisor-of-your-choice-with-ova/10:47
sanongcant logon with ubuntu / ubuntu10:47
sanongany one ?10:47
sanongany know default user/pass other than ubuntu/ubuntu10:53
zygasanong: not that I know10:54
sanongi download .OVA and  boot vm10:55
sanongcant logon10:55
mvoogra_: so I looked a bit into the multiple initird stuff for snappy - one generic initird from ubuntu-core, one with the kernel specific bits from the kernel. it seems feasible but I will need some help with the uboot stuff, do you think you could give me a hand with that?10:57
Chipacamvo: who creates the ova files?11:10
mvoChipaca: ova files? what does that mean?11:21
Chipacamvo: it's one of the options here https://cloud-images.ubuntu.com/snappy/rolling/core/edge/current/11:21
Chipacamvo: and was blogged about here https://insights.ubuntu.com/2015/01/15/snappy-ubuntu-core-now-on-the-hypervisor-of-your-choice-with-ova/11:21
Chipacamvo: but i know we don't build 'em11:21
mvoChipaca: oh, I think thats ben howard11:21
Chipacamvo: and sanong above was saying he couldn't log in with u/u11:22
mvoChipaca: with this particular image he can not log in?11:22
Chipaca<sanong> cant logon with ubuntu / ubuntu11:22
mvohe is no longer in the channel :/ did he/she mention what image?11:23
beowulfmvo: i think there's only one, i can try it on vmware now ...11:25
mvothanks beowulf11:26
sanongOVA was published  https://insights.ubuntu.com/2015/01/15/snappy-ubuntu-core-now-on-the-hypervisor-of-your-choice-with-ova/11:38
sanongby one of cannocal marketing11:39
sanongI think all snappy image will have same password. Any know ?11:39
beowulfmvo_: sanong: i see that too, the ubuntu/ubuntu password doesn't work on that image11:41
beowulfs/image/ova11:41
sanonganyone know password11:42
mvo_utlemming: hi, I hope you are the right person to ask - do you know more about the ova images? we got a report from sanong that the login via ubuntu/ubuntu does not work with those. maybe thats intentional because of the cloud nature, but maybe https://insights.ubuntu.com/2015/01/15/snappy-ubuntu-core-now-on-the-hypervisor-of-your-choice-with-ova/ could mention if the login is different11:46
utlemmingmvo_: that is correct; OVA's are cloud targets11:47
mvo_sanong: see above, this is intentional11:47
beowulfsanong: is this for virtualbox or vmware or something else?11:48
utlemmingmvo_, sanong: http://blog.utlemming.org/2015/04/using-snappy-ova-images-when-you-dont.html11:48
utlemmingsanong: use option 211:48
ogra_mvo_, multiple ?11:49
ogra_why multiple11:49
ogra_just move the modules into a squashfs and mount them right before anything else11:49
mvo_ogra_: one generic one with our scripts and one with kernel modules if you boot your snappy from a remote iscsi target11:49
utlemmingsanong: cloud image targets need to have security. We can't have every cloud image of Snappy universally accessible by a well-known password11:50
ogra_mvo_, well, if you boot from iscsi, your initrd needs to come from somewhere ... just put the modules suqshfs next to it in the same place11:50
mvo_ogra_: right, we can do that if everything is in the kernel that is needed to mount root - this won't work right now even for us because of squashfs.ko. but mayb apw can help and make squashfs.ko a buildin for the kernel11:50
ogra_and loop mount it11:50
ogra_no11:51
ogra_you dont need everything to mount root11:51
ogra_you only need everything to loop mount the modules squashfs from the same place yoou load your intird from11:51
mvo_ogra_: I'm not sure I follow. what if your initird comes from pxe boot?11:51
sanongwont work11:51
ogra_well, tftp then11:51
sanongtry that11:51
sanongalready11:51
ogra_if your initrd comes from the net that measn that you have a way to pull the suqashfs the same way11:52
sanongwill that be the cause ?11:53
ogra_i just dont see a need that we have more than /lib/modules|firmware in tthat squashfs11:53
beowulfutlemming: i've been using u-d-f and then qemu-img convert to vmdk for vmware ... option 3 :)11:53
ogra_mvo_, indeed that requires to have squashfs and loop device support in the kernel itself11:54
mvo_ogra_: so our generic initird would fetch (cp, tftp, *) a file right next to the initird img and use that for the modules? and we enforce that the kernel has enough support buildin to get to that place? that works for me11:54
ogra_(though i guess we dont necessarily need it to be a squash image)11:55
mvo_ogra_: so we just need to convince the kernel people to give us this kernel11:55
mvo_ogra_: yeah, it can be anything11:55
ogra_right11:55
utlemmingorgra_: why not an initramfs script?11:56
mvo_ogra_: works for me, lets talk about the details on monday11:56
ogra_the PXE part will be a bit tricky since we need to do the loading from there ... we cant do it from the initrd, else we'd need all NIC modules11:56
ogra_utlemming, ^11:56
ogra_:)11:56
ogra_mvo_, yeah11:56
utlemmingah, right11:56
* ogra_ is looking forward to finally implement the generic initrd :) 11:56
ogra_oh !11:57
mvo_ogra_: well AIUI the multiple-initird is really just two initrds concacted so this approach might work for PXE11:57
beowulfsanong: if you try option 2 as utlemming outlines in his blog post it will work11:57
mvo_(or multiple ones, not just two)11:57
* ogra_ just noticed that the DSL update on his second DSL line has happened while being at the dentist ... 11:57
ogra_WOHOOO !!!11:57
ogra_from 2Mbit to 50 !11:57
mvo_ogra_: congrats11:57
mvo_ogra_: thats a jump11:58
ogra_yeah11:58
shuduohi, after I sideload install a snap on snappy, what is its package name? for example, webcam-webui demo of snapcraft-examples11:58
ogra_well, i need to reconfig the phone stuff now ... else susie will kill me11:58
mvo_ogra_: enjoy, we talk monday. the pxe issue with the nics sounds serious to me though, worth thinking about it more IMO11:58
stevebiscuitshuduo: "webcam-webui.sideload" I believe11:59
ogra_mvo_, yeah11:59
shuduostevebiscuit: yes, it's . thanks.12:01
apwmvo_, there is cirtainly some support for multiple initrds concatentated yes, they all get unpacked12:01
apwmvo_, and if you want a generic one and a device specific one ramming them together on the rmeote server sounds like a good plan12:01
apwmvo_, not that you can look at them any more with the tooling but hey12:01
mvo_apw: cool, we can write new tooling for that - if thats fully supported that sounds like the easiest option.12:03
mvo_ogra_: -^12:03
mvo_ogra_: if its just a concat but otherwise looks like a normal initrd that seems like its what we want, right?12:03
apwmvo_, let me investigate to confirm, i know we use it for cpu firmware, that makes a dual initrfamfs12:03
mvo_apw: thanks!12:03
ogra_so the added part would have /lib/modules|firmware only ?12:03
apwmvo_, i believe you can literally cat A B >initrd and the kernel groks them12:04
mvo_ogra_: yeah12:04
apwmvo_, if each is in the rigght format12:04
mvo_apw: sweet12:04
ogra_yeah, thats similar to mounting a squashfs i guess12:04
ogra_just earlier12:04
apwmvo_, but let me go and confirm that on a VM first12:04
mvo_apw: thanks!12:04
apwmvo_, the refulting file is just bits from a bootloader point of view12:05
* mvo_ likes this 12:05
apwmvo_, and because we use it for cpu firmware i beleive we know the bootloaders ought to handle it right12:05
mvo_apw: yeah, exactly, this is the part I like, pxe, uboot, grub all work as before, the smartz is in the kernel12:05
apwmvo_, anyhow leave it with me for a little and i'll report back12:05
mvo_apw: and we don't even need to modify anything in our scripts12:05
mvo_apw: sure, no rush really12:05
apwjust the making the initrd needs to change12:05
mvo_apw: I was waiting for an image upload and this was nagging in the back of my mind :)12:06
apwand ... i assume ninitramfs-tools already knows how becuase it does it for cpu firmwae12:06
apwmvo_, if i don't do it now i will forget :)12:06
mvo_apw: yeah, well, we just make two initrds with the normal tooling and in the final stage do the cat - sounds easy12:06
mvo_(foumous last words)12:06
mvo_apw: ha! do it NOW12:06
mvo_:)12:06
* mvo_ gets lunch in the meantime12:06
mvo_ogra_: sounds exciting, generic initird afterall :)12:08
ogra_\o/12:08
mvo_ogra_: but I leave you alone, enjoy your vac12:08
mvo_:)12:08
ogra_yeah, and my new teeth :)12:08
* ogra_ just returned from dentist 12:08
mvo_ogra_: woah, new dsl, new teeth, the year starts great it seems12:09
mvo_(and generic initrd soon)12:10
ogra_well, only interim teeth, but yeah ... after 20years the visibla gap is gone :)12:10
apwogra_, nice12:10
kyrofaGood morning12:20
kyrofasergiusens, would it be bad if plugins could add apps?12:29
sergiusenskyrofa, not at all, but we need to design for it12:30
sergiusenskyrofa, as in, lets not just bolt that together and hope for the best passing the full snapcraft yaml dictionary to plugins12:31
sergiusenskyrofa, are you thinking of catkin?12:31
sergiusenskyrofa, the problem then becomes, is it a daemon, a cli, a desktop icon...12:32
kyrofasergiusens, right, which would need to be handled by the plugin as well. And yeah, catkin and roscore (I'm still trying to think of how to get rid of the roscore plugin :P )12:33
sergiusenskyrofa, I don't see why the catkin plugin can't just do everything in there12:34
kyrofasergiusens, only one single reason: When we have the ability to share roscore, what if someone wants to make a shared .snap containing JUST roscore?12:35
kyrofaI guess if I updated the catkin plugin to accept building no packages, then they could specify the stage package and the app just like normal12:36
kyrofasergiusens, think that would be good enough?12:36
apwmvo_, ok confirmed if you make a second initramfs cpio.gz style image and literally cat play.gz >>initrd.img the kernel will load both and merge them before executing12:36
apwmvo_, and from what i can see of the code it literally keeps trying until there is no data, so you can have 1012:37
sergiusenskyrofa, I think so12:38
sergiusenskyrofa, but lets get this in and work on that next week as I guess it is not a 1 hour task :)12:38
sanongupdated : OVA option 2 : still cant logon with ubuntu/ubuntu12:39
sanongtry 2 image now12:39
sergiusensogra_, enjoy some ferocious meat eating then ;-)12:40
ogra_haha, i will :)12:41
kyrofasergiusens, agreed. And if we can figure out a good way for plugins to add apps, that would get really slick12:41
sergiusenskyrofa, sure, let's brainstorm that a bit next week ;-)12:42
kyrofasergiusens, or the week after, considering where you'll be :P12:42
kyrofasergiusens, I need to miss standup-- I need to watch the kiddo this morning12:51
sergiusenskyrofa, no worries12:54
tsimonq2mvo_: o/12:57
tsimonq2mvo_: I have been here for the past few weeks :)12:57
* zyga posted https://github.com/ubuntu-core/snappy/pull/32912:59
zygamore bool file work around security12:59
* zyga refreshed https://github.com/ubuntu-core/snappy/pull/324 (merge with trunk, delta minimized)13:01
mvo_tsimonq2: haha, sorrry :) there is so much going on, I did not really notice :)13:09
tsimonq2:)13:09
sergiusenskyrofa, good job on the branch, I just tried it with all the other branches and it works fine :-)13:11
kyrofasergiusens, excellent!13:11
sergiusenskyrofa, so the only thing I don't like about squashing is that I can't see what changed between two pushes, any easy way to check from the github ui?13:13
kyrofasergiusens, hmm... there is in gitlab... looking13:15
zygafgimenez, elopio: what does it mean when github says "no test results found" for integration tests?13:15
zygaflaky tests? flaky test system? something else?13:17
kyrofasergiusens, it doesn't seem so. If it was just us I'd suggest using --fixup commits in response to PR review, and one autosquash before merge, but I'm concerned about asking the community at large to do that13:19
sergiusenskyrofa, maybe we can merge without using github ;-)13:22
kyrofasergiusens, what are you thinking?13:22
sergiusensdoing it manually13:23
sergiusensor maybe an automated task with our merge strategy13:23
kyrofasergiusens, haha, I mean in what situation?13:23
sergiusenskyrofa, just random friday thoughts though13:23
kyrofasergiusens, that's what Fridays are for :)13:23
kyrofasergiusens, what should REALLY happen is that github should autosquash upon merge FOR you. That's what I think13:24
sergiusenskyrofa, ask jono for that ;-)13:24
kyrofasergiusens, ha! Brilliant!13:24
kyrofasergiusens, I mean, it would always succeed and the commit message is a given because they're fixups13:25
sergiusenskyrofa, hmm, you coverage has dropped :-P13:25
kyrofasergiusens, I know... stupid roscore plugin13:25
kyrofasergiusens, I need to bite the bullet and toast it. Next week maybe13:26
kyrofasergiusens, but I think that PR is good to go if you're good with it13:27
sergiusenskyrofa, yay for toasting, and yes, I'm merging it before elopio wakes up ;)13:31
* sergiusens takes a break to run a bit13:44
kyrofamvo_, any idea when the new 15.04 image will be built?13:45
mvo_kyrofa: its ready, I am prepareing the pre-build images as we speak13:48
mvo_meeting right now13:48
kyrofamvo_, excellent :)13:49
fgimenezzyga, that's normally because of a problem before the execution even starts, if you follow the "Details" link in the PR page you can reach the console log page to inspect the cause http://162.213.35.179:8080/job/github-snappy-integration-tests-cloud/344/console14:03
fgimenezzyga, it seems that there was a connectivity problem getting the dependencies14:04
* zyga works on apparmor security module14:10
zygafgimenez: thanks! what's the procedure in that case? Retry/14:10
mvo_kyrofa: you should get the new 15.04 via snappy update already (if you haven't already)14:14
kyrofamvo_, nothing yet14:15
mvo_kyrofa: what does snappy list show you? and what does snappy info show?14:18
kyrofamvo_, wait... I see a version 12 with the release date of today. Is that it? Must have been done automatically?14:19
mvo_kyrofa: yep, magic :)14:19
mvo_kyrofa: great, thanks!14:19
fgimenezzyga, yes, you can retrigger the execution with a comment "retest this please"14:21
kyrofamvo_, jdstrand ah, 15.04.12~ppa15 of the security packages didn't make it in eh?14:28
jdstrandkyrofa: unfortunately not it seems. I just checked myself14:28
jdstrandkyrofa: I tried. the builder and mvo were too fast14:28
kyrofajdstrand, haha, that's alright, I can work around it for now :)14:29
jdstrandmvo_: context> there is an update to ubuntu-core-security that kyrofa needs that I tried to sneak in last night14:29
zygajdstrand: hello :)14:30
mvo_jdstrand: heh, the builders were not exactly fast :) thats unfortunate, but there is always a next image. how urgent is that update?14:30
jdstrandmvo_: I'll let kyrofa comment on that14:31
jdstrandzyga: hello :)14:31
sergiusenselopio, going to be 15' late if you don't mind14:32
sergiusenskyrofa, just in case ^14:32
kyrofamvo_, how often are images built? Think another one will come out before Wednesday?14:32
mvo_kyrofa: unlikely. we can build anohter one, why wednesday?14:32
kyrofamvo_, deadline for the owncloud stuff, but I can always add permission to the .snap temporarily14:33
zygajdstrand: do you know of any sysfs symlink attacks?14:33
zygajdstrand: just curiosity around how I've structured some bits in the code so far14:34
zygajdstrand: is it a security issue to resolve symlinks in sysfs multiple times vs doing it once and caching the result14:34
zyga(for the same path014:34
jdstrandzyga: not otoh but I'd like tyhicks to comment too14:36
zygajdstrand, tyhicks: https://github.com/ubuntu-core/snappy/pull/329/files that's the place14:37
kyrofasergiusens, nothing makes you appreciate mksquashfs like using 1.014:56
sergiusenskyrofa, lol14:57
jdstrandmvo_: oh, also, big thank you for the emergency update :)14:58
* jdstrand hugs mvo_ 14:58
mvo_jdstrand: heh, thanks! thank you for fixing it in the first place15:00
jdstrandmdeslaur: ^ :)15:01
mvo_jdstrand: I read through the details of the cve15:01
mvo_interessting stuff and scary15:01
jdstrandyeah, it was a really well done investigation15:01
* jdstrand notes mdeslaur did the update-- he deserves the credit :)15:02
kyrofajdstrand, ooo I'd like to read this15:03
jdstrandkyrofa: https://wiki.ubuntu.com/SecurityTeam/KnowledgeBase/OpenSSHClientRoaming. at the bottom, see Qualys findings15:04
kyrofajdstrand, ah, that explains why SSH updated on all my servers last night15:05
jdstrandindeed :)15:05
pindongaelopio, I see your PR passed tests but stalled en coveralls15:11
pindongais that normal?15:11
elopiopindonga: ugh, no, it was a lie. Travis playing with my feeligs.15:14
elopioFails with this: call to remove-on-empty (freezer:0) failed: invalid request15:14
elopiopindonga: what if you skip your tests if the system is not xenial?15:14
elopioI will run them here, and once we get this working they will start running on CI.15:14
pindongaelopio, the problem is that my PR introduces a new dependency which currently is only available on xenial15:15
pindonganot sure if it's worth playing the backports game here15:15
pindongaunless of course we need the latest snappy to work on trusty15:16
tyhickszyga: I'm not aware of any symlink attack possibilities in sysfs15:17
elopiopindonga: ah, right. We don't need to backport. So, let me bother stgraber one more time.15:17
elopiostgraber: I am now getting "call to remove-on-empty (freezer:0) failed: invalid request". Any pointers about how to fix that?15:17
sergiusenselopio, kyrofa mvo_ mind looking at this https://github.com/ubuntu-core/snapcraft/pull/234 it is the envvar replacement one15:18
sergiusensI'll run tests in the meantime15:18
elopiosergiusens: seems simple enough. And as snappy supports both for now, I won't even have to update my snaps.15:19
sergiusenselopio, right; that's why I want it in now; if people start uploading, they might as well have the smallest delta possible15:23
elopioagree.15:24
zygatyhicks: thanks15:32
sergiusensmvo_, how do I get the latest snappy-debug on 16.04?15:56
mvo_sergiusens: build as squashfs and upload to the edge channel with rolling as the target15:56
mvo_sergiusens: this way you can only install it via snappy install snappy-debug/edge in 16.0415:56
mvo_sergiusens: but at least you can intsall it15:57
mvo_and once the store is ready we can make it available without the edge15:57
sergiusensmvo_, I don't even know where snappy-debug sources are, I just consume it ;-15:59
sergiusens;-)15:59
mvo_sergiusens: neither do I, I would just download, unpack (dpkg-deb -x), repack and reupload :)15:59
mvo_sergiusens: thats what I did with docker16:00
sergiusensmvo_, ack16:00
fgimenezelopio, for the deploy you need also to wait for the images to be built https://hub.docker.com/r/fgimenez/snappy-jenkins/builds/ https://hub.docker.com/r/fgimenez/snappy-jenkins-slave-xenial/builds/ and https://hub.docker.com/r/fgimenez/snappy-jenkins-slave-vivid/builds/16:07
sergiusenselopio, green light ahead, just don't go to fast or a red light will get you crashing ;-)16:07
elopiosergiusens: do not be hasty, that is my motto.16:10
elopiohttps://i.ytimg.com/vi/8HHVPnvDBlU/maxresdefault.jpg16:10
elopiofgimenez: I forgot about this: https://github.com/ubuntu-core/snappy-jenkins/pull/4516:14
sergiusenselopio, that IS south america :-P16:15
elopiofgimenez: for the cloud provision we are still using nova.16:30
elopioshould we move that also to openstack?16:30
fgimenezelopio, yes we need to update that too, but it's not urgent IMO running from the laptop doesn't give the error, i'll take note of it16:31
elopioack.16:32
kyrofasergiusens, if vivid is EOL next month, what is the official recommendation for what people should be using for Ubuntu Core?16:36
kyrofasergiusens, it can't really be rolling, can it?16:36
elopiofgimenez: do you know about this? http://pastebin.ubuntu.com/14505876/16:38
elopioah, that's the openstack bug.16:40
fgimenezelopio, yes https://bugs.launchpad.net/ubuntu/+source/python-keystoneclient/+bug/1242992, you are running from a canonistack instance, i forgot16:41
ubottuLaunchpad bug 1242992 in python-keystoneclient (Ubuntu) "Unable to autolaunch a dbus-daemon without a $DISPLAY for X11" [Undecided,Confirmed]16:41
elopiook, I'll do the update here.16:41
sergiusenskyrofa, in theory, mvo_ is working hard to get an alpha channel or similar for 16.0416:42
sergiusensbut they know the plan better, or maybe olli16:42
fgimenezelopio, all the docker images have finished building16:43
mvo_kyrofa, sergiusens  my suggestion is to (ab)use the "edge" channel for 16.04 snaps - if that was the question, I lack some context here it seems16:47
kyrofamvo_, vivid EOL is next month. My question was "what should people use between then and 16.04?"16:48
kyrofamvo_, or will vivid Ubuntu Core continue to receive updates?16:48
mvo_kyrofa: I think we need to continue to do updates for some weeks16:48
mvo_kyrofa: I would love to get an alpha out and delcare it good enough16:48
mvo_but there are some gaps still16:49
kyrofamvo_, yeah, okay good I'm glad to hear that16:49
kyrofamvo_, I know that's more work, but I think it'll be appreciated16:49
elopiofgimenez: is nova boot --poll the same as openstack server create --wait?16:54
fgimenezelopio, yes, but not sure if the output has the same fields/format, maybe our checks needs some tweaking16:55
elopioI will know soon.16:56
elopiosergiusens: so this 2.0 release should work on all snaps? or also on the rolling edge non-all-snaps?16:57
sergiusenselopio, on both, but why?17:00
elopiosergiusens: just to see which one to flash.17:00
sergiusenselopio, flash all snaps17:00
sergiusenselopio, obviously ;-)17:00
sergiusensmvo_, bootloader stuff now lives in the kernel, rght?17:04
sergiusensor should live there17:04
mvo_sergiusens: should, its not done yet, still the gadget that is doing it17:16
sergiusensmvo_, right, I'm just in "writing presentation" mode17:24
kyrofasergiusens, can you explain now the tmp stuff works? In the binary wrapper I see `TMPDIR="/tmp/snaps/name/version/tmp"`, but when I look in /tmp I see /tmp/snap.0_name_version/ which contains a file called tmp17:34
kyrofasergiusens, is there some confinement magic happening there?17:35
sergiusenscgroups and mounts17:39
sergiusenskyrofa, ^17:39
kyrofasergiusens, okay very good, thanks :)17:40
elopiosergiusens: the shout port is 9000, right?18:04
sergiusenselopio, I will lie if I say yes18:06
sergiusenselopio, check with netstat18:06
elopiosergiusens: shows only 22 for tcp.18:07
elopioI think it's not serving, but the logs show no errors, as far as I can see.18:08
elopiofails on rolling edge #320 and on all snaps.18:14
elopiosergiusens: kyrofa: can one of you verify if you can access the shout or webchat port from the host?18:14
sergiusenselopio, let me check18:16
sergiusenskyrofa, I still have /usr/bin/python, can you give it a try?18:20
kyrofasergiusens, yeah one sec18:20
elopioOne more thing. Latest rolling edge, I get (amd64)ubuntu@localhost:~$ java-hello-world.hello18:21
elopio/apps/java-hello-world.sideload/IKNMMGUUJQeN/command-hello.wrapper: 9: exec: /bin/wrapper: not found18:21
elopiosergiusens: kyrofa ^18:21
elopioit works on all snaps.18:21
elopiomaybe it doesn't have the short env vars.18:21
sergiusenselopio, I guess it is the cap18:22
sergiusenselopio, install hello-world.mvo and verify ;-)18:22
elopiosergiusens: hello-world.echo from hello-world.mvo works.18:23
sergiusenselopio, I mean, run hello-world.env and check the env :-)18:23
elopioah18:23
kyrofasergiusens, to verify: the ros example has stuff rewritten fine?18:24
elopioSNAPP_APP_PATH=/apps/hello-world.mvo/2.018:24
sergiusenskyrofa, yeah18:24
elopiosergiusens: what cap?18:24
sergiusenselopio, network-listener18:25
elopiosergiusens: oh, you mean the shout problem.18:25
kyrofaelopio, bit me yesterday too18:25
sergiusenselopio, yeah, all server things might need that18:25
kyrofaelopio, by default the cap is network-client, which doesn't allow binding18:26
sergiusenselopio, I don't see apparmor denials though18:26
kyrofasergiusens, I think it's seccomp18:26
sergiusenskyrofa, how did you check those again?18:26
elopiowhere are seccomp problems printed?18:27
kyrofasergiusens, I think snappy-debug still pulls them out though... what clued me in initially was an illegal syscall18:27
kyrofasergiusens, i.e. my binary was aborted18:27
sergiusenskyrofa, snappy-debug does not work on rolling18:27
kyrofasergiusens, which I believe should happen if it's a seccomp denial18:27
kyrofasergiusens, oh18:28
jdstrandsergiusens: it doesn't work on rolling cause it isn't squashfs yet you mean?18:28
sergiusensjdstrand, no one asked for the full story ;-)18:28
sergiusensin any case I'm dpkg-deb -x'ing it and creating a snap again18:28
jdstrandsergiusens: does the store support targeting different releases yet? Ie, can we have snappy-debug as ar for stable and squashfs for rolling?18:29
jdstrandI saw in mvo's email that was coming but didn'18:30
jdstrandt see a subsequent announcement that it was implemented18:30
sergiusenselopio, confirmed * add one of 'firewall-management, network-listener, unix-listener' to 'caps'18:32
sergiusensjdstrand, the trick he said to use was to put rolling stuff on the edge channel18:33
jdstrandsergiusens: ack. sounds like you are handling the snappy-debug upload for rolling/edge then?18:33
sergiusensjdstrand, if you are fine with me unpacking and repacking and it is in the canonical account I forgot the password for, then sure ;-)18:34
jdstrandsergiusens: and for future reference, all I need for squashfs snaps is snapcraft 2.0?18:34
jdstrandwell, I was actually just setting up a new all snaps vm18:34
sergiusensjdstrand, yes; which we are trying to get into xenial cleanly18:34
sergiusensjdstrand, the all snaps ones are much better than the s-i ones, so much more cleaner albeit you can't hack into the os18:35
sergiusensor any other snap for that matter18:35
jdstrandsergiusens: snapcraft 2.0 is in what ppa?18:35
sergiusensjdstrand, none today; planning on going straight into xenial18:35
jdstrandsergiusens: yes, I already have a debugging/development method involving bind mounts for that :)18:35
jdstrandsergiusens: ah, so if it isn't available anywhere, I'd prefer you handle the upload18:36
jdstrandI'm happy to test it though18:36
jdstrandsergiusens: in fact, if you upload it, ping me and I'll test it and approve it18:36
sergiusensjdstrand, http://people.canonical.com/~sergiusens/snappy/snappy-debug_0.11_all.snap18:38
sergiusenselopio, kyrofa in case you need it for rolling http://people.canonical.com/~sergiusens/snappy/snappy-debug_0.11_all.snap18:38
kyrofaThanks sergiusens18:38
elopiosergiusens: kyrofa: network-listener works for shout on all snaps. Not for rolling edge, same error finding binaries.18:39
elopioI'll make a branch to add the caps.18:40
sergiusenselopio, don't worry about the s-i version of rolling18:42
sergiusensit has no new images being created18:42
sergiusenskyrofa, what if I just add the roscore part/plugin into facedetector ?18:44
kyrofasergiusens, that won't get you anything18:45
kyrofasergiusens, catkin has the same replacement logic18:45
kyrofasergiusens, I'm building this now18:47
sergiusenskyrofa, I just don't understand how one works and the other doesn't18:47
kyrofasergiusens, huh... yeah I can duplicate. What on earth18:50
kyrofasergiusens, investigating now18:50
bellyfeelif I made changes to files in the /etc directory would the changes persist after a core kernel update?18:51
kyrofasergiusens, how do my tests pass!?18:51
bellyfeelthe snappy /etc directory, not the snaps18:52
sergiusenskyrofa, the face thing fails, the talker listener works just fine18:54
sergiusensbellyfeel, all writable locations should persist, yes18:55
bellyfeel sergiusens, thanks!18:55
elopiosergiusens or kyrofa: https://github.com/ubuntu-core/snapcraft/pull/23518:57
sergiusenselopio, you are missing gopasted18:58
kyrofasergiusens, I know what it is18:58
kyrofaYour stage-packages change18:58
kyrofaIt's overwriting my customized files18:59
kyrofaWith the ones from the .debs18:59
sergiusenselopio, and tomcat-maven-webapp18:59
sergiusenskyrofa, oh, that sucks; but they are migrated twice though18:59
sergiusenskyrofa, but you are indeed right19:00
kyrofasergiusens, yeah the replacement happens in parts/19:01
sergiusenskyrofa, that's fine19:01
elopiosergiusens: tomcat-maven-webapp works with network-client and network-service: https://github.com/ubuntu-core/snapcraft/pull/228/files19:01
sergiusenselopio, oh, then ignore me19:01
elopiosergiusens: should I replace those two with network-listener?19:01
kyrofasergiusens, but then in stage/ they're definitely from the .debs. I'm not sure what the fix is, though19:02
sergiusenskyrofa, maybe shebangs should be taken care of in repo.py19:03
kyrofasergiusens, hmm, yeah maybe that's the best way19:04
kyrofasergiusens, but I'm not sure how comfortable I am with .debs clobbering my files, you know?19:04
kyrofaCan't they be staged the other way around?19:04
kyrofaDebs then built stuff so I can clobber IT?19:04
sergiusenskyrofa, can we hangout? I don't follow19:05
kyrofasergiusens, sure :)19:05
kyrofaLet me use the restroom real quick, then standup room19:05
elopiokyrofa: sergiusens: I'm left with this one in gopaste: http://pastebin.ubuntu.com/14507643/19:14
elopioclues?19:14
kyrofaelopio, why would it be using fchown?19:19
jdstrandbeuno: is there a plan to handle the existing ar format snaps that targeted rolling now that all snaps images can't install them (but they show up in search)?19:20
elopiokyrofa: I don't know.19:21
kyrofasergiusens, you're right, that works19:22
kyrofasergiusens, I also noticed no time difference19:22
kyrofasergiusens, want me to propose?19:23
elopiojdstrand: do you know anything about http://pastebin.ubuntu.com/14507643/ ?19:24
jdstrandsergiusens: fyi, the snap tests fine. there are other bugs in it related to all snaps but I'll fix those after I have an apt-gettable snapcraft19:24
jdstrandelopio: I sure do19:25
jdstrandelopio: you can't use the chown family of syscalls because of two things: we don't have per-app uids so the chown doesn't make sense under most cases, and for those cases that do make sense, we need syscall argument filtering19:26
jdstrandput more simply, do what it suggested and adjust to not use chown19:26
jdstrandthe hope is we'll have argument filtering for seccomp and can loosen that up a bit19:27
jdstrandfor 16.0419:27
sergiusenskyrofa, sure19:27
elopiohum, the chown seems to come from here: https://raw.githubusercontent.com/mattn/go-sqlite3/master/code/sqlite3-binding.c19:29
sergiusenselopio, sqlite is not going to work without patching19:29
sergiusenskyrofa, this is my lame paste fwiw http://paste.ubuntu.com/14507965/19:31
sergiusenselopio, that is a known issue we have with gopasted sadly19:31
elopiosergiusens: so, release without gopaste working?19:32
jdstrandsergiusens: ok, I uploaded 0.11 to rolling/edge which successfully keeps it out of stable, but 16.04 can't seem to find it19:32
sergiusenselopio, it has never ever ever worked19:33
sergiusensjdstrand, snappy install snappy-debug/edge iirc19:33
jdstrandyes, that's it19:34
elopiook, so this is ready: https://github.com/ubuntu-core/snapcraft/pull/23519:34
sergiusens\o/19:34
sergiusenselopio, oh, for gopasted we can use the security-override and add fchown to the valid syscalls19:35
sergiusenselopio, in case you want to try https://github.com/ubuntu-core/snappy/blob/master/docs/security.md19:36
jdstrandone could do that, but that will block autoapprovals in the store19:38
sergiusensjdstrand, but it does enhance our examples knowledge base :-)19:39
jdstrandsergiusens: which examples? how to get your app require a human review? :P19:39
sergiusensjdstrand, exactly :-P19:39
jdstrandhehe19:39
kyrofasergiusens, elopio https://github.com/ubuntu-core/snapcraft/pull/236 . Prepare yourself. Don't be overwhelmed19:40
jdstrandkyrofa, elopio: fyi, on an allsnaps image: 'sudo snappy install snappy-debug/edge'19:40
jdstrandsergiusens: thanks for your help with that ^19:40
sergiusenskyrofa, fwiw http://paste.ubuntu.com/14508130/19:42
sergiusenskyrofa, progress, but not there yet19:43
kyrofasergiusens, nooo19:44
kyrofasergiusens, that's in /usr/bin19:44
kyrofasergiusens, from the .deb19:44
kyrofasergiusens, maybe repo really should do the shebang19:44
elopiohttps://github.com/ubuntu-core/snapcraft/pull/23719:46
elopioit works.19:46
sergiusenselopio, there's an existing open bug for gopasted in case you want to link it19:46
sergiusenskyrofa, oh, goodie19:47
elopiosergiusens: I saw one, but I'm not too sure it's the same one.19:47
elopioI'll check.19:47
sergiusenselopio, it just says it doesn't work ;-)19:47
sergiusenskyrofa, how do we tackle this then?19:48
sergiusenskyrofa, what file is it specifically?19:48
kyrofasergiusens,  snap/usr/bin/rosversion19:48
kyrofasergiusens, I guess we should extract the search_and_replace method into a more general place19:48
sergiusenskyrofa, into repo.py :-)19:49
elopioI need food. And help with gbp that only says:19:49
elopiogbp:error: Version 0.6 not found19:49
elopiobbs19:49
kyrofasergiusens, well it still needs to be used by the catkin plugin though. Does repo.search_and_replace() make sense in that use case?19:49
sergiusenskyrofa, common, where we dump all the things with no home19:50
sergiusenskyrofa, do you want to tackle it or should I?19:50
kyrofasergiusens, alright. If it's on your critical path (which it seems it is) please feel free, I'm neck deep in mysql at the moment19:50
sergiusenskyrofa, will do19:51
kyrofasergiusens, but I'd be happy to check it out a bit later19:51
kyrofasergiusens, alright19:51
sergiusenskyrofa, I don't think it's that (I layman fixed it fwiw) http://paste.ubuntu.com/14509383/20:16
kyrofasergiusens, that still looks the same... ?20:17
sergiusenskyrofa, yeah, but shebang is correct. My guess is it is missing a PATH20:18
kyrofasergiusens, I thought the wrappers added usr/bin to the path20:18
sergiusenskyrofa, yeah, scratch that, just saw it was in usr/bin20:19
sergiusenselopio, does this need rebasing https://github.com/ubuntu-core/snapcraft/pull/237 ?20:30
sergiusenskyrofa, so happy to see this Jan 15 20:48:50 localhost.localdomain ubuntu-core-launcher[5196]: [ERROR] [1452890930.938570301]: Webcam: expected picture but didn't get it...20:49
sergiusens:-)20:49
kyrofasergiusens, hey! Progress20:50
kyrofasergiusens, do you see all sort of jpeg decoding errors?20:50
sergiusensyeah, now to fix the sys devices perms20:50
sergiusenskyrofa, not yet, just a repetition of that20:50
kyrofasys devices perms?20:51
kyrofasergiusens, you mean the camera permissions?20:52
kyrofasergiusens, or is this unrelated?20:52
sergiusenskyrofa, http://paste.ubuntu.com/14510342/20:52
sergiusensyeah20:52
kyrofasergiusens, oh yeah, that's probably necessary, no?20:53
sergiusensjdstrand, what's the best path to solve ^20:53
sergiusensthe paste20:53
kyrofasergiusens, not sue why it's trying to access mounts though20:54
elopiosergiusens: kyrofa: are we still planning to release today?20:55
elopiocan I help you somehow?20:55
sergiusenskyrofa, me neither, hopefully harmless20:55
kyrofasergiusens, indeed20:55
sergiusenselopio, I think I'll just keep polishing and go for a weekend release20:55
sergiusenselopio, just reviews20:55
elopiosergiusens: ack. I will be close during the weekend, so ping me on telegram if you need a hand.20:57
kyrofasergiusens, regarding the link stuff... I see those File exists: errors as well but I don't understand what's causing them20:59
kyrofasergiusens, which file exists? :P20:59
sergiusenskyrofa, it's the symlink issue20:59
sergiusenskyrofa, just copy what I did :-P20:59
kyrofasergiusens, ohh, because os.remove follows a symlink?21:01
jdstrandsergiusens: are those denials fatal? we purposefully deny the mounts access cause it is an information leak (I've seen this as harmless in the past)21:06
jdstrandsergiusens: the other one I don't think can be solved with hwassign, but the new capabilities work should address that (that is part of why we are doing it)21:06
jdstrandit may also be a harmless denial21:08
kyrofasergiusens, try adding them to the profile manually. Does it fix things?21:09
sergiusensjdstrand, the devices ones, those can be solved with a read-path, right?21:12
sergiusenskyrofa, I am; so close and yet so far :-P21:13
sergiusenssince it's friday of course21:13
kyrofasergiusens, no kidding21:13
jdstrandsergiusens: both of those denials can actually21:23
sergiusenskyrofa, https://github.com/ubuntu-core/snapcraft/pull/23821:25
sergiusenskyrofa, I took the short path for now21:25
kyrofasergiusens, it was literally only that one file? Sheesh21:26
kyrofasergiusens, or at least usr/bin only21:26
sergiusenskyrofa, that file is the only one relevant there; to be fair, in the final snap, all the other ones aren't needed (2to3 is in there)21:27
kyrofasergiusens, gotcha21:27
sergiusenskyrofa, now this is weird Jan 15 21:27:40 localhost.localdomain ubuntu-core-launcher[1654]: [camera-2] process has died [pid 1704, exit code -11, cmd /snaps/face-detector.sideload/IKNWUPeRbPPf/opt/ros/indigo/lib/usb_cam/usb_cam_node __name:=camera __log:=/var/lib/snaps/face-detector.sideload/IKNWUPeRbPPf/ros/log/cced8cc4-bbce-11e5-b9c1-0090f5ccd32c/camera-2.log].21:29
kyrofasergiusens, there should be more of a log than that... no?21:29
sergiusensnope21:30
sergiusensnothing21:30
sergiusensjdstrand, can read-paths be full dirs?21:31
kyrofasergiusens, more apparmor/seccomp denials?21:31
kyrofasergiusens, I've never seen it just collapse before21:31
sergiusenskyrofa, http://paste.ubuntu.com/14511298/21:32
sergiusenskyrofa, I need to stop for a bit, might continue later or early tomorrow; my head is too tired21:32
sergiusensand family is requiring attention21:32
kyrofasergiusens, understood :)21:32
kyrofasergiusens, yeah those hw-assign denials might be killing it21:33
kyrofasergiusens, I didn't envision using a usb device would be this difficult. That driver must be going about it in an unusual way?21:34
jdstrandsergiusens: with read-paths and write-paths, if you do /foo, that is access to a file. if you do /foo/, that is access to /foo/ and everything under it21:38
jdstrandsergiusens: you can also do things like /sys/**/devices/21:38
jdstrandwhich matches /sys/foo/devices/ and /sys/foo/bar/devices/21:39
kyrofajdstrand, any idea why I wouldn't be able to use run-parts from a snap?22:21
kyrofajdstrand, no denials... just a "run-parts: Operation not permitted"22:23
jdstrandkyrofa: DAC?23:01
jdstrandkyrofa: is the script executable, some other unix perms?23:01
kyrofajdstrand, yeah it works fine if I do it in the terminal23:08
kyrofajdstrand, but if I do it in a shell script launched with u-c-l I get that23:08
jdstrandkyrofa: it could be kernel rate limiting. snappy-debug.security tries to make that better, but the kernel has some issues in that area (a reboot and try again might help)23:10
jdstrandkyrofa: beyond that, an strace would likely be the way to go. scp strace to the device, then strace -f -o /tmp/trace /apps/bin/your.thing23:11
jdstrand(for example)23:11
jdstrandkyrofa: I have a very hard stop now though. if you see something wrong with the policy, I do read backscroll23:12
jdstrandkyrofa: oh, we also have a few explicit denials in the policy. you could comment out anything that starts with 'deny ...' in the generated policy23:12
jdstrandreload it and try again23:13
jdstrandthey are explicitly denied for a reason-- to silence noisy denials. if you suspect one is the culprit, remove 'deny' from the rule and see if that fixes it for you23:13
kyrofajdstrand, alright will do, and I understand hard stops! :)23:13
jdstrand(that turns it into an allow)23:13
kyrofajdstrand, thanks for your help23:14
jdstrandnp23:15
jerryGChipaca, ping23:23

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!