=== wgrant__ is now known as wgrant [05:31] good morning [05:35] mwhudson: I'll look into packaging this week [05:35] mwhudson: sorry for not having any time for that lately [05:37] good morning mvo :) [05:38] mvo: I got a +1 from jdstrand on 4008, could you please do 2nd review? [05:39] mvo: that branch is on the critical path towards layouts [05:39] mvo: and I'd love it if we could pull it into 2.29.2 [05:40] hey zyga-solus - good morning === JanC_ is now known as JanC [06:06] zyga-solus: pr looks very good, I added some cosmetic suggestions and I'm fine pulling this in for 2.29 [06:12] thank you === chihchun_afk is now known as chihchun [06:46] good morning, snappy [06:53] good morning kalikiana [07:31] zyga-solus: me neither [07:31] zyga-solus: i refreshed the patches, so i think it's build-dep updates and try to build [07:32] thank you, that sounds good [07:32] let me check i pushed that much to alioth :) [07:34] thank you :) [07:35] seems i did! === chihchun is now known as chihchun_afk === chihchun_afk is now known as chihchun [08:02] hi folks! I just got an extra rasperri pi 3 and would love to use it for Ubuntu core. What would you all use it for? Nextcloud? [08:02] what's the new snapped hotness? :p [08:07] mvo: hey [08:07] mvo: I updated 4008 [08:08] mvo: could you please look at secureMkdirAll again? I'm not using defer but if you feel strongly about it I can reiterate === JoshStrobl is now known as JoshStrobl|zzz [08:14] zyga-solus: thanks, I check it out. out of curiosity, whats wrong with defer there? [08:14] mvo: nothing technically, there are two reasons (perhaps three) that I didn't use defer for [08:15] mvo: it was a rewrite from C and I kept the style [08:15] mvo: I check for all possible errors, including from close (unless already handling an error) [08:15] mvo: and defer would keep more FDs open then we need (one for each path segment) [08:15] mvo: if you prefer defer I can re-work the code to use defer and adjust tests to match [08:16] zyga-solus: ok, that makes sense. I was thinking the fd usage would be it [08:17] mvo: it's not a very strong argument arguably as in typical cases it would keep a handful of FDs open at most [08:17] mvo: I'll try defer quickly, if it's not too ugly we can merge that ;) [08:23] mvo: pushed with defer [08:24] mvo: have a look at patch here please: https://github.com/snapcore/snapd/pull/4008/commits/1a4d21279aedfbad71357ee031cca068af8e4850 [08:24] PR #4008: cmd/snap-update-ns: create missing mount points automatically [08:24] * zyga-solus -> ENOTEA brb [08:25] zyga-solus: it says "done" to the rename of EnsureMountPointImpl but the name is still EnsureMountPointImpl not EnsureMountPoint ? [08:27] zyga-solus: I like it but no super strong opinion either, just feel more "natural" [08:50] mvo: oh, I must have missed it, I renamed the other Impl, correcting now [08:51] Morning guys, I have got past the error I had yesterday building the image for the jetson tk1. I'm now at step 8: populate_filesystems. But I'm missing the MLO. [08:51] no, wait, I dropped that patch entirely :/ [08:52] I have tried to go through the uboot build steps in a terminal and it isn't building the MLO, anyone who can point me in the right direction of figuring out how to build a MLO or why ubuntu-image build expects to find one? [08:53] skjensen: sorry, I don't know much about uboot :/ [08:53] mvo: ok, all done now [08:54] * zyga-solus didn't make tea but instead walked his daughter to school to help [08:55] zyga-solus: to help what? [08:55] Chipaca: to help her, it's raining all the time and her backpack was very heavy today [08:56] zyga-solus: you're supposed to let the rain water get out of the backpack [08:58] :D [08:58] Chipaca: how would they have their swimming classes if I did? [08:59] zyga-solus: fair point [08:59] mvo: hi, did you see my comment from last evening? [09:00] Chipaca: can I frame you into a review of one function? [09:00] zyga-solus: you can try [09:00] Chipaca: can you please have a look at secureMkdirAll in 4008 please [09:00] Chipaca: it's very sensitive to get right and mvo found a bug already today [09:02] pedronis: yeah, I think it makes sense. I have no managed to start with it though but I think I'm done with the xdg-settings for now until I get a review from jamie again so I will look at it next [09:05] mvo: thx [09:05] zyga-solus: I don't understand your answer wrt path vs path/filepath [09:06] mvo, hey, the autokpgtest failure on 4072 look unrelated to the change (spread passed), i think it's safe to merge isn't it? [09:06] zyga-solus: filepath is path for filesystem stuff, path is a more generic thing (for, say, the web) [09:06] Chipaca: snapd#4075 needs a review, it's mostly undoing a previouw checking and starting going in a different direction (in store/ ) [09:06] PR #4075: many: reorg things in preparation to make handling of the base url in store dynamic [09:06] Chipaca: aha [09:07] pedronis: a'ight, i'll get to it after looking at zyga's [09:07] Chipaca: I didn't get that, I'll switch to filepath [09:08] Chipaca: done [09:08] pstolowski: indeed, thank you [09:08] PR snapd#4072 closed: daemon: use newChange() in changeAliases for consistency [09:10] zyga-solus: path.go still uses path though [09:11] Chipaca: path.go? [09:12] ah I see [09:12] OTOH grepping shows a few places [09:12] maybe i should fix in a separate pr [09:12] done [09:13] pushed [09:15] zyga-solus: jamie asked that you add a comment about why secureMkdirAll doesn't take relative paths, and you said 'done', but i don't see the comment; is it somewhere else? [09:15] Chipaca: man, I added that comment, did I break my rebase? [09:15] * zyga-solus looks [09:16] yep [09:16] it's not there :/ [09:16] * zyga-solus looks at reflog [09:17] pushed [09:18] * Chipaca worries [09:20] I just checked, nothing else is lost [09:22] mwhudson: could you please check https://bugs.launchpad.net/ubuntu/+source/golang-1.7/+bug/1726706 and comment if that is safe? there is concern from the sru team that this changes existing behavior on unrelated architectures [09:22] Bug #1726706: Fails to build snapd on ppc64el [09:24] zyga-solus: how much bikeshedding is acceptable on this? [09:24] zyga-solus: 3? :-) [09:24] Chipaca: any amount, what else did you find? [09:25] mvo: sure [09:25] mvo, looks like Sergio has been waiting for your feedback on 3994 (and it's a very small change) [09:25] zyga-solus: i'll comment on the pr [09:27] pstolowski: thanks, I just checked and have the same question as you :) [09:27] good :) [09:30] mvo: where did the sru team express their concerns? [09:30] mwhudson: on irc via /query *cough* [09:30] mvo: hooray [09:31] mvo, hey, do you know what's the status of making classic snaps to work on 17.10? [09:32] mwhudson: I will ask apw to voice his concern about https://launchpad.net/bugs/1726706 in the bug :) but if you can just confirm its an ok change (with your golang maintainer/upstream head on, that would be great) [09:32] Bug #1726706: Fails to build snapd on ppc64el [09:32] mvo: done [09:32] seb128: I'm not sure we are tracking this right now, aiui snapcraft is working on a fix, maybe kalikiana knows more? [09:32] mwhudson: thank you! [09:34] mvo, seems like an important issue? we have projects that were trying to go the snap way and are considering not doing that after all and going back to some other format since snaps don't work for them on current Ubuntu :-/ [09:35] seb128: yes, it sucks. I will raise it during the standup to make sure it gets attention and a proper analysis. is there a forum topic already? [09:37] seb128, i think snapcraft works on droopping all LD_LIBARY_PATH stuff for that and to make all classic snaps use rpath ... [09:37] * ogra_ looks fo the PR ... [09:38] zyga-solus: i was wrong :-) [09:39] Chipaca: about what? [09:42] seb128, https://github.com/snapcore/snapcraft/pull/1632 and https://github.com/snapcore/snapcraft/pull/1635 (seems both are merged in master already... though i guess all existing classic snaps need to be re-built) [09:42] PR snapcraft#1632: libraries: exclude the full set of libc6 [09:42] PR snapcraft#1635: snap: remove leaking LD_LIBRARY_PATH [09:43] mvo, ogra_, thanks [09:44] mvo: Fix for...? [09:44] mvo, https://forum.snapcraft.io/t/classic-snaps-failing-on-ubuntu-17-10/2324/ is the forum post ... from what ogra_ replied it seems to be worked, would still be good to make sure it's properly tracked and know when it might land [09:44] * kalikiana reading the backlog [09:44] kalikiana, ^ [09:45] ogra_, kalikiana, mvo , could somebody post an update on that forum topic? it has several users asking for a status update in the course of the recent weeks and they just got silence in return so far [09:46] seb128: Good call. We've got some fixes for library exclusion and LD_LIBRARY_PATH handling in the pipeline. Will have to check exactly which bits apply to this topic [09:46] seb128, well, kyrofa and sergiusens have been working on it ... either of them should be able to give updates (i dont know more than whats in the discussion and the PRs) [09:52] kyrofa, sergiusens, ^ could you update that forum post before we get people who consider stopping their snap actually doing that because they feel like the system is buggy and nobody cares to update them on the issues? [09:55] zyga-solus: curse you! why am i reading open_by_handle_at(2) at this time of the morning [09:56] Chipaca, dude! now you made us all read it ! [09:57] ogra_: it's all dem bionic badgers [09:57] heh [10:02] Chipaca: haha [10:03] Chipaca: I read it too, did you find anything interesting? [10:06] zyga-solus: no, it nerdsniped me, is all [10:06] zyga-solus: commented on the pr [10:09] Chipaca: thank you [10:10] Chipaca: I can add O_PATH easily [10:10] Chipaca: please look at the defer vs hand-made cleanup response [10:10] PR snapd#4052 closed: tests: check for invalid udev files during all tests [10:10] zyga-solus: yes i know you added the defers [10:10] zyga-solus: i thought the better solution would be to move the body of the loop to a helper, but it doesn't help [10:11] Chipaca, hey, 4050 has a conflict [10:11] (that's why it took me some time to review: i wrote what i thought would help, and it didn't) [10:11] pstolowski: lies! [10:11] * Chipaca looks [10:11] :) [10:11] a PR that's been open for over a week, having a conflict? i'm shocked [10:12] fixing... [10:12] Chipaca: yes, I was thinking about that but there's no nicer way with defer [10:12] Chipaca: python refcount would be better [10:13] PR snapd#4007 closed: interfaces: add plugRef/slotRef helpers for PlugInfo/SlotInfo [10:13] zyga-solus: not really, as the refcount cleanup is not deterministic [10:13] zyga-solus: at least with defers when you're done you're done [10:14] Chipaca: in CPython it is deterministic [10:15] true [10:15] but who still uses cpython :-p [10:15] * Chipaca knows the answer is 'everybody' [10:17] mvo: remember `tidyNoticef`? did you have a better name in mind? [10:17] i'm touching that pr anyway to resolve a conflict so i might as well address this [10:20] kalikiana, thanks for posting on that forum discussion [10:20] Sure. Thanks for bring it up. I try to follow what's going on but sometimes it's just a lot to read. [10:30] i hadn't noticed github's favicon now shows the state of the tests [10:30] nice [10:32] Is it possible to unpack a gadget snap? [10:33] Chipaca: hm, I need to think about a better name but names are hard [10:33] skjensen: you can unpack it with unsquashfs, or you can mount it by hand [10:34] Chipaca: updated again [10:34] skjensen: snaps are just squashfs [10:34] Excellent.. Thanks I will try that and try understand what I have packed down into the gadget.. :) [10:34] :-) [10:35] zyga-solus: ack. On samuele's pr now, i'll check back later (unless i forget :-) [10:35] thank you! [10:35] I'll look at my other PRs that are close to landing [10:36] mvo: I'll just call it noticef, and add a comment [10:41] Chipaca: ok [10:53] Chipaca, got travis failure on completion test https://travis-ci.org/snapcore/snapd/builds/292510395?utm_source=github_status&utm_medium=notification , thought you might want to know [10:54] pstolowski: in prepare [10:55] nice one [10:55] 'tar: /var/lib/snapd: file changed as we read it' [11:07] pedronis: About your comment yesterday, perhaps the right place is indeed the handler of the "configure" task handler [11:08] pedronis: Oh, wait.. the task is actually a hook task [11:08] Hmm [11:08] niemeyer: yea, so a level up [11:08] configstate.Configure [11:08] which needs to create the hook task or a different one [11:08] unless we had overriding pluggability into hooks themselves [11:09] which seems a bit overkill unless we have another use case [11:09] pedronis: The cheapest seems to be intercepting it within the hook handler itself [11:10] pedronis: Well.. or we just have a new handler inside configstate [11:10] the 2nd one was my idea [11:11] I mean hacking in doRunHook is probably cheap but is strange unless we do it as a general mechanism, but then is not that cheap anymore [11:12] pedronis: Sounds good.. these other options in HookSetup probably don't make much sense either way [11:12] pedronis: "configure-snapd"? [11:13] sounds reasonable [11:13] mvo: ^ [11:14] elopio, sergiusens, hello! do you know how could I get reviews here? https://github.com/snapcore/snapcraft/pull/1634 thanks! [11:14] PR snapcraft#1634: Push metadata to the Store [11:24] Facu: For some reason there was no GitHub notifications of your replies... let me have another look now. [11:25] So thanks for pinging on that! [11:25] kalikiana, :) [11:25] The other guys will be around later. I can check also who would help review [11:29] pedronis, mvo: https://forum.snapcraft.io/t/special-casing-the-core-configuration/2594 [11:35] Facu: I added some comments - I'm still slightly confused, though, regarding the arch in update_metadata... what relevance does it have there, if it's unused in the failing code path? [11:36] Maybe the error should be changed? [11:36] pedronis: When you have a moment, would you mind to pass your eyes over #4070.. I think it's good to go, but it wouldn't heart to have another pair of eyes there to check we didn't miss something [11:36] PR #4070: hooks/configure: queue service restarts [11:37] thanks niemeyer [11:37] pstolowski: np [11:38] kalikiana, mmm... I see that SnapNotFoundError supports *not* receiving the arch [11:38] niemeyer, btw, any chance to have your eyes on #4013 before your holidays? [11:38] PR #4013: repo, daemon: use PlugInfo, SlotInfo [11:39] niemeyer, pedronis thanks for this, I'm working on this now [11:40] kalikiana, OTOH, see for example the function get_snap_status in that file; it builds the error with the arch even if the situation that led to the error has nothing to do with the arch (it happened to have the arch because it's just used later) [11:42] niemeyer: I'll look at 4070 in a bit [11:42] pedronis: Thanks! [11:42] mvo: np [11:42] ackk: PR reviewed, and LGTM [11:43] ackk: We need a second review on it [11:43] I don't recall who was involved in the socket activation conversations.. [11:44] Facu: I'd say rather not use it if nothing in the method does. It makes a lot more sense to me anyway [11:45] Ah, Chipaca would be a great reviewer here I think [11:45] Chipaca: #3916! [11:45] PR #3916: snap,wrappers: add support for socket activation [11:45] kalikiana, let's do that [11:46] pstolowski: Yeah, I'm hoping so.. it's looking like a long day :) [11:47] kalikiana, do you have any idea about that ACL failure in Travis? [11:48] thanks niemeyer [11:48] Facu: You mean CLI? Try merging master. The check can get confused when there's new commits. [11:49] CLA, even === chihchun is now known as chihchun_afk [11:54] skjensen, MLO is only expected if you defined it ... if your board doesnt use one you indeed dont need to add it to the gadget.yaml (sorry, only saw you now in the backlog) [11:55] skjensen, here is an example gadget without MLO https://github.com/ogra1/nanopi-neo-gadget ... note that you need to find the right size and offset values for your board indeed ... [11:55] niemeyer: pstolowski: about #4070, +1 with some comments [11:55] PR #4070: hooks/configure: queue service restarts [11:56] and questions [11:57] pstolowski: it seems some of your "upcoming" were in 2.28, time to remove the tags ? [11:57] pedronis: Good points [11:58] Definitely worth testing, and documenting in the snapctl description [11:58] pedronis, pstolowski: The flag also seems useful for the near future.. I'd wait until we have some experience, though, even to make sure we won't have to revert this decision based on user feedback [11:59] I'd name it as --now if it comes [11:59] yea [12:00] updated my comment [12:01] Thanks! [12:01] kalikiana, ack, will merge master, thanks [12:02] ogra_ thanks I will try to build the snap without.. :) [12:03] ogra_ how do you find the correct size and offset values? [12:03] skjensen, i think i wrote about thet in my blog ... [12:03] *that [12:03] okay, I will have another read through the blog.. :) [12:04] https://ograblog.wordpress.com/2017/05/30/building-u-boot-gadget-snap-packages-from-source/ [12:04] under "creating the gadget.yaml " [12:05] you need to know the values typically used for your board ... then you can convert them to byte offsets and size [12:06] yes.. [12:20] ogra_ any chance you know the difference between u-boot.img u-boot-tegra.bin u-boot-dtb-tegra.bin u-boot-nodtb-tegra.bin I see you used the u-boot.img in your example for the bbb but the nanopo is using u-boot-sunxi-with-spl.bin so a bin file.. I got both from building u-boot so which to choose? [12:23] skjensen, oh, no idea, i'd start with u-boot-tegra.bin [12:24] try to find some docs about that from someone wh has done this before [12:24] Okay.. [12:44] willcooke: hey, I had an idea about speeding up gnome snaps on first launch [12:45] willcooke: it isn't fully formed or anything, but snappy has this thing 'userd' that runs as the user in the user's session. it seems plausible that it could be the thing that compiles the gschemas [12:49] jdstrand, we're planning on layouts allowing us to use the compiled schemas which should shave a couple of seconds at least of start-up [12:49] jdstrand, I'll ask jamesh to sync with you on that topic [12:49] willcooke: I'm actually involved in the layouts work, so if he can solve it there, even better [12:50] jdstrand, nice one. I'll drop James an email now anyway [12:52] pedronis, thanks for the review, good points. i'll check my 'upcoming' tags, thanks [12:55] anybody know a snap that has a service and a command? [13:00] Chipaca: network-manager [13:02] Chipaca: it's an interesting example though, because we don't want (for now) people installing it on classic [13:02] Chipaca: fun fact: no fchown with O_PATH [13:03] Chipaca: also, standup [13:05] Chipaca: postgresql? [13:26] Hi, I have a question. Say I have a snap that needs access to /tmp what interface(s) should it connect to? [13:30] arubislander: hey [13:31] arubislander: /tmp is always available but it is private to the snap [13:31] arubislander: no snap can use the real host-side /tmp directory [13:31] arubislander: there is no interface that controls this currently [13:31] arubislander: why do you need access to the host-side /tmp? [13:34] Well, it was more that I am using the libreoffice snap, and every time I want to directly open a file downloaded in firefox I get a permissions error thrown. I need to save the file first to a location in my home folder. [13:35] So I was thinking that maybe there should be an interface for /tmp access just like there is for removable media access. [13:36] zyga-ubuntu: O, I see the convention here is to make it explicit who you are talking too. Apologies for the previous omissions. [13:38] noise][: the postgres snaps have no daemons [13:38] noise][: i suspect this is a bug [13:39] odd. [13:40] Chipaca: etcd has both [13:41] yes yes it does [13:47] zyga-ubuntu: 'daemon is not so portable actually'. what failed with daemon? [13:47] it is defined by the LSB as required [13:48] I'm curious because of something I am working on [13:48] jdstrand: solus [13:48] jdstrand: I switched to nobody nogroup [13:49] arubislander: no worries :) [13:49] arubislander: real /tmp is in /var/lib/snapd/hostfs/tmp but it's not accessible [13:49] jdstrand: I think ikey would know why daemon group is not available there :) [13:51] jdstrand: thank you for the reviews, I think the two branches are much better now [13:51] jdstrand: I'm curious to know what you are working on now [13:51] well, the uid/gid priv dropping work [13:51] but it isn't something I have much time to focus on unfortunately [13:53] jdstrand: uid/gid priv dropping where? I'm not familiar with this topic [13:53] ah === JoshStrobl|zzz is now known as JoshStrobl [13:53] you mean in-snap users? [13:53] (users and grops) [13:53] *groups) [13:53] zyga-ubuntu: that is one of 4 use cases, yes [13:54] https://forum.snapcraft.io/t/snappy-users-and-groups-take-2/1461 [13:54] the topic was renamed to focus on only one use case though... [13:55] ikey: fyi> http://refspecs.linuxfoundation.org/LSB_5.0.0/LSB-Core-generic/LSB-Core-generic/usernames.html [13:55] ikey: 'daemon' is listed under 'Required User & Group Names' [13:56] zyga-ubuntu: you might consider the fact that 'nobody' is optional under LSB and 'nogroup' is not lised as anything (I think 'nogroup' is a Debian-ism iirc) [13:57] zyga-ubuntu: perhaps your PR should use 'bin/bin' or continue to use 'daemon/daemon' and pick something else on solus? [13:57] anyway, I'm not blocking on that. it is just the test code [13:58] niemeyer: would be good to have your input here https://forum.snapcraft.io/t/new-install-refresh-api-with-the-store/2269/6 if you have any immediate feedback [14:02] jdstrand: eh, good point [14:02] jdstrand: maybe I cna put a list of things and if any of those work, pass the tset [14:02] *test [14:04] PR snapcraft#1639 opened: grammar: to statement [14:13] mvo: FYI, I just want to get this under someone's radar: https://bugs.launchpad.net/snappy/+bug/1723881 [14:13] Bug #1723881: [Feature Request] Support pre-invoke and post-invoke commands as DPkg::Pre-Invoke and DPkg::Post-Invoke in APT [14:16] * zyga-ubuntu breaks for lunch [14:29] zyga-ubuntu: thanks for the info. /tmp not being accessible, is that a confinement security based decision? [14:34] * jdstrand -> errands and lunch [14:41] mvo: can i nominate #4050 for 2.19rcN? [14:41] PR #4050: cmd/snap: tell translators about arg names and descs req's [14:42] mvo: also can i have a review of it :-) [14:43] hey popey, can you share the snapcraft.yaml of yakyak, probably a comment here: https://github.com/yakyak/yakyak/issues/741 would be nice. [14:44] arubislander: yes [14:44] arubislander: for isolation each snap sees a private /tmp [14:45] popey: someone actually proposed snap packaging a few months ago for yakyak: https://github.com/yakyak/yakyak/pull/752 but that didn't go much far. (and the diff looks weird) [14:45] PR yakyak/yakyak#752: Added Snap Support [14:45] mvo, is this the error that you mentioned in trusty https://paste.ubuntu.com/25817308/ [14:45] ? [14:46] darn, I didn't plug my laptop and it suspended [14:48] ogra_, kalikiana seb128 mvo not completely fixed yet, but definitely a high priority [14:49] ogra_, kalikiana seb128 mvo we've landed a few PRs that make progress, but we're still missing patchelf changes [14:49] Which is in progress [14:49] I'll update the forum thread [14:49] +1 [14:49] seb128, thank you for the ping, we should have been updating it as we made progress [14:50] cachio: I have not seen this one yet :/ [14:51] mvo, ok [14:52] kyrofa, thanks [15:05] PR snapd#3989 closed: client, daemon: rest api to configure store api [15:05] snappy-m-o 1630 xenial:amd64:integrationtests [15:06] PR snapd#3990 closed: cmd/snap,client,daemon: support set/unset of store front [15:08] snappy-m-o autopkgtest 1630 xenial:amd64:integrationtests [15:09] elopio: I've just triggered your test. [15:11] hrm [15:11] Chipaca: any reason not to merge #4062, you addressed the objection afaict. [15:11] PR #4062: cmd/snap: warn when a snap is not from the tracking channel [15:13] pedronis: I did, but I don't like to merge while it's still 'changes requested' [15:13] although I now see a "dismiss review" button [15:13] * Chipaca grins evily === cachio_ is now known as cachio_lunch [15:14] snappy-m-o, autopkgtest 1636 xenial:amd64 [15:14] kyrofa: I've just triggered your test. [15:15] PR snapd#3965 closed: interfaces/mount: add support for parsing x-snapd.{mode,uid,gid}= [15:15] PR snapd#3999 closed: cmd/snap-confine: add detection of stale mount namespace [15:16] PR snapd#4062 closed: cmd/snap: warn when a snap is not from the tracking channel [15:16] snappy-m-o: dance for us [15:16] Command ":" / ": dance" not found. [15:20] zyga-ubuntu: check [15:20] mvo: what's the status of #4060, I see it has two +1 but some open nitpicks ? [15:20] PR #4060: interfaces: clean system apparmor cache on core device [15:22] seb128, update given [15:23] pedronis: indeed, I will get to it later, forgot about those === Eleventh_Doctor is now known as Pharaoh_Atem [15:26] kyrofa, thanks [15:28] om26er: kk [15:36] * Chipaca hugs pedronis [15:36] thank you for doing this [15:41] Hey jdstrand, review-wise, can I claim the same dbus common name in two snaps? [15:42] zyga-ubuntu: do you have any idea about https://bugs.launchpad.net/snapd/+bug/1721518 ? the most interessting part if #3 actually, on trusty apprently sometimes interface connections get lost [15:42] Bug #1721518: Latest snapd in Trusty is broken after reboot because of systemd units start ordering [15:44] mvo: looking [15:45] mvo: that's very interesting [15:45] mvo: no idaa, come to think of it, maybe something we are doing is wiping our state [15:45] mvo: maybe some 1st boot logic? [15:45] zyga-ubuntu: interessting idea [15:45] mvo: nothing that I can think of would remove connections [15:46] mvo: especially if the snap is present [15:46] mvo: and it seems it is as there are slots there from core [15:46] zyga-ubuntu: the annoying part is that its on trusty and we have lost the knowledge about the details there [15:46] mvo: yes but I think we are not in a terrible situation, the set of units is closed, it's just deputy-systemd and snapd systemd units [15:47] mvo: we can see what starts when and what happens [15:47] mvo: the downside is that last time I looked there was no logging on 14.04 [15:47] mvo: I can look but I'm in a car now [15:48] mvo: tell me what you know [15:48] zyga-ubuntu: heh, no worries [15:48] mvo: did you manage to reproduce it? [15:49] zyga-ubuntu: I don't know anything at this point :( I have not yet found time to reproduce/debug. was mostly wondering if you saw any of this before, if not, thats fine. I can look tomorrow morning if I can reproduce (some people from landscape wait for this) [15:50] mvo: I saw one instance [15:50] mvo: but it was _not_ on 14.04 [15:50] zyga-ubuntu: oh?!? [15:50] mvo: sergio reported it on his surface [15:50] mvo: not sure what the conditions were but it wasn't 14.04 for sure [15:50] kyrofa: Perhaps you'd like to have a look at snapcraft#1639 - as written in the description that's not implementing the "on..to.." yet. I'm still working on that (and still pondering how to not make it too ugly, haha). Was wondering if it should be done in one bigger PR or rather two separate ones... [15:50] PR snapcraft#1639: grammar: to statement [15:50] mvo: I can setup a test loop [15:51] mvo: just not sure what the steps are, boot trusty, install snapd, reboot, test hello world, [15:51] mvo: at each time hello-world should have iface connections [15:51] cachio_lunch: hey, if you have a free slot in between the other work, would you mind to try to reproduce https://bugs.launchpad.net/snapd/+bug/1721518 ? [15:51] Bug #1721518: Latest snapd in Trusty is broken after reboot because of systemd units start ordering [15:51] mvo: I can also install other snaps (maybe the one used in the report matters) === cachio_lunch is now known as cachio [15:51] mvo: I can tweak my python script for snapshots to test this very quckly (many loops) [15:51] mvo, sure [15:52] mvo: but that looks like a half day effort tomorrow morning [15:52] * kalikiana will be leaving in a few minutes, but feel free to respond here anyway [15:52] zyga-ubuntu: canonical-livepatch is the important one. if you or cachio (timezone wise it might be better for him as its earlier there) could check that would be great [15:52] zyga-ubuntu: yeah, lets see if cachio can easily reproduce and then we decide what to do [15:52] PR snapd#4076 opened: many: handle core configuration internally instead of using the core configure hook [15:52] mvo: ok, Ill let cachio work on this today and I'll attack it first thing tomorrow [15:52] zyga-ubuntu: \o/ lets sync on it in the morning [15:52] I'm working on the overlayfs PR now but I have some tests to adjusts after rebasing [15:52] mvo: sounds good, [15:53] kalikiana, will do [15:53] zyga-ubuntu: ta [15:57] Thanks! [16:01] sergiusens: Maybe you wanna check this one? It's store-related and needs another reviewer snapcraft#1634 [16:01] PR snapcraft#1634: Push metadata to the Store [16:13] mvo: I left some initial comments in #4076, but looking code afaict [16:13] PR #4076: many: handle core configuration internally instead of using the core configure hook [16:18] pedronis: Thanks, will definitely look today [16:25] PR snapd#4077 opened: spdx: fix for WITH syntax, require a license name before the operator [16:31] mvo, I meant "looking good" [16:40] pedronis: I'm slightly confused about the question about epoch [16:40] pedronis: How can the server possibly respect the epoch if it doesn't know it? [16:54] mvo, I could reproduce the error [16:57] snappy-m-o, autopkgtest 1583 xenial:amd64 [16:57] kyrofa: I've just triggered your test. [17:02] mvo, http://paste.ubuntu.com/25818102/ [17:10] mvo, I don't see anything weird apart of that [17:23] * zyga-ubuntu is stuck in a traffic jam [17:23] running spread tests [17:23] watching the rain [17:23] ... [17:26] zyga-ubuntu, I could reproduce the error in trusty [17:26] raining here too :) [17:28] falling hail now [17:39] kenvandine, hey [17:39] niemeyer: I think, they are thinking of going from revision to the epoch info looking at the info in the store [17:40] pedronis: I see.. but that wouldn't work for the local case [17:40] kenvandine, trying to access to gsettings schemas from a test snap [17:40] hey cachio [17:41] kenvandine, I am using the desktop interface but I can just access by using devmode [17:41] niemeyer: yes, but the local case doesn't quite fit into things, it's really special, we don't have a snap-id either for that case, it's really a cross of an install and refresh [17:41] cachio, you need the gsettings interface too [17:41] kenvandine, yes [17:42] kenvandine, I can access to if I manually set the schemas dir to /var/lib/snapd/hostfs/usr/share/glib-2.0/schemas [17:42] kenvandine, and I am in devmode [17:42] kenvandine, is there any other way to access the user schemas? [17:42] pedronis: yay, thanks a lot for your review! [17:43] cachio: thanks, thats great. well, not great but at least easy to reproduce [17:43] mvo, yes, first attempt [17:44] cachio: what comments did you run? exactly the same as in the bugreport? I wonder why none of our existing tests caught this :( [17:44] * mvo gets the feeling that however many tests you have, its never enough [17:45] cachio, i haven't needed to change any schemas dir [17:45] all my gnome snaps work just fine [17:45] cachio, which snap are you working on? [17:45] kenvandine, do you have an example? [17:46] kenvandine, I would like to see how you are building the snaps, tx [17:46] http://bazaar.launchpad.net/~ubuntu-desktop/gnome-calculator/snap/view/head:/snapcraft.yaml [17:46] mvo, I have the same question [17:46] cachio, is an example [17:46] kenvandine, tx [17:46] cachio, and it has to be built with the ubuntu-desktop/gnome-3-26 PPA enabled [17:47] mvo, I'll gonna make a review of the tests to see if we need a new tests or what happened [17:47] cachio: can you tell me what you did to reproduce? I will do the same [17:48] zyga-ubuntu, just updated with apt [17:48] caa [17:48] cachio: thanks for chasing this, much appreciated [17:48] cachio: aha, just that? did you have any set of snaps installed? [17:48] and then followed the steps in the bug [17:48] ah, ok, so the canonical-livepatch is relevant to the bug? [17:48] cachio: I will look into it in my morning (in ~11h) to see if I can find the root cause [17:48] I removed snapd, and then installed 2.27.5 from the archive [17:49] cachio: so the steps are: [17:49] cachio: boot 14.04 [17:49] cachio: install/update snapd [17:49] cachio: install canonical-livepatch [17:49] 2.27.5 [17:49] cachio: ... ? [17:49] cachio: can you tell me which kernel you had around when the bug happened [17:49] cachio: (running) [17:50] zyga-ubuntu, 4.4.0-89-generic [17:50] cachio: ok [17:50] then you rebboot [17:50] then install hello-world and see that everything goes ok [17:50] then you reboot again [17:50] cachio: so after reboot is's okay [17:50] cachio: aha, go on [17:51] and when you do snap intergaces, you see there are not interfaces listed [17:51] cachio: when you started and before the 1st reboot, were you on 4.x already? [17:51] zyga-ubuntu, yes [17:51] the instructions sound like a spread test is not too hard to write for this (which is nice) [17:51] mvo, should be easy [17:51] I'll try to do it [17:54] \o/ [17:57] mvo: seems the change about configure made it so that we run it also on classic but now it fails seeing it cannot be, but we want some bits run also on classic, we need to reorg that somehow [18:00] or we ignore errors differently [18:02] pedronis: Indeed, but ideally we'd still try to handle it correctly [18:02] kyrofa: review-wise, yes, so long as it makes sense for both [18:02] pedronis: Based on the name [18:02] pedronis: and we might prevent obvious breakage by not allowing the epoch to go through [18:03] niemeyer: yes, but unclear we would put epoch in the context (the context doesn't have names, just snap-id), as I see it it woulb be a special case of "install" or its own "refresh-local" or something [18:04] pedronis: Hmm [18:04] we could support both snap-ids and names in context [18:04] but not a fan of that [18:04] pedronis: Yeah, I guess it'd be special indeed, and we probably don't want to send names at all cases [18:04] pedronis: So sounds worth not bothering for now [18:05] yes, I think it's special enough, we can fit it in later but with some special casing [18:05] but not worth making general changes based on it [18:06] niemeyer: I think the conclusion is tha we don't strictly need epoch in context, I don't know if we still want to be explict though, or better leave the server to do revision->epoch lookup [18:08] pedronis: I think it wouldn't hurt to have it either way [18:08] pedronis: But I also can't argue for it with a good argument [18:11] I think it's best to leave it out, at least there's no situation in which the client can send somebody that is "wrong" [18:12] s/somebody/something/ === JanC_ is now known as JanC [19:10] ogra_: is porting ubuntu core to a new ARM device something a semi-technical semi-literate numpty like me would be capable of doing? I'd love to run core on my sheevaplug device, instead of debian [19:13] You're still using a sheevaplug? Nice, I've got my old one sitting here [19:13] However, I seem to remember that being arm6 [19:13] Which Ubuntu doesn't support [19:13] kyrofa: I have yet to find anything more reliable, to be honest. It just keeps working. [19:14] mcphail, yeah I was on that train for a while as well. Used a few different plug computers. They kept eating my SD cards, though [19:15] mcphail, the Mirabox was the best [19:15] Dual USB 3, dual gigabit ethernet [19:15] I use the SD card for as little as possible. Most of my stuff is on the internal flash with an external usb drive bind-mounted over it [19:15] Ah, good idea [19:17] It is a PITA to update when a new debian version comes out, though. Messing about with uboot is never fun. That's why the snappy model is attractive [19:17] mcphail, just to double-check, can I see a `cat /proc/cpuinfo` ? [19:19] http://termbin.com/1tev [19:21] Does core require a certain feature set? [19:24] mcphail, armv5 [19:24] mcphail, Ubuntu hasn't supported that since... what... 9.10? [19:24] mcphail, and by extension, Ubuntu Core [19:24] PR snapd#4070 closed: hooks/configure: queue service restarts [19:25] kyrofa: aah. But I can build my own kernel snap, can't I? [19:25] mcphail, ogra_ is the expert here of course, but I don't think your quest will end in happiness [19:25] shame [19:25] mcphail, oh sure. But consider the core snap, and the support archs in the store [19:26] s/support/supported/ [19:26] Hmm. Isn't armhf backwards compatiblke? [19:27] Backwards compatible to... what? [19:27] a armv5 binary to run on arvm7 [19:28] an* [19:28] armel [19:31] debian moved from armel to armhf with ARMv7 CPUs. That's when Ubuntu dropped sheevaplug support, but debian continued its armel port as well. I _think_ I've run armhf packages on the asheevaplug in the past (certainly, I run syncthing which is just packaged in a generic "arm" repo). I don't really understand this stuff ;) [19:38] Can anyone here help with a snapcraft make error? [19:39] mcphail, I don't think it works that direction-- I suspect hard-float instructions aren't supported on soft-float hardware, but the other way around might be possible [19:39] mcphail, but yeah, I don't pretend to be an expert either [19:40] I also think it's beyond just the floating point hardware [19:40] youngc, hit me :) [19:43] kyrofa: thanks. You're probably right. I've just run "readelf -h syncthing | grep Flags" and it looks like it is ARM EABI v5. I suspect they release it that way and it will probably be forward compatible [19:44] here we go... As far as using make goes it works, but... when I use the following command "make -f ./Makefile-Linux.x86_64 all" the make fails. Mind you I can manually go to the folder and type make and it works. [19:44] more info just a sec [19:45] it seems to be failing due to the actual folder is trying to run from [19:47] but not sure [19:48] the code is here: https://github.com/chadyoungdell/benchmark.io.iometer.snap [19:49] youngc, when you "manually go to the folder and type make", it uses a different Makefile [19:49] youngc, unless you're missing a step? [19:49] Let me pull this thing real quick [19:51] elopio, loving all the bitesize bugs [19:53] youngc, try `makefile: src/Makefile-Linux.x86_64` [19:53] youngc, it's relative to the root of the source [19:54] youngc, which in the tarball, has that makefile in the `src/` dir [19:54] I did that before this and had the same failure - let me try again real quick [19:55] youngc, it still doesn't build, looks like the makefile is missing some things, but that'll get you unblocked anyway [19:55] youngc, I get "make: *** No rule to make target 'IOGlobals.o', needed by 'dynamo'. Stop." [19:55] thats what I get to [19:56] youngc, definitely not the same error [19:56] if you open the file Makefile-Linux.x86_64 and modifiy IOGlobals.o to src/IOGlobals.o that file actually compiles [19:57] sorry, I meant after I chaned the file to what you asked [19:57] youngc, you might find this works better: https://pastebin.ubuntu.com/25818987/ [19:58] youngc, sounds like the cwd needs to be in src/ basically [19:58] youngc, so that will help [19:58] youngc, note the `source-subdir` [19:58] ok, let me try that [19:58] youngc, also note the removal of `src` from `makefile` [19:59] basically that will run `cd src && make -f Makefileblahblah` instead [19:59] cool!! that works [20:00] Good deal [20:00] I did not know that you could add the source-subdir to something other than git [20:00] thanks for the help [20:00] youngc, any time :) [20:01] sergiusens: o/ Am I doing something wrong, or are dots not allowed in app names? [20:02] Odd_Bloke, app names consist of upper- and lower-case alphanumeric characters and hyphens. They cannot start or end with a hyphen [20:02] No periods [20:03] Hmph. [20:03] Fair enough. [20:20] sergiusens: https://forum.snapcraft.io/t/snapcraft-unable-to-install-core-snap/2599 - what am I doing wrong? [20:41] kyrofa these two PRs have been very challenging for my English. They will need many of your reviews. [20:43] elopio, my pleasure, of course [20:43] elopio, oh! Your regular nick again, eh? [20:44] I had to change my password... [20:44] Matrix is fun. [20:52] Yeah, top-of-the-line user experience, I've noticed [20:58] roadmr: fyi, https://dashboard.snapcraft.io/dev/snaps/7385/rev/995/ got stuck too. I requested to re-review [20:59] jdstrand: let's have a look [20:59] roadmr: that didn't seem to help [20:59] (the re-review) [21:00] roadmr: https://dashboard.snapcraft.io/dev/snaps/8324/rev/51/ too. 19 hours ago, review tools passed [21:00] roadmr: could this have something to do with the pacemaker bug? [21:00] pacemaker bug?? [21:01] PR snapd#4078 opened: tests: new test to check interfaces after reboot the system [21:01] so - 8324 does seem stuck but 7385 doesn't [21:01] give me a sec to check the admin [21:01] oh, 7385 too, I was looking at wrong rev [21:01] roadmr: https://launchpadlibrarian.net/342811432/pacemaker_1.1.14-2ubuntu1.2_1.1.14-2ubuntu1.3.diff.gz [21:02] roadmr: I'm just curious-- cj watson mentioned something dying before that fix [21:03] jdstrand: probably not, this seems related to celery processes in the store's application units grabbing tasks which they then don't process [21:03] roadmr: ok, 7385-- it just took longer than I expected. looks like my re-review request got it unstuck [21:03] jdstrand: ok - I do see 8324 in the "stuck" queue [21:04] jdstrand: do you have the "run the automated review again" button in https://dashboard.snapcraft.io/dev/snaps/8324/rev/51/ ? [21:04] roadmr: ok, I won't touch 8324 and let you do whatever you need [21:04] roadmr: I do [21:04] I can do that. I didn't know if you wanted to look at 8324 more closely [21:05] jdstrand: give me a sec to just check if it correlates with a rollout (which is when we see celery weirdness happening) [21:09] jdstrand: ok, I kicked 8324 so we don't block it. We did match it with a rollout yesterday, so we'll figure out a way to keep this from happening [21:09] but it might, while we do figure out a way :) so let me know of any weirdness [21:18] jdstrand, I just got a bug report from a user trying to install my snap on digitalocean, but getting "cannot perform readlinkat() on the mount namespace file descriptor of the init process: Permission denied" [21:18] roadmr: ackc [21:18] jdstrand, any clues regarding what might be the issue there? [21:21] kyrofa: sounds like the kernel blocked snap-confine. are there any security denials? [21:22] kyrofa: fyi, this is line 132 in cmd/snap-confine/ns-support.c [21:23] jdstrand, I'll check [21:24] kyrofa: if there is no denial, this is code zyga wrote so he may be more familiar with it. but would likely need a forum post with kernel version, etc [21:48] jdstrand, does this look odd? Oct 25 17:40:26 portfolio kernel: [ 223.174251] type=1400 audit(1508967626.765:94): apparmor="DENIED" operation="ptrace" profile="/snap/core/3247/usr/lib/snapd/snap-confine" pid=2427 comm="snap-confine" requested_mask="read" denied_mask="read" peer="unconfined" [21:49] kyrofa: it does [21:50] kyrofa: I'm curious if this rule would fix it: ptrace (read) peer=unconfined, [21:51] kyrofa: we already have this rule which is meant to cover this: ptrace trace peer=unconfined, [21:51] kyrofa: so it is possible that the Digital Ocean kernel is behaving differently [21:52] kyrofa: (in snap-confine's profile) [21:52] jdstrand, it's not re-execing using the profile in the core snap? [21:53] kyrofa: hmm? I don't know anything about the vm that this would be running in [21:53] jdstrand, sorry, rephrasing: where is snap-confine's profile? [21:54] kyrofa: yes, that is the question. and the answer depends on if it is re-execing :) [21:54] Oh! So I DID ask the right question, haha [21:54] jdstrand, I believe it's good old Ubuntu 16.04 [21:54] kyrofa: well, if that was your question, I didn't understand it :P [21:54] anyhoo [21:55] jdstrand, boo :( [21:55] so, if Ubuntu 16.04, then it should be reexecing [21:55] But I can still copy the profile off, edit it, and load it [21:55] you'll want to obtain the version of core. look at /snap/core/current and see what it is pointing to [21:56] jdstrand, 3247 given the denial above, no? [21:56] then it will be /etc/apparmor.d/snap.core.3247.usr.lib.snapd.snap-confine [21:56] kyrofa: I suggest copying that file to ~ [21:56] then modify it, then do: sudo apparmor_parser -r ~/snap.core.3247.usr.lib.snapd.snap-confine [21:57] jdstrand, excellent, thank you [21:57] I'll get back to you [22:00] that was harsh. I had a terminal open with an ssh session to a vm. I start to type in it and I didn't notice that typing into showed the connection was broken. then I sudo shutdown the 'vm' and tore down my session [22:00] fun! [22:00] Oouuch [22:01] jdstrand, teach YOU to type looking at your fingers [22:01] kyrofa: so, what I was going to say was make sure you add the rule to the main profile, not the mount-helper child profile [22:01] well, the vm is stopped now [22:02] so I achieved at least that much :) [22:03] kyrofa: if that works, let me know and give the output of cat /proc/version_signature [22:03] jdstrand, I only see one `ptrace trace peer=unconfined` in there [22:03] jdstrand, I'm just replacing it... no? [22:04] kyrofa: don't replace. add [22:04] Just right below? [22:04] yeah [22:05] jdstrand, double-checking: the filename that I hand to apparmor_parser doesn't matter, right? [22:06] kyrofa: correct [22:06] jdstrand, one more double-check: https://pastebin.ubuntu.com/25819686/ [22:07] Haha, dangit, flip the args [22:07] kyrofa: the diff is backwards, but yes [22:07] * jdstrand nods [22:07] Okay good [22:07] kyrofa: wait whoops [22:07] kyrofa: you forgot the trailing comma [22:07] Ah, good catch [22:08] kyrofa: this is also a safe action. if you jack it up, a reboot gives you the profile on the system since you didn't modify it [22:12] jdstrand, indeed, thank you! [22:13] kyrofa: did it work? [22:17] jdstrand, working on it, this is async I'm afraid [22:17] gotcha [22:17] jdstrand, side note, I was trying to tweak the profile myself and send it to him, only to learn that I seemingly can't access anything in my home directory with "snap-confine" in the name from a confined snap [22:17] jdstrand, is that true? [22:18] jdstrand, https://pastebin.ubuntu.com/25819750/ [22:18] kyrofa: you are within a confined snap? [22:18] jdstrand, indeed [22:19] kyrofa: and the home interface is connected? [22:19] kyrofa: it seems it would be since foo-bar-baz is there [22:19] jdstrand, yep. Note the pastebin. It works as long as "snap-confine" isn't part of the file name :P [22:22] jdstrand, wait, no sorry, only if snap-confine is starting the file name [22:22] ok [22:22] I was going to say, I couldn't see how foo-bar-snap-confine wouldn't work [22:23] kyrofa: it is this gem: http://paste.ubuntu.com/25819780/ [22:23] jdstrand, haha, ouch [22:24] kyrofa: it's incomplete [22:24] I'll add a todo for that [22:24] jdstrand, thank you! [22:26] jdstrand, that profile tweak did the trick [22:26] jdstrand, another interesting tidbit: this box was upgraded from trusty [22:27] kyrofa: ok, what is the kernel? cat /proc/version_signature [22:28] jdstrand, Ubuntu 3.13.0-71.114-generic 3.13.11-ckt29 [22:28] kyrofa: alright, so that there is your problem. you need the xenial kernel [22:29] I'm surprised things are working as well as it is [22:29] So do-release-upgrade doesn't upgrade the kernel? [22:29] kyrofa: it absolutely should have [22:30] kyrofa: perhaps the kernel was pinned? something went awry in the upgrade? grub didn't get updated? [22:30] there are a lot of things that could've gone wrong [22:30] kyrofa: sudo apt-get install linux-generic [22:31] that may provide a clue if it is pinned. beyond that, they need to upgrade their kernel [22:32] Thanks jdstrand there are actually two people saying this happened on digitalocean [22:32] Something weird is happening over there [22:33] yeah. huh [22:33] kyrofa: is this a xen environment? [22:33] jdstrand, great question, I have no idea how they do it [22:33] cause maybe it is Digital Ocean's kernel (that happens to be an Ubuntu kernel) [22:34] some hosting environments do things like that [22:50] PR core#38 closed: Add another pi-config option [22:50] PR core#58 closed: use `snapctl internal configure-core` to configure core [22:50] PR core#62 closed: create xdg-settings inside the core snap [22:51] PR core#38 opened: Add another pi-config option [22:51] PR core#58 opened: use `snapctl internal configure-core` to configure core [22:51] PR core#62 opened: create xdg-settings inside the core snap [23:09] jdstrand, finally, all resolved now [23:09] jdstrand, https://www.digitalocean.com/community/tutorials/how-to-update-a-digitalocean-server-s-kernel [23:10] jdstrand, tl;dr older droplets manage their kernel differently, outside the machine in the dashboard [23:10] jdstrand, so even after updating, while the new kernel was installed, it wasn't booting into it [23:10] kyrofa: yeah, it's a pretty regular FAQ in #ubuntu sadly [23:10] jdstrand, once we got that sorted, snaps work fine [23:10] nacc, brutal man [23:11] Weird way to structure a system [23:11] kyrofa: we'll be debugging some weird issue and it'll turn out they are runnig some random kernel :) [23:11] But it sounds like they know that, and don't do it anymore [23:11] kyrofa: VPS are a pain in that regard [23:11] nacc, oh yeah, that happens all the time, definitely [23:11] nacc, but trying to figure out why a kernel isn't being booted, despite grub looking perfect... ? [23:11] nacc, do you see that often? [23:12] kyrofa: not off the top of my head -- but i often default to blaminng the VPS provider if they are on any kind of VPS [23:12] :) [23:12] nacc, heh [23:35] kyrofa: interesting, thanks! [23:36] jdstrand, thank YOU [23:36] Didn't even consider asking about the kernel [23:36] Sorry for the wild goose chase [23:36] Now I know