/srv/irclogs.ubuntu.com/2019/07/16/#snappy.txt

=== harrisj_ is now known as harrisj
mvohey Chipaca, good morning!08:23
mvo7096 needs a second review, should be an easy one08:24
Chipacamvo: looking08:24
mvota08:24
pedronismmh08:36
mvopedronis: mmh? (and good morning :)08:44
pedronisI have vague memories that the ! would go in front , but I'm probably misremembering, the notes says after08:44
pedronisalso the shell would scream if in front08:45
pedronisso I'm misremembering for sure08:45
mvopedronis: oh, indeed08:46
pedronisalso in the context of the unset work, we shouldn't forget we decided to fix snap set a.x=... a=... by sorting09:18
mvopedronis: good point, I wonder if we captured this in one of the trello cards09:19
Chipacapedronis: what kind of sorting?09:20
Chipacaogra: mvo: do you know, offhand, how to pause the live cdimage before it boots into the actual live system? wanting to set SNAPD_DEBUG :)09:25
ogranot sure you can ... but there should be a console on tty409:26
ogra(so you can do your edits and restart all involved bits)09:27
Chipacaogra: the thing i'm wanting to see is the seeding, and i'm not fast enough09:28
mvoChipaca: uh, thats a tricky one. I wonder if you could break into initramfs09:28
ograyeah, thats a possibility but also a lot of time consuming work09:29
ogra(manually assmbling the rootfs, chrooting and editing etc)09:29
Chipacaeugh09:29
ChipacaI've asked laney, maybe they have a trick for it09:29
ogratry break=bottom09:29
ograon the kernel commandline09:29
mvoyeah, break=bottom was what I was thinking, then tweak and exit the shell and hope for the best09:30
Chipacatrying that09:30
ogra(there should be a way to enter this at the very start)09:30
Chipacabreak=bottom and then echo SNAPD_DEBUG=1 >> /root/etc/environment worked09:33
mvoChipaca: \o/09:37
Chipacaneed to step out for a bit, will bbiab09:38
pedronisChipaca: by depth09:40
mvo6878 (health status in info/list has two +1, I will merge it, I left one bikesheed comment though, but its fine to ignore that)09:49
pedronismvo: it's in the card https://trello.com/c/yxC3omC9/245-snap-unset-support09:53
pedronisbut not sure it was done yet (haven't looked at the PRs)09:53
mvopedronis: excellent, thank you!09:53
mvopedronis: not done yet in any of the PRs I have seen so far09:54
mvofwiw 7098 and 7102 should be easy wins09:54
pedroniswe are also missing snapctl unset09:56
mvopedronis: good catch09:57
pedronisanyway I added actual todos to the card09:58
mvopedronis: thanks for adding it to the card!09:58
mvofwiw - I closed 5915 now (netplan apply) now that we have #710710:03
* mvo really misses mup btw10:03
pedronismvo: thank you10:04
mvo7100 is now also green - its "funny" one, it requires that we update gorilla too10:05
pedronisit needs Chipaca to look at it, then I will look at it as well10:06
ackksergiusens, hi, would you consider merging https://github.com/sergiusens/snapcraft-preload/pull/32? we'd need it for postgres, which tries to create /dev/shm/PostgreSQL.XXXXX files10:10
Chipacamvo: wrt 7100, why not have the prereq helpers also take context?10:20
Chipacamvo: they're called from a do* handler so you've got a tomb so you've got a natural context already10:21
mvoChipaca: aha, let me check that10:22
Chipacamvo: i mean, if they break all the tests in the world, maybe it's worth leaving them for later :-)10:22
Chipacabut otherwise, ...?10:22
mvoChipaca: let me explore that10:23
mvoChipaca: I'm a bit slow (sry!) do you have an example helper name that could take the context for me? not sure I know what you have in mind10:25
Chipacamvo: installOneBaseOrRequired10:25
Chipacamvo: via installPrereqs10:25
mvoChipaca: aha, yes10:25
mvoChipaca: I can do that, however I think the reason its not done (now) is that the client-user-agent will only be set (in this PR) in the SnapAction store API call. once the change is created the client-user-agent is no longer available in the change. we could fix that but its more work and the win seems to be small. or am I missing something?10:27
mvoChipaca: we would have to persist the client-user-agent somewhere in the change if we want to keep it and use it in the handlers10:28
Chipacamvo: hm...10:30
Chipacaah so it's not in the tomb at all10:30
Chipacasary, missed that disconnect again10:30
Chipacamvo: in any case +110:31
Chipacapedronis: does request-serial in classic hit the actual store?10:44
mvoChipaca: \o/ thank you!10:46
mvo7098 is green and has one +1 already and is small…10:46
Chipacamvo: it's got two +1's though10:50
pedronisChipaca: yes10:50
Chipacapedronis: that's taking ~30s10:50
Chipacapedronis: which is the same as seeding takes10:51
Chipacaon this machine10:51
Chipacapedronis: seems slow for a single request10:51
Chipaca¯\_(ツ)_/¯10:51
pedronisthat is interesting10:51
Chipacapedronis: https://snapforum.s3.amazonaws.com/original/2X/5/55ca16db9b44fe934424c27999c3386948b4fb4e.png10:52
mvoChipaca: heh :)10:53
mvoChipaca: we are down to 51!10:53
Chipacapedronis: it's prepare-serial-request, not submit-serial-request, that takes that long though10:53
pedronisChipaca: ah, but we don't split retries10:53
pedronisso a bit unclear10:53
pedronisif that's one request or many retries10:53
Chipacapedronis: you can ask10:53
Chipacapedronis: you can ask me, even10:53
Chipacaor you can get the iso and look for yerself :-p10:54
pedronisprepare-serial-request10:54
pedronisthat is even weirder10:54
Chipacaanyway i need to go comb my hair (just one of them) and get ready for the show10:55
pedronisare we doing or changed something silly10:55
pedroniswe ask only a nonce from the store there10:55
pedronisI need to dig/look around a bit10:55
Chipacapedronis: you ok to repro this on your own, or should i get the logs somewhere10:56
Chipacapedronis: instructions here: https://forum.snapcraft.io/t/snap-seeding-is-slow-racy/1231010:56
pedronisChipaca: well, I'm not promising to repro it10:56
pedronisI'm promosing to understand what we need to look10:56
pedronismore precisely10:56
Chipacapedronis: fair enough10:56
Chipacai look forward to learning more :-D10:56
Chipacabut now i need to run10:56
mvoChipaca: I added a comment to 7083 that might be worth doing (not sure though, depends on the plans with 7092)10:58
Chipacamvo: ok, i'll take a look in a bit11:06
Chipacaafk from irc but github will work :-)11:06
pedronisI left some comments there11:15
pedronisChipaca: it takes ~200ms to get a nonce from the store, so something else is going on11:17
=== ricab is now known as ricab|lunch
mvo7102 is another easy win12:41
mvoxnox: snapd PR#7031 (re-enable the system PATH generator) is fixed now, right? or do we need some initramfs fix too (I have some vague memories that this was discussed but don't know the conclusion)13:33
mvoxnox: once you  +1 it I will merge it13:34
ograsil2100, could we get this into all gadgets (core16 and 18) soon ? https://github.com/snapcore/pi3-gadget/pull/2813:56
=== ricab|lunch is now known as ricab
ogra(i asked ondra for a signoff too, to get more eyes on it, but in general someone should really monitor the pi firmware and push regular updates to the gadgets, they often fix over/under vlotage issues, overheating etc)13:57
cwayneogra: sil2100 i thought we just landed the same thing14:00
ogracwayne, well, i couldnt make any of our official images boot on the CM3 on my desk ... neither core16 nor core18 (though i dont look much at 18 anyway given the quality)14:01
ograCM3+14:01
ograsorry14:01
ograusing my universal pi-kiosk snap with the latest firmware (also for pi4 support) boots it fine though14:02
ograotherwise it always hangs on the rainbow splashscreen (meaning the rpi bootloader itself dies before it can load anything)14:02
cwayneogra: did you try with a very recent image? think the updated gadget landed in stable ~5hrs ago14:07
cwayneworked for 18 for us14:07
ograi tried both, 16 and 18 from the current dir on cdimage14:09
om26erHi! one of my snap failed to publish because I added a new hook, is that normal will have to go through a review or is that something that needs changing in my yaml ?14:11
om26erthe warning was "unknown hooks in meta/hooks: 'disconnect-plug-services-content' lint-snap-v2_unknown_hook"14:12
ograi also dont get why we still have separate images for pi2/3/cm3 and dont use the universal gadget, i thought we moved to that14:12
ackkjdstrand, hi, wrt /run/uuidd/request, do you think it makes sense to file a bug for an interface request? I see it's currently available in openvswitch-support14:19
om26erroadmr ^14:20
xnoxmvo:  you are correct. Needs https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/1814355 tasks for initramfs-tools done.14:20
xnoxlet me comment on the PR14:20
mvoxnox: thank you14:31
jdstrandackk: last we talked in Lyons, blake, et al all felt that the snap should be adjusted to use /proc/sys/kernel/random/uuid, which is standard and in the default template). there is nothing that will guarantee that /run/uuidd/request will be there on all distros. that said, it seems systemd is providing it and snapd requires systemd (and 14.04 is no longer supported by snapd)14:45
ackkjdstrand maybe we can use snap layouts for that14:48
ackkjdstrand, we don't explicitly use that socket, libuuid does that14:48
jdstrandackk: well, sure, but why use libuuid? :)14:49
ackkjdstrand, actually we can't use templates as the kernel one is just a file you cat14:49
ackkjdstrand, because it's somewhat standard? IDK we don't use it explicitly :)14:50
ackkI mean it's not a direct dependency14:50
ackka lot of stuff use that14:50
* jdstrand wonders why it doesn't use the kernel interface rather than uuidd14:51
* cachio afk14:51
jdstrand(when the kernel supports it)14:51
ackkjdstrand, dunno, portability?14:51
ackkI mean, sure libuuid could use that file if it's there14:51
jdstrandright14:51
jdstrandanyway, I've taken a todo to investigate this for the default template14:51
jdstrandI suspect systemd will be looking at that file14:52
ackkjdstrand, the python uuid uses os.urandom() afaics14:52
sil2100ogra: that should be released already15:01
sil2100ogra: the 'master' branch is out-of-date and not used15:01
sil2100ogra: I actually need to just remove it15:01
mvoijohnson: just fyi, I'm poking at the tests in your netplan-apply pr right now15:01
sil2100ogra: there are 16 and 18 branches, and both have the latest uboot bumps for the pi315:01
ograsil2100, well, none of the images i tried on the CM3+ booted15:01
ograsil2100, this is not u-boot ... this is the raspberry pi firmware15:02
ograsil2100, it doesnt even get to a point where it would load u-boot, hangs in teh step before15:02
ogra(on the ranbow colored splash screen (which shoudl really be disabled, not sure why thats on in the official gadgets)15:03
sil2100ogra: ok, I see what's the problem - you are right, the core16 gadgets didn't get the firmware bump15:03
sil2100ogra: since we only bumped the uboot version there15:04
ograright15:04
sil2100ogra: let me do that then15:04
ograthanks !!15:04
sil2100ogra: but the 18 ones are bumped if anything15:04
sil2100ETOOMANYGADGETREPOS15:04
ograwried15:04
sil2100Sorry about that!15:04
ogra*weird even15:04
ograsil2100, i definitely tried the rpi3 UC18 images from /current15:04
ogra(as well as the (totally pointless) cm3 ones ... why do we build them ?)15:05
ograsil2100, could it be that the fix hasnt made it to /current yet ? (i can surely try /pending too if needed)15:06
sil2100hm hm hm, it looks correct, manifest shows having the latest pi gadget, and from what I see in the gadget's build log the right boot-firmware tag has been cloned15:10
sil2100And I thought waveform checked if it's the right firmware version before submitting the PR15:10
ijohnsonmvo: thanks15:10
mvoijohnson: I pushed some bits, if you mind I can also push to a separate PR15:14
ijohnsonno, it's fine you can push to the same PR, thanks!15:14
mvoijohnson: mostly suggestions, probably need a critical eye from samuele as well but should make things a bit easier15:14
ijohnsonmvo: ack, thanks for that15:14
mvoijohnson: its mostly there now, something in the TestYesNetplanApply test is unhappy still, it hangs here15:14
mvoijohnson: not sure why, probably some mocking missing for something15:15
ijohnsonyeah I've seen it hang a few times I think it has something to do with locks15:15
ijohnsonerr I've seen it hang in a few iterations I've done15:15
mvoijohnson: yeah, its probably not my changes :)15:15
mvoijohnson: aha, locks! good catch, let me check those15:15
ijohnsonthe version I pushed up shouldn't hang, but maybe your changes are moving back to what I tried originally that was hanging15:15
* mvo nods15:16
ograsil2100, looking at https://github.com/snapcore/pi-gadget/blob/18-armhf/snapcraft.yaml i see a tag from feb 2019 ... perhaps thats still not new enough15:20
sil2100ogra: maybe, but waveform selected that tag exactly because of cm3+ support15:22
sil2100Let me poke him15:22
sil2100ogra: anyway I'd expect it to work as we use the exact same firmware tag for disco and eoan classic raspi3 images, and I'm sure those work on the cm3+15:25
sil2100(also, per Dave's original commit message: https://github.com/snapcore/pi-gadget/commit/b8a16cb1e1d9a2c0419da8fef0bffc12e3c914fb )15:25
ogravery weird ...15:25
sil2100I asked him to test again15:25
sil2100Maybe there's something weird going on somewhere15:25
sil2100I'll wait for this to be resolved before I update the 16 gadgets, since I'd like it all to use the same firmware15:26
om26erWhen a new hook is added to a snap package (e.g. interface connection/disconnection hook), does that need to be approved by the store guys ?15:26
ijohnsonom26er: I'm not sure that the store review tools have been updated to take into account interface connection/disconnection plugs15:27
ijohnsonjdstrand and roadmr should be able to help you with that when they get time15:27
ograsil2100, well https://github.com/snapcore/pi-gadget/commits/18-armhf shows that all travis checks have failed ... not sure if that tree is gated by travis though15:27
ogra(for both last commits)15:27
sil2100ogra: well, it passed on the PRs15:28
sil2100ogra: (when you check the failed travis checks, those are issues with git clone and I also experienced that during the snap builds)15:30
sil2100And even locally15:30
sil2100There was a period of time where the default git repo url of uboot that we use was not usable15:31
sil2100Anyway, basically the travis checks are build-checks, so if LP was able to build the end snap, that means it passed all the tests15:31
om26erijohnson thanks, I'll wait15:32
ograok ... as long as the sync to LP isnt blocked by these travis checks i guess it is fine15:32
ograjust looked like a potential reason for not having the change in these images15:33
sil2100ogra: I checked the snap build logs, and I saw that the git clone of the firmware branch printed "Note: checking out '98997f363e3683ead4f50c37902169248628303a'.", which is a commit from feb 201915:34
ograok15:34
ogravery strange then15:34
sil2100cwayne: hey! Do you guys have cm3+'s in the lab?15:35
ograthey do15:35
roadmrom26er: can you show me (snapcraft.yaml) what you added?15:35
cwayneThey're on the way sil210015:35
cwayneplars has one at home15:35
sil2100cwayne: awesome \o/15:35
plarssil2100: have a new image I need to try?15:36
om26erroadmr https://github.com/deskconn/deskconn-server/blob/master/snap/snapcraft.yaml15:38
roadmrom26er: hm this looks reasonable; I think the best way would be for you to change what you need, upload the snap, and the review tools will tell you if it needs manual approval15:41
sil2100plars: could you check the current one? Since Dave seems to be AFK - just so that someone else also tries booting it http://cdimage.ubuntu.com/ubuntu-core/18/current/ <-15:41
roadmrom26er: typically what we do is approve that in general, and subsequent uploads won't need the same thing15:41
plarssil2100: will do15:41
sil2100plars: thank you!15:41
ograplars, i couldnt get that one to boot on my CM3+ ...15:41
om26erroadmr https://dashboard.snapcraft.io/snaps/deskconn/revisions/84/15:42
ograwould be good to have another datapoint15:42
om26erI think revision 82 is the one that needs approval15:42
sil2100This will be some good input, since I at least hope he did test that gadget change before submitting the PR15:43
sil2100(Dave that is)15:43
cwaynesil2100: we had tried an image with a gadget using Dave's pr and were able to boot core18 but not core1615:47
sil2100cwayne: yeah, the core16 is expected, because of uh, my mistake15:47
sil2100Too many repos of those gadgets15:47
sil2100cwayne: but the 18 gadget booted fine on the cm3+?15:48
cwayneplars: ^15:48
cwayneYeah that was my understanding15:48
plarsyes, still setting up to try this one though - I'm also trying to boot it with a regular cm3 in the lab15:48
sil2100The regular ones should be good, since I saw those being tested in the automated testing15:49
ograyeah, very unlikely that they could have regressed15:52
plarsogra: did that rpiboot from edge work for you at least? seems to be working on my cm3+15:52
plarsit's writing the image now15:53
ograsil2100, oh ... note that i tested http://cdimage.ubuntu.com/ubuntu-core/18/stable/current/  is that different from http://cdimage.ubuntu.com/ubuntu-core/18/current/ ?15:54
sil2100ogra: yes!15:54
ograoh man15:54
ogracan we clean up that directory mess ?15:54
sil2100ogra: we don't daily-build stable images, only during point releases15:54
sil2100ogra: you need to check the timestamps, we only daily build edge and beta images right now15:54
ograoh my ... ok15:55
sil2100ogra: stable is like the stable ones we want to brand and 'release', which only happens on every point release15:55
sil2100;)15:55
ograthen sorry for the noise ... i followed some download link (that i have lost now :( ... )15:55
ografrom our main website somewhere15:55
sil2100http://cdimage.ubuntu.com/ubuntu-core/18/current/ are for edge and http://cdimage.ubuntu.com/ubuntu-core/18/beta/current/ are for beta - and I guess for a daily stable image you'd have to build one locally with ubuntu-image --channel=stable15:56
sil2100It might be a decent idea to build some stable images before point releases15:56
sil2100But doing it daily wouldn't make much sense, there's not enough velocity there15:56
ograwell, yeah, dail stable (or daily in general) is nonsense anyway ... the images shoudl simply be built change-triggered15:56
sil2100So we'd probably switch some stable images built on every stable snap change, but that's still not there15:57
sil2100Yeah, that's the plan15:57
sil2100But we still don't have that15:57
sil2100plars, cwayne: issue has been resolved, sorry for the commotion o/15:58
ograhttp://cdimage.ubuntu.com/ubuntu-core/18/stable/current/ doesnt really suggest it is anything thats daily though ... if i navigate from the toplevel of cdimage i indeed want the "stable " release ... and then go to the most current image of that by using the "current" link15:58
ograso even if i had not follwed a download link originally,m i would have ended up in the exact same place to get the latest stable image15:59
sil2100Well, the header of the stable images mentions 'Ubuntu Core 18', where others explicitly say 'Daily Builds' - but indeed, we might want to make this a bit more intuitive15:59
sil2100ogra: well, this is the 'latest stable image' ;)16:00
ograright ... but there are no headers at http://cdimage.ubuntu.com/ubuntu-core/18/ :)16:00
sil2100ogra: as mentioned, we will only promote to 'current stable' on point releases, so people following download links will always get only the image we blessed during point release preparation16:00
sil2100True16:00
sil2100cdimage is a confusing place16:01
sil2100;p16:01
ograand when i finally enter the site i have to search for the right image between the gazillio pi images on that page (is there any reason why we do not have one pi image per arch /armhf/amd64 ?)16:01
plarssil2100: this boots on both my cm3 and cm3+, but it has edge snaps for everything. Is that expected?16:01
plarsah, just saw the backlog16:02
* ogra hands plars some https://www.youtube.com/watch?v=7nqcL0mjMjw16:02
ogra:)16:02
plarshah16:03
plarssil2100: so we are waiting on a different image to test now I guess?16:03
sil2100plars: no no, it's all good - I mean, I'll be pushing new cm3 16 gadgets out soon, but other than that we're good16:04
plarsack16:05
ograsil2100, but in all seriousness, why do we have pi2, pi3 and cm3 images there ? supposedly all using the universal pi gadget and the same kernel, so in the end they are all the same image16:07
ograthis smells like a massive waste of built/test time and server space16:08
ogra(i originally developed the universal pi gadget to exactly not have three images anymore :) )16:09
sil2100ogra: well, it is a waste, yes, that was some leftover of the 16 times, no reason for it - guess when the first 18 models have been created and signed we simply cloned what we had for 1616:10
sil2100So we got pi2, pi3 and cm3 models, thus a separate image for each model16:10
sil2100oh well16:10
ograsil2100, yeah, for 16 we couldnt change ... i had hoped for 18 it would though16:10
ograi guess i'll send some expensive tea to bribe xnox to make sure core20 gets better here ;)16:11
sil2100ogra: a missed opportunity I guess! There was a bit too much going on so I also didn't notice it's unneeded until it was already all released ;)16:11
ograyeah16:11
mvoijohnson: please check netplan-apply - should be mostly good now, feel free to fix anything I missed and there is also a spread test missing iirc16:12
ijohnsonmvo: thanks I just saw your push I was waiting to push up my spread test until you were done16:12
ograwell, who knows ... i'm not sure we can actually support the pi4 with the same kernel snaps in the end ... perhaps it was a clever thing to keep them separate16:12
ograuntil we can go to a new enough kernel that supports all of them in core2016:13
mvoijohnson: yeah, I think I'm finished with what I wanted to do :) feel free to tweak/adjust as needed, its your PR afterall, I feel slightly bad for being so pushy in it :/16:13
mvoijohnson: but it was also fun so I couldn't stop myself16:14
ijohnsonmvo: no problem, I appreciate the help in the tests that was what I was blocked on so you have unblocked me :-)16:14
mvoijohnson: great! happy to help and to be fair the testing was a bit delicate (but hopefulyl we can make things better/easier :)16:15
ijohnson+116:15
pedronis7083 needs a bit more work, there or in a follow up16:18
pedronisit has 2 +1 but I should probably look at it as well16:18
pedronisI commented about the work16:18
jdstrandhmm, om26er is gone. ijohnson> fyi, so long as the hook is known to the review-tools at all, then there is no problem. if a new hook is added to snapd, then the review-tools need to learn it16:21
pedronisijohnson: I was discussing with mvo, a smallish thing that we might need sooner rather than later, related to remodeling is this:  https://forum.snapcraft.io/t/remodeling-to-a-new-model/10477/216:22
ijohnsonjdstrand: does the store tools know how to handle interface hooks? IIUC, those hooks could be named anything in the patterns shown on https://docs.snapcraft.io/interface-hooks16:23
ijohnsonpedronis: looking16:23
jdstrandpedronis: I'm not up on remodeling and I don't see anything in that forum that references hooks (am I blind?)16:25
pedronisjdstrand: not related to the discussion, but ijohnson has progress quite a bit on his current task, so I was discussing with mvo what he can pick up next16:26
pedronis*progressed16:26
pedronis*can or could16:26
jdstrandoh, heh, I copied the wrong link. durr16:26
ijohnsonpedronis: okay this seems straight forward, but actually like jdstrand I'm not familiar with the current plan on remodeling :-)16:27
ijohnsonpedronis: is that forum post all we have for the plan for remodeling ? I see you also have quite a few PR's open with remodelling label16:27
pedronisijohnson: we progressed quite a bit16:28
pedronisthat forum topic is mostly concerened with reregistration, switching model16:28
pedronisijohnson: I'm close to eod but we can chat more tomorrow16:28
jdstrandijohnson: the tools already handle those, yes16:28
jdstrandijohnson: (https://docs.snapcraft.io/interface-hooks)16:29
ijohnsonpedronis: okay sure I will try to schedule a meeting tomorrow to discuss more16:29
ijohnsonjdstrand: hmm okay well it looked like using an interface hook was the problem that om26er was running into16:30
jdstrandijohnson: ah, the tools know about connect-*, prepare-* but not disconnect-*16:32
jdstrandI see that r82 uses disconnect-plug-...16:33
* jdstrand adjusts tools16:33
jdstrandroadmr: hi! can you pull 20190716-1700UTC? not urgent. fixes om2er's issue (cc ijohnson)17:01
roadmrjdstrand: sure thing, I'll queue it up18:52
=== kyrofa_ is now known as kyrofa

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!