/srv/irclogs.ubuntu.com/2019/05/28/#snappy.txt

mborzeckimorning05:23
mborzeckinew kernel, brb05:32
mborzeckire05:35
zygaHey hey06:09
zygamborzecki: yesterday was very productive06:22
zygaI will have nice stuff to share today.06:22
mborzeckizyga: hey06:22
zygaI want to add some polish and shine still06:22
zygaAnd maybe setup primitive ci06:22
zygaNow taking a small detour to get kids to school on time06:23
mupPR snapd#6896 closed: cmd/snap: tweak the output of snap debug timings --ensure= <Simple πŸ˜ƒ> <Created by stolowski> <Merged by bboozzoo> <https://github.com/snapcore/snapd/pull/6896>06:50
=== pstolowski|afk is now known as pstolowski
pstolowskimorning07:03
zygahey pawel07:03
mborzeckipstolowski: hey07:06
zygaquick breakfast07:09
zygapok07:18
zygabreakfast over, time to get stuff done :)07:18
zygaanyone wants to look at https://github.com/snapcore/snapd/pull/689107:21
mupPR #6891: many: make per-snap mount namespace MS_SHARED <Created by zyga> <https://github.com/snapcore/snapd/pull/6891>07:21
zygamborzecki: or perhaps 2nd review on https://github.com/snapcore/snapd/pull/690907:23
mupPR #6909: spread.yaml,tests: change MATCH and REBOOT to cmds <Created by zyga> <https://github.com/snapcore/snapd/pull/6909>07:23
mborzeckizyga: 'll add it to my queue, looking at #6900 now07:30
mupPR #6900: [RFC] snapstate: support base = "none" <Created by stolowski> <https://github.com/snapcore/snapd/pull/6900>07:30
zygathank you!07:30
pstolowskithanks mborzecki!07:50
mborzeckipstolowski: if we go down the route of snap.Validate() in 6900 then the check_snap piece can probably be dropped07:56
mborzeckibtw. do we validate that base: <foo> looks like a valid snap name?07:57
pstolowskilet me check08:00
mborzeckimvo: pedronis: hey08:04
pstolowskimborzecki: heh, it seems we don't. not super critical afaict since we will simply fail on prerequsites, but i'll address it (in a separate PR as it's not strictly related to base:none PR)08:06
mborzeckipstolowski: sgtm08:15
mupPR snapd#6882 closed: cmd: add snap-verify stub binary (UC20) <Created by mvo5> <Closed by mvo5> <https://github.com/snapcore/snapd/pull/6882>08:19
zygamvo: do you know how to get in touch with the canonical web team?08:26
pedronispstolowski: mborzecki: hi, I think we might even have a card about missing some sanity checks on base itself08:36
pedronispstolowski: we have this  (not about the name) but could fir in that new PR: https://trello.com/c/KNa3zFfQ/146-check-early-that-declared-bases-have-actually-type-base08:38
pstolowskipedronis: ack08:39
pedronispstolowski: I assigned it to you and move the base none card to doning08:41
pedronis*moved08:41
pstolowskipedronis: ok, thanks08:41
zygasnap download hangs for me, hmm09:07
zygaerror: received an unexpected http response code (503) when trying to download https://fastly.cdn.snapcraft.io/download-origin/fastly/pYVQrBcKmBa0mZ4CCN7ExT6jH8rY1hza_216.snap?token=1559048400_9a35b33e1aa3a9d811a4ee1c835fbdf663e027ed09:09
zygaanyone seeing store woes?09:09
mborzeckiwell, at least it's not 418 :)09:09
mborzeckizyga: status.snapcraft.io seems fine09:10
zygaodd, trying again09:10
zygawell, this is fastly09:10
mborzeckimaybe something about fastly09:10
zygayeah09:10
zygafluke, it's working now09:12
Eighth_Doctorzyga, mborzecki: so Flock 2019 CfP deadline is June 109:14
mborzeckiEighth_Doctor: you're reminding me of my univestity days :P09:14
Eighth_Doctordo we have something we want to do for Flock?09:15
Eighth_Doctorwe've done quite a fair bit since last year... :)09:15
Eighth_Doctorbetween the SELinux stuff and the prep work we did for bases...09:16
mborzeckiidk, selinux doesn't feel like much, zyga do you have anything?09:16
zygamborzecki: I think selinux is the thing, it'd be a nice way to meet people that know a lot about it09:16
zygaI think you should go :)09:16
zygawhere is flock this year?09:17
zygamvo: do you know how to get in touch with the canonical web team?09:17
Eighth_DoctorBudapest09:17
zygamborzecki: talk to mvo09:17
zygaI think you should go09:17
Eighth_Doctorzyga, mborzecki: do either of you think we could do something about getting fedora-based snaps something people could make by flock?09:20
Eighth_Doctorif we could get there, we could also propose a workshop for making fedora-based snaps09:20
pedronismborzecki: #6750 has a conflict btw09:24
mupPR #6750: overlord/devicestate: update-gadget task handler with stubbed gadget callbacks <Gadget update> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6750>09:25
mborzeckiwow, again? hmm09:25
zygaEighth_Doctor: I think that's unlikely, we're prepping a demo for something and even regular work is lower priority09:28
mupPR # closed: snapd#5644, snapd#5822, snapd#5915, snapd#6108, snapd#6258, snapd#6325, snapd#6327, snapd#6341, snapd#6347, snapd#6360, snapd#6367, snapd#6404, snapd#6436, snapd#6541, snapd#6588, snapd#6648, snapd#6666, snapd#6680, snapd#6681, snapd#6691, snapd#6695, snapd#6697, snapd#6705,09:35
mupsnapd#6708, snapd#6714, snapd#6721, snapd#6734, snapd#6750, snapd#6759, snapd#6760, snapd#6767, snapd#6804, snapd#6805, snapd#6825, snapd#6836, snapd#6839, snapd#6841, snapd#6848, snapd#6855, snapd#6871, snapd#6875, snapd#6876, snapd#6878, snapd#6879, snapd#6890, snapd#6891, snapd#6892, snapd#6899,09:35
mupsnapd#6900, snapd#6904, snapd#6905, snapd#6909, snapd#6913, snapd#6917, snapd#691909:35
mvozyga: the web team? yeah, I can get you in touch with people, let me look, one sec09:35
zygathank!09:35
mupPR # opened: snapd#5644, snapd#5822, snapd#5915, snapd#6108, snapd#6258, snapd#6325, snapd#6327, snapd#6341, snapd#6347, snapd#6360, snapd#6367, snapd#6404, snapd#6436, snapd#6541, snapd#6588, snapd#6648, snapd#6666, snapd#6680, snapd#6681, snapd#6691, snapd#6695, snapd#6697, snapd#6705,09:36
mupsnapd#6708, snapd#6714, snapd#6721, snapd#6734, snapd#6750, snapd#6759, snapd#6760, snapd#6767, snapd#6804, snapd#6805, snapd#6825, snapd#6836, snapd#6839, snapd#6841, snapd#6848, snapd#6855, snapd#6871, snapd#6875, snapd#6876, snapd#6878, snapd#6879, snapd#6890, snapd#6891, snapd#6892, snapd#6899,09:36
mupsnapd#6900, snapd#6904, snapd#6905, snapd#6909, snapd#6913, snapd#6917, snapd#691909:36
mborzeckipedronis: ok #6750 and #6836 updated09:36
mupPR #6750: overlord/devicestate: update-gadget task handler with stubbed gadget callbacks <Gadget update> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6750>09:36
mupPR #6836: overlord/snapstate: add update-gadget task when needed, block other changes <Gadget update> <β›” Blocked> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6836>09:36
pstolowskipedronis: fyi, i figured out my issues with base decl and policy checks wrt to the WIP branch removing sanitizeReservedForOS/Gadget/... helpers09:41
pstolowskipedronis: it all boiled down to the default "allow-installation: false" in base decl taking affect in my minimal install check09:42
mupPR snapd#6904 closed: timings: always store ensure timings as long as they have an associated change <Created by stolowski> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/6904>09:58
mvo6804 needs a second review09:59
Chipacapedronis: you got a minute?10:05
mupPR snapd#6920 opened: timings: tweak the conditional for ensure timings <Simple πŸ˜ƒ> <Created by stolowski> <https://github.com/snapcore/snapd/pull/6920>10:17
pstolowskidoh, that was wrong branch10:17
mupPR snapd#6920 closed: timings: tweak the conditional for ensure timings <Simple πŸ˜ƒ> <Created by stolowski> <Closed by stolowski> <https://github.com/snapcore/snapd/pull/6920>10:18
mupPR snapd#6921 opened: timings: tweak the conditional for ensure timings <Simple πŸ˜ƒ> <Created by stolowski> <https://github.com/snapcore/snapd/pull/6921>10:22
Saviqzyga: hey, what's the status of "base: core16 β†’ core18" migration these days? we're getting more and more headaches being stuck at core16 still…10:24
Saviqlike, how likely is it that things will break?10:25
zygaSaviq: no change, deprioritized10:30
zygasome bugs fixed, some remain10:30
zygaSaviq: online updates still not supported10:30
mupPR snapcraft#2571 opened: cli: refactor re-execution into legacy <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/2571>10:38
zygasmall break10:59
Chipacapedronis: request for a minute cancelled11:00
mupPR snapd#6917 closed: Add endpoint for snap download in the daemon <Created by glower> <Closed by glower> <https://github.com/snapcore/snapd/pull/6917>11:00
mupPR snapd#6922 opened: gadget: mounted filesystem writer <Gadget update> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6922>11:04
mborzeckizyga: split out the writer part ^^11:05
mupPR snapd#6923 opened: interfaces/policy: minimal policy check for replacing sanitizeReservedFor... helpers (1/2) <Created by stolowski> <https://github.com/snapcore/snapd/pull/6923>11:16
* pstolowski lunch11:22
mupPR snapd#6921 closed: timings: tweak the conditional for ensure timings <Simple πŸ˜ƒ> <Created by stolowski> <Merged by stolowski> <https://github.com/snapcore/snapd/pull/6921>11:23
zygamborzecki: ack11:24
zygamborzecki: can you please document things like Deploy and DeployContent11:38
zygamborzecki: reviewed11:44
mborzeckizyga: thanks, pushing the comments in a minute11:45
mborzeckizyga: the 3rd point is actually something that is done by the updater with the anlysis/rollback-preparation pass11:47
zygahmm, but the code has hard-coded sync flag?11:47
zygadid I misunderstand that?11:47
mborzeckizyga: no, the updater actually directly calls deploy{File,Directory} when needed11:48
zygahmm, that wasn't my point11:52
zygaif you deploy a tree with 3 files11:52
zygayou sync on each one11:52
zygain practice that is expensive11:52
zygayou could deploy all three and then sync once11:52
zyga(even with old-fashioned sync as sync APIs are a bit limited)11:52
mborzeckioff to pick up the kids12:03
zygahmmm12:21
zygacmatsuoka: ping12:23
cmatsuokazyga: o/12:23
zygaquestion, one sec12:24
zygaok12:25
zygaso12:25
zygathe pc-kernel snap12:25
zygain the 18 track12:25
zygaif you unsquash that12:25
zygathere's an initrd.img file12:25
zygait's 3MB more or less12:25
zygaand contains a simple initrd with a bunch of stuff12:26
zyganot sure why but I cannot seem to unpack it correclty12:26
diddledanwho's in charge of the forum? https://forum.snapcraft.io/t/code-block-syntax-highlighting-no-longer-works/11004/412:26
zygaif I do it only contains intel microcode, at 32KB12:26
zygadiddledan: don't know, perhaps mvo_ does12:26
cmatsuokaare you using unmkinitramfs?12:26
zygacmatsuoka: no, I was using cpio directly12:27
cmatsuokazyga: try with unmkinitramfs, it's easier than using binwalk and cpio12:27
zygathere's no such binary on opensuse12:27
zygabut do you know what's going on12:27
zygais this the appended cpio with some malformed stuff that causes this?12:28
zygaif you cpio --list it will show you that the initrd contains the microcode12:28
zygawhat does unmkinitramfs do?12:28
cmatsuokaso the initramfs can have multiple sections, the microcode is in the first one. if you run binwalk on the initramfs file you'll see the different sections12:29
cmatsuokabut binwalk can get confused sometimes and list something that doesn't exist12:29
cmatsuokaunmkinitramfs does the right thing and reads all sections12:30
zygaI see now, that's odd12:30
zygathanks!12:30
cmatsuokaI don't know the exact unmkinitramfs mechanism, but it works better than doing it by hand12:31
zygaI was working with a custom initrd but I wanted to play with something derived from the original12:31
zygagoogling suggests that our official initrd has the wrong alignment12:32
cmatsuokait's a short script, perhaps you can replicate or just run it on suse as well?12:32
zygayeah, now I'm good12:32
cmatsuokathe mechanism is: split all parts based on magic, uncompress/unarchive each part12:35
cmatsuokamagic bytes, not real magic12:36
=== ricab is now known as ricab|lunch
Eighth_Doctorcmatsuoka: unmkinitramfs is a initramfs-tools specific tool12:44
Eighth_Doctorfor dracut based initramfs, you need to use skipcpio and then extract the compressed payload with the appropriate tool12:47
Eighth_Doctorlike so: https://www.thegeekdiary.com/centos-rhel-7-how-to-extract-initramfs-image-and-editview-it/12:49
Eighth_Doctoror this: https://doc.rogerwhittaker.org.uk/extract-dracut-initrd/12:49
Eighth_Doctorzyga: manipulating dracut-based initramfs is typically done by adjusting dracut configuration or passing in commandline options: https://www.mankier.com/8/dracut12:50
zygaEighth_Doctor: I don't want to use dracut,12:51
zygait's really not anything close to useful now12:51
zyga(as in dracut)12:51
cmatsuokaEighth_Doctor: ah interesting. But is the actual file format different? I mean, if you split parts and uncompress/unarchive each of them on a dracut-built initramfs, shouldn't it work as well?12:57
Eighth_Doctorcmatsuoka: I don't know, maybe?12:58
Eighth_Doctorit'd be nice if someone had contributed those tools into dracut though12:58
cmatsuokamy guess is that the final format is the same, but I didn't actually check it12:58
Eighth_Doctorcmatsuoka: you can try this by generating a dracut-based initramfs on Ubuntu and seeing if the tool works13:05
* Chipaca adds a /v2/irc so people can chat with us from snapd13:11
* cachio afk13:54
=== ricab|lunch is now known as ricab
mborzeckiheh -ldflags "-linkmode external -extldflags '-static'" does what we need14:00
Chipacamborzecki: --dammit14:01
Chipaca--static-or-die14:01
mborzeckihahah14:02
mborzeckiotherwise it's guesswork whether to CGO_ENABLED or not14:02
mborzeckioh and -buildmode=pie triggers external linker14:03
mupPR snapd#6924 opened: packaging/fedora: force external linker to ensure static linking and -extldflags use <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6924>14:22
mborzeckithat should do it ^^14:23
mupPR snapcraft#2567 closed: remote build: add warning before sending data <Created by cmatsuoka> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2567>14:24
zygadinner15:01
diddledanthat sounds like a plan, zyga ! :-)15:06
webmindhi, I've got a nextcloud service installed via snap, but it should only run after an encrypted partition has been unlocked and mounted15:22
webmindhow do I prevent the service to be run on boot?15:22
zygacmatsuoka, mvo_, pedronis: go works in initrd now16:00
zygaI'll continue more tomorrow16:00
=== pstolowski is now known as pstolowski|afk
webmindis there a neat way to run a nextcloud snap on an encrypted storage?16:42
mupPR snapcraft#2572 opened: catkin spread tests: stop testing indigo <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/2572>16:46
mupPR snapd#6825 closed: cmd: rework `snap run --gdb` to work as user <β›” Blocked> <Created by mvo5> <Closed by pedronis> <https://github.com/snapcore/snapd/pull/6825>16:51
mupPR snapcraft#2573 opened: catkin spread tests: stop testing indigo <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/2573>17:25
mupPR snapcraft#2574 opened: remote build: retrieve build log files <Created by cmatsuoka> <https://github.com/snapcore/snapcraft/pull/2574>17:25
pedronisreviews of #6855 would be appreciated17:41
mupPR #6855: overlord: implement store switch remodeling  <Remodel :train:> <Created by pedronis> <https://github.com/snapcore/snapd/pull/6855>17:41
mupPR # closed: core-build#11, core-build#22, core-build#26, core-build#37, core-build#3817:53
mupPR # opened: core-build#11, core-build#22, core-build#26, core-build#37, core-build#3817:54
wmww_sergiusens: It appears Snapcraft is stripping my build-ids, which is causing mesa to break (only when the snap is built with new versions of Snapcraft). Full details of the problem here: https://github.com/MirServer/egmde-snap/pull/3, It seems to have been fixed by add no-patchelf, but it was quite difficult to diagnose. I'm wondering if this should be reported as a bug in Snapcraft.18:12
mupPR MirServer/egmde-snap#3: Resolve i965_dri.so crash by not stripping mesa build IDs <Created by wmww> <https://github.com/MirServer/egmde-snap/pull/3>18:12
mupPR snapcraft#2575 opened: catkin spread tests: use kinetic instead of indigo <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/2575>18:19
mupPR snapd#6541 closed: tests: change how xdg-desktop-portal is prepared and restored for desktop-portal-* tests <Created by sergiocazzolato> <Closed by sergiocazzolato> <https://github.com/snapcore/snapd/pull/6541>18:39
mupPR snapcraft#2572 closed: [legacy] catkin spread tests: stop testing indigo <Created by kyrofa> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2572>19:07
mupPR snapcraft#2573 closed: catkin spread tests: restrict tests to Ubuntu 16.04 <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/pull/2573>19:07
jdstrand_sergiusens[m], kyrofa: hey, I converted an older snap (the review-tools) to use 'base: core' and I'm finding that PYTHONPATH is not set like it was when I didn't specify a base. am I expected to set the PYTHONPATH myself?19:17
=== jdstrand_ is now known as jdstrand
sergiusensjdstrand_: no, it is all inferred from the path to python inside the snap19:19
sergiusensjdstrand: I think we got rid of that even before moving to bases19:19
jdstrandsergiusens: I have: #!/usr/bin/env python319:19
jdstrandsergiusens: should that be something else?19:19
sergiusensjdstrand: that is fine, this is not classic, right?19:19
mupPR snapcraft#2576 opened: [legacy] catkin plugin: remove default rosdistro <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/2576>19:19
jdstrandsergiusens: strivt19:20
jdstrandstrict19:20
jdstrandsergiusens: well, that may be 'fine' but have to do something like:19:20
jdstrandsnap run --shell review-tools.snap-review19:20
jdstrand$ PYTHONPATH=$SNAP/lib/python3.5/site-packages/:$SNAP/usr/lib/python3/dist-packages/ snap/command-chain/snapcraft-runner $SNAP/command-snap-review.wrapper ...19:21
sergiusensjdstrand: can I see your snapcraft.yaml, you shouldn't need that python path, look at "black" in the store as a reference for something using bases19:22
jdstrandsergiusens: https://paste.ubuntu.com/p/Z9g4sFX46b/19:23
jdstrandsergiusens: maybe because PATH doesn't find python3 in the snap?19:23
jdstrandfrom snap run: $ which python319:23
jdstrand/usr/bin/python319:23
sergiusensjdstrand: the environment is still set through the command wrapper19:24
sergiusensjdstrand: so use of --shell will still have its quirks19:25
jdstrandsnap/command-chain/snapcraft-runner which python3 gives me /snap/review-tools/x1/usr/bin/python319:25
jdstrandsergiusens: sure. ok, so that isn't it19:25
sergiusensjdstrand: so what is the error if you do not set PYTHONPATH? IIRC, we have not set PYTHONPATH for the past 2 years19:26
jdstrand$ review-tools.snap-review19:26
jdstrandTraceback (most recent call last):19:26
jdstrand  File "/snap/review-tools/x1/bin/snap-review", line 3, in <module>19:26
jdstrand    from reviewtools import modules19:26
jdstrandImportError: No module named 'reviewtools'19:26
sergiusensjdstrand: whats the shebang in /snap/review-tools/x1/bin/snap-review ?19:27
jdstrand$ head /snap/review-tools/x1/bin/snap-review19:27
jdstrand#!/usr/bin/env python319:27
sergiusensjdstrand: can you wormhole me the resulting snap?19:27
sergiusensthanks19:28
jdstrandsergiusens: sent via privmsg19:28
sergiusensmeeting starting in 1', but will look right after19:29
jdstrandsergiusens: so, fyi, I'm clenning up a lot with this, but review-tools.swift I didn't touch and it has the same problem (it is py2)19:29
jdstrandsergiusens: I don't think it has anything to do with the internal renaming though since if I set PYTHONPATH, it works19:30
jdstrandsergiusens: fyi, I pushed all my updates to: https://git.launchpad.net/review-tools?h=master, including PYTHONPATH, which I'm happy to update if you find anything. note, I searched the forum for PYTHONPATH and there are quite a few people using. I don't know if that is related20:13
jdstrandroadmr: hey, can you pull 20190528-2014UTC? note, this is the big cleanup with internal renamings, etc. besides that there is one change to overrides.py20:24
roadmrjdstrand: sure20:25
jdstrandroadmr: please note that for the store, I preserved bin/click-review (it is a symlink to bin/snap-review now) and data/snapd-base-declaration.yaml, which is a symlink to reviewtools/data/snapd-base-declaration.yaml20:25
jdstrand(I think snapstore may be using that 2nd one for the brand store decls)20:26
sergiusensjdstrand: you wiped `$SNAP/usr/lib/python3.5` (https://git.launchpad.net/review-tools/tree/snapcraft.yaml#n79)20:32
sergiusensjdstrand: which takes away our sitecustomize20:33
jdstrandsergiusens: ah, ok. that probably wasn't wiped before because I combined two parts20:33
jdstrandsergiusens: and I was removing clashing bits20:34
* jdstrand updates20:34
jdstrandoh, swiftclient is py3 (it is swift itself that is py2)20:35
jdstrandok, this makes sense20:35
jdstrandsergiusens: also, is your black snapcraft.yaml anywhere?20:36
jdstrandsergiusens: and thanks for looking at this! :)20:37
sergiusensjdstrand: let me make it so for the former and no problem for the latter20:38
jdstrandsergiusens: yep, removing that line fixed it right up. thanks again for your keen eyes :)20:54
roadmrjdstrand: sorry, was otp - I'll put this in the queue, our tests should catch any big-cleanup trouble21:17
jdstrandroadmr: sounds good (I also tested this a lot). lemme know if you see anything weird and I'll jump right on it21:18
roadmr+121:19
zygajdstrand: hey21:43
zygajdstrand: that thing from Friday, that was test system setup bug specific to 14.0421:44
zygajdstrand: I've put further changes on hold until more people review it21:44
jdstrandzyga: yes, jjohansen said he'd look at it and I hope to tomorrow as well21:50
jjohansenzyga: yeah I am looking into it21:51
zygathanks!21:53
=== JanC_ is now known as JanC

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!