/srv/irclogs.ubuntu.com/2019/07/25/#snappy.txt

mupPR snapd#7151 closed: tests: remove local revision of core <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/7151>00:31
mupPR snapcraft#2644 opened: Release changelog for 2.44 <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/2644>02:21
mborzeckimorning05:09
=== morphis5 is now known as morphis
mborzeckimvo: morning06:48
mvohey mborzecki06:50
mvomborzecki: lots of red PRs this morning it seems, anything in particular unhappy in the tests?06:50
mborzeckimvo: nope, nothing in particular06:54
mborzeckimvo: on the interesting-test-failures note, yesterday saw unit tests fail on travis (iirc it was daemon or cmd/snapd package) bc the port we tried to liste on was already busy06:55
mborzeckimvo: oh, and the lxd spread test failed in a weird way with cgroupv2 (AFAIK it's supported by lxd 3.x)06:56
mvomborzecki: interessting06:56
mborzeckimvo: anyways, woke up with some ideas to try out on F31, will discuss those with zyga again probably :)06:58
zygahello07:44
zygasorry for being late, stopped at 3AM07:44
mvohey zyga07:44
zygahey :)07:44
zygafinishing coffee07:44
zygaI'm eager to run downstairs to see what the test results say07:44
zygahttps://github.com/snapcore/snapd/pull/7155 <- lets merge it07:45
mupPR #7155: tests: remove locally installed core in more tests <Created by zyga> <https://github.com/snapcore/snapd/pull/7155>07:45
zygait's the same pattern as before, that got reviewed07:45
=== morphis4 is now known as morphis
zygasee you at 1007:46
zygaI'll get prepped07:46
mvozyga: do you think you could have a look at https://github.com/snapcore/core/pull/105 ?07:59
mupPR core#105: hooks: empty the configure hook <Created by mvo5> <https://github.com/snapcore/core/pull/105>07:59
mvozyga: should be pretty easy07:59
zyga`looking07:59
zygamvo: done08:00
zygamvo: let's merge https://github.com/snapcore/snapd/pull/715508:00
mupPR #7155: tests: remove locally installed core in more tests <Created by zyga> <https://github.com/snapcore/snapd/pull/7155>08:00
mupPR core#105 closed: hooks: empty the configure hook <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/core/pull/105>08:01
mupPR snapd#7155 closed: tests: remove locally installed core in more tests <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/7155>08:13
mupPR core-build#48 opened: config: remove static files in etc,lib,usr,var <Created by mvo5> <https://github.com/snapcore/core-build/pull/48>08:25
mupPR snapd#7160 opened: tests: reformat and fix markdown in snapd-state.md <Simple 😃> <Created by zyga> <https://github.com/snapcore/snapd/pull/7160>08:46
zygaa few trivial from my pool08:49
mupPR snapd#7161 opened: tests: show stderr only if it exists <Simple 😃> <Created by zyga> <https://github.com/snapcore/snapd/pull/7161>08:49
zygauff 29C in the morning08:54
Chipacapro tip: if you're used to running in the evening, getting up early to run in the morning because the evening is not going to drop below 30 is not necessarily a good plan08:57
Chipacamo'in all, sorry i'm late08:57
zygamvo: is https://github.com/CanonicalLtd/netplan/compare/master...mvo5:dbus#diff-a084b794bc0759e7a6b77810e01874f2R2 something I can review in a PR?08:57
zygaChipaca: hey :)08:57
mvozyga: https://github.com/CanonicalLtd/netplan/pull/9308:58
zygaChipaca: heat wave all around08:58
mupPR CanonicalLtd/netplan#93: add dbus based "netplan apply" interface <Created by mvo5> <https://github.com/CanonicalLtd/netplan/pull/93>08:58
mvozyga: that is the final one08:58
zygait reached us now too08:58
zygamvo: thank you08:58
mvoChipaca: running> yeah heat is bad08:58
Chipacaoh, my takeaway is that the morning is bad :-008:59
* zyga wonders what https://semaphoreci.com/cyphermox/netplan is08:59
mvoChipaca: yesterday and the day before the other side of my dsl line got a heat stroke at around 16:30. and it takes ages to talk to someone on the telco to reset it :/08:59
zygaas in semaphore08:59
pedronisI marked a bunch of my PRs for 2.4108:59
mvopedronis: thank you08:59
pedronisI mean ideally we get all in, but those are the important ones (because they fix something)09:00
Chipacamvo: if you can turn off your modem for ~5 minutes the port you're connected to gets returned to the pool, and you've got a chance of getting a new one09:00
zygamvo: there is https://github.com/CanonicalLtd/netplan/blob/master/rpm/netplan.spec but I don't know if that is used for CI09:00
zygamvo: also snap one https://github.com/CanonicalLtd/netplan/blob/master/snap/snapcraft.yaml09:00
mvoChipaca: oh? that is interessting,I will try that today at ~16:30 when the line goes down again09:01
pedronismvo: I think james #6954 is ready for merging, do you want to give a final look to the packaging/service bits?09:01
mupPR #6954: sessionagent: add a REST interface with socket activation <Needs Samuele review> <Created by jhenstridge> <https://github.com/snapcore/snapd/pull/6954>09:01
mvozyga: yeah, they use something that I'm not familar with (semaphoreci) - no idea how to add deps there09:01
mvopedronis: sure, let me check that09:02
Chipacamvo: OTOH it might be your ISP telling you to work on your work/life balance09:02
mvoChipaca: hahaha - do you have your hands in this ;) ?09:02
* Chipaca whistles innocently09:02
jameshmvo: I think I got the packaging right in that PR (mostly just followed existing examples), but an extra set of eyes is welcome09:09
pedronisChipaca: can you look at #7149 when you have a bit of time, especially output formatting  in the command and api bits09:09
mvojamesh: happy to do this09:09
mupPR #7149: [WIP] cmd: add snap model command; daemon: add /v2/model, /v2/model/serial REST APIs <Remodel :train:> <Created by anonymouse64> <https://github.com/snapcore/snapd/pull/7149>09:10
Chipacapedronis: i have time now09:10
* Chipaca looks09:10
mvojamesh: do you happen to know if there is a way to exit dbus services gracefully (and racefree) when they are not needed? context is https://github.com/CanonicalLtd/netplan/pull/93 which is a very simple service that I would like to stop if idle09:11
mupPR CanonicalLtd/netplan#93: add dbus based "netplan apply" interface <Created by mvo5> <https://github.com/CanonicalLtd/netplan/pull/93>09:11
jameshmvo: is it problematic if two copies of the daemon run simultaneously for a while?09:13
mvojamesh: I don't think so09:13
jameshmvo: in that case, releasing the name and exiting after current requests complete should be enough09:14
mvojamesh: nice!09:14
jameshmvo: I'm not sure if there is a good example of that using the systemd dbus lib though09:14
mvojamesh: no worries, I could change to gio09:15
jameshmvo: I'm sure there is a good example, I just don't know where it is09:15
mvojamesh: do you have one for gio?09:15
jameshshould have been "not sure where there is"09:15
mvojamesh: but no worries, I can figure it out :) thanks for the hint!09:16
jameshmvo: I know I dealt with this a while back for some of the unity-api projects, but can't really remember which09:17
mvojamesh: no worries, thanks again09:17
* mvo goes back to reviewing before diving into this09:17
jameshmvo: this code is using a bus_event_loop_with_idle() helper: https://github.com/systemd/systemd/blob/master/src/timedate/timedated.c09:19
jameshthat probably represents best practice with sd-dbus09:20
mvojamesh: sweet! thanks a lot, this looks like what I need09:20
Chipacahmm09:23
Chipacacannot run daemon: state startup errors: [cannot obtain snap-seccomp version information: invalid format of version-info: "cca7be4711160d1b940e8a87b8d572c8cb18e3dd 2.4.1 8c73f36d3de1f71977107bf6687514f16787f639058b4db4c67b28dfdb2fd3af"]09:23
Chipacawhat did i break now? :-|09:23
jameshmvo: https://github.com/systemd/systemd/blob/master/src/shared/bus-util.c#L92 <- this is the utility function.  It isn't part of libsystemd, but doesn't appear to be using private API09:25
pedronisChipaca: your snapd and you snap-seccomp are out of sync?09:26
Chipacapedronis: yeah that was it09:26
mvoChipaca: add a symlink from your build-tree to ../snap-seccomp/snap-seccomp09:28
mvojamesh: looking09:29
Chipacaijohnson: you there?09:29
mvoChipaca: probably not yet09:29
mvoChipaca: 4:29 for him09:29
Chipacathe 'snap model' PR seems to panic09:29
Chipacamvo: psh, so lazy09:30
mvoChipaca: heh :)09:30
zygatr09:39
zygare09:39
zygasorry, interrupts09:39
zyga(5200/5496) - no failures!09:40
zygawow09:40
zygawith the mount-ns test as last (famous last words, it may still fail)09:40
mupPR core#106 opened: core: remove config test, this moved to the snapd code <Created by mvo5> <https://github.com/snapcore/core/pull/106>09:40
mupPR snapd#6954 closed: sessionagent: add a REST interface with socket activation <Needs Samuele review> <Created by jhenstridge> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/6954>09:44
pedronisChipaca: it has no tests atm fwiw (I'm more of a write tests with the code sort of person)09:49
Chipacayeah, this is unlandable as is09:50
Chipacafor several reasons09:51
mvozyga: if you could review https://github.com/snapcore/core/pull/104  too that would be great. should be easy09:51
mupPR core#104: snapcraft.yaml: use remote fc-cache-builder <Created by mvo5> <https://github.com/snapcore/core/pull/104>09:51
mupPR core#106 closed: core: remove config test, this moved to the snapd code <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/core/pull/106>09:52
zygabrb again09:55
mvoor maybe someone else can check 104 on core? its really simple :)09:56
zygamvo: +110:00
mvozyga: ta!10:00
mupPR core#104 closed: snapcraft.yaml: use remote fc-cache-builder <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/core/pull/104>10:00
mupPR snapd#7161 closed: tests: show stderr only if it exists <Simple 😃> <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/7161>10:11
ograppisati, if i use the kdefconfig option in snapcraft.yaml, is that using ./scripts/kconfig/merge_config.sh from the kernel tree in the back or does it simply call the different configs in order ? (i see some weird behaviour between a snap kernel and a manually built one that indicates the configs are different)10:12
mupPR snapd#7153 closed: gadget: select the right updater for given structure <Gadget update> <Simple 😃> <Created by bboozzoo> <Merged by bboozzoo> <https://github.com/snapcore/snapd/pull/7153>10:13
mupPR snapd#7162 opened: usersession: move userd package to usersession/userd <Created by jhenstridge> <https://github.com/snapcore/snapd/pull/7162>10:28
mupPR snapd#7163 opened: tests: measure testbed for leaking mountinfo entries <Created by zyga> <https://github.com/snapcore/snapd/pull/7163>10:34
ppisatiogra: hold on10:36
mborzeckizyga: mvo: so lxd attempts some weird things on F31 with unified hierarchy: https://paste.ubuntu.com/p/Z4Qc4qq87v/10:37
zygamborzecki: what is fd=1010:38
mupPR snapd#7164 opened: test: enable and run mount-ns test as last <Created by zyga> <https://github.com/snapcore/snapd/pull/7164>10:38
zygamborzecki: https://github.com/snapcore/snapd/pull/716310:39
mupPR #7163: tests: measure testbed for leaking mountinfo entries <Created by zyga> <https://github.com/snapcore/snapd/pull/7163>10:39
zygaideas welcome10:39
zygaChipaca: ^ you as well, this is something similar to what you've built before10:39
ppisatiogra: 'make $kdefconfig[0] $kdefconfig[1] $kdefconfig[2] ...'10:40
ppisatiogra: but after the first one is expanded, it should call merge_config.sh by default - that's part of the kernel build rules10:41
* Chipaca steals cookies10:41
* Chipaca steals biscuits also, for better i18n coverage10:42
ograppisati, aha ... strange ... when using https://github.com/ogra1/pi4-kernel-hackery/blob/master/build-linux-5.1.sh#L10 vs https://github.com/ogra1/linux-raspberrypi-org/blob/master/snap/snapcraft.yaml#L30 i actually need to specify security=apparmor and apparmo=1 on the cmdline for the snap ... while the native build defaults to using apparmor ...10:43
ograthe patches and trees are absolutely identical10:44
mupPR snapd#7144 closed: tests: measure mount namespaces on Ubuntu 14.04 <Created by zyga> <Closed by zyga> <https://github.com/snapcore/snapd/pull/7144>10:44
Chipacamborzecki: https://www.redbubble.com/people/rodebubbel/works/31716594-i-use-arch?p=sticker10:47
mborzeckiChipaca: hahah10:47
Chipacamborzecki: even better, https://www.stickermule.com/uk/products/unixstickers-pro-pack10:49
mborzeckiChipaca: aaand placed an order :)10:53
Chipacamborzecki: <surprised zapdos>10:54
mborzeckimvo: zyga: https://forum.snapcraft.io/t/lxd-3-15-fails-with-unified-cgroup-hierarchy/12462 the lxd thing11:00
mvomborzecki: thanks11:02
Chipacahow do you spell "ALL THE LUNCH"11:26
* Chipaca all the lunches11:26
* zyga does reviews for a while11:37
mupPR snapd#7160 closed: tests: reformat and fix markdown in snapd-state.md <Simple 😃> <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/7160>11:37
mborzeckisome unfortunate project name, can anyone try `go get github.com/ojii/gettext.go`?11:50
mborzeckithe repo name causes a panic in fedora packaging tools :/11:51
zygamborzecki: perhaps we should fork it11:54
zygaI think the .go suffix on a project name is a bit unfortunate11:54
mborzeckizyga: hm there's a fork under snapcraft/go-gettext11:54
zygais it up to date?11:54
mborzeckiduh, snapcore/go-gettext11:54
mborzeckizyga: yeah, perhaps we should just package it, dropping all i18n support feels to heavy11:56
zygayeah11:58
zygaI think so11:58
zygawe should craft a plan to support (maintain) our deps in Debian and Fedora11:58
zygawe really need that11:58
zygamborzecki: can you look at https://github.com/snapcore/snapd/pull/716311:59
mupPR #7163: tests: measure testbed for leaking mountinfo entries <Created by zyga> <https://github.com/snapcore/snapd/pull/7163>11:59
zygait's super short and will hopefully open the path towards leakproof tests11:59
zygaand it found stuff I wasn't testing... 18.04 is full of fun12:16
zygaon it :)12:16
mupPR snapd#7163 closed: tests: measure testbed for leaking mountinfo entries <Created by zyga> <Closed by zyga> <https://github.com/snapcore/snapd/pull/7163>12:19
mupPR snapd#7164 closed: test: enable and run mount-ns test as last <Created by zyga> <Closed by zyga> <https://github.com/snapcore/snapd/pull/7164>12:22
ijohnsonhey Chipaca12:43
ijohnson(and everyone else)12:44
ijohnsonChipaca: thanks for the detailed review, I have in fact been running that PR, but I have been cherrypicking the commits on top of the 2.39 branch because that was easier to test without dealing with the system-key format and I naively assumed that master would work the same as that branch12:48
* Chipaca hands one of the cookies back12:49
pedronisremodeling work has changed quite a few details about DeviceManager/devicestate12:50
cmatsuokamvo: won't be at the standup today, there's an interesting session at the same time slot12:51
zygamborzecki: https://github.com/snapcore/snapd/pull/716512:52
zygaijohnson: https://github.com/snapcore/snapd/pull/7165 :)12:52
mupPR #7165: tests: restore cpuset clone_children clobbered by lxd <Created by zyga> <https://github.com/snapcore/snapd/pull/7165>12:53
zygaijohnson: I'm fighting tests that break the testbed by doing changes to the mount table12:53
mupPR snapd#7165 opened: tests: restore cpuset clone_children clobbered by lxd <Created by zyga> <https://github.com/snapcore/snapd/pull/7165>12:53
pedronisChipaca: Model was taking the lock for you in 2.39, it doesn't anymore12:53
pedronisthe older behavior had its reasons but was kind of weird (we don't take the lock for such small methods usually)12:53
ijohnsonzyga: nice, I can take a look in a bit, still reading through all of my cmd/model comments that I will need to address12:54
pedronisijohnson: 2.39 isv very different from master, if you look at changelog of 2.40 already lots have happened12:55
zygaijohnson: no worries :)12:55
* Chipaca grudgingly returns the rest of the cookies12:58
* Chipaca now needs to find his own12:58
ijohnsonChipaca: costco near me sells a big box of 16 cookies for $413:00
* ijohnson hands Chipaca some cookies13:00
* Chipaca discovered the meaning of win-win13:01
mupPR snapd#7162 closed: usersession: move userd package to usersession/userd <Created by jhenstridge> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/7162>13:27
zygaI'll grab some food and return to reviews13:36
pedronisa 2nd review for 7066 would be great (it's not urgent but it's old and there is one more on top)13:50
zygafedora tests look good but core is full of nasties13:55
mborzeckizyga: mvo_: left a note under https://bugzilla.redhat.com/show_bug.cgi?id=1438079#c614:01
zygaI saw that :)14:01
zyga(mail notification ahead of IRC)14:02
zygathank you14:02
zygaand good luck with flock14:02
mborzeckizyga: mvo_: also https://gist.github.com/bboozzoo/76b1535c93686a27bb7fdbaad0f560f7 got updated14:02
zygamborzecki: note, freezer is available since 5.2 or 5.314:02
zygaas in the freeze feature14:02
zygabut as we discussed, we should switch to safe mount api14:03
zygaand not freeze14:03
mborzeckizyga: mhm, i doubt anyone on older kernels will switch to unified anyway :)14:03
zygayeah, just saying14:03
zygatravis is starving us now14:12
mupPR snapcraft#2643 closed: project, cli: clean up snap asset messages <Created by sergiusens> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2643>14:22
zygapedronis: I did a pass over https://github.com/snapcore/snapd/pull/7066#pullrequestreview-26665675614:37
mupPR #7066: overlord/assertstate: add Batch.Precheck to check for the full validity of the batch before Commit <Created by pedronis> <https://github.com/snapcore/snapd/pull/7066>14:37
* zyga can smell lovely curry from the kitchen and goes for a break14:41
fgiulianiinthi guys, i'm trying to install Ubuntu Core on an embedded computer with an i5 CPU. I copied the ubuntu-core-18-amd64.img.xz image on the mSata disk and the boot the PC. When I press enter to make the configuration I got an error: UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 31.. etc.. and the PC promt again "press enter to c15:01
fgiulianiintonfigure"what can I do?15:01
mupPR snapd#7166 opened: client: add doTimeout to http.Client{Timeout} <Created by mvo5> <https://github.com/snapcore/snapd/pull/7166>15:02
Chipacafgiulianiint: ouch15:03
zygafgiulianiint: hmmm, I think that image is DOA, where did you get it from?15:06
ijohnsonis `make hack` still supposed to work/be used?15:07
zygaijohnson: yes, though YMMV15:08
zygaijohnson: send patches to improve it15:08
zygaI use it regularly15:08
zygabut I have a local patch that's hard to upstream, to make it work on suse15:08
zygawhere the .real suffix is not used15:08
ijohnsonok, yeah I'll send a small patch to make it work when using the go snap, because it's using options that don't work with read-only go install15:08
fgiulianiintzyga: i downloaded from the official repo (at least I think) http://cdimage.ubuntu.com/ubuntu-core/18/stable/current/?_ga=2.266211528.651887194.1563966098-1627888589.156162111315:09
zygaijohnson: read-only go install?15:09
ijohnsonthe go snap?15:09
zygaijohnson: I'm looking forward to the patch15:09
ijohnsongo build runtime/cgo: open /snap/go/4100/pkg/linux_amd64/runtime/cgo.a: read-only file system15:09
fgiulianiintzyga: what DOA stands for?15:09
zygafgiulianiint: ouch, not sure what to do about it, can you raise the topic on a forum and we can see what to do from there; p15:09
zygadead on arrival15:10
zygaI think that image is busted15:10
zygais the text localised in any way?15:10
pedroniszyga: thx, updated, I did something slightly different15:10
zyga+115:10
fgiulianiintzyga: yes, the only problem I can't copy the error becouse the monitor is cleared every time it prompts again "Press enter to configure"15:11
zygafgiulianiint: no worries, that's okay15:11
fgiulianiintok than15:12
zygafgiulianiint: thank you for reporting that, I think we should check how that happened, there's supposed to be QA around that15:12
zygamvo_: ^ who manages the images that are produced?15:13
pedroniszyga: thx, I'll land it if/when it gets green. from uc20 spike work I learned that we should probably make Batch more versatile and move it to asserts. something maybe to try during travel15:16
zyga+115:17
zygapedronis: thank you15:17
mupPR snapd#7167 opened: cmd/Makefile.am: support building with the go snap <Simple 😃> <Created by anonymouse64> <https://github.com/snapcore/snapd/pull/7167>15:19
ijohnsonzyga: see 7167 ^15:20
zygaijohnson: looking15:21
ijohnsonthanks15:21
zyga+115:22
ijohnsonbtw is there a convenient "make unhack" to undo the changes from the make hack command? I just copied all of /usr/lib/snapd and was gonna re-copy it back when done15:23
ijohnsonnot sure if there's a more convenient way to do that15:23
mupPR snapd#7166 closed: client: add doTimeout to http.Client{Timeout} <Created by mvo5> <Closed by mvo5> <https://github.com/snapcore/snapd/pull/7166>15:28
mupPR snapcraft#2639 closed: deprecations: add deprecation notice for version-script (dn10) <Created by cjp256> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2639>15:29
* cachio lunch15:29
zygaijohnson: no, just reinstall the package15:31
zygaijohnson: it's a quick and easy fix15:31
ijohnsonI see, I hadn't thought of that, but that sounds easy15:32
zyga:)15:32
zyga+1 on making that in make unhack15:32
zygaif you feel like wanting that15:32
ijohnsonit would make it easy15:32
ijohnsonI'm also gonna add some more info to HACKING.md since it is a little dusty I think15:32
zyga+115:33
zygayeah, go for it :)15:33
zygaI wish we'll reach a point where the makefile won't have to hide in the cmd directory15:33
zygaone day15:33
* zyga restarted some local tests and returns to the kitchen where it is cooler15:34
abeatozyga, hey, I'm doing some testing by bind mounting snapd, but I found this error:15:36
abeatoJul 25 15:34:45 localhost snapd[5256]: cannot run daemon: state startup errors: [cannot obtain snap-seccomp version information: invalid format of version-info: "762c8972ff78d5e5d00275810e4dba7ae0ae0ea4 2.4.1 8c73f36d3de1f71977107bf6687514f16787f639058b4db4c67b28dfdb2fd3af"]15:36
zygaabeato: hmmmm15:36
zygaah15:36
ijohnsonhey abeato, I ran into the exact same thing15:36
abeatozyga, any idea on how can I workaround this?15:36
zygayeah, new snapd needs matching snap-seccomp15:36
ijohnsonI fixed it by doing make hack in cmd/ subdir15:37
zygabind mount snap-seccomp in the _same_ directory as snapd15:37
zygait uses /proc/self/exe15:37
zygaif you develop from source ijohnson's advice is good15:37
zygamake hack is your friend15:37
abeatoijohnson, nice, so then I need to bind mount snap-confine or other binaries?15:37
zygaabeato: make hack installs them15:37
zygaabeato: if you just care about snapd then just providing snap-seccomp is sufficient to get past that15:38
ijohnsonabeato, go with what zyga says :-)15:38
abeatozyga, ok, will do that, I am compiling in a different machine to where I am testing, as it is an UC system15:38
zygaaha15:38
zygayeah, a symlink would work too15:38
zygawhatever is convenient15:39
zygajust need a "recent enough" snap-seccomp15:39
zygait's not that they have to be built together15:39
abeatook, will try that thanks ijohnson and zyga15:39
zyga:)15:39
mupPR snapd#7165 closed: tests: restore cpuset clone_children clobbered by lxd <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/7165>15:44
mupPR snapd#7168 opened: tests: measure testbed for leaking mountinfo entries <Created by zyga> <https://github.com/snapcore/snapd/pull/7168>15:46
* ijohnson goes to go look at a used car15:49
ograyou have weird hobbies15:56
mupPR snapd#7166 opened: client: add doTimeout to http.Client{Timeout} <Created by mvo5> <https://github.com/snapcore/snapd/pull/7166>15:56
Chipacaok, I'm out16:34
ChipacaAC is no longer keeping up16:34
Chipacasend help16:34
* Chipaca heads for the showers16:34
* zyga is running away from the office16:39
zygait's the hottest part of the house now16:39
zygarunning another pass16:55
zygaI found another general class of leaky tests16:55
zygacore18 is often leaked on core systems16:55
zygabecause cleanup is different there16:55
zygathis is now fixed, let's see what else is uncovered16:55
zygameanwhile, I *really* need to run away from the office16:55
zygattyl16:55
ijohnsonis it expected / by design that snaps cannot run when snapd is unable to start?17:10
zygaijohnson: it's not exactly like that17:17
zygaijohnson: in general snaps *can* almost always run without snapd17:17
zygaijohnson: your case is different because you use a local build17:17
zygaijohnson: in that case you always need snapd to compute matching security profiles17:17
zygaijohnson: (matching to snap-run)17:17
ijohnsonI should specify, this is for a classic snap17:17
ijohnsonzyga: yes I know why my local snapd can't start17:18
zygathe logic doesn't check for snap confinement type17:18
ijohnsonzyga: I'm just wondering if it's the case that something in snap-run/snap-confine needs to talk to snapd the daemon in order to continue17:18
zygayes17:18
zygabut only in a specific case17:18
zygasnap run computes the "system key"17:18
zygaand if mismatches what's on disk (written by snapd)17:18
zygait waits17:18
zygaor pokes snapd, I forgot17:19
zygabut it waits anywa17:19
zyga*anyway17:19
ijohnsonI see, so if the system key matched, but snapd still couldn't start for some other reason the snap would be able to start?17:20
zygano17:21
ijohnsonokay, so it does look like it's at least expected that the snap wouldn't be able to run, but perhaps that's not an explicit design choice17:22
ijohnsonI'm aware of the explicit design choice of snapd not blocking bootup and not getting in the way of other things running on the system17:22
ijohnsonI wasn't sure if there was a similar thing for running snaps specifically17:22
zygaijohnson: you are right with the design choice of not blocking startup17:23
zygaijohnson: but except for kernel or snapd changes17:23
zygaijohnson: and that's what's going on, effectively here17:24
zygaijohnson: running snaps is in the same area, since the boot up problem is really "snapd needs to work for system to boot"17:24
mupPR snapd#7169 opened: tests: remove core18 if installed by tests <Created by zyga> <https://github.com/snapcore/snapd/pull/7169>17:31
mupPR snapd#7170 opened: tests: fix typo "current" <Simple 😃> <Created by zyga> <https://github.com/snapcore/snapd/pull/7170>17:32
ijohnsonzyga: okay that makes sense17:35
mupPR snapd#7169 closed: tests: remove core18 if installed by tests <Created by zyga> <Closed by zyga> <https://github.com/snapcore/snapd/pull/7169>17:44
mupPR snapd#7066 closed: overlord/assertstate: add Batch.Precheck to check for the full validity of the batch before Commit <Created by pedronis> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/7066>17:51
mupPR snapd#7171 opened: tests: improve how the system is restored when the upgrade-from-2.15 test fails <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/7171>18:11
* cachio afk18:20
zygafound another bug, installing the "classic" snap clobbers the host18:43
zygafun fun fun18:43
zygauUUUUh18:51
zygaomg18:51
zygaman18:51
zygathis is bad18:51
zygaah, wait18:53
zygaI misread18:53
zygait's not bad18:53
zygageez :|18:53
sergiusenszyga: chill!18:53
sergiusenshard to do with your heat wave, come down south to our cold weather :-)18:54
zygasergiusens: polandball colors are somewhat appropriate now18:54
zyga(being upside down)18:54
mupIssue classic-snap#32 opened: Using classic clobbers /dev/pts on ubuntu-core 16 systems <Created by zyga> <https://github.com/snapcore/classic-snap/issue/32>19:21
mupPR snapd#7172 opened: tests: work around classic snap affecting the host <Created by zyga> <https://github.com/snapcore/snapd/pull/7172>19:44
zygaogra: do you know who maintains the classic snap?19:45
zygajdstrand: ^ interesting PR19:45
zygajdstrand: tl;dr; security implication is that mounts that don't propagate to the other namespaces can still remount a mount point in the other namespaces if they have the permission (or attack vector) to do so19:45
* zyga takes a break 19:45
jdstrandzyga: note devpts is special. I haven't read the code but it would surprise me if it honored propagation events. you just mount what you want at the place iirc and the kernel gives you that19:50
jdstrandzyga: and the classic snap is performing mount -o mode=666,ptmxmode=666 -t devpts devpts /dev/pts19:51
zygajdstrand: that's odd, I tried "mounting over" but it would return EBUSY unless I passed -o remount19:51
zygajdstrand: did you strace the classic snap or inferred this from the source code19:52
zygajdstrand: as it does use -o remount in some if-then-else tree19:52
zygabut anyway, it's interesting and was non-obvious to me what is the cause of this19:52
zygajdstrand: the mountinfo-tool work and the recent testbed-tool work is really paying off19:52
jdstrandclassic is doing a weird: mount -o mode=666,ptmxmode=666 -t devpts devpts /dev/pts ; $SCRIPT && umount  /dev/pts19:52
zyganote && is a bug most likely19:52
zygait's horrible and should be rewritten away from shell IMO19:53
jdstrandzyga: as mentioned, I didn't look at anything. I just know that devpts is special in many ways and it wouldn't surprise me if this was one of them19:53
zygajdstrand: ack, I'll read the kernel source to see what it does19:53
zygaI just wanted to share it because I was definitely not expecting this and I learned something today :)19:54
zygajdstrand: in case you are interested where this is coming from: https://github.com/snapcore/snapd/pull/7168/files19:54
mupPR #7168: tests: measure testbed for leaking mountinfo entries <Created by zyga> <https://github.com/snapcore/snapd/pull/7168>19:54
jdstrandzyga: it is interesting, but I don't consider it a security issue within snapd case the classic-support interface isn't meant to provide a security barrier and strict snaps can't do the mounting (and classic snaps are limited by DAC (which is only useful for non-root commands of course))19:55
jdstrandie, if you can do arbitrary devpts mounts, then well, I'm not surprised that can affect things19:56
zygajdstrand: I wonder if our apparmor policy that allows a particular mount also allows you to remount, in other words, if you don't say options=(remount), do you have that?19:57
zygajdstrand: or in other words, should way always say options=() to avoid having the effect of options=(*)19:57
jdstrandzyga: remount is a different rule19:58
jdstrandmount, umount, remount19:58
zygareally? I didn't know that19:58
zygaI recall we have some remount code19:58
* zyga looks19:58
zygahttps://github.com/snapcore/snapd/blob/7721bb9df44a136f31920515fc5d1a3c2e1e9850/cmd/snap-confine/snap-confine.apparmor.in#L29620:00
zygawe say options=(remount, ...) here20:00
zygaor did you mean that?20:00
zygabased on what you said I was expecting "remount ..." as a top-level rule20:00
jdstrandI do see options=(remount ro bind) etc in there20:00
jdstrandthere is a remount rule20:00
zygaare they equivalent?20:01
jdstrandzyga: it probably depends on how it was mediated. I can say that we use options=(...) which means that the mount options must exactly match. you can't omit or inject20:04
jdstrandjjohansen: zyga and I were curious when 'remount ...' is used, vs 'mount options=(remount, ...)'20:05
jdstrandzyga: also note that systemd-run is in play with the classic snap, so it might've done something too20:09
jdstrandzyga: the classic snap is not using 'newinstance' either...20:10
jdstrandanyway, I need to get back to what I was working on20:10
jjohansenjdstrand: remount is the same as options=(remount,...)20:11
jjohansenits just a convenience keyword20:12
ograzyga, classic should go away in favour of lxd20:13
jdstrandjjohansen: ack, thanks (cc zyga ^)20:13
ograit comes from a time where we needed a quick way to use debs on core for development, it has never been more than a hack20:14
ograzyga, also note that there has never been a stable release for a reason ;)20:16
JordiGHsnapd ate all of my AWS CPU credits. It was running for several minutes. I restarted the VM. What was that thing doing? It made the VM unresponsive.20:19
JordiGHI'm not even using snaps on this VM. :-\20:19
JordiGHIt looks like it was doing a lot of IO 'cause some kernel disk process was topping the charts.20:19
zygaJordiGH: can you run "snap changes" to let us know?20:26
zygasystemd logs could also be useful (of snapd.service)20:26
JordiGH$ snap changes20:30
JordiGHerror: no changes found20:30
JordiGH$ sudo journalctl -u snap.service20:30
JordiGH-- No entries --20:30
JordiGHOh, sorry, snapd.20:31
JordiGHDoes this mean anything to you? http://paste.debian.net/1093102/20:31
zygalooking20:33
zygais snapd still using CPU?20:33
zygaso far all it did seems nurmal20:33
zyga*normal20:33
JordiGHNo, it's not doing anything now.20:33
JordiGHBut what could it possibly have been doing?20:33
JordiGHIs there some scheduled task?20:34
zygainitially it seeds snaps20:34
zygasnaps are on disk but are not installed20:34
JordiGHEven on a system that, afaict, has no snaps?20:34
zygaI see you have two snaps20:34
zygasnap list?20:34
JordiGHOh, I do?20:34
zygaI think so20:34
JordiGHUgh, Amazon has started to use snaps.20:34
JordiGHamazon-ssm-agent20:34
zygaso it installed the two snaps, the core is quick and easy but the amazon-ssm-agent might required some CPU startup time to configure the sandbox20:34
JordiGHThat, eh?20:34
zygayeah20:34
zyga*might have required20:35
zygawhen you said it ate all your credits, what was the actual amount20:35
roadmrI believe those are baked into the images20:35
zygadid it run for minutes, hours?20:35
JordiGHI'm really worried that Ubuntu is really trying to get rid of or hide apt.20:35
zygaroadmr: yes20:35
JordiGHzyga: It ran for about 30 minutes before I noticed and terminated the instance.20:35
zygaJordiGH: we are doing neither, I can assure you; snaps do make a lot of sense for many payloads though20:35
zygaJordiGH: ouch! that's certainly bad20:36
roadmrwas it snapd itself, or the agent snap? if the latter, this is probably best raised with amazon themselves, right?20:36
zygaJordiGH: can you share the details please: what kind of instance, which image, etc20:36
zygaJordiGH: so that we can reproduce and fix this20:36
JordiGHroadmr: I don't know, I saw snapd in top(1) as well as a kernel IO process. I'm not sure if it was kswapd.20:36
roadmrJordiGH: right, that doesn't look like the agent itself20:36
JordiGHNot the agent itself? Something other than snapd?20:37
JordiGHsnapd was doing something that was doing a lot of disk writing.20:37
zygaJordiGH: ideally we can reproduce this and determine the cause20:37
JordiGHzyga: t2.large20:37
JordiGHzyga: I was told that yeah, the goal was to make people stop using apt.20:38
zygaJordiGH: can you collect this in a bug report please, I'll make sure the cloud people investigate this20:38
JordiGHWas I mislead? Canonical employees told me this.20:38
zygaJordiGH: who told you this?20:38
roadmrit wasn't me :)20:38
zygaI'm a canonical employee and I think both snaps and classic packages have their uses20:38
JordiGHyeah, apt is for building snaps, right?20:39
JordiGHUsers should only use snaps.20:39
zygait depends20:39
JordiGHI don't remember who said this.20:39
zygait's not as simple as that20:39
zygafor some use cases one is more appropriate than the other20:39
zygafor end user applications, despite the relative immaturity, snaps do make a lot of sense20:39
JordiGHI thought the point is that Canonical was going to be spending all of its energy on making snap packages and make apt packaging secondary.20:40
JordiGHAnyway, what am I going to report and to whom?20:40
zygafor certain types of services and in headless consumer electronic stuff snaps make a lot of sense20:40
zygaJordiGH: I think whoever told you that was sharing his personal view and not a company policy20:40
JordiGHI don't have a lot of data. I don't even remember exactly what I was seeing in top(1).20:40
zygaJordiGH: please collect the information and report it either on forum.snapcraft.io or on bugs.launchpad.net/snapd20:40
zygain either case please share the link, I'll get some eyes on it20:41
JordiGHLink to what?20:41
zygaJordiGH: region, instance type, image used, that should be enough to see if it happens all the time20:41
zygato the bug report or forum post you make20:41
JordiGHI'm going to make a bug report?20:42
zygaplease, if you can20:42
JordiGHeu-west-1a, t2.large, xenial-based image,20:42
JordiGHWhere should I make a bug report?20:42
zygaxenial-based?20:42
zygawas it an official image or something custom?20:42
zygaI'm only asking to know if we can reproduce it on the stock one20:43
JordiGHWe grab the xenial image, add stuff to it, and deploy VMs based on that.20:43
zygaI see20:43
zygaJordiGH: please report the bug on https://bugs.launchpad.net/snapd20:43
jdstrandogra (cc zyga): is lxd viable for the workflow you described (ie, building things in an armhf container). are there official lxd images for armhf and arm64?20:44
zygajdstrand: I'm sure there are20:44
zygajdstrand: I used lxd on both20:45
jdstrandhmm.. I recall wanting them at one point and not having them20:45
jdstrandbut that was a while ago20:45
JordiGHzyga: Can't remember my password, my email reminder isn't showing up, I'm already cross and don't want to bother with this anymore.20:45
zygaI think at this time you just install lxd and launch a container from it20:45
JordiGHIf it happens again I'll come back.20:46
zygaJordiGH: thank you20:46
zygaJordiGH: if you want to, a forum post on forum.snapcraft.io is also useful20:46
zygajust anything that we can share with you as a way to continue the conversation20:46
JordiGHThat probably also requires creating accounts, and I'm already short-tempered, ttyl!20:47
jdstrandzyga (cc ogra): sudo lxc launch ubuntu:16.04 xenial is working on arm6520:48
jdstrandarm64*20:48
zygajdstrand: cool :)20:48
jdstrandso, nm20:48
zygajdstrand: I switched off my arm machines to (ironically) save some power today so I cannot ssh into anything to check quickly20:48
jdstrandheh20:48
zygaand I'm too lazy to go down and see the office today20:48
zygait's 22:48 and here I am, working20:48
jdstrandzyga: you should stop that :)20:49
zygaI know but then we would not have this conversation about remount :)20:49
jdstrandheh20:52
jdstrandand sudo lxc launch ubuntu:16.04 xenial works on armhf too20:54
zygajdstrand: btw, if you could comment on https://github.com/snapcore/snapd/pull/7172 I would love to fix this and carry on21:07
mupPR #7172: tests: work around classic snap affecting the host <Created by zyga> <https://github.com/snapcore/snapd/pull/7172>21:07
zygathe context is that there's a new tool that shouts loudly if a test clobbers the machine21:07
zygaso we get to see things like that easily21:07
mupPR snapd#7170 closed: tests: fix typo "current" <Simple 😃> <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/7170>22:30
ograjdstrand, yeah, absolutely, i use it every day22:44
ograjdstrand, and if you add your user into /var/lib/extrausers/group to the lxd line you can even get away without sudo ;)22:45

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!