/srv/irclogs.ubuntu.com/2018/02/06/#snappy.txt

mupPR snapcraft#1915 closed: snap: patch ctypes for the snap <bug> <Created by sergiusens> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1915>01:43
thominiemeyer: Oh! I didn't realise I had edit rights to that post myself, or I would have just edited it directly, sorry :D02:17
niemeyerthomi: All good! I was still tuning it nevertheless, but yeah, if you want to tweak in the future feel free02:18
niemeyerand the magic happens ... https://snapdocs.labix.org/getting-started/387602:19
thominice02:19
mupPR snapcraft#1912 closed: lxd: unset SNAP to work-around LXD deb thinking it's a snap <Created by kalikiana> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/pull/1912>03:20
niemeyerForum going down for maintenance.. assume impact position please.03:47
niemeyerForum is back up03:51
mborzeckimorning06:11
zygagood morning06:32
mborzeckizyga: mvo_: hey06:34
mvo_hey mborzecki - good morning06:36
zygahey guys06:52
mvo_hey zyga06:58
zygahey :-)06:59
mupPR snapd#4611 closed: overlord/configstate/config: make [GS]etSnapConfig use *RawMessage <Created by chipaca> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4611>07:00
* zyga iterates on the feedback from jamie07:03
zygajdstrand thank you :)07:03
zygaoh, I have a conflict to resolve first07:03
mupPR snapd#4604 closed: cmd/snap-confine: create lib/{gl,gl32,vulkan} under /var/lib/snapd and chown as root:root <Created by bboozzoo> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4604>07:38
=== chihchun_afk is now known as chihchun
mupPR snapd#4612 opened: snap: exclude `gettimeofday` from `snap run --strace` <Created by mvo5> <https://github.com/snapcore/snapd/pull/4612>08:01
kalikianasliff08:01
pstolowskigood morning!08:13
zygahey pawel08:16
mvo_hey pstolowski !08:17
zygamvo_ 4590 is now ready, I pushed some WIP patches by accident but they are gone now08:18
zygaI'll add a spread test before jumping into sun profiles more08:19
mvo_zyga: ta08:19
kalikianao/ pstolowski08:20
* kalikiana coffee08:21
zygajamesh hey08:21
jameshzyga: hi08:21
zygaI wanted to catch up with you08:21
mborzeckipstolowski: morning08:21
zygahow is that branch, I saw jamie gave you a review, are you just waiting on a re-review from him?08:22
zygaI also wanted to give you an update on some of the work I'm doing that intersects (though I don't anticipate any problems)08:22
zygawe will soon have per-snap profiles for snap-update-ns08:23
ackkmvo_, hi, was the updated base-18 with distro-data built?08:23
zyga(apparmor profiles that is)08:23
jameshzyga: I still need to get the mountinfo stuff working: I had other things on my plate on Friday, and was flying home on Monday08:23
mvo_ackk: it was, iirc it was sitting in the review queue, we need to poke jdstrand about accepting the updated base-18 snap08:23
ackkmvo_, oh, I see08:24
zygajamesh did my suggestion help you in any way?08:24
jameshzyga: I still need to think it over a bit more.  I wasn't even looking at the device numbers before.08:26
zygaokay08:26
zygamy changes for per snap s-u-n profiles will touch snap-confine a little and mostly the backend code08:27
zygathere will be some new logic before running s-u-n from C08:27
zygathe idea behind sun profiles is that they can be tailored to the given snap and describe the operations we anticipate to perform08:29
zygaso that s-u-n doesn't have to carry very broad write and mount permissions08:29
zygajamesh when do you think your branch will be ready for re-review?08:30
jameshzyga: well, I need to be able to add the check jdstrand requested, which so far I haven't been able to implement08:30
zygajamesh ok, I'll look at that part, maybe I can help somehow08:31
zygajamesh do you mind if I push there directly?08:32
zygawoot, 4590 is ready for 2nd review08:40
zyga~100 diff08:40
zyga(and most of that is in apparmor which was acked by jamie)08:41
zygaanyone? :)08:41
=== chihchun is now known as chihchun_afk
zygahey Chipaca08:55
Chipacamoin moin08:55
zygaChipaca maybe I can grab you for a 2nd review of about 100 lines09:01
zygahttps://github.com/snapcore/snapd/pull/459009:01
mupPR #4590: many: allow constructing layouts (phase 1) <Created by zyga> <https://github.com/snapcore/snapd/pull/4590>09:01
mupPR snapd#4613 opened: release: snapd 2.31 <Created by mvo5> <https://github.com/snapcore/snapd/pull/4613>09:05
Chipacazyga: missed your message before, looking now09:18
=== chihchun_afk is now known as chihchun
zygathank you09:20
Chipacafmt's widths and precision are pretty messed up09:23
mupPR snapd#4614 opened: data/systemd: for debugging/testing use /etc/environment also for snap-repair runs <Created by pedronis> <https://github.com/snapcore/snapd/pull/4614>09:23
pedronismvo_:   ^ trivial fix/tweak to snap-repair  service unit09:23
mvo_pedronis: looking09:24
mvo_pedronis: ta09:25
zygahave we tested repairs for real yet?09:26
pedroniszyga: no, they have been tested in staging,  it's been 2nd highest prioritity thing for a while though,  next weeks might be the charm though09:29
zygacool, it's a very important thing to see work as it can save our skin one day09:29
pedroniszyga: anyway that PR is the result of me trying to reload state about them09:31
=== sparkieg` is now known as sparkiegeek
pedroniszyga: it's also been delayed by meltdown/spectre, as many other things09:33
zygayeah, timing is not on our side09:33
ikeydo you guys regret picking go yet? :)09:49
pedronisikey: instead of?09:49
ikeyi mean in general09:49
ikeyseems to me the lower down you go with go the more ugly warts are there waiting to be found09:50
mupPR snapd#4614 closed: data/systemd: for debugging/testing use /etc/environment also for snap-repair runs <Created by pedronis> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/4614>09:52
mupPR snapd#4615 opened: overlord/snapstate/backend: perform cleanup if snap setup fails <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4615>09:52
mborzeckiikey: how far down?09:52
ikeymborzecki, process level attributes and sandboxing09:53
ikeynamespaces, etc09:53
ikey(also process vs thread)09:54
ikeysorta stuff we ran into with solbuild in solus, kinda assumed similar brick walls would be hit and worked around with snapd09:54
mborzeckiright, that doesn't work so well (at all) in go09:54
ikeythen again i suppose the flipside is not dealing with berkley sockets :]09:55
pedronisit mostly affects snap-confine though (wich now is split between C and go helpers)09:55
ikeyah so thats why its split, makes sense09:55
ikeyso the design is more like "bootstrap environment and then exec" in a sense?09:55
zygayes09:55
zygaand actually, we managed to move a lot of it to go now09:55
ikeyneat way of doing it :]09:55
zygasnap-update-ns and snap-confine do stuff together09:56
zygaand we can move much more to go09:56
ikeyoh nice09:56
pedronisotherwise we mostly hit issues with go threads and exec09:56
zygathere are just a handful of things that cannot be done from go09:56
ikeyyeah go threads are.. special09:56
zyga(where C pre-go code doesn't count as "go" ;-)09:56
mborzeckithere are workaround those09:56
mborzeckii mean, iirc libcontainer is all go right?09:56
ikeyhuh spose yea09:56
mborzeckiprobably quite a lot of (un-)lockosthread and maxprocs fun09:57
ikeyyea09:57
mborzeckinot that i would like to do it though :)09:57
ikeybut ofc. :D09:57
ikeyi think the most evil go issue i had wasn't actually go's fault, cgo/xz09:57
pedronisthe other issue is that go moves faster than some distros (this one we haven't tackled but probably should somehow)09:57
ikeyi suspected i had a memory leak but my peanut gallery training told me that nope, that memory will get returned, its just virtual memory09:58
mborzeckioh and we haven't done anything with go assembly, which is quite nice actually :)09:58
ikeythat was until it OOM'd with 30GB used09:58
ikeyhadn't heard about go assembly, gonna have to google it09:58
mborzeckiikey: try this https://talks.golang.org/2016/asm.slide09:59
zygamborzecki note that even with those some things just cannot be done in go (several syscalls require you to have ever only had one thread in a process)09:59
ikeymborzecki, danke09:59
mborzeckizyga: hm i wonder if that couldn't be doen with GOMAXPROCS=1 and LockOsThread in init()10:00
ikeyo cheeky10:00
zygano10:00
zygawe tried10:00
zygago does stuff in library initialization10:00
ikeygo needs a -pleasebelikec flag lol10:00
zygaand it's too late then10:00
zygahence the magic in snap-update-ns10:00
zygaand the split in general10:00
ikeyso i assume you just wanna do the bare minimum in C land10:01
ikeyi.e. what cant be done in go10:01
ikeyer what cant be done /safely/sanely/ *10:01
mborzeckiif not c then probably d or rust could be used as alternatives10:03
zygaI think we'll stick to C10:03
mborzeckiprovided you can actually build those on older systems10:03
zygano need to introduce a new language for a tiny fragment10:03
zygawe really need C for pivot_root and some of the early namespace manipulation10:04
mupPR snapd#4590 closed: many: allow constructing layouts (phase 1) <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4590>10:29
mupPR snapd#4616 opened: interfaces/apparmor: remove leaked future layout code <Created by zyga> <https://github.com/snapcore/snapd/pull/4616>10:31
mvo_Chipaca: bad news, powerpc is failing since some days and it looks the change is the addition of the osutil/context.go stuff10:51
Chipacamvo_: can i see?10:51
zygamvo_ is that going to block the release?10:51
zygaand do you need my powerpc box?10:51
mvo_Chipaca: https://launchpadlibrarian.net/355941418/buildlog_ubuntu-xenial-powerpc.snapd_2.31~rc2+git540.4a4ed58~ubuntu16.04.1_BUILDING.txt.gz10:52
mvo_zyga: its just master afaict10:52
Chipacaso much "reading database"10:52
mvo_Chipaca: silly dpkg10:52
mvo_Chipaca: we are getting rid of this ;)10:52
Chipacai thought that was apt10:52
mvo_Chipaca: that part is dpkg10:53
mvo_Chipaca: or, hold on10:53
mvo_Chipaca: yeah, thats dpkg10:53
Chipacazyga: mind if i use your powerpc box?10:54
zyganot at all10:55
zygaplease coordinate with mvo, there's just 1GB ram10:55
mvo_Chipaca: the backtrace is not helpful at all10:55
Chipacamvo_: are you going to use zyga's powerpc?10:55
mvo_Chipaca: yeah, I was about to. but if you are on it, I will leave it, its almost lunchtime anyway10:56
Chipacamvo_: yeah if it's my context thing it's fair that i bash my head on it10:56
mvo_Chipaca: it probably is (this is the merge when the builds start to fail). thanks for looking into it!10:56
* Chipaca sees a 'if runtime.GOARCH == "powerpc" { throw a fit }' in his future10:57
Chipacazyga: do i have sudo on the ppc box?10:59
zygachecking11:00
zygayes11:01
zygayou should11:01
Chipacazyga: what i might not have is a password :-)11:01
zygaaha :D11:01
mborzeckiyour voice is ..11:02
Chipaca.. not what it was11:02
mborzeckiha ha :)11:02
Chipacaok, I've seen this error once before and thought it was weird gamma ray thing :-) but this being the second time, I need to bring it up11:07
Chipaca+ mkdir -p /home/test/snap/test-snapd-tools/6/11:07
Chipaca+ touch '/home/*/snap/test-snapd-tools/6/mock-data'11:07
Chipacatouch: cannot touch '/home/*/snap/test-snapd-tools/6/mock-data': No such file or directory11:07
Chipacawhat the *what*11:07
ikeydid you quote the wildcard?11:08
* Chipaca looks at the test11:08
Chipacaikey: that's a good question :-)11:08
Chipacathank you11:08
ikeynp11:08
Chipacaikey: although if it was that, it wouldn't fail just sometimes11:08
Chipacastill, looking11:09
Chipacaikey: the script actually has11:09
Chipaca    mkdir -p /home/*/snap/test-snapd-tools/$rev/11:10
Chipaca    touch /home/*/snap/test-snapd-tools/$rev/mock-data11:10
ikeyo11:10
Chipacait expands the first one, but fails to expand the second one11:10
ikeybut what.11:11
* ikey scratches head11:11
zygaChipaca concurrent magic?11:11
Chipacain spread?11:11
zygasuggestion: get rid of the * and use a one-time expansion to know what the thing is called11:11
Chipacazyga: in the log above, it logs it expanded11:12
zygahmm hmm11:12
pedronisChipaca: you have  '' there11:12
pedronisso no * expansion11:12
pedronisafaict11:12
ikeylooks like the set +x escape put the ' in11:12
pedronisChipaca: it might also be, the file doesn't exist, so it doesn't expand11:13
pedronisthere's no match for that11:13
Chipacahmmmm11:14
pedronisbut then why it works for the dir11:14
Chipacagasp11:14
Chipacabah11:15
ChipacaI'm going to push a PR that changes the test, dunno why we're using a * but it's hard to think about11:15
Chipacameanwhile restarting this individual run should be good enough for now11:15
Chipacathanks11:15
pstolowskipedronis, hey, struggling a bit with autoconnect test based on content interface, policy check prevents autoconnect, what to do in my mocked snaps to make it happy?11:24
pedronispstolowski: where are you writing the test?11:24
pstolowskipedronis, in overlord/managers_test.go11:24
pedronispstolowski: you need to setup snap declarations from the same publisher, we should have some tests like that there11:26
pstolowskipedronis, thanks, looking11:30
pedronispstolowski: it's mostly tedious and long11:31
pedronisthere are some helpers though11:31
pedronisI think11:31
cachio_mvo_, hey, unit tests failing in the PR which is removing gettimeofday11:34
zyga- Download snap "test-snapd-control-consumer" (2) from channel "stable" (Get https://api.snapcraft.io/api/v1/snaps/download/a8xXlpZKNsesIzT1wxZ4kP0DaCzeDUtj_2.snap: dial tcp 91.189.92.19:443: i/o timeout)11:35
* zyga restarts11:36
Chipacamvo_: there are many changes in debian/ between what I get via apt, and git11:39
Chipacamvo_: to the point where dpkg-buildpackage from master doesn't work11:39
mvo_Chipaca: what version do you get via apt?11:41
mvo_Chipaca: try "apt build-dep ./" if build-deps are missing11:41
Chipacamvo_: snapd-2.29.4.211:41
mvo_Chipaca: or are vendor/ dirs missing?11:41
Chipacamvo_: I did, nothing new brought in11:41
mvo_Chipaca: what is the failure?11:41
Chipacamvo_: oh i thought dpkg-buildpackage does that?11:41
* Chipaca does that11:41
Chipacagovendor does _not_ like ppc11:43
Chipacapowerpc*11:43
ChipacaI can't even install govendor :-(11:43
* Chipaca copies his vendor tree from a reasonable architecture11:44
pstolowskipedronis, ok, i see store signing stack is already created in managers_test; it will work if I install snaps via InstallPath and with devmode provide correct SideInfo?11:45
* zyga found a CD with the doors in one of the boxes yesterday11:47
* zyga never listened to that11:47
Chipacazyga: the doors! (beep tweedle bip bip)*11:49
zygait sounds nice11:49
Chipacazyga: talk to me when your beep-tweedle-bip-bip counter reaches 10k11:50
Chipacamvo_: it was the vendor tree missing that was thwarting me, silly me, and thank you11:51
mvo_Chipaca: happy that it works now11:55
mupPR snapd#4617 opened: many: implement "refresh-mode: survive" for services <Created by mvo5> <https://github.com/snapcore/snapd/pull/4617>11:56
Chipacamvo_: hmm. I think you dropped these from around a word there: ❝❞11:59
Chipacabut hey the package is building :) so that's something12:00
zygahmm hmm lunch time12:01
mupPR snapcraft#1916 opened: lxd: initialize remote lazily <Created by kalikiana> <https://github.com/snapcore/snapcraft/pull/1916>12:03
Chipacahmm, gccgo doesn't seem to find things from vendor/12:05
ackkhi, I have a snapcraft question: I'm including a python lib from a deb via stage-packages, but the resulting library in the snap seems laid out differently. does snapcraft do anything special?12:05
ackk kalikiana, ^ perhaps you can help?12:09
pedronispstolowski: yes, it should work with SideInfo12:11
pstolowskipedronis, thanks, got it working!12:14
mborzeckipstolowski: should i restart the travis job in 4584 or will you be pushing more patches to that branch?12:19
ikeysadface. looks like snap mounts are regressing my boot12:20
ikeyblocks early boot: https://ibin.co/3qlqeUao9o5w.png12:20
pstolowskimborzecki, yeah, pls restart, thanks, no more commits12:20
kalikianaackk: can you be more specifc? in what sense are the files laid out differently?12:23
mborzeckianyone feels like looking at #4615?12:23
mupPR #4615: overlord/snapstate/backend: perform cleanup if snap setup fails <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4615>12:23
ackkkalikiana, I think I found the issue, locally I have a deb which is more recent than the one in the repo, but snapcraft pulls deb from the archive directly, so it's using a different version fro the one installed locally12:23
ackkkalikiana, if I copy my updated deb in .cache/snapcraft/...... will it pick the latest?12:24
ackkkalikiana, or does it only use what's in the archive12:24
zygaikey idea: use auto mounts12:24
ikey?12:24
zygaikey they will start only when accessed12:25
ikeythese are the mount units written by snapd12:25
ikeynot me12:25
zyga3 min12:25
zygayes12:25
* ikey blinks12:25
zygait would be a patch12:25
ikeyoh you mean patch it to mungle it12:25
ikeyhm12:25
ikeycould do yeah12:25
zyga*chew chew*12:25
zygasorry, I stuffed a sandwitch into my mouth to type12:25
zygaso12:25
zygasystemd can do that mount lazily by installing an automount unit12:26
zygaI believe it's a tiny one word patch in each .mount unit12:26
zygado an experiment12:26
zygalet me tell you ...12:26
zygaadd x.systemd-automount to mount options12:27
zygajust edit those mount units and change that12:27
zygaand reboot12:27
zygaaww, systemd needs foo.automount as unit name12:28
zygabut maybe the option will be sufficient12:28
zyga(option in a mount unit)12:28
zygaah wait12:28
zygano12:28
zygaso reading systemd.automount12:28
zygakeep the mount units12:28
ikeyright12:29
zygajust add a .automount unit next to vanilla mount units12:29
zygaso if you do that experiment and it works we can consider that as a feature to add12:29
zygait would be nice as it would help boot time and also improve memory use12:29
ikeyyeah12:29
ikeynot having every possible snap mounted unless it needs to be12:29
zygayep12:29
zygaI believe we could also do automatic deactivation so they would go away over time, when unused12:30
zygamaybe there are dragons (because it's tricky what we do) but worth a check12:30
ikeyaye12:30
mborzeckizyga: TimeoutIdleSec= ?12:33
zygayeah12:33
mborzeckiright, doesn't look like too much work12:33
kalikianaackk: Hmmm why do you have a different version? Do you want to use the local version? You could specify the .deb file in that case12:35
ackkkalikiana, yes I wanted to user the newer version I have installed. So, I can specify the path to a deb file instead of just the name in stage-packages?12:35
kalikianaackk: You can use a part with plugin: dump and source: foobar.deb12:37
kalikianaackk: The files will be extracted relative to the part ie. ./usr/bin/foobar12:40
ackkkalikiana, does this work for libs too?12:41
kalikianaackk: Sure12:42
ackkkalikiana, thanks, TIL12:42
Chipacaikey: zyga: in my experience automount is a pain in the pudenda12:43
Chipacaikey: zyga: maybe you can get the same effect by giving snap .mounts a reasonable After=?12:43
ikeypossible12:44
Chipacamvo_: so, I have a super easy way for tests to pass on powerpc12:44
Chipacamvo_: (beyond "skip this test" :-)12:44
Chipacabut … hmm12:45
zygaChipaca after=5 minutes ;-)12:45
Chipacamvo_: i suspect gccgo has not been well tested [in general but especially] on uniprocessors12:46
mupPR snapd#4616 closed: interfaces/apparmor: remove leaked future layout code <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4616>12:47
mupPR snapd#4618 opened: tests: new snaps to test installs nightly <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/4618>12:50
zygamvo_ trivial feedback on https://github.com/snapcore/snapd/pull/461712:54
mupPR #4617: many: implement "refresh-mode: survive" for services <Created by mvo5> <https://github.com/snapcore/snapd/pull/4617>12:54
mupPR snapd#4576 closed: cmd/snap-update-ns: large refactor / update of unit tests <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4576>12:55
mvo_zyga: ta12:59
zygafor wht?12:59
zyga:)12:59
zygaoh, meeting12:59
mvo_Chipaca: I look forward to the fix12:59
Chipacamvo_: ah, oh, hm12:59
mvo_zyga: the feedback in my PR12:59
Chipacamvo_: the fix is "run go test with GOMAXPROCS=<something bigger than 1>"12:59
mvo_heh13:00
Chipacamvo_: which I suspect means actual gccgo programs don't work well on uniprocessors13:00
zygaChipaca: buy bigger machine13:00
Chipacamvo_: I need to test this obvs13:00
mvo_ok13:00
* kalikiana lunch13:48
Chipacazyga: "on any supported Fedora system you be good to," -> "on any supported Fedora system you should be good to go,"13:48
Chipacazyga: imho13:48
zygaah13:48
zygashould13:48
zygaI should add should13:48
zygaThanks for spotting13:50
zygaI could use some coffee13:55
* genii slides zyga a large shiny Ubuntu mug full of strongly brewed Somalian Arabica, at just the right temperature for sipping13:56
zygaman13:56
zygaI wish there was "snap install coffee"13:56
genii:D13:56
zygacoffee sounds like a nice name for software13:57
zygawhat would it do though?13:57
zyga grind?13:57
geniiKeep you awake, ideally13:58
Chipacazyga: you are a step away from reinventing java13:59
zygaoooh13:59
Chipacazyga: are you sure you want to continue [n/N/WTFNO]13:59
zygait could do coffee in containers known as *capsules*13:59
* zyga stands up and walks to the coffee machine13:59
* pstolowski lunch14:01
jdstrandmvo_: re base-18> as of last night, it wasn't in the review queue. I didn't see it all last week. I feel like I *did* see it at some point and accepted it. yes, r5 was accepted. r6 has some extra 'unusual' files in it. if you request a manual review, I'll accept it14:11
zygahey jamie! thank you for the feedback there14:12
Saviqniemeyer: hey, we've had a handful of jobs fail today with spread tasks getting stuck (?) on linode https://travis-ci.org/MirServer/mir/jobs/33788010714:12
jdstrandyou're welcome. sorry if I was a bit confused :)14:12
Saviqniemeyer: shall we add -v on top of the -v to see what's what if this hits us again?14:13
zygaI'll have more soon, I'm working on tests for existing, non-hardened implementation14:13
Chipacaniemeyer: @attache in the forum (on the planet jumper post) has the exact same cpu/gpu as i do14:13
Chipacaand the error is the same14:14
mupPR snapd#4619 opened: tests/main/user-data-handling: get rid of ordering bug <Created by chipaca> <https://github.com/snapcore/snapd/pull/4619>14:15
jdstrandmvo_: so, I've add sudo and the ssh binaries to the review tools, but the /var/log/journal setgid dir is weird. did you actually want to include that?14:15
Chipacamvo_: why do we worry so much about powerpc if we don't have a core for it?14:16
mvo_jdstrand: aha, good point, will kill it14:16
mvo_jdstrand: we don't want this to prevent wear out o14:16
mvo_f the mmc14:17
mvo_Chipaca: don't ask14:17
Chipacamvo_: OK.14:17
mvo_Chipaca: well, I will answer anyway14:17
Chipacamvo_: oops too late, already retracted my question14:17
ChipacaI can't undo the undo! the universe will fall apart!14:17
jdstrandmvo_: ping me when r7 is uploaded and you request a manual review and I'll push it through14:17
mvo_Chipaca: we should stop supporting it, but that means a bit of paperwork, i.e. add this to the exception for our SRU policy etc. which probably needs approval and discussion. the end result is most likely that supporting is cheaper than stopping14:18
jdstrand*this* is the week that I will *finally* request a pull of the review tools, but ping me until that is in prod14:18
mvo_jdstrand: will do, let me kill that dir, I think it sneaked in due to a systemd change14:18
* jdstrand nods14:21
Chipacapedronis: niemeyer: is there any obvious (or non-obvious) bug in this: https://pastebin.ubuntu.com/26530120/ ?14:31
Chipacapedronis: niemeyer: symptom I'm seeing is that in some environments it never prints a dot, and hangs forever14:32
Chipacapedronis: niemeyer: gccgo and the playground14:32
Chipacaand, where do bugs on gccgo get reported :-)14:33
mvo_jdstrand: there is a r7 now for base-1814:34
mborzeckiniemeyer: https://paste.ubuntu.com/26530133/ TLS handshake timeout, are we abusing linode too much?14:35
Chipacazyga: do you have a bionic system to hand?14:38
zygamborzecki, niemeyer: I updated 461014:39
kalikianare14:47
jdstrandmvo_: can you request a manual review? (if I do, then I can't process it)14:47
mvo_jdstrand: ups, sorry, done. thank you14:48
jdstrandmvo_: approved but not published to a channel14:49
mvo_jdstrand: ta14:51
mborzeckiniemeyer: edited the https://forum.snapcraft.io/t/core-configuration-options/87 and added info on refresh.timer, feel free to review and redact as needed14:51
mvo_ackk: please check the latest base-18 in edge14:51
ackkmvo_, ah, thanks, checking now14:52
* Chipaca bbiab14:52
mupPR snapd#4619 closed: tests/main/user-data-handling: get rid of ordering bug <Created by chipaca> <Closed by chipaca> <https://github.com/snapcore/snapd/pull/4619>14:52
pedronisChipaca: sounds like a compiler that doesn't put, let's give a chance to other goroutines checkpoints, in some cases ?14:59
mupPR snapd#4607 closed: wrappers: cleanup enabled service sockets <Created by bboozzoo> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4607>15:04
mvo_cachio_: I triggered a new 2.31 core snap build, it seems the builders are quite busy right now, so hopefully in ~1h it will be there15:08
cachio_mvo_, great, tx15:08
cwaynemvo_: do we expect it in beta today?15:27
andyrockmvo_ , niemeyer: hi! In bionic we  are almost ready to push the changes (in udisks2 and gnome-disk-utility) to hide snap loop devices from gnome-disks15:40
Chipacapedronis: yeah, going to file a bug15:40
zygafor context, we need a way to refresh existing .mount units to get the benefits for all the snaps people have installed15:41
Chipacapedronis: as soon as i check it isn't yet fixed in a more recent build15:41
pedronisdidn't we have already something else that required .mount updates?15:41
Chipacahence me asking around for a B15:41
andyrockyeah thanks zyga15:41
zygaI was thinking we could port that code to use the ensure dir state code so that we can freely change mount units in the future15:42
zygabut I wasn't sure where to put the call, probably just like interface manager15:42
zyga(on interface startup)15:42
zygaer15:43
zygas/interface/overlord/15:43
ackkmvo_, so I got further then bafore with base-18, but maas snap now fails with django.db.utils.DataError: invalid value for parameter "TimeZone": "UTC"15:44
mvo_ackk: aha, the I think this one if from the timezone database15:45
mvo_ackk: if you use the beta core snap, you can probably use "snap run --strace" when starting your app to see what files it tries to access15:45
ackkmvo_, so the build you gave a while ago add something that's still missing in edge I guess15:45
* cachio_ lunch15:46
mvo_cwayne: yeah, it should be in beta today15:46
mvo_cwayne: builds are a bit slow though15:46
mvo_cachio_: i386/amd64/ppc64el are ready15:47
zygamvo_, do you think this can be a 2.32 roadmap item?15:51
mvo_ackk: let me check the timezone db, is that something that the snap could ship?15:53
mvo_zyga: what is "this"?15:53
zygamvo_ what I described above, a way to refresh .mount units15:53
ackkmvo_, maybe yes15:53
ackkmvo_, fwiw http://paste.ubuntu.com/26530521/ is the diff between the content of the custom built you gave me and the one in edge15:54
mvo_ackk: I think its the -./usr/share/zoneinfo/Etc/UTC zoneinfo stuff16:06
mvo_cachio_: armhf/arm64 are ready now too16:08
=== chihchun is now known as chihchun_afk
Chipacapedronis: https://github.com/golang/go/issues/23721 fwiw16:14
ackkmvo_, yeah I think so, could that be included too?16:14
Chipacamvo_: ^that's our powerpc issue :-)16:14
Chipacamvo_: workaround coming in a pr rsn16:14
niemeyerandyrock: Thanks for that16:20
andyrockniemeyer the problem is that this is not going to work for existing mounted snaps16:20
andyrockso zyga proposed a way16:21
andyrockbut we (the desktop team) need to know it this is going to get done before B is released16:21
mupPR snapd#4620 opened: debian/rules: workaround for https://github.com/golang/go/issues/23721 <Created by chipaca> <https://github.com/snapcore/snapd/pull/4620>16:22
mupPR snapd#4619 opened: tests/main/user-data-handling: get rid of ordering bug <Created by chipaca> <https://github.com/snapcore/snapd/pull/4619>16:24
niemeyerandyrock: I'm a bit out of context about what this is fixing and what we want to achieve at the end. Is there a thread I could read?16:28
andyrockniemeyer: https://www.irccloud.com/irc/canonical.com/messages/zyga16:29
andyrocksorry16:29
andyrockhttps://github.com/snapcore/snapd/pull/429416:29
mupPR #4294: Mount with x-gdu.hide option <Created by azzar1> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4294>16:29
* zyga raises his ear16:30
zyga(feel free to pull me into the conversation)16:30
zygajdstrand replied16:31
zyga37 seconds after you asked :)16:31
niemeyerandyrock: Thanks, get it now16:36
andyrockniemeyer so zyga proposed this:16:37
andyrockhttps://www.irccloud.com/pastebin/EwM37tE1/16:37
andyrockif we know that this is going to be done before B is released we push the changes as they're upstream16:38
zygaandyrock why not push the changes already?16:39
andyrockotherwise for the moment we apply also a distro patch to work around this (in gnome-disk-utilities)16:39
andyrockzyga to avoid pushing twice16:39
* zyga doesn't get it16:39
andyrockfirst push: the generic fix (already upstream)16:39
andyrocksecond push: the ubuntu specific fix16:40
zygawhat is the difference between them?16:40
zygaI assumed we would just carry the patch in the package16:40
andyrockif we know that this is not going to get done we push both16:40
zygaaha, I see16:40
niemeyerI don't quite see yet.. one way or the other the fix will work out16:41
zygaI think the answer is, it will be done, the only question is how soon16:41
andyrockin Ubuntu16:41
andyrocknot in other distros16:41
niemeyerIn one scenario it gets gradually cleaned, in other it gets cleaned at once16:41
zygaand the patch won't hurt, in other places everyone will benefit from new upstream udisks16:41
niemeyerFor anyone installing 18.04, they have no previous mounts16:41
zygaand all new installs are not affected anymore16:41
niemeyerI'd actually prefer to do nothing on that basis.. at least for now.. rewriting all mount units feels uncomfortable from a sanity standpoint, if nothing else16:42
andyrockseb128: ^^^16:42
andyrockso at this point we could just apply the workaround16:43
jdstrandandyrock: as an aside, thank you for your work on this. this will be a nice improvement16:43
seb128andyrock, in a call atm but I read later, if it's not perfect / have some mounts still showing that clean over time that's not the end of the world16:43
* jdstrand only just now saw that PR16:44
andyrockseb128: kk. So what I suggest is the following:16:44
andyrockboth in bionic, artful and xenial we distro patch to use the workaround (just hide if the loop backing file has the ".snap" suffix)16:45
andyrockthe workaround is just in gnome-disk-utilities16:45
zygaandyrock is that released? I still see them16:46
andyrockupstream will benefits from the upstreamed patches16:46
seb128zyga, not yet, should be uploaded to bionic tomorrow16:46
zygaah16:46
niemeyerandyrock: Sounds nice16:47
andyrockseb128: If you arealdy started the uploading process we can keep it16:48
andyrockit can be used somewhere else too16:49
seb128andyrock, not, I'm in a call, I'm going to do that tomorrow morning16:49
seb128but yours patches are still good/right16:49
Chipacazyga: finished with the powerpc box16:49
seb128so why not including them?16:49
andyrockkk16:49
andyrockbut I'll proposed another workaround too16:49
andyrockbut we can discuss about this in #ubuntu-desktop after the call16:50
seb128right, let's discuss that tomorrow morning16:51
seb128that call is still ongoing for a while and then I need to go16:51
zygaChipaca glad I could help, sad I could help16:52
andyrockkk16:57
philrocheIs there a way to enable site-packages in the virtualenv in a snap built with the python plugin? I have a requirement python-apt that cannot be installed using pip. I can't see anything in the docs or examples on how to do this17:04
* kalikiana wrapping up for today17:09
kalikianaphilroche: not quite an answer to your question, but Snapcraft uses a tarball in requirements.txt to achieve the same thing. See https://github.com/snapcore/snapcraft/blob/master/requirements.txt#L1017:10
philrochekalikiana: Interesting. Thank you17:11
lotuspsychjegood eveing to all17:44
jdstrandmvo_: I see new revisions for base-18. can you request manual review for the ones you are interested in?17:44
lotuspsychjesomeone might know why skype doesnt come anywhere latest here? http://feeds.feedburner.com/uAppExplorerNewSnaps17:45
kyrofalotuspsychje, uAppExplorer is a third-party site, we have no control over it17:47
lotuspsychjekyrofa: ok, im trying to find an rss the way sudo snap find lists the latest ones, got any idea?17:48
Chipacamvo_: question about #461717:55
mupPR #4617: many: implement "refresh-mode: survive" for services <Created by mvo5> <https://github.com/snapcore/snapd/pull/4617>17:55
Chipacamvo_: if it's survive, and has a reloadcommand, wouldn't you fire that?17:55
Chipacahm, maybe i'll ask it on the pr :-)17:56
* Chipaca sees it's dinnertime in mvoland17:56
* Chipaca EOWs (mostly)18:01
el_tigro1kurofa: Thanks again for the help yesterday18:11
el_tigro1zyga: I ran into this great documentation today which I'm assuming you wrote18:12
zygawhich documentation was that?18:13
el_tigro1zyga: https://github.com/snapcore/snapd/wiki/Snap-Execution-Environment18:13
zygaah, yes18:13
el_tigro1Question about the last paragraph "Preserving the mount namespace". The "/run/ns/snapd/" directory doesn't seem to exist on my system18:14
zygasorry, that's backwards, it should be /run/snapd/ns18:14
zygalet me fix that18:15
el_tigro1Ohh I should have caught that :D18:15
el_tigro1zyga: Also I was wondering in what order "snap-confine" does its job. I'm assuming it handles the mount namespace stuff first, and then applies the apparmor/seccomp confinement?18:19
zygait's complicated, I should write something more in depth18:19
zygait handles all of mount namespace handling first, using itself and a helper process (snap-update-sn)18:20
zygait applies seccomp and apparmor and cgroup handling before running the application18:20
zyganormally the order should not matter to apps, it should just work18:20
el_tigro1really? the reason I assumed that was the order is that I thought apparmor/seccomp could disable the "mount" system call18:22
el_tigro1Actually I mean the unshare/clone system calls18:23
el_tigro1Actually I'm confused. Just ignore what I'm saying :P18:23
zygayes it can18:23
zygaduring the whole process the sandbox changes a few times18:23
zygasnap-confine itself is confined with one profile18:23
zygasnap-update-ns is confined with another profile18:23
zygaand the application being started is confined with its own profile18:24
zyga(and some of the work I'm doing now will also tailor snap-update-ns to have different profile per snap)18:24
zygaall of this is so that it's harder to attack the system and so that super-power wielding things are as confined as possible18:24
zygamount is confined both at syscall level through seccomp and at path/device/options level through apparmor18:25
el_tigro1Thanks. I find this stuff really interesting18:27
el_tigro1I guess 'snap-confine' uses the 'pivot_root' system call to change its root?18:28
zygayes, that's correct18:28
zygait also jumps in and out of namespaces18:28
zygainspects them, invalidates them when necessary18:28
zygait handles cgroups (freezer and device)18:28
zygait uses snap-update-ns to construct and update existing namespaces18:29
zygaand saves them on disk to preserve them across process lifecycle18:29
el_tigro1'pivot_root' takes an 'put_old' argument, which I guess is the '/var/lib/snapd/hostfs'?18:31
zygayes18:31
el_tigro1And in that documentation link from above "Certain directories from the host file system are mapped (bind-mounted) to the mount namespace (see below).". They directories are the ones listed below the "The mount profile of the snap is applied (e.g. content sharing uses this)" bullet point right?18:32
zygayes18:33
zygathough that's an incomplete list now, it also depends on interfaces18:33
zygaand it also depends on nvidia driver being used18:33
el_tigro1Wow thanks a lot for your time. You've given me quite a few leads. Back to experimenting/studying :D18:34
zygafeel free to ask questions18:34
zygaperhaps you would like to contribute back by writing documentation18:34
zygalet me know if you'd like to help18:35
el_tigro1Defintely. Once I feel like I have a solid enough understanding18:35
mvo_ackk: I added tzdata now, it will be part of the next base-18 build18:55
mvo_ackk: (sorry for the delay)18:55
el_tigro1One thing that I noticed is that older versions of snaps are not removed. For example if I do 'ls /snap/lxd' I see 3 folders and a symbolic link 'current' pointing to the latest version. Would removing the directories containing the older versions be a bad idea?18:57
zygathis is on purpose18:57
zygayou also have three revisions of the snap installed, but not active18:57
zyga(only one is active)18:58
zygawhen something goes bad and you want to revert to a prior version (e.g. broken update) the data is kept around18:58
el_tigro1ahh I see18:58
zygaover time old revisions are removed, no need to do that manually18:58
zyganiemeyer +1 to merge 4610?19:29
niemeyerzyga: Should be.. let me check19:29
niemeyerzyga: Looks fine, thanks for double checking19:32
zygagreat, thank you!19:33
* zyga gets a coffee and works on some more :)19:33
mupPR snapd#4610 closed: interfaces/apparmor: early support for snap-update-ns snippets <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4610>19:33
philrocheCan anyone see what is wrong with my snapcraft.yaml as I can not get the organize section to work with the python plugin https://github.com/philroche/ubuntu-watch-packages/blob/master/snap/snapcraft.yaml ? Thanks20:16
nacc_philroche: i think it's your .'20:17
nacc_philroche: so i believe, it's going to be running form the root of your source20:17
nacc_it won't find 'wrapper' there20:17
mupPR snapd#4621 opened: tests: skip alsa interface test when the system does not have any audio devices <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/4621>20:18
nacc_philroche: i put wrappers in their own part that's dump'd into the snap20:18
nacc_philroche: alternatively, you put it i your MANIFEST.in20:18
nacc_philroche: but otherwise, i don't thinkt he setup.py will see it and soo the python plugin won't20:19
philrochenacc_: I tried it with wrapper in root too and the same error "The specified command 'wrapper' defined in the app 'ubuntu-watch-packages' does not exist or is not executable"20:19
philrochenacc_: Yeah using a second dump part was my next approach20:19
nacc_philroche: i would try that first (the dump part)20:20
philrochenacc_: I hadn't thought of using the MANIFEST.in either but that seems a bit dirty by introducing snap stuff to the python package20:20
nacc_philroche: yeah i woulldn't recommend it :)20:21
sergiusensjdstrand stgraber in case you have a couple of minutes https://forum.snapcraft.io/t/disconnected-issue-a-cocktail-of-running-snapcraft-cleanbuild-in-multipass-with-the-lxd-snap/389120:31
philrochenacc_: Thanks. Trying dump method now20:34
cachio_niemeyer, https://travis-ci.org/snapcore/snapd/builds/33803714021:25
cachio_Cannot allocate linode:ubuntu-14.04-64: cannot perform Linode request: Post https://api.linode.com: net/http: TLS handshake timeout21:25
cachio_that happened today21:26
cachio_it is not so frequent but I see 1 or 2 of those every day21:26
niemeyercachio_: Thanks, also keeping an eye on those21:27
niemeyercachio_: But the most important issue is still the state corruption they seem to observe21:27
niemeyercachio_: Without that sorted we'll need to go elsewhere in the near future.. fingers crossed21:27
cachio_niemeyer, good, tx21:28
kyrofazyga, I can't seem to reproduce the LXD issue as of 2.30. I'm not sure what changed21:56
zygamaybe lxd shipped some workaround?21:56
kyrofaYeah that's my only clue as well21:56
zygaare you sure you are on 2.30?21:56
kyrofaYeah, rev 374821:57
kyrofa(tracking stable)21:58
mupIssue snapcraft#1918 opened: Add y/n support for sending errors back <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/1918>22:08
mupIssue snapcraft#1919 opened: Add Always/neVer support when sending errors <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/1919>22:08
mupIssue snapcraft#1920 opened: Design error reporting <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/1920>22:08
mupPR snapd#4622 opened: strutil: introducing MatchCounter <Created by chipaca> <https://github.com/snapcore/snapd/pull/4622>22:44
mupPR snapd#4620 closed: debian/rules: workaround for https://github.com/golang/go/issues/23721 <Created by chipaca> <Merged by chipaca> <https://github.com/snapcore/snapd/pull/4620>22:45

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!