/srv/irclogs.ubuntu.com/2017/11/09/#snappy.txt

kyrofaMan... I've spent all day commenting out tests trying to find which one is actually interfering with another. I need a drink00:01
ikeybuilt: solus-runtime-gaming_0.0.0_all.snap00:12
ikeyheh00:12
mcphailkyrofa: https://ovh.themcphails.uk/index.php/s/LbKIquTSxMernmM00:14
kyrofamcphail, you're too kind00:15
mcphailikey: so is this the "core" snap side of things?00:15
ikeyright00:15
ikeyjust gonna be cheap and dirty and use 'snap pack'00:15
ikeybut i think im gonna need to force some stuff like 'architectures' field, etc00:16
ikeybuilt: solus-runtime-gaming_0.0.0_amd64.snap00:17
ikeybit better :p00:17
mcphailThis is very exciting00:18
ikeycertainly a learning experience for me00:18
ikeyi imagine the initial 0.0.0 is gonna be nasty a.f.00:18
ikeybut then i can start optimising it and cleaning it up00:18
ikeyand allow us to do builds with local overlay layers onto the image00:19
ikeyi.e. so we can stage mesa properly, etc00:19
ikeyand part of this is gonna be a cleanup process to unjank the image00:19
ikeyas long as i got `snap pack` command now i'm golden00:19
mcphailyes, I like that way of doing things00:20
ikeyi strongly suspect we're gonna just rename linux-steam-integration to `LSI` and add an `lsi-exec` command, because I can think of a few games where this will help even outside steam..00:20
ikeybut one thing at a time :D00:20
mupPR snapd#4184 opened: tests: adding new test for uhid interface <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/4184>00:21
kyrofaWhat does `snap pack` do that `snapcraft snap <dir>` doesn't?00:22
ikeydoesn't use dpkg/apt/etc00:23
ikey:P00:23
ikeyi'm creating a base snap00:23
ikeyi.e. not ubuntu00:23
ikeysnapcraft is bricked for solus00:23
ikeybecause its basically ubuntu specific last we looked00:23
kyrofaikey, yeah `snapcraft snap <dir>` just runs `mksquashfs` with all the magical flags. It doesn't actually do anything with the dir00:28
kyrofaAlthough actually getting snapcraft ON there might be hard, unless classic snaps work00:28
ikeyclassic snaps work00:28
ikeyclassic "i think im ubuntu" not so much00:28
ikeythis saves me a bit of work just having the command directly there00:28
ikeyand yeah i saw its basically cleanup + meta + mksquashfs00:29
ikeybasically im just tryna be hella lazy00:29
=== jero is now known as Guest81164
=== mup_ is now known as mup
=== mup_ is now known as mup
=== wgrant_ is now known as wgrant
mborzeckimorning everyone05:59
zyga-ubuntuo/06:02
zyga-ubuntuhmm06:04
zyga-ubuntu    - linode:ubuntu-16.04-32:tests/main/xdg-open-compat06:04
zyga-ubuntu    - linode:ubuntu-16.04-64:tests/main/xdg-open-compat06:04
zyga-ubuntuI'm seeing those fail in 2.29 branches06:04
zyga-ubuntu...06:26
mborzeckizyga-ubuntu: hey06:39
zyga-ubuntuho06:40
zyga-ubuntueating breakfast06:40
mupPR snapd#4185 opened: interfaces/builtin/account_control: drop group filter from seccomp rules <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4185>06:40
zyga-ubuntuneetd to look into those failing tests06:40
mborzeckiyeah, noticed that sergiusens spread tests were failing because of those06:41
zyga-ubuntucommented06:41
zyga-ubuntulook at 418506:41
mborzeckiha, good catch, do you know if I could feed this rule to snap-seccomp locally to see if it compiles?06:42
zyga-ubuntuyes06:43
zyga-ubuntuI think it will compile06:43
zyga-ubuntuit just needs to run to see what happens06:43
zyga-ubuntucompile vs run06:43
mborzeckihm there's tests/main/interfaces-account-control i'll run it to see what will happen06:44
zyga-ubuntuok06:45
zyga-ubuntumorning mvo06:45
mvohey zyga-ubuntu06:45
zyga-ubuntumvo: we have a problem with one spread test, it fails very very often across many PRs (including 2.29)06:45
zyga-ubuntutests/main/xdg-open-compat06:45
mvozyga-ubuntu: ok, I have a look. do you happen to have the error at hand?06:47
zyga-ubuntuno, sorry, running it now to see06:47
mborzeckimvo: https://s3.amazonaws.com/archive.travis-ci.org/jobs/299323286/log.txt there's some error log here06:50
mvomborzecki: hm, <Message>Access Denied</Message> - anyway I will find one if its common :)06:52
mvo49 PRs, woah06:52
zyga-ubuntuI think it's review sprint time06:52
zyga-ubuntumvo: many are approved and need 2nd review06:52
zyga-ubuntuhttps://s3.amazonaws.com/archive.travis-ci.org/jobs/299180299/log.txt?X-Amz-Expires=30&X-Amz-Date=20171109T065333Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAJRYRXRSVGNKPKO5A/20171109/us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host&X-Amz-Signature=b2c9efa5b8cf4fe1b35132841d988eeaa70be47b26b4d84a68d849221c1b553d06:53
zyga-ubuntumvo: ^ failure06:53
zyga-ubuntu+ apt download snapd-xdg-open=0.0.0~16.0406:54
zyga-ubuntuWARNING: apt does not have a stable CLI interface. Use with caution in scripts.06:54
zyga-ubuntuE: Version '0.0.0~16.04' for 'snapd-xdg-open' was not found06:54
zyga-ubuntuthat's it06:54
zyga-ubuntuaha06:54
zyga-ubuntuseems simple06:54
mvozyga-ubuntu: aha, I think that happens because snapd 2.28.5 is now in xenail-updates and we have the older version not available anymore06:54
mvozyga-ubuntu: it should fail consistently though06:54
zyga-ubuntuhttps://packages.ubuntu.com/search?keywords=snapd-xdg-open&searchon=names&suite=all&section=all06:55
zyga-ubuntuyes06:55
zyga-ubuntumagic, right?06:55
zyga-ubuntumaybe the non-xenial-updates version is cached on some images?06:55
zyga-ubuntu(just pulling ideas out ..)06:55
mvozyga-ubuntu: thats how mborzecki name is pronounced ;)06:55
mvozyga-ubuntu: a good question, or maybe not all mirrors are up-to-date or something06:55
zyga-ubuntuhaha :)06:55
mvozyga-ubuntu: definitely strange06:55
mborzeckiclose enough :)06:55
mvomborzecki: I will learn it eventually :)06:56
zyga-ubuntum-a-ch-e-y06:56
=== chihchun_afk is now known as chihchun
zyga-ubuntumvo: curiously I didn't hit this locally yesterday, after running spread extensively06:56
zyga-ubuntulet's see if today's any different06:56
zyga-ubuntuofftopic: I found this very funny to read: http://www.sciencemag.org/careers/2016/01/how-read-scientific-paper :)06:57
zyga-ubuntuwhile I make some tea06:57
mvozyga-ubuntu: yeah, but we need to fix it for 2.29 or autopkgtest in the distro will be unahppy :(06:57
zyga-ubuntuyes06:59
zyga-ubuntuha, failed now06:59
zyga-ubuntuso maybe old package was garbage collected07:00
mvozyga-ubuntu: heh, this how-to-read- article reminds me of https://www.youtube.com/watch?v=ILysMhm8lXs which is about taxes but otherwise similar07:00
mvozyga-ubuntu: yes07:00
zyga-ubuntuonly 2.28.5 is in the archive now07:00
* zyga-ubuntu tries a simple fix07:00
mvozyga-ubuntu: we need to thing what to do, maybe the only thing we can do is to kill the test :(07:00
mvozyga-ubuntu: aha, cool. simple++07:00
zyga-ubunturunning now07:01
* zyga-ubuntu looks at tea07:01
mborzeckiis there a way to mark it as expected failure (provided it fails consistently), like pytest.xfail or sth?07:02
zyga-ubuntunope07:02
zyga-ubuntumborzecki: sorry about my last answer, it was a mental shortcut07:14
mborzeckihm?07:15
zyga-ubuntumborzecki: there's no direct way, we can echo "blah blah"; exit 0, or switch a test to manual: true to skip it07:15
zyga-ubuntumborzecki: we can also patch spread, it's github.com/snapcore/spread after all07:15
zyga-ubuntumborzecki: it's just that we traditinally tried to fix tests rather than improve the infra07:15
mvozyga-ubuntu: I wonder why we did not notice 4182 ourselfs07:16
zyga-ubuntumvo: it's curious07:16
zyga-ubuntumvo: I ran snap-confine counltess times recently07:17
mvozyga-ubuntu: does your fix for the download thing works?07:17
zyga-ubuntuand it did work07:17
zyga-ubuntumvo: I made two tweaks to the policy that I haven't upstreamed yet but they are not for os-release07:17
mvozyga-ubuntu: yeah, looking at the code we should check for os-release often and yet07:17
zyga-ubuntumaybe the real issue is more subtle and we're missing something?07:17
zyga-ubuntu        # Allow reading the os-release file (possibly a symlink to /usr/lib).07:18
zyga-ubuntu        /{etc/,usr/lib/}os-release r,07:18
zyga-ubuntuthis is in the profile, but for snap-update-ns07:18
zyga-ubuntunot for snap-confine07:18
mupPR snapd#4181 closed: interfaces/many: misc policy updates for browser-support, cups-control and network-status (2.29) <Created by jdstrand> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4181>07:18
mborzeckii'm trying to run linode:ubuntu-core-16-64:tests/main/interfaces-account-control and got `cp: error writing '/mnt/user-data/gopath/bin/fakestore': No space left on device` :/07:19
zyga-ubuntuha07:19
zyga-ubuntumvo: it's silly07:19
zyga-ubuntu mvo: this why http://pastebin.ubuntu.com/25923441/07:19
zyga-ubuntufopen fails, no worries, return true07:20
zyga-ubuntuwe don't even log it07:20
zyga-ubuntuit would only show up on core07:20
mvoautsch07:20
mvook07:20
zyga-ubuntuand when we run on core and we treat it as classic we do the normal thing07:20
zyga-ubuntuand because it's actually meant to work07:20
zyga-ubuntunothing failed07:20
zyga-ubuntuwe did "base snaps" on core since this code was introduced07:20
zyga-ubuntuif you know what I mean by this shortcut07:20
zyga-ubuntuwe were treating core as classic systems, setting up separate namespaces, constricting them out of base snaps07:21
zyga-ubuntumvo: as for your earlier question, no it's still running07:21
zyga-ubuntunot sure if stuck07:21
zyga-ubuntuhttp://pastebin.ubuntu.com/25923446/07:21
zyga-ubuntu(feels broken)07:22
mvozyga-ubuntu: yeah, what did you do to fix it?07:23
zyga-ubuntumvo: I just pushed fix/xdg-open-compat07:23
zyga-ubuntubut it's not a real fix I think (it's not working)07:23
zyga-ubuntuI just changed the version07:23
zyga-ubuntu--dest=com.canonical.SafeLauncher07:24
zyga-ubuntuI wonder if we are missing a service file for the legacy object path07:25
zyga-ubuntu(not the one at io.snapcraft....)07:25
zyga-ubuntuaha07:25
zyga-ubuntuyeah, no such launcher in data/dbus07:25
mvozyga-ubuntu: yeah, that will just pull in the empty transitional package07:26
mupPR snapd#4186 opened: tests: disable xdg-open-compat test <Created by mvo5> <https://github.com/snapcore/snapd/pull/4186>07:26
zyga-ubuntumvo: yeah, let's kill this test for now07:29
mupPR snapd#4187 opened: tests: fix xdg-open-compat <Created by mvo5> <https://github.com/snapcore/snapd/pull/4187>07:29
mvozyga-ubuntu: I pushed also a followup which just downloads the right deb from LP - I pushed both so that we have at least one working, we need to unblock 2.29, I fear we will be starved by travis not doing tests for us07:30
mborzeckii can also kill cgo'ed user lookup while fixing the groups07:30
mvozyga-ubuntu: so when we push the fix into the open PRs we need to make sure we push only to the important ones we want for 2.2907:30
mvomborzecki: \o/07:30
mvomborzecki: +1 for that07:30
zyga-ubuntumvo: +107:33
zyga-ubuntuok, I'll re-focus on lxd issues now07:34
pedronismvo: hi, I got that error (apt snap-xdg-open) also on my last PRs, it seems consistent afaict07:35
* pedronis breakfast07:35
mvopedronis: yes, we are fixing it as we speak07:37
=== JoshStrobl|Away is now known as JoshStrobl
mupPR snapd#4160 closed: cmd/snap-confine: add slave PTYs and let devpts newinstance perform mediation (2.29) <Created by jdstrand> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4160>08:11
mvozyga-ubuntu: does 4146 needs further changes ? it looks like there are commits for 4144 which are not part of 4146?08:13
mupPR snapd#4188 opened: osutil: replace cgo bits with non-cgo, vendered os/user  <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4188>08:15
pedronismvo: what's the status of #4049, seems old but nobody ever looked at it?08:17
mupPR #4049: debian,vendor: import github.com/snapcore/squashfs and use <Created by mvo5> <https://github.com/snapcore/snapd/pull/4049>08:17
mvopedronis: its in a sad state, its not fully working and its unclear if the vendor approach is powerful enough, go get/govendor make some assumptions that are hard to workaround08:18
mvopedronis: I need to get back to it but have not managed it yet, we may need to do something simpler and abandon this (simpler as in not using govendoring but copy code/git submodule or smilar08:19
pedronismvo: #4046  has two +1  but mentions spread-cron, so not sure what to do with it08:20
mupPR #4046: release: snapd 2.28.5 <Created by mvo5> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4046>08:20
pedronisheh sorry08:20
pedronismvo: #4043  has two +1  but mentions spread-cron, so not sure what to do with it08:20
mupPR #4043: cmd/snap-confine: update valid security tag regexp <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4043>08:20
pedronisoops08:20
* pedronis is not sure to be actually awake08:20
mvolol08:20
* mvo hugs pedronis 08:20
* mvo hands pedronis a cup of coffee as well08:20
pedronismvo:  I meant  #406308:21
mupPR #4063: tests: add new kernel refresh/revert test for spread-cron <Created by mvo5> <https://github.com/snapcore/snapd/pull/4063>08:21
pedronismvo: also unsure what needs to happen with #405908:22
mupPR #4059: tests: add test that checks core reverts on core devices <Created by mvo5> <https://github.com/snapcore/snapd/pull/4059>08:22
mvopedronis: I think this one can go in and needs the coresponding spread cron branch to get merged. let me do this now08:24
mupPR snapd#4059 closed: tests: add test that checks core reverts on core devices <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4059>08:24
mvopedronis: uh, it did not actually have two +1 :/08:24
mvopedronis: sorry, I mixed this up with the previous one. its manual: true so no harm08:24
zyga-ubuntumvo: no, 4146 can go in as-is08:26
pedronismvo: #4129 has also two +1 , made a small comment there though08:26
mupPR #4129: wrappers: do not error on incorrect Exec= lines <Created by mvo5> <https://github.com/snapcore/snapd/pull/4129>08:26
zyga-ubuntumvo: 4146 has the same fix without the extra pretty printing08:26
mvozyga-ubuntu: ok08:27
pedronismvo: #4173 has also two +1 , but not sure where you want to redo the disabling of auto-refreshes in tests08:31
mupPR #4173: corecfg: validate refresh.schedule when it is applied <Created by mvo5> <https://github.com/snapcore/snapd/pull/4173>08:31
mvopedronis: I can fix that there (in a bit, need to go over the 2.29 PRs as we need a new 2.29.3 :(08:33
pedronissorry, I'm distracting you08:33
pedronismvo: otoh you should garden your old PRs a bit more (friendly nag)08:34
mvopedronis: no worries about distracting. and yes, agreed sorry for this08:36
pedronismvo: should we close #4049 for now then?08:40
mupPR #4049: debian,vendor: import github.com/snapcore/squashfs and use <Created by mvo5> <https://github.com/snapcore/snapd/pull/4049>08:40
=== pachulo_ is now known as pachulo
mvopedronis: if we close we need another reminder that we need to do this work soon, it felt off the agenda once before. but yeah, in its current form it is not close to be mergable08:43
pedronismvo: I can mark it blocked if you prefer that way08:44
pedronisis there no matching topic?08:44
mvopedronis: please mark it as blocked08:45
mvopedronis: no topic it seems, thats sad08:46
mvozyga-ubuntu: I have some questions for 4146, how confident are you in the changes?08:46
mvozyga-ubuntu: there are actual review questions in there too :)08:46
mvopedronis: a second review for 4146 would be great08:47
mvo(or someone else, maybe pstolowski ?)08:47
pedronismvo: marked as blocked, but yes best would be to have an upcoming topic and close it if the approach is non-viable08:47
pedronismvo: #4063  has two +1 but it is failing afaict08:48
mupPR #4063: tests: add new kernel refresh/revert test for spread-cron <Created by mvo5> <https://github.com/snapcore/snapd/pull/4063>08:48
mvopedronis: agreed, I updated the bug08:49
mvopedronis: I will look into the failure08:49
pstolowskimvo, sure, gladly08:49
pedroniszyga-ubuntu: I looked at #4146 , seems alright, I have an unrelated (in the sense it was like that before) there though08:59
mupPR #4146:  interfaces: fix udev tagging for hooks (2.29) <Created by zyga> <https://github.com/snapcore/snapd/pull/4146>08:59
pedronisunrelated question08:59
TribaalHey so whoever snapped Electrum: thanks a lot!09:00
Tribaalbeer++09:00
zyga-ubuntupedronis: yes?09:00
pedroniszyga-ubuntu: sorry, see PR09:00
pedronisnow09:00
zyga-ubuntuah, ok09:00
zyga-ubuntuah, great question, let me check09:01
mvothanks for your review pedronis09:02
mvozyga-ubuntu: please don't get me wrong, I want to merge it (and like a lot of it). I'm just worried about the churn09:02
zyga-ubuntupedronis: so looking at 61a4a0e442ab329f10773098448eb931fe6c355b I'm not sure09:02
zyga-ubuntujamie patched one specific instance, not any of the generic helpers09:02
=== __chip__ is now known as Chipaca
zyga-ubuntuI think we need jdstrand to answer that; I don't quite know how that works09:03
pedroniszyga-ubuntu: maybe something to chat with him about, anyway the code was like that before09:03
zyga-ubuntujdstrand: (and I'd love to know)09:03
zyga-ubuntuyes, definitely09:04
pedronisso it's not a blocker for the PR09:04
mvoyay09:04
pedronis#4122 needs a 2nd review09:04
mupPR #4122: configstate: add support for configure-snapd for snapstate.IgnoreHookError <Created by mvo5> <https://github.com/snapcore/snapd/pull/4122>09:04
zyga-ubuntumvo, pedronis: I agree about finding a better way to work on spec objects;09:04
zyga-ubuntuto explain it quickly, I wanted to stay consistent and not introduce a huge argument change patch09:05
mupPR snapd#4186 closed: tests: disable xdg-open-compat test <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4186>09:07
mvozyga-ubuntu: yeah, thats ok, thank you. I was not aware it was a common pattern09:07
mvozyga-ubuntu: (I still dislike it but not something for the PR in question :)09:08
zyga-ubuntumvo: yes, no disagreement there09:10
pedroniszyga-ubuntu: in #4062 seems you promised a couple more comment tweaks ... also probably then mvo and pstolowski should look at it again09:11
mupPR #4062: cmd/snap: warn when a snap is not from the tracking channel <Created by chipaca> <Merged by chipaca> <https://github.com/snapcore/snapd/pull/4062>09:11
pedroniswrong PR09:11
pedronissorry09:11
pedroniszyga-ubuntu: I meant #406809:11
mupPR #4068: interfaces/builtin: add support for content "source" section <Created by zyga> <https://github.com/snapcore/snapd/pull/4068>09:11
zyga-ubuntupedronis: 4068 is not ready for landing, I'll add a "blocked" tag there, it's meant to land after most of the layout patches are ready09:12
pedronisheh ok09:12
pedronis#4100 needs niemeyer09:12
mupPR #4100: add ssh-keys, ssh-public-keys, gpg-keys and gpg-public keys interfaces <Created by jdstrand> <https://github.com/snapcore/snapd/pull/4100>09:12
pstolowskipedronis, zyga-ubuntu I think my general comment about cleanSubPath still needs addressing, would be good to fix it with 406809:15
pstolowskiunless I miss something09:16
* zyga-ubuntu looks09:17
zyga-ubuntuinteresting09:17
zyga-ubuntuanyway, I'll return to that after bulk of layout code is in09:17
mvozyga-ubuntu: sorry for being annoying - did you idea about the lxd fix work out?09:19
zyga-ubuntumvo: no, not yet :/09:20
zyga-ubuntumvo: I'm writing a test that reproduces it09:20
zyga-ubuntuat least will be a start for another look09:20
mvozyga-ubuntu: cool, still keen to have it for .3 if its small and targeted09:21
pedronispstolowski: there are still open questions how the API should work in #410809:26
mupPR #4108: repo: ConnectedPlug and ConnectedSlot types <Created by stolowski> <https://github.com/snapcore/snapd/pull/4108>09:26
pstolowskipedronis, I know, i'm getting to it, got sidetracked by the snapctl and cookie issues09:26
pstolowskipedronis, can you take a look at lanes helper PR?09:27
pedronispstolowski: yes, I'm going through PRs cronologically (mostly)09:27
pstolowskithanks09:27
pedronisdoing only reviews this morning09:27
=== LarreaMikel1 is now known as LarreaMikel
=== JanC_ is now known as JanC
zyga-ubuntuhmm09:30
zyga-ubuntu[ 1280.959106] audit: type=1400 audit(1510219691.912:133): apparmor="DENIED" operation="open" profile="snap.lxd.lxc" name="/var/lib/snapd/hostfs/usr/lib/os-release" pid=29008 comm="snap-exec" requested_mask="r" denied_mask="r" fsuid=0 ouid=009:30
zyga-ubuntu(unrelated but something we probably want to fix)09:31
zyga-ubuntuif anyone wants to make a quick PR for lxd interface09:31
mborzeckii can take a look at it09:34
mborzeckii'm going through review anyway, so might as well take a look at something else :)09:35
pstolowskizyga-ubuntu, commented on #414609:37
mupPR #4146:  interfaces: fix udev tagging for hooks (2.29) <Created by zyga> <https://github.com/snapcore/snapd/pull/4146>09:37
zyga-ubuntupstolowski: ack on one, not sure about other09:38
zyga-ubuntuI'm deep in lxd if you wnat to push small tweak there please do09:38
pedroniszyga-ubuntu: do all snap-update-ns PRs need a jdstrand review ?09:41
zyga-ubuntupedronis: not all but some surely do09:41
zyga-ubuntupedronis: the one about designing the "writable mimic" is the one I need a review on09:41
zyga-ubuntupedronis: the ones about secure-mk{dir,file} do as well09:42
pedronisok, I have a bunch of older/big ones to go through first though09:43
mupPR snapd#4172 closed:  interfaces/kmod: simplify loadModules now that errors are ignored  <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4172>09:43
mvopedronis: 4122 is good from your POV, right? just needs a second review?09:48
pedronismvo: yes, needs 2nd review09:54
mvota09:55
pedronispstolowski: #4152 has my +1, needs a re-review by zyga-ubuntu10:05
mupPR #4152: snapd: fix snap cookie bugs <Created by stolowski> <https://github.com/snapcore/snapd/pull/4152>10:05
Chipacaso... we're moving exclusively to /etc/{passwd,group} for lookups?10:05
Chipacamborzecki: or were we already there and I hadn't noticed?10:06
pstolowskipedronis, thanks!10:06
Chipacabecause if this is what we want to do, we need to refactor some code10:06
Chipacain particular the code that looks up user dirs10:06
Chipacathis is relevant to my current work, so i can whip up the refactor right now10:06
mborzeckiChipaca: something we discussed yesterday with niemeyer, the idea is to kill cgo code (or most of it at least)10:06
mborzeckii've pulled in non-cgo pieces of os/user as osutil/user for now and put it up for the review10:08
Chipacaright, but this could lead to inconsistencies, which is why i'm checking -- if this is what we want to do i need to refactor a bit of code10:08
Chipacai can do it after we merge the osutil/user pr10:08
mborzeckias i understand that's the direction we want to go, zyga-ubuntu mvo ?10:09
zyga-ubuntuChipaca: I think we wanted to be cgo free and decided to kill the c-goat on the altar to attain that10:09
zyga-ubuntuChipaca: whatever you need / do I think we're not adding more cgo10:10
Chipacazyga-ubuntu: my question is: is /etc/passwd and /etc/group going to be the canonical (heh) source of users and groups on all snappy systems10:10
Chipacabecause that's the impact in practice10:10
Chipacawe're not even looking at extrausers/groups10:10
zyga-ubuntuChipaca: no, (see extrausers)10:10
zyga-ubuntuChipaca: it's more subtle10:10
zyga-ubuntuChipaca: we're killing reasons to know10:10
zyga-ubuntuChipaca: not picking means to know10:11
Chipacazyga-ubuntu: sorry, i don't understand10:11
Chipacathe code in #4188 looks up things only in /etc, no extra10:11
mupPR #4188: osutil: replace cgo bits with non-cgo, vendored os/user  <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4188>10:11
pedronispstolowski: about LaneTasks, I said something wrong I think about lane 0 and then corrected myself but it got missed, I think lane 0 behavior is wrong, probably easy to find out with a different test10:11
Chipacafrom this conversation i suspect the lack of extra is oversight10:12
Chipacaeasily fixable10:12
zyga-ubuntuChipaca: I mean, as far as I understand it, is that we haven't said we'll use /etc/passwd exclusively (yet), more like we said for each of the reasons to lookup users/groups _so far_ we want to avoid that reason10:12
Chipacabut the approach of making files the only source of users, that's policy now? (fine by me) (still needs a refactor from me)10:12
* zyga-ubuntu killed qemu to "refresh" kernel state10:12
zyga-ubuntuman this mount business10:12
pedroniszyga-ubuntu: did we discuss this changes with jdstrand btw ? he added that stuff I think10:12
zyga-ubuntufishy stuff10:12
Chipacazyga-ubuntu: in core we will be creating users and groups we will then fail to find10:13
zyga-ubuntupedronis: no,10:13
zyga-ubuntupedronis: we plan to today10:13
zyga-ubuntuthat was just yesterday10:13
pedronisok10:13
Chipacaso I maintain that that aspect at least is a bug10:13
pstolowskipedronis, ah, thanks, will fix10:13
Chipacazyga-ubuntu: your sentence about avoiding looking up things clashes with the pr we have which has a bunch of code for looking up things10:14
zyga-ubuntuChipaca: yeah, I probably miss something then10:14
Chipacayou might be thinking about us not wanting to list all users10:14
mborzeckiChipaca: there's a related PR #4185 where we remove group from seccom rules, if that does not fly because of security concerns, we'll probably need to look into #418810:14
mupPR #4185: interfaces/builtin/account_control: drop group filter from seccomp rules <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4185>10:14
mupPR #4188: osutil: replace cgo bits with non-cgo, vendored os/user  <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4188>10:14
Chipacawhich is valid, unless we limit our users/groups to files -- then we can list them all no problem10:15
mborzeckiat least that that's how i undestood the discussion from yday10:15
Chipacamborzecki: doesn't 4188 make 4185 pointless?10:16
Chipacafeels like we're trying to solve problems breadth-first10:17
mborzeckiyes, it does, but I guess we'll see where 4185 takes us10:18
mvoChipaca: sorry for coming in late, was distracted. so I think its worth checking with niemeyer if we really want to go as far as to kill off the cgo user lookup bits. we certainly do not want to add more cgo code (this is the first part of the work that mborzecki is doing). we need to check that we really do not need anything from nss on classic systems, i.e. that we don't accidentally break snapd there10:28
mvomeh, all four pending 2.29 PRs have not even started yet in travis :/10:30
pedronismvo: we should not push anything to other PRs I suppose :/10:33
* zyga-ubuntu scratches head10:35
Chipacamborzecki, mvo, niemeyer, pedronis, zyga-ubuntu: https://forum.snapcraft.io/t/system-user-lookup/275310:35
mvopedronis: yeah10:36
mvoChipaca: thank you, reading10:36
zyga-ubuntuaha10:39
Chipacagah, mis-edit10:40
* Chipaca fixes10:40
mvoChipaca: silly question, from looking at the code we use user.Current().HomeDir a bunch of time, if the user is on ldap (or whatnot) will this still work in the new world? if not I think we will break a bunch of users10:40
Chipacamvo: it won't work for arbitrary users, but in general you can count on the local users to also being in passwd10:41
Chipaca*not always*10:42
Chipacaso, no in the general case10:42
mupPR snapd#4189 opened: interfaces/builtin/lxd_support: allow discovering of host's os-release <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4189>10:42
mvoChipaca: thats my concerns, in large deploys with ldap-nss or similar suddenly snaps might stop working because our env setup code fails10:42
Chipacamvo: but … the general case, looking at /home is horrible also10:42
mvoChipaca: yes, I mean, I am not sure we can get around nss for those systems10:43
Chipacamvo: i agree. do we care?10:43
mvoChipaca: unless we do stuff like blindly trusting the HOME env or something10:43
Chipacathat's basically the question :-)10:43
greybackzyga-ubuntu: hey, would you mind having a look and see if you have anyting to suggest: https://forum.snapcraft.io/t/mir-snap-not-detecting-new-input-devices/274210:43
mvoChipaca: right, thats the question we need to answer: is not having cgo worth breaking users on ldap-nss and similar10:44
Chipacamvo: yes. i'll add this.10:45
mvothank you10:45
zyga-ubuntugreyback: I'm debugging something else now but quick question:10:47
greybackzyga-ubuntu: no hurry, whatsoever, but thanks10:47
zyga-ubuntugreyback: go to /sys/fs/cgroup/devices/_the_one_for_mir/ and look at devices.list10:48
zyga-ubuntuplease add that to the post10:48
zyga-ubuntuthat will help understand things a lot10:48
greybackzyga-ubuntu: ack10:48
* zyga-ubuntu is back into insanity land 10:48
zyga-ubuntubut now has a working reproducer for the bug10:48
zyga-ubuntuand I think I can now test my idea10:48
zyga-ubuntugreyback: I can look at this issue as soon as I'm done with lxd/14.04 issue10:54
zyga-ubuntumvo: I have a test that breaks now, I can share that and I am testing theories10:54
zyga-ubuntugreyback: great,10:55
greybackzyga-ubuntu: appreciated. I've learned a lot while debugging, but I expect you'll make progress much faster10:55
zyga-ubuntugreyback: what is the major/minor of the input device that gets added?10:55
mvozyga-ubuntu: cool, curious to know what the test looks like10:55
zyga-ubuntumvo: ha, it's an iteration of your lxd test (thank you very very much for that)10:55
zyga-ubuntumvo: though a simpler 14.04 test will do the same10:55
zyga-ubuntustill, I kept it lxd since it may be something lxd specific in the end10:55
mvozyga-ubuntu: cool, thanks10:56
zyga-ubuntu SPREAD_DEBUG_EACH=0 spread -reuse -shell-after -v qemu:ubuntu-16.04-64:tests/main/lxd-refresh-cycle10:59
zyga-ubuntucode is in rfc/lxd-issue-test in my remote10:59
zyga-ubuntuI'm not 100% sure qemu can survive too many -reuse cycles with this one,10:59
zyga-ubuntujust FYI10:59
greybackzyga-ubuntu: udevadm info -rq name /sys/dev/shar/13:69 return the correct thing: /dev/input/event5, so 13:69? Sound right?11:00
zyga-ubuntugreyback: (not sure, but it's not present in that file)11:01
zyga-ubuntugreyback: so this is why it doesn't work11:01
zyga-ubuntunow the question that's really interesting: why :)11:01
greybackzyga-ubuntu: ok. What should be updating that?11:01
zyga-ubuntugreyback: it's updated by snappy-app-dev11:02
zyga-ubuntuand udev rules11:02
zyga-ubuntuwhat is the profile generated for mir ?11:02
zyga-ubuntu(/etc/udev/rules.d/)11:03
greybackzyga-ubuntu: http://pastebin.ubuntu.com/25924450/11:04
zyga-ubuntuso KERNEL=="event[0-9]*", TAG+="snap_mir-kiosk_mir-kiosk" looks like something that ought to make this work11:05
zyga-ubuntugreyback: TBH, now I don't know more11:06
zyga-ubuntugreyback: look at udev events when you plug this in11:06
zyga-ubuntuis it matchin?11:06
greybackzyga-ubuntu: tbh I'm not sure how to tell. http://pastebin.ubuntu.com/25924507/ ??11:08
zyga-ubuntugreyback: good, just add the options to show kernel and other things11:09
zyga-ubuntuand annotate the log with like "idle", "inserted", "removed"11:09
zyga-ubuntuso we know where's happening11:09
zyga-ubuntugreyback: if you add that to the post it will help a lot11:14
greybackzyga-ubuntu: just about to11:14
greybackdone, added to last post11:15
zyga-ubuntuthank you11:16
zyga-ubuntugreyback: does it work if you run the app after plugging the mouse?11:19
greybackzyga-ubuntu: yes11:19
greybackand after that, removal and re-insertion is working fine11:19
zyga-ubuntuok11:20
zyga-ubuntucan you please edit /lib/udev/snappy-app-dev11:20
zyga-ubuntucomment out the debug section11:20
zyga-ubuntuand see what happens when you plug it in11:20
zyga-ubuntualso add that to the post when ready11:20
greybackack11:21
zyga-ubuntuhttp://pastebin.ubuntu.com/25924595/11:28
zyga-ubuntuha11:33
zyga-ubuntureally interesting11:33
mupPR snapd#4176 closed: cmd: fix re-exec bug with classic confinement for host snapd < 2.28 <Critical> <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4176>11:33
zyga-ubuntumvo: I think (is) I understand it now11:37
zyga-ubuntumvo: but not ready with patch yet11:37
zyga-ubuntumvo: I'll keep you posted11:37
mvothanks for the heads up11:39
zyga-ubuntumvo: not a trivial one liner but something I may have a fix for for evaluation (kyrofa, et all)11:39
* zyga-ubuntu -> coffee && power11:40
mvozyga-ubuntu: if you could quickly jump into the HO channel, I want to see if the external cam I organized works well enough11:44
zyga-ubuntusure11:44
zyga-ubuntuone moment11:44
pstolowskido we have any (expected) travis/store hiccups today?11:44
zyga-ubuntumvo: joining11:45
zyga-ubuntupstolowski: nobody expects the unexpected issues11:53
pstolowski:)11:54
zyga-ubuntuok, so I confirmed what is hanging inside lxd now (just ran a patched version), let me explore this further with some C code11:54
mupPR snapd#4190 opened: cmd/snap-seccomp: do not use group 'shadow' in tests <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4190>11:56
pstolowskimvo, +1 on 4122 with little nitpick11:58
mupPR snapd#4146 closed:  interfaces: fix udev tagging for hooks (2.29) <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4146>12:04
mupPR snapd#4182 closed: cmd/snap-confine: Ensure snap-confine is allowed to access os-release <Created by ikeydoherty> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4182>12:08
mupPR snapd#4183 closed: cmd/snap-confine: Respect biarch nature of libdirs <Created by ikeydoherty> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4183>12:09
zyga-ubuntugah, darn it12:11
zyga-ubuntuin linux it's impossible to know what's really mounted :P12:11
* zyga-ubuntu -> thinking12:12
mvopstolowski: thanks for your review12:16
mupPR snapd#4191 opened: cmd/snap-update-ns: do not assume 'nogroup' exists <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4191>12:17
* kalikiana croissant&coffee break12:26
greybackzyga-ubuntu: I've done as you suggested, but I see no debug log file being created at all, suggesting /lib/udev/snappy-app-dev isn't ever being called12:29
mupIssue snapcraft#1462 closed: update story <designed> <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1462>12:29
mupPR snapcraft#1412 closed: lxd: snapcraft refresh in containers <Created by kalikiana> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1412>12:29
kalikianasergiusens: thanks for merging!12:39
zyga-ubuntugreyback: interesting, I'll investigate myself later12:41
zyga-ubuntumvo: I have a much much simpler solution in my head now, trying it out12:41
greybackzyga-ubuntu: thank you.12:42
mupPR snapcraft#1721 closed: integration tests: use ruby v2.4.2 <Created by kyrofa> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/pull/1721>12:44
zyga-ubunturunning now, fingers crossed12:46
jdstrandmborzecki: I gave some other options, but before you change anything, please let's get consensus on the direction12:49
mborzeckijdstrand: thanks for the review12:49
zyga-ubuntujdstrand: o/12:50
jdstrandhey zyga-ubuntu :)12:50
zyga-ubuntujdstrand: maybe we want to have a call about that?12:50
zyga-ubuntujdstrand: btw, I found a (hopefully) super simple solution for the bane of systems without rshared /12:50
jdstrandI don't think it needs a call. there is a very simple path that can be taken12:50
mvozyga-ubuntu: whats your timeline? I have a local 2.29.3 here that I would like to make push to beta12:51
zyga-ubuntujdstrand: I'll ask you to look at the diff today (fits on my screen)12:51
mborzeckiagreed, vwe've been there before, although I unnecessarily used group name to setup g:<name>, should have used just group ID at that point12:51
zyga-ubuntumvo: it's testing now12:51
zyga-ubuntumvo: I'll run the full suite in LXD (external) if that works12:51
zyga-ubuntumvo: let's chat in HO12:51
mupPR snapd#4192 opened: osutil: add helper for obtaining group ID of given file path <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4192>12:52
mvozyga-ubuntu: sure12:52
zyga-ubuntumvo: it works :)12:56
zyga-ubuntumvo: I'll run all of main now12:56
zyga-ubuntumvo: and while that runs I'll look at running all of main in lxd12:57
zyga-ubuntumvo: do you know if we have any helpers for that?12:57
mvozyga-ubuntu: I think we don't have helpers for that :/13:00
mvozyga-ubuntu: keen to see your fix, great work!13:00
=== lborda is now known as lborda_afk
pstolowskimvo, one more comment to your change ;)13:02
mvopstolowski: ta13:03
sergiusenskalikiana no problem13:17
zyga-ubuntukyrofa: hey13:18
jdstrandmvo: hey, not sure you got the message, but no mpris PR from me for 2.2913:19
zyga-ubuntujdstrand: https://github.com/snapcore/snapd/compare/master...zyga:rfc/lxd-issue-test?expand=1 (not fully spread-tested yet)13:20
mvojdstrand: aha, I did not get this message. thank you, one less worry13:26
jdstrandyep13:26
Son_Gokumvo: I'm updating the build in Fedora Rawhide to 2.29.213:33
Son_Gokuso I should have an updated Provides list matching the subsystems exposed in snapd-devel13:33
mvoSon_Goku: thank you, if you could merge master into your fedora PR I will pull it in13:34
mvoSon_Goku: I will do a 2.29.3 today13:34
Son_Gokugive me a few minutes and I will have that13:34
mvoSon_Goku: small issue related to classic snaps, nothing terrible but want to fix it13:34
Son_Gokusure13:34
mvoSon_Goku: no worries, all the time you need13:34
Son_Gokuand it's a nice time to fix the Fedora build13:34
mvoSon_Goku: and *thank you*13:34
jdstrandzyga-ubuntu: interesting. can you add a comment above sc_ensure_shared_snap_mount() describing why it needs to be shared and why mounting all the snaps as shared addresses things?13:45
zyga-ubuntujdstrand: yes, sure13:49
Son_Gokumvo: https://github.com/snapcore/snapd/pull/419314:01
mupPR #4193: packaging/fedora: Merge changes from Fedora Dist-Git <Created by Conan-Kudo> <https://github.com/snapcore/snapd/pull/4193>14:01
mupPR snapd#4155 closed: packaging/fedora: Merge changes from Fedora Dist-Git <Created by Conan-Kudo> <Closed by Conan-Kudo> <https://github.com/snapcore/snapd/pull/4155>14:02
mupPR snapd#4193 opened: packaging/fedora: Merge changes from Fedora Dist-Git <Created by Conan-Kudo> <https://github.com/snapcore/snapd/pull/4193>14:02
cachiomvo, where did you uploaded the snaps?14:03
* zyga-ubuntu is silly and ran 14.04 tests on 3.14 kernel14:04
zyga-ubuntuI need to fix my image14:04
Son_Gokumvo, do you plan to make 2.29.3 right after merging my spec changes in?14:06
* Son_Goku is trying to weigh whether to submit a build for 2.29.2 at all14:07
Son_GokuI'm thinking I shouldn't if you're going to make a 2.29.3 release before I have to leave for work14:07
mvoSon_Goku: 2.29.3 will go out today, waiting for one more branch still14:11
mvocachio: I pushed them to the store you should have mail from the store. i only build locally so far14:11
Son_Gokumvo: anyway, you should pull those spec changes in and merge it back into 2.2914:11
popeyjdstrand:  Whats the process if an upstream wants a snap name and it's the same name as the same app in the deb archive? They get it, right?14:11
Son_Gokuthis is also now adjusted for the new tarball scheme14:11
mvocachio: one easy way to get it build for everything is to push just the snaps to a LP branch and setup snap building for that branch and auto-store upload. that should work as you are the "owner" of the snaps now14:12
mvoSon_Goku: yeah, once tests are green I will merge14:12
popeyjdstrand: i.e. they ask on the forum, we grant it, they upload, and the path means users get the snap in preference to the deb?14:12
Son_Gokumvo: the tests seem to be red for unrelated reasons :/14:12
jdstrandpopey: iirc, there needs to be a store override. noise][ could comment (I don't typically handle name registration questions)14:12
Son_Gokuthat happened with the other spec change14:12
popeyoh, sorry.14:12
cachiomvo, I don't see those snaps in the store14:12
mvogreyback, zyga-ubuntu if its a cgroup problem, could you uncomment the debug lines in /lib/udev/snappy-app-dev ? maybe that gives us a hint14:13
cachioI mvo I just got the email14:13
mvocachio: hm, could you /msg me your primary SSO address? maybe that is the problem, in the past the store only send the invite to that14:13
jdstrandpopey: as for snap in preference to the deb: no. /snap/bin is after /usr/bin in PATH14:13
mvocachio: aha, ok. woah, I added the snaps hours ago :)14:13
greybackmvo: zyga-ubuntu suggests I do that, but I saw no log file being created at all14:13
greyback-s+ed14:14
mvoSon_Goku: yeah, tests are red, please merge master14:14
diddledanpopey: I believe the store has marked all the names of debs in the ubuntu repo as reserved so you need to file a claim using the request name form when you try to register the snap14:14
mvogreyback: autsch, thats bad14:14
popeyyeah, thats the problem14:14
jdstrandthose don't work14:14
popeysomeone tried to register and never got a reply14:14
mvoSon_Goku: I wanted to do that and push to your branch but it looks like you disabled that I can push to your PRs ;)14:14
cachiomvo, a rule remove that email from my inbox14:14
popeyI'm trying to smooth it out.14:14
mvocachio: aha, ok.14:14
cachiomvo, sorry14:14
jdstrandmvo, greyback: those debug lines don't work iirc14:14
Son_Gokumvo: gimme a sec to rebase14:14
mvocachio: no problem14:14
Son_GokuI thought I had already done it this morning14:14
mvojdstrand: they worked at some point, if they no longer do we should remove them :(14:15
mvoSon_Goku: thank you14:15
Son_Gokumvo: done14:15
jdstrandmvo: yes and yes14:15
mvojdstrand: and YES :)14:15
jdstrandmvo: YES!!14:15
jdstrand:)14:15
* mvo hugs jdstrand 14:15
noise][popey: i don't see any outstanding name dispute requests14:15
noise][what name?14:16
popeyhtmldoc14:16
popeyI'm mailing the dev and will cc you14:16
jdstrandmvo, greyback: istr an issue with reexec or it being in the readonly squashfs and not being able to have the system recognize the overlay14:16
popeythey added numbers to the name to get it, but say they got no response, but I don't know when / where they asked14:16
* jdstrand will sometimes use overlayfs to test things on a core image14:16
noise][i see an htmldoc19 approved14:17
noise][that's the only one14:17
popeyyeah, he did that because he said he got no reply for htmldoc14:17
noise][hmm14:17
popeywill get clarification over email14:17
popeyYou Have Mail! </aol>14:18
mvopopey: lol14:18
jdstrandmvo, greyback: I think(?) it might be possible to cp it somewhere, adjust that to output to a file (eg 'echo $@ > /var/tmp/foo'), then overlayfs that (maybe a bind mount would do?), then stop and start udev14:20
jdstrandzyga-ubuntu: I guess you are looking at this. fyi ^14:22
greybackjdstrand: yeah I thought it best to let an expert have a go :)14:23
greybackthough I'd still exect those debug lines to create the log file on a Classic system14:24
pedronisChipaca: did a pass over #415414:26
mupPR #4154: overlord/snapstate: support completion for command aliases <Created by chipaca> <https://github.com/snapcore/snapd/pull/4154>14:26
zyga-ubuntujdstrand: I plan to next14:27
zyga-ubuntujdstrand: still looking at the rshare issue, some initial enthusiasm is receeding14:27
jdstrandzyga-ubuntu: why don't you let me look at greyback's issue14:28
jdstrandI was planning on reaching out today anyway14:29
zyga-ubuntujdstrand: go ahead, I don't block you14:29
jdstrandgreyback, mvo: ^14:29
jdstrandI'll be looking at this14:29
greybackjdstrand: if I can help at all, let me know14:29
mvojdstrand: ta14:30
jdstrandgreyback: is it possible to reproduce in a vm? eg, sub hotplug a moue via virsh or something?14:30
jdstrandman14:31
jdstrandthat was some mighty poor typing14:31
jdstrandusb hotplug a mouse via virsh*14:31
zyga-ubuntujdstrand: at some point the acronyms take over english and it's all ok14:31
jdstrandhaha14:31
mupPR snapd#4194 opened: daemon: for /v2/logs, 404 when no services are found <Created by chipaca> <https://github.com/snapcore/snapd/pull/4194>14:34
Chipacamvo: ^14:34
greybackjdstrand: mir should work fine inside a vms yes14:34
greybackjdstrand: I don't know how to simulate mouse plug/unplug to a vm though14:35
jdstrandgreyback: I'll play with it a little. I have a physical device I can try too though14:35
greybackjdstrand: yeah I tend to use a separate machine when working on mir14:35
* jdstrand has wanted to document debugging this part of snapd anyway14:36
jdstrand(the udev hotplug)14:36
* mvo hugs Chipaca 14:36
zyga-ubuntujdstrand: there's a way to do that14:36
mvoChipaca: thank you!14:36
zyga-ubuntujdstrand: using the qemu monitor14:36
jdstrandzyga-ubuntu: yeah. I just need to recall how to do it :)14:36
zyga-ubuntujdstrand: I wrote some python that could help but not something you can spread test easily (AFAIK) without nested spread14:37
jdstrandthat's fine14:37
zyga-ubuntuhttps://en.wikibooks.org/wiki/QEMU/Monitor#usb_add14:37
jdstrandoh bummer, my core vm is hosed14:38
* jdstrand creates a new one14:38
mvoChipaca: lets hope travis builds it reasonable soon14:38
zyga-ubuntujdstrand: -snapshot to the rescue14:39
elopiosnappy-m-o echo test14:40
Chipacamvo: dumb fix for dumb bug :-)14:41
jdstrandzyga-ubuntu: well, that is the problem. I did -snapshot and it was broken14:41
zyga-ubuntuthat's interesting, so it wrote back?14:41
jdstrandno idea. I've already destroyed it and will have a new one in a moment14:42
Chipacamborzecki: what was your usecase of group lookup? was it "who is the owner of /etc/shadow"?14:42
jdstrandChipaca: it was to know what to use with 'g:<group>'. but we already have the gid with stat so no point finding the group name to then lookup the gid14:44
Chipacaheh14:45
Chipacajdstrand: nice14:45
Chipacaso that's all going away?14:45
* ikey had no idea that snaps were held together with silly string and environmental variables..14:46
jdstrandChipaca: his PR doesn't get rid of lookupGroup, no. lookupGroup *could* go away if the template.go was similarly updated, but I would argue to keep it for when we need it, but use my alternative suggestion of shelling out14:47
jdstrand(see my comments in the PR)14:47
Chipacawill do14:48
Chipacathis is relevant to some work coming out of the standup14:48
Chipacabut right now, i need to go regruntle a chid14:48
jdstrandChipaca: a faster alternative since we don't have it today would be to update template.go as I mentioned in the PR, remove all cgo code related to this, keep FindGid() but have it return an err that points to my PR comment. that way whoever needs it next would know how to proceed. since that would likely be me, I'm ok with implementing my design14:51
Son_Gokuikey: you finally figured it out14:51
jdstrands/don't have it today/don't need it today/14:52
zyga-ubuntuikey: environment variables and tongue at the right angle14:54
ikeyso, amusing fact14:54
ikeymy solus based snap refuses to accept the nvidia GL libraries in /var/lib/snapd/gl14:54
ikeyor w/e the path is14:54
ikeybecause it sets secure execution mode as the binaries + libs are mostly all full relro and ignores LD_LIBRARY_PATH14:55
ikeyergo, solus snap binaries are more secure in nature than ubuntu ones :p14:55
elopiosnappy-m-o echo test14:55
snappy-m-otest14:55
ikeyim gonna need to work around it with ld.so.conf14:56
=== kenvandine_ is now known as kenvadine
=== kenvadine is now known as kenvandine
* zyga-ubuntu is sleepy now15:02
zyga-ubuntudamn it15:02
zyga-ubuntuI hate that sun is over at 16:0015:02
zyga-ubuntu:/15:02
zyga-ubuntuok, you win15:05
zyga-ubuntuI'll get some coffee15:05
zyga-ubuntudarn sun15:05
kalikianaikey: what do you mean by "solus based" here? built on solus or running on solus?15:07
ikeyboth15:07
ikeythe snap has `base: solus-runtime-gaming`15:07
ikeyand solus-runtime-gaming has `type: base`15:08
zyga-ubuntukalikiana: the rootfs is solus15:14
zyga-ubuntukalikiana: (at runtime)15:14
zyga-ubuntukalikiana: base snaps :)15:14
=== cachio is now known as cachio_lunch
ikeyi found some assumptions that i had to cater for in the rootfs15:15
ikeyand it really doesn't like lib6415:16
ikeyi think the most surprising one was the expectation for /lib/udev/snappy-app-dev to be present15:17
zyga-ubuntuikey: that's correct, we need to make more things configurable in base snap's layout section15:18
zyga-ubuntuikey: we can correct those as we go, thank you for pushing the boundaries15:18
ikeyah my pleasure :D15:18
zyga-ubuntuikey: much of what I do now relates to that15:18
ikeyright now my script is an abomination15:18
zyga-ubuntuikey: but you are ahead of the curve :)15:18
ikeyhttps://github.com/solus-project/runtime-snaps/blob/master/round1.sh15:18
ikeybut you can kinda get a feel for whats going on easily enough15:18
kalikianaikey: oooohhhh sweet15:19
ikeyi mean its kinda nasty but it does the job, right?15:19
ikeyand the main yaml is here https://github.com/solus-project/runtime-snaps/blob/master/runtimes/gaming/meta/snap.yaml15:19
ikeyi added a debug apps: part to it to let me poke it15:19
ikeyso now my next test is to see if i can prefix ld.so.conf so that the SNAP_LIBRARY_PATH portions would be respected15:20
ikeyas right now my poor snap is using mesa15:20
jdstrandgreyback (cc zyga-ubuntu): fyi, virsh qemu-monitor-command snappy-16-amd64 '{"execute":"device_add","arguments":{"driver":"virtio-mouse-pci","id":"input1","bus":"pci.0","addr":"0xa"}}'15:22
jdstrandgreyback (cc zyga-ubuntu): virsh qemu-monitor-command snappy-16-amd64 '{"execute":"device_del","arguments":{"id":"input1"}}'15:23
zyga-ubuntujdstrand: oh, you are using the qemu qpi interface15:23
zyga-ubuntujdstrand: nice, does it work?15:23
jdstrandyep15:23
greybackjdstrand: sweet15:24
zyga-ubuntui mean, does snapd part work?15:24
jdstrandudevadm monitor shows them coming and going15:24
jdstrandthe udev tagging works too (it is getting assigned to mir-kiosk)15:24
jdstrandthe adding to the cgroup is not working15:24
jdstrandI'm looking into that15:24
jdstrandE: TAGS=:snap_mir-kiosk_mir-kiosk:15:24
zyga-ubuntujdstrand: ha15:27
zyga-ubuntujdstrand: same result as what the reporter found15:27
jdstrandyes. that's a good thing :)15:28
jdstrandI have reproduced it15:28
* greyback sighs with relief15:28
zyga-ubuntujdstrand: as a side note15:29
zyga-ubuntujdstrand: that script is -e, right?15:29
jdstrandit is15:29
zyga-ubuntujdstrand: just sayin :)15:29
zyga-ubuntujdstrand: we should burn that script with fire15:29
zyga-ubuntujdstrand: and write it in C15:30
jdstrandit is on our trello board15:30
jdstrandwe hate the shell script15:30
zyga-ubuntuthat sounds like a line from a song15:30
ikeyWe didn't start the shell script....15:31
ikeyIt was always churning from before snapd was turning..15:31
* ikey sees himself out15:31
jdstrandhehe15:31
* popey shuts the door15:31
zyga-ubuntuah15:31
zyga-ubuntuit was "we love the pain"15:31
zyga-ubuntubut I somehow translated that to "we have the shell script"15:31
ikeypopey, just turn around now15:31
kalikianaikey: kinda wonder if that couldn't be baked into --shell... so you don't have to add those awkward "apps"15:32
ikey>_>15:32
ikeykalikiana, *prolly* but the apps shouldn't really be in the runtime15:32
ikeyit was there for le debugging15:32
ikeyonce i have the higher layer working properly ill remove it15:32
kalikianaikey: right, it's more that you need to add something solely for debugging15:32
kalikianathat strikes me as awkward15:33
ikeyyeah spose15:33
kalikianajust thinking out loud15:33
ikeytbh it was mostly "can i chroot"15:33
ikeythen later i had fun due to not using dash in the image15:34
* zyga-ubuntu now wants to listen to "we love the pain"15:34
ikeyturns out readline + ncurses, pretty important.. lol15:34
ikeyconfinement wouldn't let em load ^^15:34
ikeyoh, le Q15:34
zyga-ubuntuhttps://www.youtube.com/watch?v=jkXP-aqKmPQ ^_^15:34
ikeymy snap can't seem to execute stuff from /usr/bin15:34
ikeydespite the runtime having zenity there15:34
ikeyi mean sure its janky to have zenity there15:35
ikeybut still15:35
ikeycurious why it can't execute stuff15:35
zyga-ubuntuikey: what's the error?15:35
ikeyehm it was permission denied15:36
zyga-ubuntuikey: typically you get the answer from audit log15:36
ikeyill need to rebuild me whatchacallits15:36
ikeymy snaps and install and find out what their issue is15:36
zyga-ubuntujdstrand: not sure if you were trying to tell me politely "explain how it works so that you will see it doesn't" or was that just an accident but I think I need another (much more annoying) solution15:42
zyga-ubuntuannoying as in complex15:43
=== chihchun is now known as chihchun_afk
* mvo is unhappy because the travis run for 4194 has not even started yet15:51
zyga-ubuntumvo: :/15:52
* zyga-ubuntu has a very crazy idea on how to fix the problem affecting lxd15:54
mvozyga-ubuntu: tell me more15:55
zyga-ubuntumvo: it goes away if we move snap mounts to /var/lib/snapd/snap and then have an unconditional mount unit that bind mounts /var/lib/snapd/snap to /snap15:57
zyga-ubuntumvo: then /snap is a real mount unit with correct options15:57
zyga-ubuntumvo: and the hack goes away15:57
zyga-ubuntumvo: as for fixing this in snap-confine: we could keep the hack we had but we need to unmount everything first15:57
zyga-ubuntumvo: then create the bind mount (/snap -> /snap)15:58
zyga-ubuntumvo: and then re-mount all the mount units15:58
zyga-ubuntumvo: (re-start them, we cannot mount ourselves as we don't know what was there)15:58
zyga-ubuntumvo: (then there's confinement that will make this more complex)15:58
ikeyim seeeing lots of spam for NSS modules in my snap: https://hastebin.com/cumofisodi.sql15:59
ikeybut nothing that could explain why this is still refusing to use my NVIDIA libraries15:59
ikeyfor zenity execution:16:02
ikeyNov 09 16:01:48 ironhide audit[11528]: AVC apparmor="DENIED" operation="exec" profile="snap.linux-steam-integration.settings" name="/usr/bin/zenity" pid=11528 comm="sh" requested_mask="x" denied_mask="x" fsuid=1000 ouid=016:02
ikeyis there some kind of plug i need to add so i can actually execute stuff from my runtime?16:03
ikeyotherwise it gets a bit pointless having a runtime..16:03
mvozyga-ubuntu: hm, interessting16:03
pedronisinteresting is the word16:03
naccikey: it *might* help to run `snap run --shell <app>` and try to run it by hand?16:03
mvozyga-ubuntu: and funny in some way as this would be fhs compliant by "accident"16:04
mvopedronis: lol16:04
naccikey: dunno if you'd get more logging, or be able to see what precisely is failing16:04
ikeycan't see /usr/bin16:04
naccikey: confined snap?16:04
ikeyyeah16:04
ikeyok i can see some of /usr/bin..16:04
ikeybash: /usr/bin/file: Permission denied16:05
naccikey: well ... it should't be able to see /usr/bin; not sure if hte apparmor logging is showing you the confined view or not (i'm not deep enough into snappy to know)16:05
ikeybasically i cannot execute anything from /usr/bin16:05
naccikey:  a confined snap should be able to use the core snap it's running on and the snap's contents only, I think?16:05
pedroniszyga-ubuntu: will that not confuse snapd vs snap-confine? are all the relevant ops done with the snap-confine lock?16:05
ikeyright, and zenity is in my core snap16:05
ikeybut /bin works..16:05
ikey/usr/bin doesn't16:05
ikeycurious.16:05
naccikey: that's weird :/16:05
ikeyi.e /bin/ls is fine16:06
naccikey: sounds like you need an actual snap developer, sorry :)16:06
ikeyheh16:06
ikeybut i can't ls /bin16:06
zyga-ubuntupedronis: this would be done at system level, before we get to run;; but honestly this is lala land for now;16:06
ikey-_-16:06
ikeythis is jank of the highest order lol16:06
zyga-ubuntupedronis: I'd like to find easier solution16:06
pedroniszyga-ubuntu: hope so, both of those don't sound very appealing16:06
naccikey: so you can read but not execute?16:07
pedronisat first sight16:07
ikeyi can read /usr/bin, not execute, execute /bin, not read dir16:07
ikeyok so symlinks seem to work ok if its symlinked into /bin16:07
ikeyworkarounds intensify16:07
naccikey: to be clear it's possible `ls /bin` and `/bin/ls /bin` are different16:07
naccikey: but this sounds like AA madness :)16:07
ikeyyeah16:07
ikeyima test a theory.16:08
ikeysymlink the runtime16:08
ikeyat this point i really wish snaps were implemented using overlayfs16:10
ikeyand not having mangled /snap/* trees and LD_LIBRARY_PATH hacks16:10
kyrofazyga-ubuntu, hey there! I'm around now16:10
ikeycould have a core snap mounted as a lowerdir, a tmpfs mounted as an intermediary with snapd requirements on top (such as gl overrides), and then a new overlayfs using that tmpfs as a bottom dir16:10
ikeyand the compounded Thingy would have a natural filesystem layout16:11
ikeyand no need for the butchered scripts anymore16:11
=== cachio_lunch is now known as cachio
zyga-ubuntukyrofa: I had a up/down cycle today16:13
zyga-ubuntukyrofa: fixing that bug all day16:13
kyrofazyga-ubuntu, hahaha16:14
kyrofazyga-ubuntu, did it end with success?16:14
mupPR snapd#4195 opened: daemon: for /v2/logs, 404 when no services are found (2.29) <Created by mvo5> <https://github.com/snapcore/snapd/pull/4195>16:15
zyga-ubuntukyrofa: yes, I didn't jump off a cliff ;)16:15
mvocan someone review 4195 please? it's 4194 for 2.2916:15
zyga-ubuntukyrofa: no, not fixed yet, mostly understood now but still trying to fix it16:15
zyga-ubuntumvo: I cna16:15
ikeybash: /bin/zenity: Permission denied16:16
ikey*gah*16:16
mvozyga-ubuntu: ta!16:16
zyga-ubuntumvo: man, ∀, I always find that confusing "All or Every it was?"16:16
zyga-ubuntumvo: :)16:16
ikeyapparmor is a pain in the ass. just sayin.16:18
zyga-ubuntuikey: you should try selinux16:19
zyga-ubuntuikey: then you'll say "man, remember that pain in the ass, haha, that was just tingling"16:19
ikeyat that point id fork smack and bring it up to scratch again16:19
ikeyfor the love of christ why can it still not run stuff16:20
zyga-ubuntuikey: you can recompile the policy16:22
zyga-ubuntuikey: and make it permissive16:22
zyga-ubuntuikey: then you can just do stuff until you get proper logging to see the denials16:22
ikeyugh16:22
ikeyi found out why16:22
ikeyinterfaces/apparmor/template.go16:22
naccikey: i wonder if it's acustom core snap (iirc?) then maybe you need to do apparmor modifications?16:22
ikeyhard-coded permitted commands?16:23
ikeycmon guys16:23
niemeyerChipaca: ping16:23
zyga-ubuntuikey: yes, because then we cannot change the base snaps otherwise16:24
zyga-ubuntuikey: if we allow anything then everything is backwards compatible stone that is by your leg16:24
ikeyi cant even ldconfig -_-16:25
ikeythis also means i cant do an update to an icon theme asset in the secondary snap16:26
ikeybecause the gtk-update-icon-cache is inside the core runtime16:26
ikeyand i cant execute commands there16:27
zyga-ubuntuikey: I think base snaps should have a base apparmor template16:27
zyga-ubuntuikey: it's just something we haven't done yet16:28
Chipacaniemeyer: pong16:28
niemeyerChipaca: Yo16:28
Chipacaniemeyer: 'sup16:28
niemeyerChipaca: Looking at the fixes for /v2/logs16:28
niemeyerChipaca: Got me thinking about our old issues with 404s on valid endpoints16:28
niemeyerChipaca: Do we have a pattern already established of returning 404s in similar cases?16:29
Chipacaniemeyer: /v2/logs?names=rubbish 404s16:29
ikeycan i have all the magical chroot esque functionality of strict snaps **without** the apparmor denials?16:29
ikeylike some magic "i dont want this" flag? :P16:29
kyrofazyga-ubuntu, glad to hear it :)16:31
jdstrandikey: what specifically are you trying to do. launch zenity from your snap?16:31
ikeyya, but have zenity in my base snap16:31
ikeyand apparmor denials make it impossible to have my useful executables there16:31
ikeysorta defeating the point of "runtime" :p16:32
* jdstrand notes that base snaps are a very new thing and the security policy needs to be designed for it16:32
naccikey: i think that's what i was tryign to say earlier --^16:32
Chipacaniemeyer: /v2/snaps/rubbish 404s16:33
Chipacaetc16:33
Chipacaniemeyer: 404 isn't "this is not a valid endpoint"16:33
jdstrandlike, should each base snap have it's own policy? should base snaps extend existing policy?16:33
* ikey will make magic workarounds16:34
ikeyand stick zenity into the secondary snap16:34
naccjdstrand: really good questions :)16:34
niemeyerChipaca: I guess it's a bit late to be changing that in this case, but we should at least try to consider further similar cases16:34
jdstrandikey: now, for zenity in particular, perhaps it makes sense to add it to the desktop or desktop-legacy interface16:35
ikeyalso gotta wonder what the SDK/debug story is for base runtimes16:35
niemeyerChipaca: I guess in our case it's a bit less of a problem as we are indeed returning a richer value despite the status code16:35
ikeyjdstrand, tbf i shouldn't be copping out and using zenity in the first place16:35
ikeybut there it is ^^16:35
ikeyi should have been less lazy and used a real GtkDialog16:35
niemeyerChipaca: But I've learned to be afraid of that exact behavior after recurring bugs16:35
ikey** (zenity:26283): WARNING **: Could not load ui file /usr/share/zenity/zenity.ui: Failed to open file ?/usr/share/zenity/zenity.ui?: No such file or directory16:36
ikeyah for feck sake16:36
Chipacaniemeyer: nice json 404 in appserver resulting in nasty plain text 404 from load balancer?16:36
* ikey punches a baby donkey16:36
jdstrandikey: that's a good question. I don't know tbh. I think the idea is get the concept out there and see how people are using them and design the next steps16:36
* jdstrand hasn't been part of most base snap discussions16:36
niemeyerChipaca: Problem is that there's little difference between a real response, and a broken configuration with a wrong path, or a broken configuration with a wrong endpoint altogether, or even a broken configuration talking to a proxy that is getting in the way16:36
ikeyjdstrand, it'd be a whole lot easier if we could rely on real usable system paths16:37
ikeyand not mangle every single package..16:37
ikeywonder if i can cheat here and install zenity twice.16:37
Chipacaikey: https://i.imgur.com/5jysoQE.jpg16:37
ikeyls: cannot open directory '/usr/share/locale': Permission denied16:38
ikey*gah!!*16:38
niemeyerChipaca: Also, clients getting 404s for different reasons out of the same endpoint (missing snap, or missing service, or missing ...)16:38
niemeyerChipaca: We even got one of those cases in our buying endpoint ("Please login" when really it was "This stuff is free dude!")16:38
Chipacaniemeyer: yeah; in our case it's an error response, so it's not _just_ a 404, but yes, agreed16:38
ikeyok new objective, make snap work, then make strict confinement work later.16:39
ikeyless stress16:39
mupPR snapd#4168 closed: cmd/snap-update-ns: add new helpers for mount entries <Created by zyga> <Merged by stolowski> <https://github.com/snapcore/snapd/pull/4168>16:40
ikeyheh now i can run zenity xD16:45
mupPR snapd#4196 opened: daemon: cherry-picked /v2/logs fixes <Created by chipaca> <https://github.com/snapcore/snapd/pull/4196>16:45
Chipaca^ cherry-picking the v2/logs fixes for 2.29, plz16:46
* ikey still has that one cute donkey jpeg open16:49
ikeyi couldn't punch that16:49
ikeyhttps://ibin.co/3gibO7Bha09C.png :D16:51
Chipacaikey: https://i.imgur.com/6G3FTUC.jpg16:51
popeydiddledan: apologies for the mail store spam16:51
ikeyok that one looks like it already took a slap16:51
ikeylibGL error: unable to load driver: swrast_dri.so16:52
ikeylibGL error: failed to load driver: swrast16:52
diddledan:-)16:52
ikeyok so the last thing to work out now is how to expose the NVIDIA16:52
* diddledan clicks on ALL the links! :-p16:52
ikeybut yeah i have steam trying to install itself now16:52
ikeyfrom within the solus runtime16:52
ikeyi think jdstrand is right about custom apparmor profiles <in future>16:53
ikeybecause the solus base is gonna be wildly different (lib32s and such)16:53
ikeybut - ignoring confinement for now, the concept is working.16:53
Chipacadiddledan: https://gfycat.com/QuickWaterloggedAmurminnow16:53
popeyawwwwww17:00
popeyif i filmed that my cat would run up and devour the little birdie17:01
diddledantasty17:02
ikeynomnom :p17:06
pedronisChipaca: mvo: do I see it correctly that #4196 supersedes #419517:07
mupPR #4196: daemon: cherry-picked /v2/logs fixes (2.29) <Created by chipaca> <https://github.com/snapcore/snapd/pull/4196>17:07
mupPR #4195: daemon: for /v2/logs, 404 when no services are found (2.29) <Created by mvo5> <https://github.com/snapcore/snapd/pull/4195>17:07
ikeyso how do you guys make the magical /var/lib/snapd/lib/gl thingy work?17:08
ikeyif anyone knows the innards on it17:08
* ikey is curious if the fact libGL already exists in the root is the issue17:08
ikeywait maybe thats it17:08
ikeyits in the place its meant to be!17:09
ikey*duh*17:09
ikey(if i had brains id be dangerous.)17:10
* zyga-ubuntu does one more try17:11
zyga-ubuntu(proably won't work but due to typos or others, let's see)17:11
zyga-ubuntumvo: mount based solution17:11
zyga-ubuntumvo: not as crazy17:12
zyga-ubuntumvo: as in mount unit based17:12
* ikey is suddenly more fond of mad environmental variables and sillystring17:13
zyga-ubuntuikey: what happened?17:13
ikeyzyga-ubuntu, well i figured i can *abuse* the linker17:13
ikeyits looking for /usr/lib/libGL* and finds them17:13
ikeyso why not nuke them17:14
ikeyand abuse LD_LIBRARY_PATH to *force* it to lookup even for mesa17:14
ikeyand i think thats more similar to what your snaps do already actually..17:14
ikeymesa/mesa-default17:14
diddledanikey: abuse is never the right solution. Please seek counciling for your abbarant behaviour :-p17:15
ikeyxD17:15
ikey7fd36217d000-7fd36218e000 r-xp 00000000 103:03 8133128                   /var/lib/snapd/hostfs/usr/lib64/glx-provider/nvidia/libEGL.so.384.9817:15
ikeyomg17:15
ikey:317:15
ikeyits using the nvidias17:16
diddledanoops17:16
ikeyno thats good17:16
ikeyim on nvidia17:16
ikeybefore it was stuck on mesa drivers17:16
zyga-ubuntuAEVA - anonymous environment variable abusers17:16
ikeyXD17:17
diddledansounds like a political movement17:17
ikeyomg so close17:17
ikeyi need to teach snapd about 32-bit drivers17:18
ikeyhttps://ibin.co/3gijqdorLIW2.png17:19
ikey^_^17:19
zyga-ubuntu mmm17:22
zyga-ubuntujust install those them drivers17:22
ikeyi have them host side17:22
ikeyi need to teach snapd to expose them17:22
ikeyneeds 32-bit *and* 64-bit exposed17:23
zyga-ubuntuthem verygenuinedriversforeverything.ru/themdrivers.exe17:23
* zyga-ubuntu is in funky mode17:23
ikeylol17:23
zyga-ubuntu.txt.exe (or something)17:23
diddledanthat url doesn't work17:23
diddledan(yes I clicked it :-p)17:23
mupPR snapd#4197 opened: cmd/snap-confine: Support bash as base runtime entry <Created by ikeydoherty> <https://github.com/snapcore/snapd/pull/4197>17:23
ikeyah crap we'd need a secondary directory17:24
ikeymaybe /var/lib/snapd/lib/gl/32 ?17:24
zyga-ubuntuwhy for snap-confine?17:24
zyga-ubuntuI don't get it17:24
ikey?17:24
ikeymount-support-nvidia.c17:25
zyga-ubuntuhuh17:25
ikeyit only copies 64-bit drivers17:25
zyga-ubuntuI mean17:25
zyga-ubuntuwhy did you change the apparmor profile for snap-confine17:25
zyga-ubuntuit doesn't run bash, does it?17:25
ikeyit does if you run --shell17:25
ikeyand both of my entry points are bash based17:25
ikeywe don't use dash in solus17:26
ikeyso our /bin/sh == /bin/bash17:26
ikeyand any "system" style calls will also use /bin/sh17:26
zyga-ubuntuno, wait, it doesn't17:27
zyga-ubuntuit runs snap-exec which does that17:27
Chipacahas travis had a breakfast of snails today?17:27
zyga-ubuntuChipaca: travis is on holidays17:27
zyga-ubuntutrying to tell us stuff17:27
ikeywell i had apparmor denials for it yesterday anyway17:27
ikeyand bash was broken17:27
zyga-ubuntuikey: --shell runs under the confinement of the app17:27
zyga-ubuntuikey: were they for snap-confine profile?17:28
zyga-ubuntuikey: ah, maybe it is (jdstrand: maybe) snappy-app-dev17:28
ikeyi cant remember this was yesterday, but without that patch stuff wouldn't work17:28
zyga-ubuntuwhich is written in shell17:28
zyga-ubuntusadly I think you are right17:28
ikeythis was before i'd even gotten my LSI snap made17:28
zyga-ubuntujdstrand: if I rewrite that into C will you review it?17:28
ikeyjust the core stuff17:28
ikeyi can't see where we create /var/lib/snapd/lib/gl17:29
zyga-ubuntuit's baked into packaging17:30
zyga-ubuntuI need a break17:30
zyga-ubuntuI just have to leave this place17:31
zyga-ubuntu(tests are running)17:35
Chipacamvo: i suspect we both cherry-picked for 2.29 ¯\_(ツ)_/¯17:44
zyga-ubuntuI'll go for a walk now17:47
zyga-ubuntuI'll be back later to see if the tests pass17:47
ChipacaEOD is nigh18:01
Chipacao/18:01
=== alan_g is now known as alan_g|EOD
cachiomvo, hey, is it comming 2.29.3 today?18:05
diddledanI heard 2.29.3 was for Monday, but that might be the stable release rather than candidate or such18:06
mvocachio: it is coming, it a bit slow though, we had one more PR that needs to go in18:13
mvocachio: I'm looking at the status right now18:13
* kalikiana edo'ing as well now18:13
cachiomvo, good, tx18:15
mupPR snapd#4195 closed: daemon: for /v2/logs, 404 when no services are found (2.29) <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4195>18:15
mupPR snapd#4196 closed: daemon: cherry-picked /v2/logs fixes (2.29) <Created by chipaca> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4196>18:16
mvocachio: 2.29.3 is now uploaded to the image ppa, build there is running so should be build in ~10min and then I trigger a core snap build18:22
mvocachio: so total turnaround hopefully ~1h and we have a new beta18:22
cachiomvo, nice18:22
cachiomvo, tx18:23
pedronisniemeyer: btw, I don't know if you noticed among all the things but there are 2 or 3 open PRs that have you specifically requested as reviewer18:57
mvocachio: i386/amd64 ready in beta19:07
cachiomvo, nice, starting now :)19:08
diddledanthat was quick19:16
mvocachio: armhf ready now too19:16
mupPR snapd#4198 opened: release: 2.29.3 <Created by mvo5> <https://github.com/snapcore/snapd/pull/4198>19:19
* elopio <- lunch + nap. I'll be back in 2 hours.19:22
mvocachio: and arm64 as well, go wild!19:24
cachiomvo, great, thanks, I'll have results by tomorrow19:24
mvocachio: could you also please notify CE about this so that they can run their tests? iirc the automatic tests are run by a US timezone team, right?19:25
cachiomvo, sure, doing that19:25
mvocachio: so with a bit of luck we might get results tonight19:25
mvocachio: thank you!19:25
mvocachio: eh, I mean results today(ish)19:25
cachiomvo, yes, in few hours I'll see the first set of results19:25
cachioand complete the suites during the night19:26
cachiomvo, tomorrow morning you should see 80% of the results updated19:26
Pharaoh_Atemmvo: you didn't merge the spec changes into 2.29.3?19:27
Pharaoh_Atemmvo: :'(19:28
Pharaoh_AtemI had it ready this morning so that you could do it19:28
Pharaoh_Atemit's even got the green checkmarks :/19:28
mvocachio: thanks19:29
mvoPharaoh_Atem: so sorry! I can do a special .4 just for you with this in19:29
mvoPharaoh_Atem: there was a bit of turmoil because of two other last minute PRs, apologies again19:30
Pharaoh_Atemmvo: please do, thanks19:31
Pharaoh_AtemI'd like to get everything properly in sync19:31
mupPR snapd#4193 closed: packaging/fedora: Merge changes from Fedora Dist-Git <Created by Conan-Kudo> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4193>19:31
Pharaoh_Atemespecially since there were build changes this time around19:31
mvoPharaoh_Atem: its in the release/2.29 branch now, I will do the formal GH release in my morning that includes your updates19:33
Pharaoh_Atemexcellent19:33
Pharaoh_Atembut 2.29.4 was tagged now?19:33
Pharaoh_AtemI just need the regular tag for Fedora builds ;)19:33
mupPR snapd#4194 closed: daemon: for /v2/logs, 404 when no services are found <Created by chipaca> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4194>19:33
Pharaoh_Atemthe special tarballs are needed only for my prototype EL7 builds19:34
mvoPharaoh_Atem: oh, I can give you 2.29.3.1 as a tag19:35
Pharaoh_Atemthat works too19:35
Pharaoh_AtemI just need a release to work from19:35
Pharaoh_Atemthough I suppose I can work from 2.29.3 as-is19:36
Pharaoh_AtemI just wanted to make sure that it was in the branch and in master19:36
mvoPharaoh_Atem: ok, its there now19:36
Pharaoh_Atemexcellent19:36
mvoPharaoh_Atem: gtg, but I will read scrollback19:36
* mvo waves19:36
Pharaoh_Atembye19:37
=== JanC_ is now known as JanC
=== ParkerR_ is now known as ParkerR
=== JoshStrobl is now known as JoshStrobl|zzz
mupPR snapcraft#1722 opened: unit tests: reset log level after test <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/1722>21:08
* zyga-ubuntu fights the mount issue a little more21:09
sergiusenssnappy-m-o autopkgtest 1657 xenial:amd6421:17
snappy-m-osergiusens: I've just triggered your test.21:17
sergiusenselopio mind addressing the comment in snapcraft#1633 ?21:19
mupPR snapcraft#1633:  recording: record information from the image in container builds  <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1633>21:19
sergiusensat least the one about the use of `format` in the unit test?21:19
mariogripjdstrand: ping21:28
jdstrandmariogrip: hey21:38
elopiosergiusens on it21:41
mariogriphow do i make a file executable with snapcraft, now the the apps command does not seem to get +x21:42
mariogripusing the plugin sump21:43
mariogripdump*21:43
sergiusenskyrofa were you manually running snapcraft#1717 ?21:43
mupPR snapcraft#1717: catkin plugin: check for pip packages in part only <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/1717>21:43
sergiusensadt for it that is21:44
kyrofasergiusens, wanted to, ran into breakage :D21:44
kyrofasergiusens, fixed in snapcraft#1722 which is running now21:44
mupPR snapcraft#1722: unit tests: reset log level after test <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/1722>21:44
sergiusensmariogrip is the tar not tarred up correctly? You can tell it too with the `install` script in the part21:44
jdstrandmariogrip: I'm not a snapcraft expert, which is why I mentioned you come here (so others could help). the dump plugin should keep the exec bit set. I've certainly used it21:44
sergiusensjdstrand unless it isn't exec at all in the first place21:45
sergiusensor a strange umask is in place21:45
mariogripIt is +x in the zip file21:45
elopiosergiusens: didn't we agree on squashing our own pull requests? I like more the squash and merge button, but I thought I was following the new rules.21:45
sergiusenskyrofa are you running them merged together locally?21:46
kyrofasergiusens, no, heck I'm just making sure master passes at this point21:46
kyrofasergiusens, it doesn't, I already see more errors21:46
sergiusenselopio at one point, but then over a month ago we said we wouldn't do that anymore as there was little point as the hash was rewritten anyways21:46
kyrofasergiusens, elopio is there a reason our tests keep going even though we know they're errored out?21:47
sergiusenskyrofa maybe a PEBKAC ?21:47
kyrofaShould we fail fast?21:47
kyrofasergiusens, never!21:47
sergiusenskyrofa we want all the errors, to fix them all (we assume tests are independent for this to work)21:47
sergiusenskyrofa what errors do you see now?21:48
kyrofasergiusens, no idea, just ERROR and I assume I'll see a summary at the end21:48
kyrofasergiusens, I know if I cancel I won't see them21:49
kyrofaWhich seems like a waste of time21:49
mariogripok if i extract it first to a folder and told snapcraft to use that it worked (without modifying any chmod's)21:50
kyrofasergiusens, errors look like build-snap related, I wonder if it's a squashfuse issue21:50
sergiusenskyrofa how long do they tak locally?21:50
kyrofasergiusens, unknown, I haven't had a success yet21:51
sergiusensmariogrip are you up for a bug fixing opportunity ? :-)21:51
sergiusenskyrofa you can tell the system to error out quickly before running21:51
kyrofaYeah I'm changing it now21:51
sergiusenselopio also snapcraft#1530 ... given the use of ros more aggressively now, we could take advantage of the caching as kyrofa mentions, but let's limit it to the ros class21:53
mupPR snapcraft#1530: tests: share the cache dir in the integration suite <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1530>21:53
kyrofasergiusens, worried about side-effects?21:53
kyrofaSeems like a sensible first step21:53
mariogripjdstrand: think i found my adb problem, no cluse what has changed, but now i get symbol __mmap error, also since we haven't updated the snap in a while, not sure what has changed to make this error21:53
sergiusenskyrofa worried about doing it for no benefits and then yes, missing out on catching a bug just because we were lazy to think about what we are trying to solve :-)21:54
kyrofaMakes sense21:54
mariogripsergiusens: sure21:54
kyrofaSo maybe a "SaveCacheTest" base class of some sort21:54
sergiusenskyrofa it should be a mixin if that is the case, but it also doesn't need to much thinking, just applied to the test class defined for ROS and done21:55
sergiusensI will be back later tonight and save my phone from tethering for a bit (isp blackout for the past 6 hours)21:55
kyrofaWell there isn't a common base class for ROS right now, so something will need to be written one way or another. But yeah21:55
elopiokyrofa: I feel that we wait a long time for the runners to be assigned, so running as much as possible when we have it sounded good. But that has obvious down sides, I wouldn't mind trying failfast.21:56
mariogripjdstrand: I can try switching to a the adb version that comes with ubuntu (right now we use never directly from google)21:56
kyrofaelopio, I think that's probably the right call for the real deal. It's a pain running locally, but adding -f everywhere isn't hard21:57
kyrofaMaybe we can bake a nicer solution in the script, but nothing to worry about now21:57
jdstrandmariogrip: huh, interesting. maybe that is the difference between devmode (which would use libc, etc from the core snap) and classic which would use whatever is on your system22:02
mariogripbase snap is xenial right?22:03
jdstrandmariogrip: if it helps, the core snap is built from 16.04, so if you are building/etc, build on 16.04 so everything matches up22:03
mariogripyeah, using xenial and classic works there22:04
jdstrandfyi, we still are using the core snap as the implied base snap. that will soon change (just clarifying our different terminology)22:04
jdstrandmariogrip: could be a missing stage package. note, I'm kinda guessing here-- sergiusens, kyrofa, et al will be able to help more if you get stuck getting it to work in devmode22:05
jdstrandmariogrip: once we get to tryingto get it to work in strict mode, I will be able to help more :)22:06
mariogriptried with this (older adb version) that seems to work https://github.com/ubports/android-tools22:06
ikeywhat would you guys say to supporting /var/lib/snapd/lib/gl/32 for biarch nvidia driver support?22:07
jdstrandmariogrip: I'm going to eod, but feel free to post questions here or in the forum (we all read backscroll and forum posts)22:11
mariogripjdstrand: Ok, Thanks for you help :)22:11
jdstrandmariogrip: glad https://github.com/ubports/android-tools works for you, that'll be a good start. good luck! :)22:11
mariogripsergiusens: found a fix for the zip not preserving permission problem, pr coming up22:12
sergiusensmariogrip thanks22:13
* ikey has a local patch for the 32 thing fwiw22:14
sergiusensikey is there a reason not to support it?22:17
ikeyi dont think so22:17
sergiusensgreat :-)22:17
sergiusensmariogrip jdstrand about the missing symbol, smells like building on 17.04 or greater22:18
sergiusensas you suggest jdstrand22:18
sergiusensmariogrip you want to wait for our "building with libraries from the future" task to get completed22:19
mariogripthe binaries are from google, no clue what they are built on22:19
sergiusenswhere building, is not really building but dumping22:19
sergiusensif you build all your deps, it should work22:19
sergiusenswhich is really the only supported way we have for classic until we finish of the daunting task of elf patching ;-)22:20
mariogripcan do that :) but this is an crossplatform application so we wanted to use same adb for all the os22:20
sergiusensmariogrip it would be the same adb once it is in the snap22:21
mariogripfor linux yes22:21
sergiusensmariogrip wait, google has a cross-os build of adb?22:21
mariogripbut i wont get started on even building windows adb22:21
mariogripwell they provide for all the os, but it's the same adb version22:22
sergiusensoh, they certainly provide sources, right?22:22
sergiusensanyways, you can also wait for that other work22:22
sergiusensunless you go strict/devmode, then you do not need to wait22:22
mariogripi guess it's easier to just use the version https://github.com/ubports/android-tools then start importing the android source to get hold of the adb source22:23
sergiusenskyrofa I've been thinking, no need to really run adt; just create a container of a different release to 16.04 and run the snap as we do on travis22:23
sergiusensor are you doing another arch?22:24
kyrofasergiusens, right now I'm just doing xenial:amd64 so I can make sure it actually works, then I can start running other releases. Even if I did the snaps tests, we need adt to pass, right?22:26
mariogripsergiusens: https://github.com/snapcore/snapcraft/pull/172322:39
mupPR snapcraft#1723: Workaround for ZipFile.extractall not preserving permission <Created by mariogrip> <https://github.com/snapcore/snapcraft/pull/1723>22:39
mupPR snapcraft#1723 opened: Workaround for ZipFile.extractall not preserving permission <Created by mariogrip> <https://github.com/snapcore/snapcraft/pull/1723>22:41
elopiokyrofa: so, my patch didn't solve your adt log errors?22:44
kyrofaelopio, wait, which patch?22:44
kyrofaHuh, -f isn't failing fast, either22:44
kyrofaThis definitely has something to do with build-snaps, though22:45
elopiokyrofa: http://paste.ubuntu.com/25920819/22:46
elopiosorry, I misunderstood your next ping as an ack.22:46
kyrofaelopio, wait, what is this? I'm so lost now :P22:47
kyrofaOh, we don't use runtests.sh in adt, nice22:50
elopiokyrofa: we are sooo out of sync :)22:50
kyrofaelopio, no kidding :D22:50
elopiokyrofa: is your test failing because it prints some extra v2/snaps GET ?22:50
kyrofaelopio, no, I fixed that in snapcraft#172222:51
mupPR snapcraft#1722: unit tests: reset log level after test <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/1722>22:51
kyrofaelopio, you fixed it another way, eh? Hahaha22:51
elopiokyrofa: yes, I'm reviewing that PR and not liking your solution.22:51
elopio:)22:51
kyrofaelopio, meanie. Well YOUR solution doesn't make any sense!22:52
kyrofaelopio, why would that only cause issues occasionally?22:52
elopiokyrofa: about that, I'm not sure. There's a nuke option on the fake logger, that maybe is combining with a few other things that are wrong on the way we use the log.22:54
kyrofaHahaha22:54
elopioso, my fix makes the fake snapd server to not print to stdout. All the other fakes print to debug, but it wasn't using the common base class.22:54
elopiomy guess is that sometimes it prints to stdout, and that is collected by the following test.22:54
elopiono wait, it always prints to stdout and that sometimes is collected by the following test.22:55
kyrofaelopio, hmm.... that ALSO sounds like a problem22:56
kyrofaBut a different one22:56
elopiothat's why I was wondering if the patch fixed the problem for you. Because I no longer get those spurious GETs printed, and my adt unit tests are all green.22:57
kyrofaelopio, I didn't even see the patch, I must have missed your ping22:58
elopionow the real problem to me is that most of our tests shouldn't be checking the log. But that will take a long time to fix.22:58
kyrofaYeah22:58
elopioI'm not -1 on your branch. It's just that it's not a reset. If it works, I'm ok landing it. Anyway we'll need to improve that soon.22:59
kyrofaIt's not a reset?22:59
kyrofaHow is it not a reset?22:59
kyrofaIt always sets it to whatever is default at the end of each test22:59
elopiokyrofa: most of our tests never call log.configure. Only the ones that excercise the cli module.23:00
kyrofaelopio, right, the issue seems to be that the logging level sticks around and effects other tests23:00
elopioso for the tests that have nothing to do with that configure, you are calling it at the end of the test, which is weird.23:00
elopiokyrofa: and that about the logging level sticking is what I don't understand. The fixture does this: https://github.com/testing-cabal/fixtures/blob/master/fixtures/_fixtures/logger.py#L5423:01
elopioso, summary, there are many things wrong. I will propose my patch, because I think all the fake servers should do the same. I think that will have the side effect of fixing the issue for you too.23:03
elopioI could +1 your branch if you still like it, because calling log.configure always will not affect anything. Or at least, it's clearly not more wrong than all the wrong things that are happening around :)23:04
kyrofaelopio, yeah fair enough, propose your branch, I'll +1 if it fixes it, and we can close mine23:04
elopiokyrofa: I would also like to see if the nuke option solves the problem, it could be a good safeguard.23:06
kyrofaYeah that's an interesting-sounding option23:06
mupPR snapcraft#1724 opened: tests: use the common base handler on the fake snapd server <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1724>23:14
* ikey is uploading a video..23:34
ikeyhttps://plus.google.com/+Solus-Project/posts/cTzfduUHht823:38
kyrofaAtta boy ikey!23:41
ikey:D23:41
mupPR snapcraft#1725 opened: tests: share the cache in ros tests <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1725>23:56

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!