[04:17] <mup> Bug # changed: 1663615, 1667359, 1681328, 1682550
[04:20] <mup> Bug #1667408 changed: docker container command XXXX could not be invoked <docker> <Snappy:Expired> <https://launchpad.net/bugs/1667408>
[04:25] <Lin-Buo-Ren> https://forum.snapcraft.io/t/how-to-create-a-lxd-container-for-snap-development/4658
[04:25] <Lin-Buo-Ren> RFC
[05:13] <mborzecki> morning
[06:25] <zyga> hey
[06:25]  * zyga will be a little late due to DST change
[06:25] <mborzecki> zyga: hey
[06:29] <zyga> hey ho
[06:29] <zyga> so this week will be, hopefully, more at ease than the last one
[06:30]  * zyga -> breakfast
[07:13] <kalikiana> good morning
[07:14] <pstolowski> morning guys!
[07:16] <kalikiana> o/ pstolowski
[07:23] <zyga> Hey hey
[07:40] <mup> PR snapd#4929 opened: cmd/snap-confine: apparmor: allow creating prefix path for gl/vulkan <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4929>
[07:40] <zyga> Looking
[07:42] <mborzecki-ubuntu> there's probably a nicer way to write this rule, would appreciate suggestions
[07:46] <zyga> Not in a major way
[07:46] <zyga> It is fine
[07:47] <mborzecki-ubuntu> oh, ok ;)
[07:47] <mborzecki-ubuntu> zyga: can you take a look at https://github.com/snapcore/snapd/pull/4908 too?
[07:47] <mup> PR #4908: [RFC] cmd/snap-confine: attempt to detect if multiarch host uses arch triplets <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4908>
[07:49] <mborzecki-ubuntu> zyga: a thought i had during the weekend, maybe we should dump all the figuring out of nvidia dirs from snap-confine and do it in snap command instead, only pass the paths we detected in some predefined environment variables
[07:49] <zyga> Yes, that is the goal
[07:50] <zyga> I think we have all the means now
[07:50] <mborzecki-ubuntu> something SC_NVIDIA_LIB=/usr/lib/..., SC_NVIDIA_METHOD=symlink, or SC_NVIDA_LIB=/usr/lib/nvidia-340xx, SC_NVIDIA_METHOD=bind, simiarly for 32bit variants
[07:50] <zyga> No no
[07:50] <zyga> Just use the mount profile
[07:51] <zyga> No need for more variables
[07:51] <mborzecki-ubuntu> .fstab files?
[07:52] <zyga> Yes they have all the bits needed now
[07:52] <zyga> I wanted to do this for quite some time now
[07:56] <zyga> Move the existing system over
[07:56] <zyga> Let snapd handle this
[07:56] <zyga> Rip the c code out
[07:58] <zyga> Nvidia mode gets added to system key
[07:58] <zyga> Later on it just becomes nvidia snap
[07:59] <mborzecki-ubuntu> zyga: yes, this will work
[08:00] <mborzecki-ubuntu> meanwhile, 4908 fixes nvidia not working at all with 18.04 :/
[08:03] <mborzecki-ubuntu> running new gnome, they seem to half-respect LC_DATE, it currently shows 'poniedziałek, 26 March 2018'
[08:04] <zyga> mborzecki-ubuntu: oh? maybe it's IPC'd over from gnome-something-something
[08:04] <zyga> mborzecki-ubuntu: looking at 4908 now
[08:04]  * zyga got back from a walk
[08:07] <zyga> how did the failure look like?
[08:08] <mborzecki-ubuntu> zyga: which failure?
[08:09] <zyga> the 4908 fix for nvidia on ubuntu
[08:10] <mborzecki-ubuntu> zyga: well, no 3d with nvidia on 18.04
[08:10] <mborzecki-ubuntu> zyga: some details https://forum.snapcraft.io/t/nvidia-gl-libs-access-broken-on-ubuntu-18-04/4440
[08:10] <zyga> let me read that
[08:11] <zyga> so I'm puzzled, you said that your triplet branch made it work on 18.04
[08:11] <zyga> or was that still on arch?
[08:12] <mborzecki-ubuntu> zyga: arch fixes are already merged
[08:12] <zyga> and what happens on ubuntu with that multi-arch branch?
[08:12] <mborzecki-ubuntu> zyga: triplet is for ubuntu, but uses the same thing as is used on arch
[08:13] <zyga> does it crash, does it just not do anything?
[08:13] <mborzecki-ubuntu> zyga: without the branch there's no 3d, eg. ohmygiraffe hangs, glxinfo shows swrast
[08:13] <zyga> right
[08:14] <zyga> that's expected now that 18.04 uses libglvnd
[08:14] <mborzecki-ubuntu> zyga: with the branch, if nvidia libs are in /usr/lib/<arch-tiplet>, they'll get symlinked, otherwise /usr/lib/nvidia-xxx is bind mounted (if it exists)
[08:14] <zyga> right
[08:14] <zyga> and what happens on 18.04? we get the symlinks, right?
[08:14] <mborzecki-ubuntu> zyga: yes
[08:15] <zyga> and?
[08:15] <mborzecki-ubuntu> zyga: and it works
[08:18] <zyga> oh
[08:19] <zyga> I must be sleepy then, I misunderstood you
[08:19] <mborzecki-ubuntu> zyga: heh, no worries, I might be sleepy too and talking garbage :P
[08:22] <pedronis> hi,  a 2nd review of #4928  would be appreciated  (should solve at least of most tests/main/layout failures)
[08:22] <mup> PR #4928: tests: disentangle etc vs extrausers in core tests <Critical> <Squash-merge> <Created by pedronis> <https://github.com/snapcore/snapd/pull/4928>
[08:23] <mwhudson> good morning
[08:23] <zyga> hey mwhudson
[08:24] <zyga> pedronis: yes, thank you for pointing that out, pstolowski, mborzecki-ubuntu can you please look at 4928
[08:25] <pedronis> mborzecki-ubuntu: did you see this https://forum.snapcraft.io/t/refresh-scheduling-on-specific-days-of-the-month/1239/22
[08:25] <pstolowski> looking
[08:26] <mborzecki-ubuntu> pedronis: yes, that's the 5minute ensure interval playing tricks, i recall asking about that back when i was double checking that it works, but the behavior (and the code) looked so specific that i did not view it as a bug
[08:27] <pedronis> well, it's an easy fix
[08:28] <mborzecki-ubuntu> zyga: hm pretty much any pr to master touchich apparmor profiles has a problem with temp profile files left behind
[08:29] <pedronis> mborzecki-ubuntu: I can prepare a PR if you are busy with nvidia debugging
[08:29] <mborzecki-ubuntu> pedronis: that'd be great if that's not a big problem for you :)
[08:29] <zyga> mborzecki-ubuntu: can you reproduce that with -debug?
[08:30] <zyga> something must have changed to cause this
[08:32] <mborzecki-ubuntu> zyga: i have 3 prs for master, 4875, 4908, 4929, each touching apparmor profile and all fail tests/main/snap-confine, i was able to get a debug shell in 4875 using the same -seed, but i was only able to confirm there were temp files in /etc/apparmor.d and those files were not in snapd state snapshot
[08:32] <zyga> interesting
[08:32] <zyga> perhaps the key to trigger it is to change the apparmor profile
[08:32] <zyga> that would trigger the code that updates it
[08:34] <mborzecki-ubuntu> pedronis: btw. that's just calling EnsureBefore() at the right place?
[08:34] <pedronis> yes
[08:34] <pedronis> the most annoying bit is writing the unit test
[08:34] <pedronis> anyway I started already
[08:35] <mborzecki-ubuntu> pedronis: great, thank you!
[08:45] <mup> Bug #1758849 opened: Snap not able to enable ssh after core upgrade  <Snappy:New> <https://launchpad.net/bugs/1758849>
[08:50]  * zyga tests the community update to the opensuse package
[09:05] <mborzecki-ubuntu> `VK_ICD_FILENAMES=/var/lib/snapd/lib/vulkan/icd.d/nvidia_icd.json` snap run  graphics-debug-tools-bboozzoo.vulkaninfo makes it find nvidia icd now
[09:09] <mup> PR snapd#4930 opened: skip test that requires internet when not present <Created by rkitover> <https://github.com/snapcore/snapd/pull/4930>
[09:16] <mup> PR snapd#4931 opened: configcore: give a chance to immediately recompute the next refresh time when schedules are set <Created by pedronis> <https://github.com/snapcore/snapd/pull/4931>
[09:17] <pedronis> mborzecki: ^
[09:18] <pedronis> we probably need to revisit  validateRefreshSchedule  , it has grown convoluted
[09:18] <pedronis> pstolowski: still looking at 4928, any questions?
[09:29] <pstolowski> pedronis: yes, i've a qustion
[09:29] <pstolowski> pedronis: just got sidetracked.. give me a sec
[09:33] <pstolowski> pedronis: commented
[09:34] <jamesh> zyga: hi.  Now that jdstrand seems mostly happy with the "secure bind mount" implementation, what's next as far as integrating it?
[09:35] <pedronis> pstolowski: yes, the tail/head usage is preexisting, we could use grep  (at least for root and test), the issue is that afaict the user called ubuntu, is not called like that, it depens on the cloud
[09:36] <pedronis> so it's a win some/lose some kind of situation
[09:37] <pedronis> pstolowski: I suppose we can use a mixed approach, grep for root,  and sanity check for test  (but copy the two users, the "cloud" one as well)
[09:38] <pedronis> pstolowski: seems like a follow material though
[09:38] <pedronis> *follow up
[09:38] <pstolowski> pedronis: yes, 'test' user would be worth checking for
[09:38] <pstolowski> pedronis: ok
[09:39] <pedronis> I'll do a 2nd PR this afternoon
[09:41] <pedronis> I'm squash merging it, because we probably want it in 2.32 if we have more development to do there, or if we get in trouble for this problem with the validations
[09:42] <pedronis> pstolowski: thank you for the review
[09:42] <mup> PR snapd#4928 closed: tests: disentangle etc vs extrausers in core tests <Critical> <Squash-merge> <Created by pedronis> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/4928>
[09:43] <mborzecki> pedronis: just to be sure, each EnsureBefore(0) causes one iteration of this loop https://github.com/snapcore/snapd/blob/master/overlord/overlord.go#L257 right?
[09:44] <pedronis> mborzecki: not each,  if you call EnsureBefore(0) many times before the loop has a chance to run, they coalesce to one request
[09:44] <pedronis> that's why it's time based
[10:00] <flexiondotorg> zyga mvo Morning
[10:00] <zyga> hey flexiondotorg
[10:00] <zyga> mvo is off this week
[10:00] <flexiondotorg> Last week before I left for the US I mentioned that snapd 2.32 caused some serious regressions on 18.04.
[10:01] <flexiondotorg> Is there a new release to resolve that?
[10:01] <flexiondotorg> I'm still experiencing problems.
[10:02] <flexiondotorg> niemeyer: ^
[10:02] <mborzecki> pedronis: i'm a bit slow today, where are the calls coalesced into one? iirc calling time.Timer.Reset(0) makes it expire immediately, so if the call is made from a handled in one of the .Ensure() calls in overlord/.. the loop will wait (from what i saw those are run in the same goroutine), but if a call like this was made from daemon api, then the loop could turn (different gouroutines), or am i missing
[10:02] <mborzecki> something?
[10:03] <mborzecki> zyga: hm got these 2 files: etc/apparmor.d/snap.core.4321.usr.lib.snapd.snap-confine  /etc/apparmor.d/snap.core.4321.usr.lib.snapd.snap-confine.pXJnJ6rsK7wX
[10:07] <zyga> mborzecki: do you have a debug session?
[10:07] <mborzecki> zyga: jest
[10:07] <mborzecki> zyga: notice this:
[10:07] <zyga> can you stat both of the files
[10:07] <mborzecki> -rw-r--r-- 1 root root 21297 Mar 26 09:33 /etc/apparmor.d/snap.core.4321.usr.lib.snapd.snap-confine
[10:07] <zyga> and diff them
[10:07] <mborzecki> -rw-r--r-- 1 root root 21297 Mar 26 09:26 /etc/apparmor.d/snap.core.4321.usr.lib.snapd.snap-confine.pXJnJ6rsK7wX
[10:08] <zyga> so the garbage one is slightly older
[10:08] <mborzecki> this host executed tests/main/snap-seccomp around 9:26
[10:08] <zyga> I wonder if we don't do some error checking
[10:09] <zyga> aha
[10:09] <mborzecki> (have this special patch to spread that logs machine names running each test)
[10:10] <zyga> there is nothing in that test that looks like it would touch snap-confine
[10:10] <zyga> and we only make that file when snapd starts up
[10:11] <zyga> actually, and when it installs new core snap
[10:11] <mborzecki> zyga: hmm 2018-03-26 11:26:12 Executing google:ubuntu-16.04-64:tests/main/snap-seccomp (1/230) (google:ubuntu-16.04-64 (mar261114-742037))...
[10:18] <pedronis> mborzecki: we move reset only if the next is before the current next, but yes usually calls from api.go will provoke many ensures
[10:19] <mborzecki> pedronis: thanks for confirming :)
[10:22] <Caelum> zyga: sorry, for some reason I only got your email now
[10:22] <Caelum> zyga: about opensuse package
[10:22] <zyga> hey!
[10:22] <zyga> haha, I'm running "osc build" now :)
[10:22] <zyga> welcome Caelum :)
[10:23] <Caelum> I fixed the spaces in the PR, I'll update the patch
[10:23] <zyga> thanks, I'll test it and see what is going on there
[10:24] <zyga> we have some packaging in the git tree
[10:24] <zyga> but it's aimed at our CI loop
[10:24] <zyga> it would be great if you could see how to unify the. two
[10:24] <zyga> Caelum: and again, thank you so much for doing this!
[10:24] <Caelum> what was that about the udev rules, just remove those files?
[10:24] <zyga> mmm, which one was that? let me look
[10:24] <Caelum> hey, I was only doing this so I could run spotify :D
[10:26] <zyga> I think we don't need to ship the repair service at all
[10:26] <zyga> it's a feature that is only for core devices (distribution that is using just snaps for everything)
[10:26] <zyga> here we can always update snapd with the regular rpm
[10:26] <zyga> ah, I see -%{_udevrulesdir}/80-snappy-assign.rules
[10:26]  * zyga looks at that file
[10:27] <zyga> so that file we do need
[10:28] <zyga> it's there so that devices that are udev-tagged to a specific snap are actually added to the device cgroup of that snapo
[10:28] <zyga> what made you remove that?
[10:29] <Caelum> I didn't touch that
[10:29] <zyga> looking at https://build.opensuse.org/request/show/590994
[10:29] <zyga> I see -%{_udevrulesdir}/80-snappy-assign.rules
[10:31] <Caelum> oh I must have removed it because the dist didn't install it
[10:31] <zyga> oh, I see
[10:32] <zyga> but we still need it, it's also a little bit more complex as it was renamed recently
[10:32] <zyga> let me see what I get in the built rpm now
[10:34] <Caelum> do you want me to update to 2.32 ? I didn't do that yet because it wasn't listed as a release
[10:34] <zyga> yes, I think we want that as it brings in a lot of fixes and new features
[10:35] <zyga> but
[10:35] <zyga> let's see if we can get 2.31.x out first
[10:35] <zyga> note that we want to do 2.31.2 probably
[10:35] <zyga> as it's a minor bug fix release and should be the same for packaging
[10:35] <Caelum> ah ok, I will update this
[10:39] <flexiondotorg> zyga: Regarding snapd in 18.04.
[10:40] <flexiondotorg> I've just tested core snap from edge and *all* strictly confined desktop snaps fail to execute.
[10:40] <flexiondotorg> `failed to create prefix path: /tmp/snap.rootfs_wo6vzw/var/lib/snapd/lib/vulkan/icd.d: Permission denied`
[10:41] <zyga> mborzecki: ^ is that covered by your recent work?
[10:41] <zyga> or do we need a new PR to update the profiles to match?
[10:41] <mborzecki> zyga: flexiondotorg: #4929 fixes that
[10:41] <mup> PR #4929: cmd/snap-confine: apparmor: allow creating prefix path for gl/vulkan <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4929>
[10:42] <flexiondotorg> mborzecki: Thanks. When is that due to land?
[10:42] <Caelum> zyga: well ran into a snag already, the vendor releases have the go libs bundled, but the github tarball does not
[10:43] <zyga> Caelum: oh, I see, we didn't make a .vendor tarball?
[10:43] <flexiondotorg> OpenGL apps on 18.04 using core from stable either fail to execute or attempt to regression to swrast.
[10:43] <Caelum> I think I had a similar problem and I solved it by creating the /var/lib/snapd/lib directory
[10:43] <zyga> flexiondotorg: opengl is well known and not fixed yet
[10:43] <mborzecki> flexiondotorg: hopefully as sonn as jdstrand gives it a green light (and the build is green)
[10:43] <zyga> Caelum: no, the issue here is much more complex
[10:44] <mborzecki> flexiondotorg: proposal for fixing opengl is in #4908
[10:44] <mup> PR #4908: [RFC] cmd/snap-confine: attempt to detect if multiarch host uses arch triplets <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4908>
[10:44] <zyga> Caelum: I'll try to get that corrected
[10:44] <Caelum> zyga: awesome, because I have no idea how I'd get the go libs otherwise :)
[10:45] <zyga> Caelum: ./get-deps.sh does that
[10:45] <zyga> but I think we can get the vendor tarball done
[10:47] <Caelum> is it standard for go to use real tabs? I don't know much about go yet
[10:51] <zyga> Caelum: I think this is what the default "go fmt" formatting does
[10:52] <Caelum> ah
[11:03] <Caelum> zyga: also you said in the original email, which I only got now for some reason, to remove snap.mount and snap-repair units, should I do that?
[11:07] <zyga> yes
[11:15] <mup> PR snapd#4932 opened: RFC: Content-interface: add rule so slot can access shared directory using plug's namespace <Created by gerboland> <https://github.com/snapcore/snapd/pull/4932>
[11:15] <greyback> zyga: jdstrand: when you have a moment, I'd appreciate your opinions on this: https://github.com/snapcore/snapd/pull/4932
[11:15] <mup> PR #4932: RFC: Content-interface: add rule so slot can access shared directory using plug's namespace <Created by gerboland> <https://github.com/snapcore/snapd/pull/4932>
[11:16] <zyga> greyback: ack, I'll read this and get back to you
[11:16] <greyback> thank you
[11:18] <zyga> Caelum: so, I know how to make the vendor tarball now, I will make one for 2.31.2 now
[11:18] <zyga> Caelum: and then we can look at 2.32.1 later today
[11:18] <zyga> 2.32 has a small known issue that we must address first
[11:20] <zyga> Caelum: I will let you know when it is available and I will test your package and approve it in the end
[11:20] <zyga> Caelum: perhaps with small tweaks if needed
[11:27] <Caelum> zyga: awesome thank you!
[11:39] <mup> PR snapd#4933 opened: tests: copy or sanity check core users using usernames <Created by pedronis> <https://github.com/snapcore/snapd/pull/4933>
[11:40] <pedronis> pstolowski: ^
[11:43]  * cachio afk
[11:55] <pstolowski> pedronis: thanks
[11:57] <pstolowski> +1
[12:04]  * zyga curses at backspace-goes-back-in-history in firefox
[12:04] <zyga> and erases *all* form input
[12:10] <mup> PR snapd#4933 closed: tests: copy or sanity check core users using usernames <Created by pedronis> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/4933>
[12:18] <zyga> pedronis: hey
[12:18] <zyga> pedronis: mborzecki figured out why we have the garbage filenames in snap-confine profile
[12:19] <zyga> pedronis: I think you will need to review that change, it's not big by any standards but it's curious
[12:20] <mborzecki> so far it's looking good, i'll start another spread run and open a PR
[12:22] <zyga> mborzecki: then we need to rebase/merge the vulcan PR so that it passes
[12:24] <pedronis> ok,  given that the standup has moved, I will have walk now but can review after the standup
[12:24] <zyga> pedronis: sounds good, thank you
[12:26] <mup> PR snapd#4934 opened: cmd/snapd: make sure signal handlers are established during early daemon startup <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4934>
[12:26] <mborzecki> pedronis: ^^
[12:28] <greyback> zyga: go to "about:config", search for backspace, and change to 2. Disable backspace=back in FF
[12:29] <zyga> greyback: +1 on your PR
[12:29] <zyga> I added it to 2.32
[12:29] <zyga> we will do a 2.32.x release soon
[12:30] <greyback> zyga: cool thanks
[12:30]  * greyback waves https://github.com/snapcore/snapd/pull/4545 seductively
[12:30] <mup> PR #4545: interfaces/x11: allow X11 slot implementations <Created by gerboland> <https://github.com/snapcore/snapd/pull/4545>
[12:32] <zyga> greyback: for 2.33 I'm afraid
[12:32] <greyback> zyga: fair enough
[12:34] <zyga> greyback: can you check if I answered all the open questions that are addressed at me
[12:36] <greyback> zyga: you did, thanks
[12:44] <zyga> thank you jdstrand
[12:44] <mborzecki> jdstrand: thanks
[12:45] <jdstrand> np
[12:45] <mborzecki> zyga: #4939 first, once merged rebase #4929 on top and we should be good, right?
[12:45] <mup> PR #4929: cmd/snap-confine: apparmor: allow creating prefix path for gl/vulkan <Critical> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4929>
[12:45] <jdstrand> and hi
[12:45] <zyga> yes
[12:45] <mborzecki> i meant #4934
[12:45] <mup> PR #4934: cmd/snapd: make sure signal handlers are established during early daemon startup <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4934>
[12:46]  * kalikiana lunch
[12:46] <jdstrand> mborzecki: I noticed that there was a 'conflicting profile for snap-confine.XXXXXX. I restarted the test, but it seems like there are temporary files still on disk when the test runs...
[12:46] <zyga> jdstrand: the PR mborzecki just mentioned (4934) fixes that
[12:47] <jdstrand> ok cool
[12:47] <zyga> hence the rebase dance
[12:47] <jdstrand> nice
[12:51] <mup> PR snapcraft#2010 closed: Release/2.40+18.04 <do-not-merge-yet> <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/pull/2010>
[12:53] <zyga> pedronis: do you think we should include the fix for //deleted mounts for 2.32.1
[12:53] <zyga> pedronis: it was just test code but could save us some issues in autopkgtest
[13:00] <pedronis> zyga: yes
[13:01] <pedronis> I squashed thinking it might need backporting
[13:01] <zyga> pedronis: thank you
[13:21] <mup> Issue snapcraft#2025 opened: Proper error on held packages <bug> <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/2025>
[13:30] <mup> Issue snapcraft#2026 opened: Implement a passthrough feature <bug> <enhancement> <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/2026>
[13:33] <mup> Issue snapcraft#2027 opened: Properly crawl tree of remote parts <bug> <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/2027>
[13:33] <mup> Issue snapcraft#2028 opened: When asking to release to a branch that's too long, a traceback is printed that gives no hints as to the source of the error <bug> <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/2028>
[13:36] <mup> Issue snapcraft#2029 opened: Proper error for apt hash sum mismatches <bug> <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/2029>
[13:36] <mup> Issue snapcraft#2030 opened: Properly invalidate the cache if sources change <bug> <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/2030>
[13:39] <mup> Issue snapcraft#2031 opened: Inconsistent results when building, cleaning stage and rebuilding <bug> <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/2031>
[13:42] <mup> Issue snapcraft#2032 opened: Can not use NodeJS 8 <bug> <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/2032>
[13:42] <mup> Issue snapcraft#2033 opened: LP: #1752344 <bug> <Created by sergiusens> <https://github.com/snapcore/snapcraft/issue/2033>
[13:48] <zyga> mborzecki: I have a fix for the atomic file thing
[13:48] <mborzecki> zyga: pr?
[13:48] <mup> Issue snapcraft#1682 closed: Refactor grammar to be compatible with Python 2 <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1682>
[13:48] <mup> Issue snapcraft#1683 closed: Make grammar processing available in pypi <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1683>
[13:48] <mup> Issue snapcraft#1684 closed: Vendor grammar logic into snapcraft <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1684>
[13:50] <mup> PR snapd#4935 opened: tests: disentangle etc vs extrausers in core tests (2.32) <Created by pedronis> <https://github.com/snapcore/snapd/pull/4935>
[13:51] <mup> Issue snapcraft#1708 closed: Implement new design for travis CI UX <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1708>
[13:51] <popey> mborzecki: i saw you mention you'd update snapd in arch recently. On my manjaro system I'm only seeing 2.30. Do I need to do some voodoo to get updated?
[13:52] <mborzecki> popey: build snapd from aur https://aur.archlinux.org/packages/snapd
[13:53] <popey> mborzecki: is that the 'recommend' way going forward to get the latest version?
[13:54] <mup> Issue snapcraft#1670 closed: Change file migrations such that files move from stage to prime rather than coming from the part each time <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1670>
[13:57] <mup> Issue snapcraft#1690 closed: Design quilt support <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1690>
[13:57] <mup> Issue snapcraft#1691 closed: Implement quilt design <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1691>
[13:57] <mup> Issue snapcraft#1692 closed: snapcraft quilt tutorial <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1692>
[14:00] <mborzecki> popey: yes, at least on arch
[14:00] <mborzecki> popey: manjaro maintains a set of prebuilt packages from aur, but i have no clue when they get updated
[14:01] <popey> mborzecki: ok, what's the command to install it? Because that's not the way we have documented how to install snapd on arch.. https://docs.snapcraft.io/core/install-arch-linux
[14:01] <popey> ah okay
[14:01] <popey> maybe we need a guide for vanilla arch and one for manjaro?
[14:01] <popey> oh duh, we have one for manjaro
[14:01] <popey> https://docs.snapcraft.io/core/install-manjaro
[14:01] <popey> thanks mborzecki
[14:03] <mborzecki> zyga: so #4934 is timing out...
[14:03] <mup> PR #4934: cmd/snapd: make sure signal handlers are established during early daemon startup <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4934>
[14:07] <zyga> mborzecki: fun
[14:07] <zyga> mborzecki: I need to break for a moment now but I will propose a fix for the atomic issue when I'm back
[14:07] <mborzecki> zyga: yeah, fun fact, passing when i run it from spread directly (using google backend obviously)
[14:25] <mborzecki> zyga: i'll update tests/main/snap-confine to check rules vulkan
[14:25] <mborzecki> vulkan glob rules
[14:26] <zyga> mborzecki: see if we can mock enough of the logic to break
[14:26] <zyga> as in
[14:26] <zyga> mock the environment
[14:26] <zyga> not the logic
[14:26] <mborzecki> zyga: yeah, i'm dumping a canary into /usr/share/vulkan/icd.d/
[14:26] <zyga> it would be cool to install real package with driver deps
[14:26] <zyga> and mock something in sysfs to have snap-confine go the nvidia path
[14:28] <mborzecki> zyga: afaik nvidia libs are the only driver that ships icd files, but our rules pick up any file for that matter
[14:28] <zyga> mborzecki: can we install nvidia libs in a test?
[14:29] <zyga> in case some pattern is off and only real files cause the issue
[14:31] <zyga> Caelum: you can now get the 2.31.2 tarball
[14:40] <mborzecki> zyga: then the code path would be executed only on artful (nvidia-384) and bionic (libnvidia-gl-390)
[14:42] <zyga> mborzecki: it's better than nothing
[14:42] <zyga> niemeyer: can you please look at https://github.com/snapcore/snapd/compare/master...zyga:fix/apparmor-tilde?expand=1
[14:42] <zyga> this is for the ~ in apparmor profiles
[14:42] <zyga> I will write some unit tests but I wanted to get your quick feedback on how this is done
[14:43] <pedronis> zyga: there's a typo  in the fedora spec on 2.32
[14:43] <pedronis> mmh, also the changelog
[14:43] <zyga> ah, in the changelog
[14:43] <mborzecki> pedronis: what typo? 'relevant'?
[14:43] <zyga> I saw that
[14:43] <pedronis> yes
[14:43] <zyga> I thought it was fixed with the 2.32 merge back to master
[14:44] <zyga> but we should fix it in the release branch too
[14:44] <pedronis> zyga: I did  thebackport but is failing
[14:44] <zyga> it will annoy tests
[14:44] <pedronis> on that
[14:44] <pedronis> zyga:   https://github.com/snapcore/snapd/pull/4935 is my backport
[14:44] <mup> PR #4935: tests: disentangle etc vs extrausers in core tests (2.32) <Created by pedronis> <https://github.com/snapcore/snapd/pull/4935>
[14:45] <zyga> pedronis: just rename it in your PR
[14:45] <zyga> (fix the typo)
[14:45] <zyga> I think it's fine to do
[14:45] <niemeyer> zyga: What's the current suffix?
[14:46] <zyga> random alphanumeric AFAIR
[14:46] <pedronis> zyga: was there a corresponding PR on master?
[14:46] <zyga> strutil.MakeRandomString(12)
[14:46] <zyga> pedronis: I suspect mvo fixed that in the 2.32 merge but I didn't see a dedicated PR ; it had to be done within the release ->master merge
[14:47] <niemeyer> zyga: Why not just appending the ~ at the end?
[14:47] <zyga> niemeyer: I'm doing that now
[14:47] <pedronis> zyga: that's not even merged yet
[14:47] <zyga> are you saying unconditionally?
[14:47] <zyga> pedronis: ahh, I must have seen wrong
[14:47] <niemeyer> zyga: Yes, the "just" part :)
[14:47] <pedronis> #4927
[14:47] <mup> PR #4927: release 2.32 <Created by mvo5> <https://github.com/snapcore/snapd/pull/4927>
[14:47] <zyga> niemeyer: sure, that works too
[14:47] <zyga> it's a nice thing to do in general
[14:47] <zyga> maybe more tools skip ~
[14:48] <zyga> pedronis: so there's no fixing PR yet, sorry
[14:48] <niemeyer> zyga: Yeah..
[14:49] <pedronis> zyga: I need to have some tea, I will think what to do
[14:49] <zyga> pedronis: thank you
[14:49] <pedronis> we probably want to take care of 4927 as well
[14:49] <zyga> niemeyer: I'll do that, thanks!
[14:50]  * zyga needs to lunch too
[14:51] <niemeyer> np, and lunch is a pretty good idea
[14:57] <mborzecki> zyga: hm vulkan code is gated by nvidia driver check too
[14:58] <mborzecki> let me try the simplest tring, i.e. to load the driver without the card, if that doesn't work well, we could somehow try to mock the path to sys, or try to override it at runtime
[15:01] <mborzecki> modprobe: ERROR: could not insert 'nvidia_384': No such device
[15:03] <mup> PR snapd#4936 opened: packaging: fix changelogs' typo (2.32) <Created by pedronis> <https://github.com/snapcore/snapd/pull/4936>
[15:10] <zyga>  mborzecki you can perhaps mount tmpfs in a place in sysfs and make it appear to be loaded?
[15:46] <zyga> re
[15:46]  * zyga returns to updating the PRs
[15:53] <Caelum> zyga: was passed out on the couch, will update things now, did you want me to pull the udev file from the old dist and add it back in?
[15:53] <zyga> Caelum: yes, please
[15:54] <zyga> Caelum: I will review your update shortly but I have some things to finish
[15:54] <Caelum> ok will do :)
[15:54] <zyga> Caelum: just try 2.31.2
[15:54] <zyga> look at the release page for info
[15:54] <Caelum> wait until I update everything
[15:54] <zyga> we added snapd-generator binary
[15:54] <zyga> thats a new thing
[15:54] <zyga> and it replaces the snap.mount unit
[15:54] <zyga> please package that one, it fixes snapd running inside containers
[15:55] <zyga> other than that it should be fairly similar
[15:55] <Caelum> got it
[16:01] <cachio> mborzecki, hey, could you please tellme what of all this is not needed for the arch images?
[16:01] <cachio> https://github.com/sergiocazzolato/compute-archlinux-image-builder/blob/master/arch-image.py
[16:01] <cachio> mborzecki, they are doing many thinks but I am not sure what's really needed
[16:02] <cachio> mborzecki, I am starting from this image http://mirror.rackspace.com/archlinux/iso/2018.03.01/archlinux-bootstrap-2018.03.01-x86_64.tar.gz
[16:18] <mup> PR snapd#4937 opened: osutil: use tilde suffix for temporary files used for atomic replacement <Created by zyga> <https://github.com/snapcore/snapd/pull/4937>
[16:18] <zyga> niemeyer: ^ that's the simplified version
[16:27] <niemeyer> zyga: Reviewed
[16:32] <zyga> niemeyer: thanks, updated now
[16:34]  * kalikiana heading out for the day
[16:35] <zyga> mborzecki: ^
[16:38] <sergiusens> stgraber nacc: hey, I think I got you covered already, but just in case, want to try out https://forum.snapcraft.io/t/call-for-testing-snapcraft-2-40/4643 ?
[16:39] <sergiusens> diddledan: thanks for the updates to the ref :-)
[16:40] <zyga> mborzecki: I wonder why the signal handler change is causing things to hang though
[16:40] <zyga> mborzecki: did you try it in qemu?
[16:42] <mborzecki> zyga: no, it'd be useful to compare how long each test takes now
[16:44] <zyga> mborzecki: you can run qemu with the qemu gui on
[16:44] <zyga> and then log in and watch/interact
[16:44] <zyga> bionic looks different...
[16:45] <mborzecki> zyga: 'fake' nvidia test https://github.com/bboozzoo/snapd/commit/2c8aa956b3ffe68d98fd446988472db81dbd4c51
[16:46] <zyga> mmm
[16:49] <mborzecki> need to wrap it up for today, my wife is really unamused with me now
[16:49] <zyga> mborzecki: thank you!
[16:50] <zyga> mborzecki: I gave you a quick review
[16:50] <zyga> mborzecki: can you propose that?
[16:50] <mborzecki> pedronis: pushed a patch with buffered channel as you suggested
[16:51] <kaliy> hi there! is there a way of changing the display name for the developer of a snap, other than transferring ownership? I tried adding a 'company' name to my profile, but to no avail
[16:51] <mborzecki> zyga: i'll drop the daemon patch from 4929 and push the test there instead
[16:52] <zyga> thanks
[16:53] <nacc> sergiusens: is it in xenial-updates already?
[16:53] <sergiusens> nacc: xenial-proposed
[16:53] <nacc> sergiusens: ah ok
[16:53] <nacc> i'll check it out
[16:57] <Caelum> the tests take a really long time, would be nice if you could run a smaller subset of important tests
[17:05] <mup> PR snapd#4936 closed: packaging: fix changelogs' typo (2.32) <Created by pedronis> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4936>
[17:05] <mup> PR snapd#4937 closed: osutil: use tilde suffix for temporary files used for atomic replacement <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4937>
[17:05] <thresh> hello.  I'm having different sets of staged packages (almost) every time I run snapcraft prime;  what do I use to debug that?
[17:07] <thresh> the snap does not change, the iamge I build in the snap is the same, too.
[17:07] <thresh> s/the snap/snapcraft.yaml/
[17:09] <zyga> Caelum: unit tests? They should run pretty quickly. What are you getting?
[17:14] <pedronis> zyga: I updated   #4927 to include the typo fix,  #4935 is green
[17:14] <mup> PR #4927: release 2.32 <Created by mvo5> <https://github.com/snapcore/snapd/pull/4927>
[17:14] <mup> PR #4935: tests: disentangle etc vs extrausers in core tests (2.32) <Created by pedronis> <https://github.com/snapcore/snapd/pull/4935>
[17:14] <zyga>  Thank you, looking
[17:16] <zyga> We are only missing one thing now. The fix for apparmor profiles
[17:16] <mup> PR snapd#4935 closed: tests: disentangle etc vs extrausers in core tests (2.32) <Created by pedronis> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4935>
[17:16] <zyga> It should be mergable soon
[17:17] <thresh> maybe there is a ML where I can post so it wont get scrolledback into oblivion?
[17:17] <zyga> thresh: use forum.snapcraft.io please
[17:18] <thresh> fancy :-)
[17:39] <sergiusens> nacc: thanks
[17:39] <Caelum> zyga: the tests take longer for me than the whole build, although I have an old laptop
[17:40] <zyga> I see, I think you will be happy to know our integration tests run for a few hours
[17:41] <Caelum> heh
[18:06] <mup> PR snapd#4938 opened: release-tools: add repack-debian-tarball.sh <Created by zyga> <https://github.com/snapcore/snapd/pull/4938>
[18:16] <zyga> Caelum: I think unit tests are worth keeping
[18:17] <zyga> it's the minimalistic line of defence
[18:21] <Caelum> oh sure, they are definitely worth having, I just meant that you have like a "quick sanity check mode" and "all unit tests" mode
[18:22] <Caelum> zyga: so I'm done with the changes, updated to 2.31.2, re-added udev rule, removed snap-repair units
[18:22] <zyga> excellent
[18:23] <zyga> I will build, review and test it today and tomorrow
[18:23] <zyga> we can release it tomorrow
[18:23] <zyga> try as many snaps as you can
[18:23] <Caelum> sweet
[18:23] <zyga> and see if something breaks
[18:23] <Caelum> yeah I already have mailspring and spotify working nicely
[18:23] <zyga> :-)
[18:23] <zyga> would you like to help me get snapd into opensuse proper?
[18:24] <zyga> into factory and tumbleweed and leap?
[18:25] <Caelum> yes
[18:25] <zyga> woot, fantastic
[18:25] <zyga> are you familiar with the process?
[18:41] <zyga> hey mvo
[18:41] <mvo> hey zyga
[18:41] <zyga> 700/2000 tests
[18:41] <zyga> I reverted a spread test for nvidia that isn't ready
[18:41] <mvo> zyga: neat
[18:41] <zyga> sorry :/
[18:41] <mvo> zyga: what pr is it?
[18:41] <zyga> https://github.com/snapcore/snapd/pull/4929
[18:41] <mup> PR #4929: cmd/snap-confine: apparmor: allow creating prefix path for gl/vulkan <Critical> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4929>
[18:42] <zyga> mvo: I updated 2.31.2 release page https://github.com/snapcore/snapd/releases/tag/2.31.2
[18:42] <mvo> zyga: great, thank you!
[18:44] <Caelum> zyga: I'm not, this is the first package for oS I've worked on, but from what I can tell from the wiki you just submit the package and it gets reviewed and added, and I know some people in oS who can help me
[18:45] <zyga> Caelum: that's good, I think we can help too
[18:45] <zyga> Caelum: I think we can try to propose 2.32.x once that's ready this week
[18:45] <mup> PR snapd#4927 closed: release 2.32 <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4927>
[18:45] <zyga> mvo: did you see my question here: https://github.com/snapcore/snapd/pull/4927#discussion_r176911637
[18:45] <mup> PR #4927: release 2.32 <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4927>
[18:47] <mvo> zyga: I did not, sorry - too trigger happy :(
[18:48] <mvo> zyga: but that is ok, the exact verison in the postinst needs to be adjusted for each upload anyway. but only once
[18:48] <zyga> no worries, what's the answer?
[18:48] <zyga> oh?
[18:48] <zyga> why only once?
[18:50] <mvo> zyga: we need it to match the exact version of the upload (so e.g. 2.32.1+17.10)
[18:50] <mvo> zyga: after that (when we release 2.32.2) it will be enough to test for "less-than" 2.32.2 I think
[18:50] <mvo> zyga: any news on the nvivia 18.04 work?
[18:52] <zyga> not more than earlier today, maciej needs to add the scoping and the tests for this
[18:52] <zyga> I think it can all happen tomorrow
[18:52] <zyga> I think the last PR looks happy now
[18:52] <zyga> discarding machines
[18:53] <mvo> zyga: yay, no errors?
[18:53] <mvo> zyga: cool, once its merged I will cherry-pick
[18:53] <zyga> yes
[18:53] <zyga> it's green now
[18:53] <zyga> merging
[18:54] <zyga> drat, I didn't squash
[18:54] <zyga> mvo: please take just https://github.com/snapcore/snapd/pull/4929/commits/5f1762b0b8ab52b7e60fcce377e24c5ce025b219
[18:54] <mup> PR #4929: cmd/snap-confine: apparmor: allow creating prefix path for gl/vulkan <Critical> <Created by bboozzoo> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4929>
[18:54] <mup> PR snapd#4929 closed: cmd/snap-confine: apparmor: allow creating prefix path for gl/vulkan <Critical> <Created by bboozzoo> <Merged by zyga> <https://github.com/snapcore/snapd/pull/4929>
[18:54] <zyga> mvo: and f3f77d9ac192e78523c82a15d368dea943ed8841
[18:55] <zyga> and that's the release
[18:55] <mvo> zyga: ok, thanks
[18:55] <mvo> zyga: nothing from beta validation that needs fixing? all green there?
[18:55] <zyga> no, all green there
[18:56] <mvo> zyga: cool
[18:56] <zyga> mvo: you can consider https://github.com/snapcore/snapd/pull/4934 if you want but I'm not pushing for that
[18:56] <mup> PR #4934: cmd/snapd: make sure signal handlers are established during early daemon startup <Squash-merge> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/4934>
[18:56] <mvo> zyga: the "~" pr is a bit of a workaround ;)
[18:56] <zyga> it's 2.32.2 material
[18:56] <zyga> haha, yes
[18:56] <zyga> I read apparmor source code
[18:56] <zyga> anything else is worse
[18:56] <zyga> like .rej
[18:56] <zyga> or .dpkg-new
[18:56] <mvo> zyga: ;)
[18:56] <zyga> or .rpm-something
[18:57] <mvo> zyga: ideally we would figure out why we have the leftovers but I think we are in agreement here :)
[18:57] <mvo> zyga: I looked at the singal PR, it looks harmless, does it fix a real issue?
[18:57] <mvo> zyga: I mean, anything that was reported by users etc?
[18:57] <zyga> oh
[18:57] <zyga> we did
[18:58] <zyga> it is the real issue
[18:58] <zyga> we have logs where we start initializing stuff
[18:58] <zyga> and then get killed with SIGINT
[18:58] <zyga> this and the ~ PRs fix the same issue from two ways
[18:58] <zyga> or sides
[18:58] <zyga> we will only process signal and shutdown after snapd is constructed
[18:58] <zyga> and we will write files that are ignored by apparmor anyway
[18:59] <zyga> this is a test issue but it can affect real systems too
[18:59] <zyga> in tests it's just shutting down snapd being unreliable
[19:00] <zyga> squash it please
[19:00] <mup> PR snapd#4934 closed: cmd/snapd: make sure signal handlers are established during early daemon startup <Squash-merge> <Created by bboozzoo> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4934>
[19:00] <zyga> mvo: if you prepare the debian part I can make the release page look nice again :)
[19:00] <zyga> mvo: I need to take Bit out for a walk
[19:01] <zyga> (Bit is how our dog is called :)
[19:05] <mvo> zyga: sure, I prepare things and we sync up when you are back. cu
[19:11] <mup> PR snapd#4939 opened: release: 2.32.1 <Created by mvo5> <https://github.com/snapcore/snapd/pull/4939>
[19:13] <mvo> zyga: its building in ppa:snappy-dev/image now, once that is done I will trigger beta build etc
[19:15] <zyga>  Super
[19:36] <zyga> mvo: back
[19:39] <mvo> zyga: waiting for publication
[19:41] <zyga> mvo: I'm seeing the same thing
[19:44] <zyga> mvo: we need to be careful in typos in changelog
[19:44] <zyga> they cause test failures
[19:45] <zyga> I think it's fine now,  just saying
[19:46] <zyga> mvo: published
[19:48] <mvo> zyga: yeah, triggered the build
[19:48] <zyga> mvo: so that's it now, just -> beta publishing once it's out
[19:52] <mvo> zyga: yeah
[19:53] <mvo> zyga: and ideally merge the changelog pr so that we have a edge build again :)
[19:53] <zyga>  yeah
[19:53] <zyga> you can merge https://github.com/snapcore/snapd/pull/4938
[19:53] <mup> PR #4938: release-tools: add repack-debian-tarball.sh <Created by zyga> <https://github.com/snapcore/snapd/pull/4938>
[19:57] <mup> PR snapcraft#2023 closed: repo: catch error due to broken build packages <Created by kalikiana> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2023>
[20:00] <mup> Issue snapcraft#2025 closed: Proper error on held packages <bug> <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/2025>
[20:08] <mup> PR snapd#4939 closed: release: 2.32.1 <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/4939>
[20:09] <mvo> zyga: pushed to beta
[20:10] <zyga> great, then that's today
[20:11] <zyga> have a peaceful night :-)
[20:11] <mvo> zyga: thank you, you too! keep me posted if things work or if we need a .2 :)
[20:11]  * mvo waves
[20:12] <mup> PR snapcraft#2034 opened: pluginhandler: organize correcly for targets with leading / <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/2034>
[20:15] <Caelum> zyga: fwiw, this is the page I was following the past few days, and it also describes how to add stuff to Factory (TW) I think we can start with the process of requesting a new devel project or finding an appropriate top-level space right now https://en.opensuse.org/openSUSE:How_to_contribute_to_Factory
[20:33] <mup> PR snapcraft#2035 opened: ci: cache core and lxd to avoid redownloading <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/2035>
[20:37] <zyga> Caelum: I think we have a nice devel project already
[20:37] <zyga> Caelum: system:snappy is a good place
[21:37] <Caelum> zyga: yeah then it's just one osc command to submit to Factory
[21:38] <Caelum> That's the beauty of OpenSUSE
[22:00] <kyrofa> zyga, thought you'd like to know, I'm now a sublime text user
[23:25] <mup> Issue snapcraft#1974 closed: organize with forward slashes should be stripped <bug> <Created by sergiusens> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/issue/1974>
[23:25] <mup> PR snapcraft#2034 closed: pluginhandler: organize correcly for targets with leading / <Created by sergiusens> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/2034>
[23:34] <sergiusens> nacc: hey, did you have an opportunity to look into 2.40? Personally I setup my own buildd for git-ubuntu and ran the self-tests succesfully, not sure what more could be done
[23:35] <nacc> sergiusens: i haven't had a chance yet; if you've run the above, though, that's what i'd do
[23:35] <nacc> so i'm +1 if that passed
[23:35] <nacc> (which is what didn't before :)
[23:35] <sergiusens> nacc: yes, fwiw https://forum.snapcraft.io/t/snapcraft-snap-building-sanity-checks-for-build-snapcraft-io/4632/1
[23:36] <sergiusens> I still need to hook more of it up in some orchestration system, but this will be part of our release testing