/srv/irclogs.ubuntu.com/2018/12/06/#snappy.txt

=== chihchun_afk is now known as chihchun
mborzeckimorning06:06
mborzeckizyga: pushed some fixes to #626407:57
mupPR #6264: spread, tests: add Fedora 29 <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6264>07:57
mborzeckithat was one annoying distro upgrade, hopefully the changes make the whole test suite better07:57
=== pstolowski|afk is now known as pstolowski
pstolowskimornings08:07
zygaHey ho08:13
zygaJust woke up08:14
zygaI’ll be around shortly08:14
mborzeckipstolowski: zyga: hey08:15
zygaHi :-)08:25
zygaFeels like winter08:25
jameshzyga: thanks for the help with that test snap yesterday.  It build successfully, but I'm guessing it got trapped by automated review.  I'm not sure who other than mvo has access to that snap.08:27
zygaI think jdstrand can check the status08:29
zygaI will ping mvo about the snap too just in case he has some time08:29
jameshRunning review-tools manually, it seems to be complaining about the new attribute on the dbus interface, and the fact I used "daemon: dbus" for one of the apps08:31
jameshsomething snapd supports but snapcraft and review-tools don't seem to like08:31
zygaHmmmm08:33
vidal72[m]mborzecki: this may affect snapd in arch: https://git.archlinux.org/svntogit/packages.git/commit/trunk?h=packages/filesystem&id=6fa932aa685da87e78e0f845bd890645607d302e , https://bugs.archlinux.org/task/5849908:33
zygaMaybe that is something for roadmr as well08:33
zygaCan you write a forum post about it please? It will be easier to as for help this way08:34
mborzeckividal72[m]: thanks, i'm subscribed already, they actually changed it to ID=archlinux https://git.archlinux.org/svntogit/packages.git/commit/trunk?h=packages/filesystem&id=6fa932aa685da87e78e0f845bd890645607d302e08:35
mborzeckiwonder if snapd is the only project that checks that at all08:36
vidal72[m]breaking something is the best way to know is someone used it :)08:38
mborzeckiupdated golang got pushed to EPEL stable, hopefully we'll be able to switch centos image to 7.6 tomorrow08:43
zyga:-)08:59
mborzeckihm hm actually switched the image temporarily and was able to build snapd package09:01
mborzeckia unit test failed failed in fedora 29 pr https://paste.ubuntu.com/p/r8WGW9DHNW/ a race of sorts?09:03
pstolowskilooking09:12
pstolowskimborzecki: hmm close to the area of system key computation that was touched recently09:13
pstolowskizyga: ^09:14
pstolowskirunning this test in a loop locally, works fine, i suspect it's because system key is in place (do we miss mocking in the test?)09:27
zygammm09:31
zygalooking09:31
zygafeels unrelated09:31
zygalike missing mocking09:31
zyga"foo failed" was expectef09:31
zygabut logs had something else09:32
mupPR snapd#6232 closed: overlord/snapstate: support for pre-remove hook <â›” Blocked> <Created by stolowski> <Closed by stolowski> <https://github.com/snapcore/snapd/pull/6232>09:34
pstolowskizyga, mborzecki #6268 is green now and needs reviews09:34
mupPR #6268: overlord/ifacestate: helpers for serializing hotplug changes <Hotplug 🔌> <Created by stolowski> <https://github.com/snapcore/snapd/pull/6268>09:34
zygalooking09:34
pstolowskizyga, mborzecki do you have anything that needs a review?09:39
zygaI mainly have https://github.com/snapcore/snapd/pull/619009:40
mupPR #6190: overlord/configstate,features: expose features to snapd tools <â›” Blocked> <Created by zyga> <https://github.com/snapcore/snapd/pull/6190>09:40
mborzeckipstolowski: #626409:40
mupPR #6264: spread, tests: add Fedora 29 <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6264>09:40
pstolowskiok09:40
pstolowskimborzecki: oh wow... that looks like whack-a-mole (not your fault)09:42
mborzeckipstolowski: yeah, loads of fun09:44
zygamborzecki: did you get to the bottom of why those tests with swapped su username passed before?09:57
mborzeckizyga: yes, the project path created by spread is subject to default umask, that has changed in fedora 29, but was 022 before, so the directories along the path got 755, then the snapd source tree is owned by test:test, even though /home/gopath/src/github.com/snapcore/snapd is owned by root:root10:10
pstolowskimborzecki: would it be possible to set umask anywhere in prepare.sh to have sane defaults for all tests (if not already there)?10:10
pstolowski(i suppose it's not that easy, but curious)10:10
mborzeckipstolowski: idk whether spread makes a single huge script of each prepare, prepare-each, execute block, but it'd probably need to be set by spread to be effective10:12
mborzeckimaybe it makes sense to extend spread to support umask: 022 in spread.yaml10:12
pstolowskimborzecki: uhm, right, i see10:12
mborzeckizyga: oh, and some of the tests that i fixed never executed on fedora (because of systems: [..]), or only ran for strict confinement10:13
zygamborzecki: spread uses shell, cat to write files and execute them10:18
zygamborzecki: I spent some time looking at it10:18
mborzeckizyga: hm so spread level thing probably makes most sense10:19
zygamborzecki: I have some patches to use sftp to send files back and forth10:19
zygabut probably unlikely to land them10:19
mborzeckianyways, the fixes are imo useful either way :)10:20
mborzeckidamn, hate travis ui10:26
mborzeckiopen travis job, 'raw log' button appears only once the log was downloaded a chopped into folds by js10:27
zygamaybe we should kill the folds10:29
zygathey are -1 useful10:29
zygatravis is slow like hell anyway10:30
zygaI only ever use the raw log10:30
zygaand often it is too long10:30
zygafolds don't help in the raw log10:30
mupPR snapd#6269 opened: cmd, dirs, interfaces/apparmor: update distro identification to support ID="archlinux" <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6269>10:46
mborzeckizyga: pstolowski: ^^ simple one10:47
zygaI will probably do only reviews in the morning10:47
pstolowskik10:47
zygathanks maciek!10:47
mborzeckiwe'll need to cherry-pick that to 2.3610:48
mborzeckiand in the meantime, i'll ship a patch with the package10:48
zygamborzecki: commented inline but +110:49
mborzeckithx10:49
zygaI think we should do 2.37 next week10:49
zygabackporting sucks10:50
mborzeckizyga: btw. i think there was a subtle bug in the code you pointed10:56
zygaoh? where?10:56
mborzeckidefers are executed LIFO, so the defer dirs.SetRootDir() would execute before restore of mocking os release10:57
zygammm10:58
pstolowskimborzecki: there is one more defer setrootdir in this test11:03
pstolowski(in the old code)11:04
Xceedis there a way to do the following with getting a validation error...11:18
Xceedtext=$(cat <<EOF11:18
Xceedbranch = master11:18
XceedEOF11:18
Xceed)11:18
Xceedwithin override-prime:11:18
Xceedas a scriptlet11:18
Xceeds/with/without11:18
* zyga is not well11:26
pstolowskiXceed: you may want to ask on the forum where more snapcrafters can help11:27
zygamborzecki, pstolowski: it's funny how we use go11:36
zygabut our task/change system is really a bunch of python-like key=value store11:36
zygapstolowski: sorry for the lag, I feel really so-so11:38
zygareviewed11:38
pstolowskitrue. i think that's common for task-based solutions like ours.. i saw that in other projects11:38
pstolowskiyou end up with flexible datatypes, such as variant to stuff metadata on tasks11:38
pstolowskizyga: no worries, get some rest11:39
zygaI'm happy to do more reviews11:39
zygaanyone?11:40
Xceedi used separate lines of echos instead, crude, but it works and ive spent too much time on this11:41
zygaxnox: is the problem with yaml?11:41
zygaer11:41
zygaXceed: ^11:41
zyga(sorry xnox, bad tab completion again)11:41
pstolowskizyga: https://github.com/snapcore/snapd/pull/6114 is the closes hotplug PR to land, but i think we want mvo's review anyway11:42
mupPR #6114: overlord/ifacestate: handler for hotplug-disconnect task <Hotplug 🔌> <Created by stolowski> <https://github.com/snapcore/snapd/pull/6114>11:42
Xceedyes, i copied pasted a multiline cat file <<EOF type that works in the script to the yaml and it failed11:42
pstolowskizyga: otherwise nothing immediate from me, thanks for the review of hotplug seq11:42
zygaXceed: can you show me the yaml please?11:42
Xceedi did, see above11:42
zygaI mean a larger fragment11:43
zygathat shows the key-value in yaml11:43
zygaunless I missed that, sorry11:43
zygamy daughter has cold and is sick this week, I guess I'm becoming affected11:44
zygamborzecki: do you feel we could review and land the snapd.mk branch?11:47
Xceedzyga, https://vgy.me/OT7tii.png11:48
zygaaba11:48
zygathat's not valid yaml11:48
zyganot the way you expect at least11:48
zygaparse that with any yaml parser to see what the structure is11:48
zygaindent lines 69-7111:49
zygato be flush with the indent of cat11:49
mborzeckiXceed: indent to match `cat`11:49
zygaand re-parse11:49
zygayep11:49
Xceedits a scriptlet, i expect all inside EOT to be taken as a raw output though11:49
Xceedotherise any identation will be added to the output file11:49
zygait's yaml11:50
zyganot shell script11:50
zygaall the stuff in this document is yaml11:50
mborzeckiXceed: but it must be a valid yaml in the first place, this one is not11:50
zygathe values may be strings11:50
zygathe strings may have any content11:50
zygabut you must make it valid yaml first11:50
Xceedk, thanks guys11:50
mupPR snapd#6267 closed: overlord: move Conf interface to configstate/config to avoid cyclic imports <Simple 😃> <Created by zyga> <Closed by zyga> <https://github.com/snapcore/snapd/pull/6267>11:55
zygamborzecki: https://github.com/snapcore/snapd/pull/6264 is green11:57
mupPR #6264: spread, tests: add Fedora 29 <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6264>11:57
mborzeckiyay11:58
mupPR snapd#6264 closed: spread, tests: add Fedora 29 <Created by bboozzoo> <Merged by bboozzoo> <https://github.com/snapcore/snapd/pull/6264>12:00
zygajamesh: relayed to mvo12:02
zygaI'll also chase with jdstrand later today12:03
zygamborzecki: looking at https://github.com/kubernetes-sigs/kind12:04
zygaI like the pkg/ tree12:04
zygaI mean, putting various source code under pkg/12:04
zygaand not in random spots in the top level12:04
mborzeckihm can we replace the nice 'crushing failure and despair' or the pony with a useful piece of text?12:07
mborzecki./run-checks --short-unit output is ok locally, but quite useless on travis12:08
mborzeckican't figure out why unit tests (the separate job) fail: https://api.travis-ci.org/v3/job/464278797/log.txt12:09
mborzeckithe log ends with:12:09
mborzeckiThe command "./run-checks --short-unit" exited with 012:09
mborzeckiDone. Your build exited with 1.12:09
mborzeckiwtf?12:09
jameshzyga: thanks.  I've written up the question over using "daemon: dbus" here: https://forum.snapcraft.io/t/support-for-daemon-dbus/885512:15
zygajamesh: thank you, I will use this for talking with jdstrand later todat12:36
zyga*today12:36
zygamborzecki: yes12:36
zygamborzecki: it sucks12:36
zygamborzecki: I had a PR for this, one sec12:36
zygahttps://github.com/snapcore/snapd/pull/620912:37
mupPR #6209: run-checks: discard test good/bad banner <Created by zyga> <Closed by zyga> <https://github.com/snapcore/snapd/pull/6209>12:37
mupPR snapd#6209 opened: run-checks: discard test good/bad banner <Created by zyga> <https://github.com/snapcore/snapd/pull/6209>12:37
mborzeckinice12:37
mborzeckiwonder if mvo prefers to see the banner on his terminal or on travis12:38
zygaone thing to fix12:38
mborzeckithe html log shows the banner correctly iirc12:38
zygais to fail fastt12:38
mborzeckiyup12:38
zyganot go on doing useless extra tests if something failed12:38
zygamborzecki: I would honestly prefer a short summary12:39
zygasaying stuff like:12:39
zygaunit tests: pass12:39
zygaformat: fail12:39
zygavet: pass12:39
zygaetc12:39
zygathe banner is childlish12:39
zygaand I haven't seen it displayed properly in the last year12:40
mborzeckiheh12:40
mborzeckiidk maybe some isatty check in the shell would do12:40
zygaIMO the banner is pointless but that's just me12:44
pstolowski+112:49
pstolowskiwe could easily find a single utf emoji to replace it ;)12:49
Xceed${SNAP_COMMON} used in the scope of the apps.name.command: contains <apps.name> i.e. /var/snap/<apps.name>/common but in the scope of override-prime does not i.e. /var/snap/snapcraft/common (so 'snapcraft' instead). So, I append '/../../<apps.name>/common' in order to make ${SNAP_COMMON} path in the scope of prime to be consistent with that at the command runtime - a little kludgy but it worked.13:02
pstolowskizyga: some comments to #619013:10
mupPR #6190: overlord/configstate,features: expose features to snapd tools <â›” Blocked> <Created by zyga> <https://github.com/snapcore/snapd/pull/6190>13:10
zygathank you13:11
pstolowskizyga: sorry if they are naive13:11
pstolowskii'm likely missing a detail or some agreement13:11
zygapstolowski: thank you, replied to most13:15
zygaask questions about anything you want, I realise some of the choices may be more obscure than usual13:16
pstolowskizyga: thanks13:18
zygathank you for looking :)13:23
jdstrandjamesh, zyga: there is some history with 'daemon: dbus'. I'll have to research but will comment in the forum13:33
* zyga nods13:33
pstolowskimborzecki: i'm still puzzled about multiple dirs.SetRootDir("/") in TestPathsArch in https://github.com/snapcore/snapd/pull/626913:34
mupPR #6269: cmd, dirs, interfaces/apparmor: update distro identification to support ID="archlinux" <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6269>13:34
pstolowskiif you can address that then i'm happy to approve13:35
mborzeckipstolowski: we update the paths only when dirs.SetRootDir() is called, that's why it has to be called again after changing the mocked os-reelase info13:39
mborzeckipstolowski: does that answer your question?13:39
pstolowskimborzecki: ah, i see, yes, thanks!13:39
cachiozyga, hey13:41
cachioabout this spread: detect "signal: terminated" in journal logs13:41
cachioit is breaking all the tests on borads13:41
cachio:(13:41
zygacan you show some example please?13:42
cachioI see lines like this one13:42
cachioDec 06 05:12:04 localhost.localdomain snapd[1998]: udevmon.go:119: udev enumeration error: cannot read udevadm output: signal: terminated13:42
cachiowhich make the test suite fail13:42
zygacachio: can you please show systemctl cat snapd.service13:42
cachiozyga, https://paste.ubuntu.com/p/64hkcch6FT/13:43
zygacachio: can you tell me how those tests are being used13:43
zygait seems like tests are out of sync with the running code13:44
zygahttps://github.com/snapcore/snapd/pull/625013:44
mupPR #6250: data: set KillMode=process for snapd <Created by mvo5> <Merged by zyga> <https://github.com/snapcore/snapd/pull/6250>13:44
zygathis PR introduced the check for "signal: terminated"13:44
zygaas well as a change to the systemd unit for snapd service13:44
cachiothe ones on edge: I flash stable image, then I refresh to edge13:44
cachioand run the tests using external backend13:44
zygathe only way tests would pass is you always tested (whichever channel) with a matching test tree13:44
zygaso we need to either update snapd/core to match tetsts13:45
zygaor downgrade tests to match snapd/core13:45
cachiozyga, on edge tests I am doing that13:46
cachiousing core from edge and using the last commit pushed to snapd-vender and used to build the core snap13:47
zygaand the failure you saw, was that following the process?13:48
zygathat you just outlined?13:48
mborzeckipstolowski: can i have your +1 on https://github.com/snapcore/snapd/pull/6269 ? :)13:50
mupPR #6269: cmd, dirs, interfaces/apparmor: update distro identification to support ID="archlinux" <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6269>13:50
zygacachio: ?13:50
cachiozyga, I ran the lxd test13:51
pstolowskimborzecki: absolutely13:51
zygacachio: not sure how that answers my question13:51
zygacachio: were the tests and the code in sync when that failure was reported?13:51
cachiozyga, yes13:51
mborzeckipstolowski: ta13:51
cachiocore from edge13:51
zygacachio: can you look at the PR I referenced above please13:51
zygait adds the new check13:51
zygaand adds a KillMode=process entry to the systemd service13:52
zygaright?13:52
zygahow can we explain that the test was present but the service was not changed?13:52
cachiozyga, checking logs to see traceability13:54
zygacachio: my explanation is that the service is not changed because the test system was out of date with tests13:54
zygawould be great to figure out if that's true and if so, what needs changing13:54
cachiozyga, yes, got it, I am trying to see the traceability between the tests we are using and the changes included in edge13:55
cachioto determine if those are really on sync13:55
zygamborzecki, pstolowski: I'm in bed, will skip standup13:57
mborzeckizyga: ack13:57
zygamy update: not feeling well, doing some simpler tasks,13:57
pstolowskiack, shall we skipp standup then and do quick one on irc?13:58
mborzeckipstolowski: we can do the regular one13:58
pstolowskiok13:58
mupPR snapd#6269 closed: cmd, dirs, interfaces/apparmor: update distro identification to support ID="archlinux" <Created by bboozzoo> <Merged by bboozzoo> <https://github.com/snapcore/snapd/pull/6269>14:34
mupPR snapd#6270 opened: data/selinux, tests: refactor SELinux policy, add minimal tests <SELinux> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6270>14:37
mborzeckioff to pick up the kids14:39
kravietzhi all, my snapcraft has just upgraded to 3 and it tries to build snaps with multipass, but multipass won't work on a build server that is a VM itself - any ideas?14:57
roadmrkravietz: if the VM is throwaway, you can use --destructive-mode14:58
roadmrbut it is destructive :)14:58
kravietzin what sense?14:58
kravietzis is the same as in snapcraft 2?14:58
kravietzfor now I have just reverted to the latest 2.x14:58
zygajdstrand: gentle ping about https://github.com/snapcore/snapd/pull/624415:02
mupPR #6244: release: detect too old apparmor_parser <Created by zyga> <https://github.com/snapcore/snapd/pull/6244>15:02
niemeyersergiusens: Was just running snapcraft now and got surprised by how slow it is to even start15:07
niemeyersergiusens: Looks like a regression15:07
* cachio lunch15:49
=== chihchun is now known as chihchun_afk
kjackalhi snappy people, I have this LP builder that was supposed to push a snap to the store an hour ago, but I do not see it https://launchpad.net/~microk8s-dev/+snap/microk8s-1.1316:08
kjackalWe have already builders for 1.12, 1.11, 1.10 and latest snap tracks and they work with no issues16:08
=== pstolowski is now known as pstolowski|afk
* cachio afk18:57
zygajdstrand: thank you!22:57
zygajdstrand: I pushed the fixes too btw22:57
zygawoot, that was one spicy branch to land :-)22:57
jdstrandzyga: thanks!23:20
jdstrandhehe, yes23:20
zygaI'm happy 2.36 got the "short" version of that branch23:21
zygawith 0 changes to release/apparmor.go23:21
zygabut I'm also happy this made it into master, it's much nicer now23:21

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!