/srv/irclogs.ubuntu.com/2018/12/18/#snappy.txt

rbasaksergiusens: around? I'm having trouble with the python plugin, setting requirements.txt. Documentation says it's a string, but the code says it's a list. I can't seem to give it a list.02:09
rbasakI tried using override-pull to dynamically create a requirements.txt concatenating my own list, but snapcraft seems to fail to read a generated requirements.txt _before_ override-pull runs, even though it complains after (based on what strace says).02:10
rbasakThe underlying problem I'm trying to solve is: https://pastebin.ubuntu.com/p/7yknPXQG7G/02:11
rbasakUpstream aren't sure that it's correct to include an == for setuptools in requirements.txt.02:12
rbasakBut it might work for me here. Except I can't figure out how to get snapcraft to let me interfere with the requirements.txt before it uses it.02:12
mupPR snapd#6316 opened: tests: skip snapd snap on reser for core systems <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/6316>02:15
mborzeckimorning07:03
zygaHello07:35
zygaI will be in the office shortly, just need to take the dog out07:36
mborzeckizyga: hey07:37
zygare :)07:47
zygahey hey07:47
zygaI feel *much* better than yesterday07:47
zygamborzecki: was the sky overcast last night around your place?07:48
mborzeckizyga: idk, didn't pay much attention, probably yes07:49
zygaI want to take a chance to see the comet07:49
zygabut lights and clouds make it hard to do so :/07:49
mborzeckizyga: hah, the worst time of year if you ask me07:49
zygaright?07:49
zygamid summer would be awesome07:49
mborzeckizyga: or super cold weather07:53
zygamborzecki: any highlights from yesterday?07:58
mborzeckithe test suite is givig headaches07:58
mborzeckizyga: couldn't even get https://github.com/snapcore/snapd/pull/6314 to land07:58
mupPR #6314: cmd/snap-discard-ns: fix umount(2) typo <Simple 😃> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6314>07:58
zygayeah, I'm looking at taht now07:59
zygabut that's hardly new problem :/07:59
mborzeckiand it's a damn typo07:59
zyga+ test-snapd-udev-input-subsystem.slot07:59
zygacannot perform operation: mount --rbind /dev /tmp/snap.rootfs_tdsBnR//dev: No such file or directory07:59
=== pstolowski|afk is now known as pstolowski
pstolowskiheyas07:59
zygathis means that core snap is empty07:59
zygawhich probably signifies another bug in test restore somewhere08:00
zygaeh08:00
zygapstolowski: hey08:00
zygapstolowski: did you see the comet?08:00
mborzeckizyga: on a side not, pulled in the latest updates today, linux-firmware got updated to 20181216 version and my vega stopped working :/08:00
zygauh?08:00
zyga:|08:00
zyganew vega firmware?08:00
pstolowskizyga: oh, no; did you?08:00
zygamaybe it requires new kernel too08:00
zygapstolowski: no, sky is totally covered with clouds08:01
zygapstolowski: but I want to08:01
mborzeckizyga: i'm at 4.19.908:01
zygapstolowski: I learned a thing yesterday08:01
mborzeckizyga: tought the kernel update was botched, but reverting firmware was enough to make it work again08:01
zygapstolowski: downloaded mojave installer app, rebooted (required somehow), created a new vm with fusion and the mojave installer, clicked through everything, rebooted, held command+r to enter recovery, disabled system integrity protection (root is real root now), rebooted back to the system, now I can dtrace system binaries or use dtruss to see the system calls; I wanted to understand what fuels readdir on macos, and I found out08:02
zyga:)08:02
zyga(and it is not getdents)08:03
pstolowskizyga: :D08:03
mborzeckizyga: can you upload the source tarballs to github releases page?08:08
zygamborzecki: yeah, I'm looking into that now08:08
mborzeckizyga: thanks!08:08
zygamborzecki: btw, some good stuff over weekend08:09
zygaI, by accident, got the attention of the suse golang stack maintainer08:09
zygaand they will remove the global environment variables08:09
zygawhich means we will not only get fixed go in suse08:09
zygabut have a simple way out of the current problem08:09
zyga(just unset the damn GO* mess)08:09
zygamborzecki: tweeting with a rant actually solved a problem :)08:11
mborzeckizyga: nice08:16
zygaFK08:24
zygafirefox ate my release page08:25
zygaf*****08:25
zygawent "back"08:25
zygamoronic feature08:25
mborzeckinom nom nom08:25
zygamborzecki: release page updated08:31
zygaI'll do opensuse next08:32
zygathen look at bugfixes for layout bug08:32
zygaI would love if we did 0 features and made the test suite stable08:32
zygaany ideas apply08:32
mborzeckizyga: thanks08:32
mborzeckii'm seeing this on arch: gru 18 09:29:09 galeon snapd[24323]: link.go:75: cannot update fontconfig cache: cannot get fc-cache-v6 from core: open /var/lib/snapd/snap/core/current/bin/fc-cache-v6: no such file or directory08:33
mborzeckiuhh08:33
zygadunno08:34
mborzeckizyga: https://github.com/snapcore/snapd/blob/master/overlord/snapstate/backend/link.go#L62..L94 i think this is wrong08:35
zygaI low how we ship TODO/XXX but discuss ad infinitum about variable names08:35
zygamborzecki: can you walk me through your thought process08:36
mborzeckizyga: it's using CommandFromCore, which does mountDir+core/current, but the symlink is updated only at the end08:36
mborzeckizyga: so it's trying to call fc-cache-v6 from the old 'current' of the core snap08:36
zygaindeed!08:37
zygauh08:37
zygaplease file a bug08:37
mborzeckizyga: only visible when switching between !edge & edge08:37
pedroniszyga: I don't know of anything that isn't tiny that doesn't ship with TODOs08:38
mborzeckizyga: better yet, i'll open a PR :P08:38
zygapedronis: that was not my point :)08:46
zygapstolowski: is this expected? 2.36.3  https://www.irccloud.com/pastebin/Yxx3gjEC/09:00
mupPR snapd#6314 closed: cmd/snap-discard-ns: fix umount(2) typo <Simple 😃> <Created by bboozzoo> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/6314>09:00
mupPR snapd#6316 closed: tests: skip snapd snap on reset for core systems <Created by sergiocazzolato> <Merged by stolowski> <https://github.com/snapcore/snapd/pull/6316>09:00
mborzeckizyga: just on .3?09:01
zygayep09:01
zygamborzecki: happens each time09:02
mborzeckizyga: hm don't see this here09:03
zyga"osc build"09:03
pstolowskizyga: no, failures are not expected ;). i don't know, looks like mvo touched this test a few days ago. do you see it consistently?09:03
zygayes09:03
zygaeach time09:03
pstolowskiinteresting09:03
pstolowskizyga: let me look09:03
zygamborzecki: I sent this to obs09:04
zygait will fail there09:04
mborzeckizyga: go version?09:04
zygahttps://build.opensuse.org/package/show/system:snappy/snapd09:04
zyga1.11.209:04
zygamborzecki: note, it happens in osc build09:05
zygaI don't see this in "go test ./..."09:05
mborzeckizyga: wasn't there something with network being disabled in obs builds and that causing some werid issues?09:06
zygaI don't know09:06
zygapresumably maybe so09:06
mborzeckizyga: i recall something like this when you were updating snapd with that other opensuse community guy09:06
zygahmmmm09:07
zygahttp://nonexistingserver909123.com/09:08
pstolowskizyga: i'm looking at this test right now. running in httputil/ tests in a loop, so far no failure, so perhaps flaky?09:08
zygapstolowski: no09:09
zygaperhaps flaky assumption09:09
zygait fails each time in obs build09:09
zygahttps://build.opensuse.org/package/show/system:snappy/snapd09:09
zygawe are assuming a specific answer for a domain name09:10
zygathe problem is that the test can run in arbitrary environment, including one with proxies09:10
zyganot a unit test09:10
zygawe test the system09:10
pstolowskizyga: i see. also looking at comments in e3db0504f5b28029e4a253614782244150ebeb50, go versions introduce variances here...09:14
zygapstolowski: https://build.opensuse.org/package/show/system:snappy/snapd failed across all suse versions09:14
pstolowskiuhm09:16
pstolowskizyga: i think we should c.Skip this test then for the time being, and try come up with a better one09:19
zygapstolowski: agreed09:19
zygapstolowski: perhaps we should spawn our own server and return the expected error code09:20
zygaotherwise we can really see anything the system crafts09:20
pstolowski+109:20
pstolowskizyga: shall i prep quick PR against 2.36?09:20
zygapstolowski: I can cherry pick as well, thank you for looking09:21
zygaif you can, please try to improve the test09:21
pstolowskizyga: ok09:21
zygasorry, that came out confusing and ambiguous09:21
pstolowskizyga: ok, for master then09:21
zygaI mean I will do the skip09:21
pstolowskiah ok09:21
zygaand you can look at changing the test properly for master09:21
zygaI will carry a distro patch09:21
pstolowskizyga: perhaps c.Skip conditional on suse?09:22
zygapstolowski: no, I mean I will just skip this unconditionally in distro packaging09:22
zygawe should not special case any distribution here09:22
pedronispstolowski: zyga: we already have a test like that somewhere else09:37
pedroniswe don't skip generically09:37
pedronispstolowski: see TestDoRequestSerialErrorsOnNoHost  in devicestate_test.go09:39
pedroniszyga: ^09:40
zygalooking09:40
pstolowskiah!09:40
pstolowskipedronis: nice09:40
zygayep09:40
zyga+109:40
zygathough I would really argue those are not unit tests09:41
zygabut camouflaged integration tests09:41
pedroniszyga:  we have some _test.go files with integration tests (of various kind), yes09:45
zygauh, heads up: I need  to go and do paperwork (today and tomorrow) for the car that has finally arrived09:46
zygaperhaps I can skip today09:46
zygaI'll learn more soon09:46
pedroniszyga: heh, two full days of papework?  that sounds annoying09:47
zygano, just two instances09:47
zygainsurance today09:47
zygaand final pickup tomorrow09:47
zygaI just need to be there to sign the papers09:48
zygathough we're trying to do the insurance remotely to avoid going there for really silly reason09:48
pedroniswe are seeing this kind of error often:  cannot perform operation: mount --rbind /dev /tmp/snap.rootfs_niWil9//dev: No such file or directory09:50
pedroniszyga: ^ any idea?09:50
zygayes09:51
zygaso this fails if either of the things happen09:51
pstolowskiyeah i just see it as well09:51
zygaa /tmp/snap.rootfs_niWil9/dev (which we make ourselves just prior to that call) doesn't eixst09:51
zygaor if /dev doesn't exist09:51
zygaI did see this a few  times09:52
zygalet me think09:52
zygaunit test failure https://www.irccloud.com/pastebin/5TCsf2ae/09:53
pedronisbtw were we sure this was solid now:  https://github.com/snapcore/snapd/pull/621709:55
mupPR #6217: tests: reset snapd state on tests restore <Created by sergiocazzolato> <Merged by zyga> <https://github.com/snapcore/snapd/pull/6217>09:55
pedroniszyga: do we need more logging around that error? to know which it is?  /dev or the directory we just created (that sounds scary)09:56
zygapedronis: I think it was okay, the problem is that our test suite has interlocking issues that sometimes mask each other, fixing something has impact that uncovers another thing that is broken; it's not good because we have no way to measure anything09:56
zygapedronis: ish, logging anything is notoriously difficult in snap-confine because of fear of string ops; I spent about a month discussing how to do it with jdstrand with no result other than "only in debug builds, too scary in production builds"09:57
mupPR snapd#6317 opened: overlord/snapstate/backend: call fontconfig helpers from the new 'current' <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6317>09:57
mborzeckizyga: pedronis: ^^09:57
pstolowskipedronis: i'll work on that snapctl get bug if that's ok?10:01
pedronispstolowski: are you blocked on hot plug?10:02
pstolowskipedronis: 2 hotplug PRs need reviews (i'm deconflicting one of them atm)10:03
pedronispstolowski: we need to write the main respond to events? handle enumeration? is that right?10:04
pedronisis that work blocked?10:04
zygamborzecki: I'm wondering about something10:04
zygayour patch looks good10:04
zygaI wonder if we should release an update with this in distro patches10:04
pstolowskipedronis: that's all implemented in the big hotplug branch already (i'm not deconflicting it until the smaller ones land though)10:05
pedronispstolowski: so the idea is to shrink that? and then ask for a review of it?10:06
pstolowskipedronis: yes, i'd like the smaller ones to land, otherwise it's constant battle with de-conflicting10:06
pedronisok10:07
pstolowskipedronis: otherwise what remains todo is the open questions (camera etc.), polishing around naming, better summaries (what we discuessed ~yesterday)10:08
pstolowskinaming = slot naming10:08
pedronisok, sounds good10:08
pedronisI'll see if I get to review a bit more of those open ones10:08
pstolowskipedronis: ah, and the gadget-declared slots discussed last week10:09
pedronisyes10:10
* Chipaca shakes his fist at conflict detection, and goes for more coffee10:13
Chipacaactually scratch that, i'll go for a walk instead10:13
Chipacabbiab10:13
Chipacapedronis: I suspect this bit won't pass review: https://pastebin.ubuntu.com/p/QDbNMmmWh2/10:14
pedronisChipaca: indeed, but there is probably something we can10:15
pedronisdo10:15
pedronisChipaca: we can have a quick chat once you are back if it can help10:15
Chipacapedronis: I think I need to generalise doInstall to take a current-change, and pass that in to the conflict checker10:16
Chipacapedronis: hopefully I can do it without breaking all the doInstall tests :-)10:16
pedroniswe don't have direct doInstall tests I think10:16
Chipacabonus :-)10:17
Chipacaanyway, walk to clear head, bbiab10:17
mupPR snapd#6318 opened: release-tools: display self-help <Created by zyga> <https://github.com/snapcore/snapd/pull/6318>10:20
* pstolowski gets xmax haircut, bbl10:23
pstolowski*xmas even10:25
mborzeckicannot perform operation: mount --rbind /dev /tmp/snap.rootfs_Nb69ea//dev: No such file or directory10:36
mborzeckithis thing pops up quite often10:36
pedronismborzecki: yes10:37
mborzeckizyga: any clue what that might be?10:37
pedronismborzecki: are we removing /dev somehow?10:39
mborzeckipedronis: not that i know of10:45
pedronisor is some cgroup handling problem?10:45
mborzeckiidk, this comes from s-c, looking at things, we have a scratch dir (otherwise it'd die earlier), the we mount the rootfs (core in this case), and proceed to setup individual mounts, /dev is the first one10:49
mborzecki\/dev is in core, there's probably one on the host too10:50
pedronismborzecki: zyga: I fear but it seems it started with landing of #621710:50
mupPR #6217: tests: reset snapd state on tests restore <Created by sergiocazzolato> <Merged by zyga> <https://github.com/snapcore/snapd/pull/6217>10:50
zygapedronis: hmmmm, let me think10:51
zygaI don’t mind reverting that now10:51
zygaI have enough state to work locally10:52
pedronisgiven where we have are timewise, I would revert it10:52
pedroniss/have//10:53
pedronismborzecki: can you prepare a revert?10:53
mborzeckipedronis: ok, let's do this10:53
pedronismborzecki: if the revert itself fails that way we learn something either way10:55
mupPR snapd#6319 opened: Revert "Merge pull request #6217 from sergiocazzolato/tests-reorg-prepare-restore" <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6319>11:02
pedronislet's see how it goes11:09
pedronismborzecki: thx11:10
popeyHas *anyone* actually got audio (alsa or pulse) working on core?11:10
popeyI have tried everything i can, and never get any audio over either11:10
popeyFollowed every tip / trick I can, and am losing the will to live11:10
Chipacapopey: have some chocolate, go for a walk, play some music or draw something! don't lose your will to live11:17
popey:)11:17
popeyFigure of speech :)11:17
Chipacapopey: couldn't risk it11:18
ograpopey, what hardware ?11:25
popeyogra: a pc11:26
ograit should definitely work through pulse if you installed the pulse snap and connected all inerfaces properly11:26
popeythe best I can get is apparmor failure on /run/pulse/native which leads to https://forum.snapcraft.io/t/pulseaudio-in-daemon-mode/660611:26
popeyit does not11:26
popeyI would appreciate someone else confirming this. I spent hours on this last night and it should not be this hard.11:27
ograit is quite a while ago that i tested pulse (about  year) and there it used to work ... something might have changed11:28
Chipacawhat was the name of the mixer that mate ships by default as a snap?11:29
popeypulsemixer11:29
ograyou might need to switch to the right output device though ... i dont think core picks a proper default11:29
* Chipaca installs that11:29
popeywhich also doesnt work on core11:30
Chipacapopey: I can confirm the DENIEDs11:30
Chipacapopey: 'snap logs pulseaudio' talks about cookies11:31
Chipacapopey: hmm!11:31
Chipacapopey: I can open the mixer just fine with sudo though11:31
ograpopey, the pulse snap ships pactl ... (way more low level than pulsemixer and way more cryptic to use but has the same powers)11:32
Chipacaogra: when you say 'the pulse snap', is it called "pulseaudio"?11:32
* Chipaca assumes so11:33
ograyes11:33
ograhttps://git.launchpad.net/~snappy-hwe-team/snappy-hwe-snaps/+git/pulseaudio/tree/snapcraft.yaml11:33
Chipacak11:33
Chipacapopey: so11:35
Chipacapopey: I installed pulseaudio11:35
Chipacapopey: and mpv11:35
Chipacapopey: and copied a music file to /root/snap/mpv/current/11:36
Chipacapopey: and mpv plays it11:36
ChipacaI get nothing out the speakers but that might be me sucking at kvm11:36
popeyusing sudo?11:36
Chipacapopey: yes11:36
Chipacapopey: my user isn't part of the audio group11:36
ograthat shouldnt matter ... you talk to the daemon, not to the device11:37
Chipacapopey: note that the home interface doesn't auto-connect on core11:37
ograyou should use paplay for testing11:38
Chipacaogra: can that play oggs?11:38
ogra(comes with the pulseaudio snap(11:38
ograi think it should11:38
Chipacait doesn't error out, but as i said i don't have sound in the kvm for whatever reason (might be a core issue -- but might be me sucking at kvm)11:39
Chipaca(I had to copy the audio file to /root/snap/pulseaudio/current )11:39
ograeither that or pulse uses the wrong audio device11:39
Chipacayeah that could be happening11:40
Chipacapopey: has this helped, or are you in the same place still?11:40
ogracore has nothing to select a device as default11:40
ograso you might need some pactl tinkering frst11:40
popeyI cannot get mpv working as user or root either11:42
ograChipaca, kvm should just need "-soundhw ac97" btw11:42
popeyso no, no further forward11:42
XceedI've also observed the following... https://forum.snapcraft.io/t/snapcraft-python-plugin-install-wrong-pip-version-during-snap-build/5445 ... however, the thread/issue was never answered/fixed, and I can't seem to find a how-to update pip for building.11:42
ograpopey, use paplay11:42
popeypaplay farts that it needs root11:43
popey"This script must be run as root"11:43
niemeyerHeya11:43
Chipacapopey: how does mpv fail?11:44
Chipacapopey: what are you trying  :-)11:44
niemeyerAre there any failing tests I could look at that would be fixed by spread#70, or is that random?11:44
mupPR spread#70: Reboot on backgraound to avoid spread wait for long time <Created by sergiocazzolato> <https://github.com/snapcore/spread/pull/70>11:44
popeyChipaca: error opening/initializing the selected video_out (--vo) device.11:45
popeyis what I get from mpv playing an mp3 in root home folder11:45
ograpopey, -vo null11:45
ograor --vo11:45
Chipacapopey: do you have x or something? mine didn't even try11:45
Chipacapopey: if you do, you might need to connect the x11 interface11:45
ograand equivalently ... --ao pulse11:45
popeyChipaca: x11 on core?11:46
ograheh11:46
Chipacapopey: it exist11:46
Chipacas11:46
popeyok, as sudo, mpv can play audio now. yay11:46
ograyeah11:46
ograif you install some snap that provides it11:46
Chipacapopey: i mean: there's an x11 snap somewhere11:46
popeySorry, rewind.11:46
Chipacawe added support for running the x server as a snap, on core11:46
Chipacaanyway, woo11:46
popeyUser, wants to install a snap that plays audio.11:47
popeyCurrently we have to copy files to a root owned folder, and run as root?11:47
Chipaca1 sec11:47
ograpopey, well, core is more focused on headless and userless i guess so nobody thought about that before11:47
Chipacapopey: i killed my kvm, need to do the dance again to test something11:48
ogra(all clients you'd normally use would run as daemons as well in that case)11:48
ograpopey, btw, you could take a look at my video-kiosk snap ...11:51
ograit spawns mplayer as a daemon that uses pulse from the pulseaudio snap and offers a web-ui to play files11:52
zygaI added a check for unmounted base snap11:52
zygalet's see if I can hit this11:52
popeyInteresting, thanks ogra.11:52
popeyI hadn't even considered doing everything as root.11:52
popeyThis gets me further forward, thanks Chipaca / ogra :)11:53
ograhttps://github.com/krpors/wasp11:53
ogra(and https://github.com/ogra1/video-kiosk-snap)11:53
popeyIt does moan that "failed to create secure directory (/run/user/0/snap.(snapname)/pulse: No such file or directory11:54
popeybut that seems to not be a massive problem, as audio does play11:54
ograwell, that sounds like a bug ... with confinement or confinement integration11:55
popeysudo pulsemixer also works, as a bonus for fiddling the volumes11:56
popeyand shows the client connected too.11:56
* popey is happy11:56
ogra:)11:56
mborzeckiso i'm playing with my gl debugging snap on a system with a vega cards, and there's no gl support at all11:59
mborzeckia revision which uses core18 as base is somewhat better12:00
zygamborzecki: we need to implement better driver support12:00
zygamborzecki: it would help if core{16,} got updated driver stack but that's probably unlikely12:01
mborzeckizyga: we have a task for opengl and nvidia, but mesa is in bad shape too12:02
zygayes12:02
zygabut doing it for nvidia will open up the path for generic support12:02
zygaI fully agree though12:02
pedronismborzecki: zyga: that revert is green12:05
zygalet's merge it12:05
mborzeckior maybe another travis run?12:05
zygaI wonder if there's some interplay with another branch12:05
mupPR snapd#6319 closed: Revert "Merge pull request #6217 from sergiocazzolato/tests-reorg-prepare-restore" <Created by bboozzoo> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/6319>12:06
zygadepending on pressure, we can run this several times more if you prefer12:06
pedronisit cannot make things worse12:10
Chipacapedronis: https://pastebin.ubuntu.com/p/mKhGh4rGcr/ with conflict resolution back on \o/12:23
* Chipaca ~> lunch12:24
zygaChipaca: "Done    today at 12:23 GMT  today at 12:23 GMT  Run configure hook of "test-snapd-epoch" snap if present" - didn't we have a patch that makes hooks run if they are really present?]12:26
zygaif we did, should that just say "running configure hook..."12:26
Chipacahttps://pastebin.ubuntu.com/p/H6vJfTZRQN/12:26
Chipaca^ two refreshes  with epoch changes in parallel12:26
Chipacazyga: ¯\_(ツ)_/¯ no idea12:26
Chipacapstolowski: ^?12:27
* Chipaca ~> really lunch12:27
pedronisChipaca: :)12:27
pedroniszyga: don't think that patch was for all hooks12:27
pedronisafaict it was only for interface hooks12:31
pstolowskizyga, Chipaca: we did, but for interface hooks only12:32
zygammm12:32
zygathanks12:32
pstolowskisince these had the most impact (4 extra task for every connect)12:33
zygahmm12:34
zygathe failure with /dev is a bit hard to reproduce12:34
pstolowskiwe can maybe apply this optimization everywhere12:34
pedroniszyga: I expect you need some combination of tests and bad restore12:35
pedronisif the casue was really that PR12:35
zygadidn't this happen on the PR that was fixing a typo as well?12:36
zygaI can switch to any ref it someone has an idea12:36
pedroniszyga: yes12:36
pedronisafaik it happened in some form in all of the master runs12:36
pedronissince that PR was merged12:36
zygaI'll run one more go12:38
zygaand write a spread test for the extra check12:38
zygawe can propose it regardless of current occurrence12:38
pedronispstolowski: what's the status of this: https://trello.com/c/KCMZcd5F/74-fix-for-kr-pretty-diff-memleak-affecting-our-tests12:41
sergiusensrbasak I am off until Thursday. An email will certainly remind me to get back to you.12:57
pedroniszyga: master failed but on a pull and the mount bug, not anymore on the /dev issue12:58
zygaso back to where we were, thank you12:59
pedronisthe mount bug we have ideas12:59
pedronispull of repos, life is hard12:59
pstolowskipedronis: radio silence from upstream; he has a bunch of PRs pending reviews..13:03
mborzeckioff to pick up the kids13:05
zygaI guess during my "holidays" I could and should fix the debian package13:05
zygaunless there are any takers I will do it13:05
zygabut first13:05
zygalunch13:05
FacuHi all! Is there a simple way to make the installed snap "writable"? I just want to debug a Python tool installed through snap... add a couple of "print"s inside the code and run it13:13
ograFacu, you can "cp /snap/foobar/current/bin/my-script ." and then "sudo mount -bind my-script /snap/foobar/current/bin/my-script" ... that gives you an overalyed writable version of the script13:15
ogra*overlayed13:15
Facuogra, can I do that with a whole dir? /snap/foobar/current/lib/python3.5/site-packages/foobar/13:18
ChipacaFacu: unsqashfs /var/lib/snapd/snaps/the-snap.snap13:19
Facu(the script doesn't really do much, all what really happens is inside own libs)13:19
ChipacaFacu: snap try squashfs-root13:19
ograyou have to copy the whole dir content and it gets really confusing to handle multiple files that way i guess ...13:19
ChipacaFacu: squashfs-root is the directory unsquashfs creates (unless you tell it otherwise), it will have the (now rw) contents of the snap13:20
ograbut technically you can indeed also overlay a dir that way ... though Chipaca has the better option here13:20
Chipacaogra: if this is your own snap, you can just 'snap try' the prime directory, if you're using an old-style snapcraft.yaml13:20
Chipacathe new-style build-in-a-vm snapcraft doesn't leave a 'prime' :-/13:21
ograwell, if you have the source :)13:21
FacuChipaca, it complains that  - Montar snap "snapcraft" (unset) (snap "snapcraft" requires classic confinement)13:22
FacuChipaca, I'll try ogra's solution with just the couple of files that I think I need to debug13:22
pedronisFacu: you can do snap try --classic13:24
Facupedronis, worked great, thanks!13:27
pedronisnp13:28
ChipacaFacu: snap try --dwim13:29
FacuChipaca, "dwim"? I don't see it in `snap help try`13:30
ChipacaFacu: https://en.wikipedia.org/wiki/DWIM13:30
Facuja13:30
zygaeh13:30
zygamultipass doesn't work on opensuse13:30
zygano group "sudo"13:30
zygaergo13:30
zygano snapcraft13:31
zygaergo13:31
zygasucks :/13:31
jdstrandzyga (pedronis): re logging> that's probably overstating things a bit. it is quite true that we want to be careful sending arbitrary strings, but that doesn't mean we can't send anything13:32
mborzeckizyga: yes, that should be fixed in edge i think13:33
zygaah, perfect13:34
mupPR snapd#6320 opened: tests: install core and save it as part of snapd state <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/6320>13:36
=== ricab is now known as ricab|lunch
rbasaksergiusens: thanks. I'm off from tomorrow until the new year. I'll follow up with you in the new year then. Enjoy your time off!13:57
pedroniscachio: we had to revert #6217, we really need  to go about this much much more carefully, I am also not sure how much of a priority it is13:57
mupPR #6217: tests: reset snapd state on tests restore <Created by sergiocazzolato> <Merged by zyga> <https://github.com/snapcore/snapd/pull/6217>13:57
cachiopedronis, it is ok, it is not  high prioriry14:00
pedroniszyga: are you joining or skipping?14:01
zygadiddledan: hello14:01
zygaoh14:01
zygajoining!14:01
zyga2fa14:03
zygaready14:03
zygadiddledan: so I spent some time on the layout issue14:03
zygaand I cannot reproduce it14:03
zygacan you still get to that point where it breaks?14:03
diddledanweird14:03
diddledanyes14:03
zygacan you collect /var/lib/snapd/mount/*.fstab file (for layout-test)14:04
zygaas well as /run/snapd/ns/*.fstab14:04
zygaand lastly14:04
diddledanyou need to be running on a system that isn't i386 (x86_64, for example) and you need to run the app every install to ensure the mount namespace is set-up14:04
zygaI did that14:04
zygalastly nsenter -m/run/snapd/ns/layout-test.mnt14:05
zygaand then cat /proc/self/mountinfo14:05
zyga(and exit to quit the shell)14:05
diddledanwhich step do you want these from? when it's got to the broken stage, or before?14:05
zygawhen it is in a broken state14:05
diddledankk14:05
zygathank you14:05
zygaI tested with 2.36.314:05
zygathough this should be the same as .214:05
zygano changes in that area14:06
diddledanor maybe I can't?14:07
diddledanweirder and weirder14:07
diddledanok, I can't reproduce it any more with my test snap14:09
zygadid you perhaps snap-try before14:09
diddledanfooey14:09
zygaon similar snap name14:09
diddledannope14:09
zygahmmm14:09
zygado you have snap changes14:09
zygathat go all the way back when this failed?14:09
zygadid core18 refresh in the meantime?14:09
diddledanyou can see all my testing in this paste (next message)14:10
diddledanhttps://www.irccloud.com/pastebin/7NgxTerq/14:10
FacuChipaca, I finished "trying" my unsquashed snap ... how do I tell snap to resume normal refresh behaviour? (that is, when a new snap is available, to use that one instead the one I was trying)14:10
diddledanthe ones from yesterday are my attempts that were showing the failure after each third time, and the ones from today aren't failing14:10
zygaChipaca: one small bug related to snap state: https://bugs.launchpad.net/snapd/+bug/180751214:11
mupBug #1807512: Classic snaps used in --jailmode still use real home directory <snapd:Triaged> <https://launchpad.net/bugs/1807512>14:11
diddledanlooks like core18 did change overnight https://www.irccloud.com/pastebin/8q3GPA3v/snap-tasks-18914:12
zygaha14:12
zygaI bet this is a factor14:12
zygabut I cannot explain how this fixed it for you14:12
diddledanprobably need to mark the bug as resolved for now, and revisit it if it resurfaces?14:13
zygacan you revert core and reproduce it?14:13
zygajust as a last resort?14:13
* diddledan tries14:13
zygathank y ou14:13
zygaI still think there was more to it14:14
zyganot that specific revision of core14:14
zygabut perhaps?14:14
diddledanyeah, I can't reproduce it after reverting core1814:15
ChipacaFacu: snap refresh --amend thesnap14:16
zygadiddledan: thank you for checking14:26
FacuChipaca, wonderful, thanks!14:26
mborzeckizyga: about no space left on device, take a look at this: https://github.com/snapcore/snapd/blob/master/tests/main/install-store-laaaarge/task.yaml#L3..L17 specifically `umount /tmp || true`14:38
zygaor true ;)14:38
mborzeckiyeah14:38
zygaI also worry that we may leak a mount namespace14:38
zygaor something equally non obvious14:38
zygathat can keep any number of bytes in flight14:38
zygawe need to measure leaks14:39
zygawe leak a lot of stuff14:39
mborzeckizyga: hm simple df -h in debug could be useful14:40
zygamborzecki: yes14:43
mborzeckizyga: ok, let me do a quick pr14:43
zygamborzecki: but we should have something that says "this test was not cleaned up correctly: this is what leaked" too14:43
zygamborzecki: but that is harder14:43
mborzeckizyga: iff we see a 4k /tmp we'll know :P14:44
zyga4k is too small14:49
=== ricab|lunch is now known as ricab
mupPR snapd#6321 opened: spread: show free space in debug output <Simple 😃> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6321>14:50
mborzeckizyga: ^^14:52
Son_Gokumborzecki, I'm building 2.36.3 now15:02
zygaSon_Goku: thank you :)15:06
Son_Gokuugh, everything is a bloody mess right now15:06
mborzeckiSon_Goku: yay!15:08
Son_GokuI'm going to deal with the mess of updating F28 and F29 later15:09
Son_Gokubut at least rawhide and epel7 will be done right now15:09
pstolowskicachio: that issue with nightly test you pasted during the standup, was it against 2.36.2?15:12
cachioit uses master15:18
cachiopstolowski, ~15:18
cachiopstolowski, it is part of the snapd main suite15:18
pstolowskicachio: i see, thanks15:18
cachiopstolowski, it is called install-snaps15:19
Son_Gokumborzecki, 2.36.3 built and attached to update: https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2018-b240f3418f15:21
Son_Gokuyou'll have to grab the rpms from here to test for now: https://koji.fedoraproject.org/koji/buildinfo?buildID=117414915:21
pstolowskicachio: ack15:21
pstolowskii'm trying to reproduce manually (with 2.36.2 atm), of course after removing gnome and gtk-common-themes snaps, so far no luck15:22
cachiopstolowski, you can try running this test with -debug15:23
cachionot sure if it is 100% reproduceable15:23
zygaI'm in a debug session, test failed on random network fluke15:24
zygabut maybe not really random15:24
zygacore snap is not installed15:25
zygaand all stuff I try times out15:25
zygawhat was the magic sequence to dump iptables?15:25
zygahttps://www.irccloud.com/pastebin/x6lNrfPW/15:25
zygaaha15:25
zygawe leaked iptables across tests15:26
zygagoogle:ubuntu-16.04-64:tests/main/interfaces-many google:ubuntu-16.04-64:tests/main/remove-errors google:ubuntu-16.04-64:tests/main/install-errors:withreexec google:ubuntu-16.04-64:tests/main/try-snap-goes-away:test_snapd_service google:ubuntu-16.04-64:tests/main/interfaces-gpg-keys google:ubuntu-16.04-64:tests/main/snap-service-after-before google:ubuntu-16.04-64:tests/main/snap-run-alias:testsnapdtoolscat15:27
zygagoogle:ubuntu-16.04-64:tests/main/classic-ubuntu-core-transition-auth google:ubuntu-16.04-64:tests/main/proxy-no-core google:ubuntu-16.04-64 .../tests/runtime-state#15:27
zygaone of those tests leaked it15:27
zygaor is that expected somehow?15:27
zygapstolowski: is this related to your work recently>?15:27
pstolowskizyga: no, the test i added recently added the following rule "iptables -I OUTPUT -p udp --dport 53 -j REJECT --reject-with icmp-port-unreachable"15:30
pstolowskizyga: (snap-network-errors test)15:30
zygammmm15:30
pstolowskizyga: iptables-save > ... dumps the rules15:31
mborzeckizyga: proxy-no-core does this15:31
zygayeah15:31
zygaI just git grepped15:31
pstolowskizyga: econnreset is the other test where we have iptables15:32
pstolowskinah, it has different rules as well15:32
zygarestore is broken?15:34
zyga+ iptables -D OUTPUT -m owner --uid-owner 12345 -j ACCEPT -p tcp15:34
zygaiptables: Bad rule (does a matching rule exist in that chain?).15:34
zygamain/snap-network-errors/task.yaml also didn't restore correctly15:37
pstolowskizyga: hmm looks identical to the one that inserts the rule, except for the order of args15:37
zygaI don't think it's just the restore logic15:37
zygait's not a test that always fails15:37
zygait's something that triggers the castle to fall apart15:38
mborzeckiSon_Goku: i've installed the packages, will try with some random snaps now15:38
pstolowskizyga: where do you see a leftovers from snap-network-errors?15:39
zygapstolowski: just iptables -L15:39
zygahttps://www.irccloud.com/pastebin/8TX9Hu77/15:39
zygaall tests fail so -debug shell is very chatty about it15:39
pstolowskizyga: i don't see the dns rule from s-n-errors test there?15:40
zygaREJECT     all  --  anywhere             anywhere             reject-with icmp-port-unreachable15:41
zygaisn't that it?15:41
pstolowskino15:42
pstolowskizyga: s-n-errors has  iptables -I OUTPUT -p udp --dport 53 -j REJECT --reject-with icmp-port-unreachable (narrowed down to udp, port 53), and in OUTPUT chain, not FORWARD15:42
zygaso something went south15:42
zygaanywy15:43
zygathat's not what I was looking at15:43
zygarestarted to see15:43
zygato see if I can reproduce the issue I'm after15:43
mborzeckiSon_Goku: seems to work fine, +1 karma :)15:48
Son_Gokuexcellent15:48
pedroniscachio: having lunch? are you going to work on core promotion after?15:58
pedronismborzecki: I review #631715:58
mupPR #6317: overlord/snapstate/backend: call fontconfig helpers from the new 'current' <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/6317>15:58
cachiopedronis, preparing lunch16:00
cachiopedronis, core has been promoted to stable16:00
cachiopedronis, but store team was dealing with some infra issues16:01
pedroniscachio: yes, sorry, I somehow missed in the logs16:01
cachiopedronis, np16:01
WimpressAfternoon snapd team :-)16:02
* cachio lunch16:03
WimpressI remember a pending PR that would make it possible to expose access to defined dot file/directories via an interface.16:03
WimpressWhat is the status of that?16:03
pstolowskiWimpress: hey, this https://github.com/snapcore/snapd/pull/5845 ?16:04
mupPR #5845: interface: add new `{personal,system}-files`  interface <Created by mvo5> <https://github.com/snapcore/snapd/pull/5845>16:04
pedronisWimpress: it will be in 2.37,  it will need store declaration approval for use tough16:04
WimpressYep, that is the PR pstolowski 👍16:05
Wimpresspedronis: OK, no problem.16:05
WimpressI've got some ISVs who are keen to take advantage of this.16:05
pstolowskiWimpress: did you manage to find a reproducer for the issue with snap remove taking forever?16:06
Wimpress@sergiusens When will Snapcraft grow support for this capability?16:07
Wimpresspstolowski: I think so. Let me just comfirm the steps.16:07
WimpressTypically, I can't reproduce the issue now.16:09
Wimpresspedronis: What is the ETA for snapd 2.37?16:09
pedronisWimpress: after the break for sure, bit hard to give a precise date right now, core18 work and bug fixes for 2.36.x have delayed it somewhat16:12
niemeyercachio: The proposed reboot command looks a bit suspect16:13
niemeyercachio: The exit on background doesn't do much.. it should be equivalent to doing nothing16:16
niemeyercachio: Then, the reboot isn't being nohup'd, which means if the terminal actually exits it might be killed16:17
niemeyercachio: So I wonder what the actual fix really is16:17
niemeyercachio: The two relevant differences is the use of -f, and the redirect of stdout.. I wonder which of these fixed your problem16:18
zygaRe, had to help the kids in the kitchen16:18
niemeyercachio: Ah, it also puts it in background, although it's not clear what effect that has given that we keep the shell alive16:30
niemeyercachio: The force is also unclear.. systemctl's manual says "When used with halt, poweroff, reboot or kexec, execute the selected operation without shutting down all units."16:31
niemeyercachio: Unclear we want that during testing16:31
niemeyercachio: Would you mind to break down this change and do only a single modification at a time, and see which one actually fixed the problem?16:32
cachioniemeyer, sure16:56
cachioI'll split it16:56
=== pstolowski is now known as pstolowski|afk
popeyogra: got audio working in core on x86 laptop, but pi shows "Dummy Output" like there's no audio card?17:34
popeyhttps://usercontent.irccloud-cdn.com/file/LuF1hBWY/Screenshot%20from%202018-12-18%2017-33-53.png17:34
zygaimages on irc17:34
zygamust be 199517:34
popeyget off my lawn17:34
zygapopey, ogra: not that I should try, I would be interested in alsa status on raspbian17:35
popeyI am not touching alsa with a 10 foot pole, thanks :)17:35
pedroniszyga: "Precious Logs" means do not re-run?17:36
zygayeah17:36
zygaI just did that because I wanted the seed written down17:36
zygaI'll remove the label now17:36
zygafingers crossed, I really want to understand that test failure17:37
popeyon raspbian pulsemixer / pulseaudio snaps work17:41
ograpopey, you need to set the right output device with pactl17:41
popeyhttps://usercontent.irccloud-cdn.com/file/HnIcoVqh/Screenshot%20from%202018-12-18%2017-41-18.png17:41
popeyahhh17:41
ograthe default is HDMIM out on the pi iirc17:41
ogra*HDMI17:42
popeypactl list cards lists none17:43
popeyon raspbian, it lists one17:45
ograhmm, what gadget is that ?17:46
popeypi2            16.04-0.17         29    stable    canonical✓      gadget17:47
popeyon raspbian sys/devices/platform/soc/soc\:audio/bcm2835_alsa/sound/card0/ exists17:47
popeyit doesn't exist on core17:47
ograogra@localhost:~$ cat /proc/asound/cards17:48
ogra 0 [ALSA           ]: bcm2835 - bcm2835 ALSA17:48
ogra                      bcm2835 ALSA17:48
popeyproc asound doesn't exist17:49
ograpopey, does your gadget have:17:49
ograogra@localhost:~$ grep audio= /boot/uboot/config.txt17:49
ogradtparam=audio=on17:49
popeyno17:50
ograaha...17:50
ograthe curse f gadgets not updating payload data17:50
ogra*of17:50
zygait is scheduled to be fixed this 6-month cycle17:50
ograi assume this is an older installation ?17:50
popeyi have a pile 'o' pies, no idea which one this is17:51
popeyit could be, how can I tell when it was installed?17:51
zygayou should be able to look at the seed17:51
zygathe seed is what was made by ubuntu-image17:51
zygaincluding the revisions17:51
ogra(the latest pi gadget has all this fixed ... but config.txt doesnt get upgraded after first install)17:51
popeysnap changes only goes up to 4017:51
zygals /var/lib/snapd/seed17:51
popeyso not that old17:51
ograpopey, well, make sure the above line is in confog.txt and reboot17:51
ogra*config17:52
popeythat'll fix it?17:52
ograyes17:52
ograthat enables the audio device17:52
zygapopey: broken=no17:52
zyga;)17:52
popeydtparam=audio=on  in config.txt, right?17:53
ograyeah17:53
popeyok, now i see proc/asound17:56
popeybut pulseaudio didn't start17:56
popeyah, i was just impatient :D17:56
popeyPi's take a while to boot :)17:56
popey\o/ pulsemixer shows the device now \o/17:57
* ogra just got his first "your month in snaps" 17:57
ograso awesome !17:57
ograthough it is worrying how many users my experimental snaps that are not ready for public yet do have ...17:58
ograseems people dont care if something is in edge only :)17:58
popey\o/ spotify playing on my core \o/17:58
ogra\o/17:58
ograon the pi ?!?17:58
WimpressThanks for the assist ogra :-)17:59
ogranp :)17:59
popeyhttps://usercontent.irccloud-cdn.com/file/Oh3iN6Ux/Screenshot%20from%202018-12-18%2017-59-08.png17:59
popeyYes, controlled from my desktop, pi connected to speaker17:59
ograawesome !17:59
popeyyes :D17:59
popeyblog post coming :D17:59
ograpopey, make sure to recommend the most recent image for it, that will have the fixed config.txt18:00
popeyyeah, will do :D18:00
mupPR snapd#6311 closed: image: do not write empty etc/cloud <Created by mvo5> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/6311>18:23
zygachipaca: does this make any sense to you? https://www.irccloud.com/pastebin/ZfOqgk4D/19:06
zygaChipaca: (in case case sensitive notification)19:06
zygaalso perhaps unexpected file name :)19:06
zygahttps://www.irccloud.com/pastebin/z2xkvTgz/19:06
zygaThe file "-" has text "core (bogus/stable) 16-2.36.3+git1063.bbf4a49 from Canonical✓ refreshed"19:08
zygain any case that test is borken19:09
smosero/19:33
smoserhey.19:33
smoseri'mi trying to update the license at19:33
smoser https://snapcraft.io/image-status/listing19:33
smoseri click 'simple'.  hit 'x' on the "Proprietary" tag that is currently there.19:34
smoserthen type 'GPL' and click the provided "GNU General Public License v2.0 or later"19:34
smoserhit 'Save'19:34
smoserit says19:34
smoserInvalid symbols sequence such as (A B) for token: "-" at position: 719:34
smoserany ideas?19:35
smoseralso nit pick... there are two entries for 'GNU General Public License v2.0 or later'19:35
cachioniemeyer, update done19:56
niemeyercachio: What was the outcome of the test?20:01
cachiothis test is updating the debian image and running snapd tests on the new one20:01
cachioin case the tests pass then that image is promoted to be used on google tests20:02
cachioniemeyer, it is also failing on fedora and amazon images20:02
cachioI reduced the reboot expression as mucha as possible20:05
niemeyerSorry, I meant to ask what was the actual reason the change done fixed the tests?20:05
niemeyerConsidering that there were several bundled changes20:05
cachioniemeyer, the command reboot was not returning20:08
cachiois not returning20:08
cachioso ssh command is getting stuck20:08
cachiowith the & we make sure the ssh finished the execution20:09
cachioniemeyer, just to clarify, by doing "reboot" the reboot is done but the ssh command does not finish20:12
cachiothis is the log https://paste.ubuntu.com/p/x3cyDFZ2nb/20:12
cachioniemeyer,  I also added the & to make it work on devices20:20
cachiobecause just with -f is was failing on rpi20:21
pedroniszyga: I'm also very confused why that test started failing20:21
zygait failed once20:21
zygaI'm running on a loop with the seed from the failure earlier20:21
pedronisI see various PR failing with it20:24
zygaoh?20:26
zygathat's unexpected20:26
zygaI mean20:26
zygaI think the failure is genuine20:26
zygathe redirect is bogus20:26
zygaor some fancy shell syntax I'm unfamiliar with20:26
zygaand I see a file with "-" in the name20:26
zygaso it must be something bad20:26
zygabut not sure why it fails20:26
pedronisI don't see any recent change that would correlate with that failing20:29
zygaI see the same thing, I cannot explain it20:31
zygaI would start undoing the layers of the onion20:31
zygalet's fix the syntax woes20:31
pedroniszyga: I think I know why it's failing20:41
zygaoh, do tell please20:41
Son_Gokuzyga: snapd updates for f28 and f2920:42
Son_Gokuhttps://bodhi.fedoraproject.org/updates/FEDORA-2018-b66c5e0d5320:42
Son_Gokuhttps://bodhi.fedoraproject.org/updates/FEDORA-2018-0aaf48e19620:42
zygaSon_Goku: thank you, I will test it tomorrow20:42
zygaSon_Goku: any surprises?20:42
Son_Gokunah, this just brings us in sync with the epel7 update20:42
zygathat's good20:42
zygauneventful stuff is best20:43
Son_GokuI had to wait for go-systemd update to be available in f28 buildroot override20:43
Son_Goku2.37 will hopefully be the exciting update20:43
Son_GokuI'll be closing somewhere around 50 SELinux policy bugs with that one20:43
niemeyercachio: Does it work with & alone and no other change?20:44
Son_Gokunot necessarily because they're fixed, but because the policy is rewritten too much to apply anymore20:44
cachioniemeyer, it doesn't20:50
cachioit failed with debian20:50
cachiojust with -f it fails in the boards20:50
cachioI don't know why the ssh command is getting stuck20:51
niemeyerWhy?20:51
cachiosame issue20:51
niemeyerHave you read the docs for -f?20:51
cachiossh command does not finish20:51
niemeyerDebian systems shouldn't require it for not failing20:52
niemeyercachio: We need to know what the actual issue is20:52
cachiook, I'll continue researching20:52
cachioany idea what to look in the debian system?20:53
cachioI already checked logs and there is nothing20:53
cachiothe reboot is done20:53
niemeyercachio: If the reboot is done, it can't possibly be about the -f flag.. this is just a way to force it and ignore what services think about the process20:56
niemeyercachio: It's most likely a matter of timing20:56
cachioniemeyer, I mean the reboot is done with -f and without20:57
cachioit is allways done20:57
niemeyerThat's what I mean too20:57
cachioahh20:57
cachiosorry20:57
niemeyerThe -f flag is irrelevant20:57
niemeyerSounds like just shooting stuff on the wall to see what sticks20:58
cachioniemeyer, you mean that -f make it reboots slower20:58
niemeyercachio: step zero is understanding *why* it's not working..20:58
niemeyercachio: No, I mean this is one of many possibilities.. we need to not guess and actually understand the real reason20:59
cachioniemeyer, ok20:59
niemeyercachio: If the machine is rebooting, the problem is much easier to debug20:59
cachioniemeyer, ok21:00
cachioI'll work on this21:01
niemeyercachio: Thanks!21:01
cachioniemeyer, to you21:01

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!