/srv/irclogs.ubuntu.com/2020/08/14/#snappy.txt

mupPR snapd#9145 closed: boot: track trusted assets during initial install, assets cache  <UC20> <Created by bboozzoo> <Merged by bboozzoo> <https://github.com/snapcore/snapd/pull/9145>05:22
mborzeckimorning05:59
mborzeckizyga: hey06:20
zygahey :)06:20
zygaI both wake up at around 6:3006:25
zygaand am sleepy because I cannot get to bed earlier than 1AM06:25
mborzeckimvo: hey06:46
mvogood morning mborzecki06:51
mupPR snapd#9139 closed: interfaces/many: miscellaneous updates for strict microk8s <Created by jdstrand> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/9139>06:53
mupPR snapd#9143 closed: snap: fix repeated "cannot list recovery system" and add test <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/9143>06:53
mvomborzecki: is 9137 something you are looking at or shall I do that?06:53
mupPR snapd#9122 closed: mkversion.sh: disallow changelog versions that have git in it, if we also have git version <Simple 😃> <Created by anonymouse64> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/9122>06:58
mborzeckimvo: i'm looking at it06:58
mvota06:59
mvomborzecki: I had it open so just wanted to make sure we don't duplicate work :)06:59
* mvo looks at fuse instead06:59
pstolowskimorning07:03
zyganow all under control07:10
zygaback to bugfixing07:12
mvogood morning pstolowski and zyga07:12
zygagood morning :)07:13
pstolowskio/07:15
zygahey Pawel :)07:15
mborzeckipstolowski: hey07:15
mborzeckihave you seen https://news.ycombinator.com/item?id=24129208 ?07:15
mborzeckiand https://www.reddit.com/r/linux/comments/i7yk1i/why_is_there_only_one_snap_store/ ?07:16
zygamborzecki the amount of crap there really makes me wonder if having a walk is an order of magnitude more productive way to spend time07:26
zygano amount of facts will help with the infinite pool of opinion07:26
mborzeckizyga: haha, i appraise galgalesh's effort to explain the state of things, but at the same time if feels it's all futile07:27
mborzeckihm there's no tool in core to calculate sha3-384?07:30
mvomborzecki: we should probably have a snap debug for this :/07:31
mvopstolowski: sorry that the generator PR is such a bikeseed :/07:31
mborzeckimvo: i'll try with python's hashlib first, don't recall if sha3 is supported there or not07:32
mvook07:32
pstolowskimvo: don't think there is bikeshed, it's fine07:34
pstolowskithanks for review and suggestions07:34
pstolowskimvo: the /run/systemd/container tip is excellent07:42
zygayeah, that's really cool07:48
zygaerror: cannot install snap file: snap "test-snapd-app" has running apps (pause)07:53
zygaheh, I guess that's dogfooding allright07:53
pstolowskizyga: re #9152 and system("which.."), do you suggest splitting+looping over PATH and "manual" checks?07:57
mupPR #9152: cmd/snapd-generator: generate drop-in to use fuse in container <Bug> <Preseeding 🍞> <Created by stolowski> <https://github.com/snapcore/snapd/pull/9152>07:57
zygayes07:57
zygastrtok_r or something like07:57
zygastat or access(X_OK)07:57
pstolowskiyep08:02
pstolowskizyga: do you think it should be a helper in libprivate..?08:02
zygaonly if you want to - we don't need that in snap-confine today08:02
seb128is there a way to stop 'snap watch <id>'?08:08
seb128ctrl-C, q, aren't working08:08
seb128neither is esc08:08
zygahmm?08:10
zygathat's weird08:10
zygawhat's the state of the process?08:10
seb128what process?08:10
seb128there is something weird08:10
seb128Télécharger un paquet Snap "ubuntu-bug-triage" (205) à partir du canal "l…  56% 3.75MB/s 731ms08:11
seb128the snap is 19M08:11
seb128  latest/stable:    2020.08.13+git2e8c31d 2020-08-13 (205) 19MB -08:11
seb128and it's doing that 56% for some minutes08:11
seb128so I think something is stuck08:11
seb128also according to gnome-system-monitor there is no activity, so the snap watch info is lying08:13
seb128zyga, any idea? can I get any more debug info before I kill snapd?08:20
zygaseb128 snapd or snap wait?08:20
seb128I'm going to kill snapd since it seems stuck08:20
zygahmm08:20
zygacan you abort the change08:21
zygaand try again08:21
seb128I've killed snap wait a bunch of times already08:21
seb128I should have to do that though08:21
zygayeah08:21
zygabut I want to see if snapd is responsive08:21
zygawhat's the state of snapd.service?08:21
seb128zyga, https://people.canonical.com/~seb128/snapd.png08:22
seb128zyga, https://people.canonical.com/~seb128/snapdstatus.txt08:24
zygaaoût 14 09:00:03 sebxps snapd[1336]: 2020/08/14 09:00:03 Unsolicited response received on idle HTTP channel starting with "HTTP/1.0 408 Request Time-out\r\nCache-Control: no-cache\r\nConnection: close\r\nContent-Type: text/html\r\n\r\n<html><body><h1>408 Request Time-out</h1>\nYour browser didn't send a complete request in time.\n</body></html>\n"; err=<nil>08:24
zygaha08:24
zygathat's interesting08:24
zygaI guess that's what failed08:24
zygaif you "snap abort" the refresh change it will fix itself08:24
zygaand we should fix our side to handle this error better08:24
seb128should I open a bug on launchpad?08:25
seb128do you need more info before I abort?08:25
zygayeah, I think it will help, I'm not super familiar with out store stack08:25
zygapstolowski ^08:25
seb128which I guess is going to loose the state08:25
zygacan you have a look please and advise seb12808:25
seb128zyga, thanks for the replies!08:25
zygaalways :)08:25
pstolowskiseb128: yes, please open a bug. i don't have immediate answer to that, seems error handling is missing somewhere, needs investigating08:32
seb128pstolowski, I still have the state, I didn't abort yet, do you need any more info before I press the trigger?08:33
pstolowskiseb128: just in case - 'snap changes' and 'snap change <the refresh change>' if snapd is responding; if not, then 'snap debug state /var/lib/snapd/state.json --changes' and 'snap debug state /var/lib/snapd/state.json --change=..'08:38
mvo408 are kind of a known issue, a combination of store and snapd08:38
seb128pstolowski, snapd is responding08:39
seb128315          Doing  today at 08:59 CEST      -                        Actualiser automatiquement les paquets Snap "openstackclients", "ubuntu-bug-triage", "snapcraft"08:39
pstolowskiseb128: ok, also snap change 315, please attach to bug report (@mvo: do we already have a bug for that?)08:41
seb128pstolowski, https://people.canonical.com/~seb128/snapchange.txt08:41
seb128k, I will open a bug with those info08:41
seb128thanks08:41
pstolowskiseb128: thank you08:44
zygare08:49
zygaI'm making progress in my recovery08:50
zygabut man is that annoying08:50
zygamy ass hurts from sitting08:50
zygajust not used to it08:50
zygaI need to take breaks every 15 minutes or so08:50
seb128pstolowski, zyga, mvo, k, reported as https://bugs.launchpad.net/snapd/+bug/1891618 now09:03
mupBug #1891618: Snapd stucked after a request timeout error <snapd:New> <https://launchpad.net/bugs/1891618>09:03
pstolowskiseb128: ty09:05
seb128bah09:07
seb128so I did snap abort 31509:07
mupPR core18#43 closed: Remove manpages and other documentation, cleanup empty doc dirs <Created by sil2100> <Closed by mvo5> <https://github.com/snapcore/core18/pull/43>09:07
mupPR core18#72 closed: writable-path: enable persistent journal <Created by mvo5> <Closed by mvo5> <https://github.com/snapcore/core18/pull/72>09:07
seb128$ snap changes09:07
seb128...09:07
pstolowskiseb128: could you please attach full https://people.canonical.com/~seb128/snapchange.txt there?09:07
seb128315          Abort  today at 08:59 CEST      -                        Actualiser automatiquement les paquets Snap "openstackclients", "ubuntu-bug-triage", "snapcraft"09:07
seb128but09:07
seb128$ sudo snap refresh ubuntu-bug-triage09:07
seb128erreur : snap "ubuntu-bug-triage" has "auto-refresh" change in progress09:07
seb128 09:07
seb128I still can't refresh my snap?09:07
seb128pstolowski, I'm trying but launchpad timeouts when I try to add a file :/09:08
pstolowskimhm09:08
seb128ah, worked now09:08
pstolowskiwhat worked? refresh or adding attachment?09:08
seb128addind attachment09:08
seb128I guess I need to kill snapd09:09
seb128or to reboot but I've work open and I don't want to loose the context09:09
pstolowskiseb128: give it a few moments, i think it needs to abort and undo things09:10
seb128pstolowski, it has been 5 minutes on a modern config and I see no sign of new activity in snap changes09:11
seb128I think it's not going to recover or unstuck itself09:11
seb128I can wait a bit longer though09:12
mupPR core18#90 closed: Placeholder files <Created by mvo5> <Closed by mvo5> <https://github.com/snapcore/core18/pull/90>09:12
mupPR core18#126 closed: hooks: reduce snapd skeleton directories <Created by zyga> <Merged by sil2100> <https://github.com/snapcore/core18/pull/126>09:12
pstolowskimaybe it's stuck inside this task, give it a minute then yes, snapd restart09:12
mupPR core18#134 closed: hooks: add apt/apt-get/apt-cache warning (based on mvo's branch) <Created by sil2100> <Merged by mvo5> <https://github.com/snapcore/core18/pull/134>09:12
pstolowskiwe will look into it09:12
mupPR core18#166 closed: hooks/900-cleanup-etc-var.chroot: rm cloud-init config file which we don't want <Created by anonymouse64> <Merged by mvo5> <https://github.com/snapcore/core18/pull/166>09:17
seb128pstolowski, it has been 10 minutes, I don't think it makes sense to keep waiting, I restart snapd09:18
pstolowskiseb128: yes09:18
seb128what, systemctl restart snapd is also blocking09:19
mupPR core20#11 closed: Add arm64 architecture <Created by xnox> <Closed by mvo5> <https://github.com/snapcore/core20/pull/11>09:19
* seb128 does shotgun snapd09:19
seb128hum09:20
seb128~$ ps aux | grep snapd09:20
seb128root       11537  0.0  0.0 477372  6116 ?        Ssl  11:19   0:00 /usr/lib/snapd/snap-failure snapd09:20
seb128what is snap-failure?09:20
seb128(no manpage)09:20
zygaseb128 it's a program we invoke after snapd fails09:24
mborzeckiseb128: reverts snapd to a previous revision09:24
zygaIIRC it should only run on core systmems09:24
zygaand yes, we should write manual pages09:24
mupPR core20#54 closed: static: switch /etc/cloud from synced to persistent <question> <Created by mvo5> <Merged by sil2100> <https://github.com/snapcore/core20/pull/54>09:24
* zyga happily will09:24
seb128well, there process is there on my classic desktop09:25
seb128and not going away09:25
seb128I guess I do need to restart the machine :(09:25
zygahmmm09:25
zygamvo ^09:25
zygathis is probably very not intentional09:25
seb128that's annoying, I really don't want to reboot now09:25
seb128but I need to refresh some snaps to work on things09:26
* seb128 tries to kill snap-failure, who knows09:26
pstolowskii'm setting this to critical09:26
seb128ah, I got a working snapd back09:26
seb128pstolowski, zyga, thanks for the help09:27
seb128pstolowski, well, if it's rare enough that only me have been hitting it that's probably not critical09:27
mborzeckizyga: it runs on classic too, otherwise nothing would revert snapd if it fails to start09:27
pstolowskiseb128: sure, sorry for the inconvienience, we will look into it09:27
zygamborzecki hmmmmm09:27
seb128np, thanks for the help!09:27
mborzeckiseb128: can you post journalctl -u snapd somewhere?09:27
mborzeckizyga: maybe you meant snap-repair?09:27
zygano09:28
zygahmm09:28
zygaso what is going on09:28
zygawhy is it running?09:28
mupPR snapd#9156 opened: boot: copy boot assets cache to new root <UC20> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/9156>09:28
mborzeckizyga: snapd crashed & failed probably09:28
seb128mborzecki, https://people.canonical.com/~seb128/snapjournal.txt09:29
zygayes but is snapd-failure finished09:29
zygaor stuck09:29
mupIssue core20#66 closed: Use focal base in travis <Created by xnox> <Closed by sil2100> <https://github.com/snapcore/core20/issues/66>09:29
mupPR # closed: core20#58, core20#73, core20#74, core20#77, core20#7809:29
mborzeckiseb128: thanks, can you include all of journal between 11:06 and 11:26?09:30
seb128mborzecki, https://people.canonical.com/~seb128/journal.txt09:32
mborzeckiseb128: thanks!09:33
seb128mborzecki, 11:19 is when I ended up doing a kill -9 snapd09:33
seb128mborzecki, and :26 when I killed snap-failure09:33
seb128or :25 rather09:34
mborzeckimvo: ^^ some weird interaction, snapd failed, `snap-failure snapd` got started and launched snapd, which then worked as if nothing happened, because original failure was not related to snapd task09:37
mvomborzecki: oh, why did the original snapd fail? also that sounds like we need snap-failure more clever and just do nothing but restart snapd if it's unrelated to refreshes09:38
mupPR snapd#9137 closed: boot: refactor such that bootStateUpdate20 mainly carries Modeenv <UC20> <Created by pedronis> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/9137>09:38
mborzeckiseb128: i see you tried to referesh ubuntu-bug-triage snap and abort a change 315, what was the change about?09:38
mvodo we know why snapd failed? nil pointer or something?09:39
mborzeckiseb128: was there a prompt from gtk polkit asking for a password maybe?09:40
mborzeckimvo: looks like snapd was not responding, seb128 tried to restart it, but snapd did not exit so got killed by systemd and triggered snap-failure09:41
seb128mborzecki, no, but I was on xubuntu session for trying something and polkit prompting seems to not work there09:41
seb128so maybe it did try and fail09:41
mborzeckimvo: i'm speculating, but what would happen if you have a polkit prompt (or snapd goes to ask polkit) and you try to restart the snapd service?09:43
mvomborzecki: no idea, but that sounds plausible09:44
mvothat it would hang then09:44
mborzeckimvo: heh, systemctl restart snapd is hanging, snapd is clearly waiting for polkit to answer09:49
mborzeckimvo: well, but it was stuck on api activity, so eventually closed09:50
mborzeckimvo: so prpbably something else then09:50
mvomborzecki: looking at snap-failure I think it is indeed a bit too naive and not considering non-upgrade cases properly09:54
mupPR snapd#9157 opened: o/devicestate: wrap asset update observer error <Simple 😃> <Skip spread> <UC20> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/9157>09:59
mborzeckimvo: we don't look at the state at all, it feels like snapd should do it when it's launched by snap-failure09:59
mvomborzecki: yeah09:59
mborzeckimvo: perhaps we need snap failure to indicate it's in some sort of failure handling mode and the previous snapd would act accordingly (eg. in this case exit nicely and do nothing?)09:59
* zyga heads upstairs10:09
zygamvo I have a fix for the bug10:31
zygamvo I will have a patch with a regression test ready by the standup10:32
zygait's something we can easily cherry pick into any release10:32
mvomborzecki: yes, I think so10:42
mvozyga: for which bug?10:42
zygamvo the priority bug from field https://bugs.launchpad.net/snapd/+bug/189137110:42
mupBug #1891371: mount namespace issues <snapd:In Progress by zyga> <https://launchpad.net/bugs/1891371>10:42
zygajust working on better testing10:42
zygaand explanations10:42
mvozyga: nice!10:43
mupPR snapcraft#3203 closed: experimental ros2 extension & colcon v2 plugin <enhancement> <specification> <Created by cjp256> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/3203>10:51
pstolowskimvo: updated #9152, spread test passed now locally, i had a silly bug (C is full of traps)10:59
mupPR #9152: cmd/snapd-generator: generate drop-in to use fuse in container <Bug> <Preseeding 🍞> <Created by stolowski> <https://github.com/snapcore/snapd/pull/9152>10:59
mvopstolowski: nice10:59
zygapstolowski I'll re-review after standup11:03
pstolowskity11:05
* pstolowski lunch11:13
mvolooks like we have a bug with "service.console-conf.disable: true" during seeidng of core20, instigating right now11:26
zyga /me learned something new justn ow11:29
mupPR snapcraft#3248 opened: specifications: fix typo in package-repositories <Created by cjp256> <https://github.com/snapcore/snapcraft/pull/3248>11:36
mupPR snapcraft#3249 opened: Tiny typo fix <Created by igorljubuncic> <https://github.com/snapcore/snapcraft/pull/3249>11:36
mupPR snapd#9158 opened: logger: add support for setting snapd.debug=1 on kernel cmdline <Created by mvo5> <https://github.com/snapcore/snapd/pull/9158>11:44
pstolowskioh wow, GitLens for ms visual code is nice12:02
zygaE: Failed to fetch http://us-east1.gce.archive.ubuntu.com/ubuntu/pool/main/a/apparmor/libapparmor-dev_2.13.3-7ubuntu6_amd64.deb  Temporary failure resolving 'us-east1.gce.archive.ubuntu.com'12:03
zygaanyone seen this?12:03
mupPR snapd#9159 opened: cmd/snap-update-ns: detach all bind-mounted file <Bug> <Created by zyga> <https://github.com/snapcore/snapd/pull/9159>12:04
zygamborzecki /proc/pid/fdinfo/FD shows the mount id of the filesystem that contains the open file12:11
zygaTIL12:11
mupPR snapcraft#3248 closed: specifications: fix typo in package-repositories <Created by cjp256> <Closed by sergiusens> <https://github.com/snapcore/snapcraft/pull/3248>12:11
* zyga coffee and then more bugs12:11
mupPR snapcraft#3249 closed: Tiny typo fix <specification> <Created by igorljubuncic> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/3249>12:11
mvoxnox: do you think you could have a look at https://bugs.launchpad.net/snapd/+bug/1891644 ? what should we do with console-conf when it's disabled12:16
mupBug #1891644: uc20 seeding fails with "service.console-conf.disable: true" <uc20> <snapd:Triaged> <https://launchpad.net/bugs/1891644>12:16
zygapstolowski: https://github.com/snapcore/snapd/pull/9152#pullrequestreview-46753031712:28
mupPR #9152: cmd/snapd-generator: generate drop-in to use fuse in container <Bug> <Preseeding 🍞> <Created by stolowski> <https://github.com/snapcore/snapd/pull/9152>12:28
mupPR snapd#9157 closed: o/devicestate: wrap asset update observer error <Simple 😃> <Skip spread> <UC20> <Created by bboozzoo> <Merged by cmatsuoka> <https://github.com/snapcore/snapd/pull/9157>12:39
pstolowskizyga-mbp: thanks12:43
zyga-mbpafk, see you at the standup12:44
mupPR snapd#9160 opened: boot, o/devicestate: observe existing recovery bootloader trusted boot assets <UC20> <Created by bboozzoo> <https://github.com/snapcore/snapd/pull/9160>13:19
zygaI'll grab lunch now if I can13:23
mborzeckii need to wrap it up for now and attend to some errands, bbl13:34
mupPR snapd#9161 opened: kernel: add kernel.Validate() <Created by mvo5> <https://github.com/snapcore/snapd/pull/9161>15:05
cachiopstolowski, hey15:10
cachioI see this https://paste.ubuntu.com/p/V2hF7TJzjB/15:10
cachioany idea which could be the root cause'15:11
cachio?15:11
pstolowskicachio: is this master?15:12
cachiopstolowski, it is my nested branch15:13
pstolowskicachio: this test is hacking stuff around snapd inside the preseeded system. it is senstive about what version of snapd runs with snap-preseed, and what version of snapd is used when the preseeded system boots15:14
cachiopstolowski, ok, I'll try to see if it is caused because any change in the PR15:16
pstolowskicachio: it is also injecting snapd into seeds of the preseeded system15:17
pstolowskicachio: also, do you have all changes from master in your branch?15:17
cachiopstolowski, no latest ones15:18
* cachio lunch15:22
zyga-mbpI have a fix for networkd15:49
zyga-mbpwill send and EOD15:49
mupPR snapd#9162 opened: gadget: change mountedfilesystemwriter to use resolvedSource (3/N) <Created by mvo5> <https://github.com/snapcore/snapd/pull/9162>15:55
mupPR snapd#8931 closed: tests/main/install-fontconfig-cache-gen: enhance test by verifying, add fonts to test <Simple 😃> <Test Robustness> <Created by anonymouse64> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/8931>16:00
* zyga-mbp goes to exercise17:19
mupPR snapd#9163 opened: tests: work around broken update of systemd-networkd <Test Robustness> <Created by zyga> <https://github.com/snapcore/snapd/pull/9163>17:20
zyga-mbpcachio ^ plz merge when green17:26
cachiozyga-mbp, sure17:26
cachioenjoy the exercises17:27
mupPR snapd#9165 opened: interfaces: add kernel-crypto-api interface - 2.46 <Created by jdstrand> <https://github.com/snapcore/snapd/pull/9165>18:01
mupPR snapd#9166 opened: interfaces/many: miscellaneous updates for strict microk8s - 2.46 <Created by jdstrand> <https://github.com/snapcore/snapd/pull/9166>18:11
mupPR snapd#9167 opened: many: correctly calculate the desktop file prefix everywhere <Created by jdstrand> <https://github.com/snapcore/snapd/pull/9167>20:56
mupPR snapd#9163 closed: tests: work around broken update of systemd-networkd <Test Robustness> <Created by zyga> <Merged by sergiocazzolato> <https://github.com/snapcore/snapd/pull/9163>21:11
mupPR snapcraft#3250 opened: cli: implement list-tracks <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/3250>21:42

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!