/srv/irclogs.ubuntu.com/2017/04/11/#snappy.txt

mbenzDid you see Tino is gone as of today?00:07
morphismorning!06:20
tvossgood morning :)06:32
mupPR snapd#3167 opened: interfaces: fold network bind into core support with tests <Created by mvo5> <https://github.com/snapcore/snapd/pull/3167>06:44
tvosspedronis: so tyhicks is proposing /run/snapd as the place to put the temporary key files06:45
tvosspedronis: is that reasonable for you?06:46
zygagood morning06:46
zygatvoss: what's up? :-)06:46
tvosszyga: aiming to finalize the key generation PR06:47
zygatvoss: mhm06:47
zygamvo: hey06:47
tvosszyga: tyhicks is proposing /run/snapd to place the temporary key files, I'm fine with that. Do you have any objections?06:48
zygamvo: I merged one of the approved PRs last night06:48
zygatvoss: who will place them there?06:48
tvosszyga: snapd itself, when generating the device key. cleaning them up once the operation finishes06:49
zygatvoss: /run/snapd/lock and /run/snapd/ns are touched by snap-confine but I think this is fine06:49
zygatvoss: maybe you can use a sub-directory, not sure what your plan is fully06:49
tvosszyga: I just need a place to put the key files temporarily06:50
zygatvoss: and /tmp is not good?06:50
tvosszyga: so readable/writable by snapd only is pretty much the only requirement06:50
zygaaha06:50
morphiszyga: so this static/non-static build of snap-confine is really tricky now, why did you drop the the --enable-partially-static thing and switched to individual --enable-static-* switches?06:52
tvosszyga: with that, /run/snapd seems like a good choice06:52
zygamorphis: because --enable-partially-static is a no-op in the new scheme, it's always like that06:52
zygamorphis: you can pick any partially static part of snap-confine06:52
zygamorphis: and it is not possible to build a fully static snap-confine anyway, because of udev06:53
zygatvoss: and /tmp?06:53
tvosszyga: does snapd get its own /tmp? If not, I would rather put it in a more specific directory06:53
zygatvoss: no, snapd doesn't get any magic treatment, /tmp is shared06:54
tvosszyga: so I would rather go for /run/snapd then06:54
* zyga is still somehow confused, why /run vs /tmp for temp file06:54
zygait's not that /run is bad, I just want to understand why it was picked over /tmp06:54
tvosszyga: following securities advice. /tmp is world readable, right?06:55
zygatvoss: as is run06:55
zygatvoss: it's just a matter of giving the right mode to the file06:55
tvosszyga: it get's the right mode from ssh-keygen already06:56
zygatvoss: so there's no difference06:56
tvosszyga: feel free to comment on the PR, too.06:56
zygatvoss: yep, thanks06:58
zygatvoss: is that 2.24 material?06:58
zygatvoss: or 2.25?06:58
tvosszyga: well, ideally, we would have it in 2.2406:58
* zyga nods07:00
zygapedronis: hey07:05
zygapedronis: so I'd like to understand how we are going to proceed07:05
zygapedronis: (fold and fix later vs fix now)07:06
zygapedronis: do I understand correctly that the root issue is how auto-connect works?07:06
mvohttps://forum.snapcraft.io/t/unblocking-2-24/238 is my proposal to get 2.24 out and then fix the deeper issues07:07
pstolowskimorning07:10
zygapstolowski: hello :)07:11
morphiszyga: so for whatever libtool/autotools reason https://github.com/snapcore/snapd/pull/3162 disables linking libcap statically, it ends up in _STATIC but is linked against the .so07:11
mupPR snapd#3162: cmd: use libtool for the internal library <Created by morphis> <https://github.com/snapcore/snapd/pull/3162>07:11
morphispstolowski: morning!07:12
zygamorphis: because the .la files now dictate everything07:12
zygamorphis: kind of suspected this would happen though, did we merge that already by any chance?07:12
morphissure, but shouldn't we be able to override that?07:12
morphiszyga: we didn't07:13
morphistests are detecting that libcap is dynamically linked07:13
zygamorphis: yes but the way is not the same, I suspect07:13
pedronismvo: zyga: I answered there07:13
zygamorphis: look at the resulting makefile07:13
zygapedronis: thanks!07:13
morphiszyga: I do07:14
morphiszyga: .._STATIC = -lcap is what we have there07:14
mvopedronis: so just picking selected bits from 3145 ? let me see07:14
zygapedronis: "this part" is fixDisconnectedCorePlugs or the hack further down in autoConnect?07:16
zygamorphis: those are just variables, look at rules07:16
pedroniszyga: the hack in autoconnect, after thinking it seems we don't need fixDisconnectedCorePlugs ... when we intall the new core we run autoconnect logic again07:16
zygapedronis: aha, interesting07:17
* zyga thinks 07:17
pedroniszyga: remember that for core we run setup-profiles twice, once in the old snapd and once in the new one07:17
zygayes, that's right07:18
zygaand the 2nd try will already have the hack and will connect things07:18
zyga(the plugs that is)07:18
zygamvo: I think it will work too07:19
zygaI worry about folding (a little) that it's a slippery slope we will have to climb out of for some reason we cannot forsee yet07:19
pedronisthis is not true for very old snapds but then those have other bugs around running configure too07:19
zyga(that we will end up needing the privilege separation in core007:20
zygamvo: I think this is your call ultimately, while we discuss more and more there will be more and more branches proposed/merged07:20
zygamvo: so if you want to limit the extent of the changes we put into 2.24, I think the way is to release now07:21
mupPR snapd#3168 opened: .travis.yml: add option make raw log less noisy <Created by fgimenez> <https://github.com/snapcore/snapd/pull/3168>07:21
mvozyga, pedronis: I am fine with adding a special case for core/core-support in auto-connect, if its small and targeted, but I really want to get on with 2.24, that is my overriding priority right now (of course while still making sane decisions)07:21
mvozyga: release now with 3167? or release now now :) ?07:22
zygamvo: "now" as in quickly07:22
mvo+10007:22
mvopedronis: so your second suggestion is to use folding + special case, a special case like http://paste.ubuntu.com/24359539/ ?07:25
pedronismvo: well if we also fold the special case could be just about core-support but yes07:25
mvopedronis: do you have something simpler in mind already, if so, would you mind sketching it out? I'm fine with fold+special-case as it feels like we at least have everything ready when autoconnect is fully fixed this way. as long as its straightfoward :)07:27
* zyga would like to know what the fully fixed autoconnect is like07:28
mvozyga: thats for later, lets not get distracted ;)07:29
pedronisthat's a bigger thing07:29
* mvo puts on his tunnel vision glasses07:29
pedronisnot doing to think about that now (though I have ideas)07:29
pedronismvo: I think just taking that bit and   plug.Interface == "core-support"  first would be enough for now , if we fold ... we can improve/change it later07:30
zygado you want me to prepare that branch?07:33
mvozyga: if you don't mind, as small as possible please :)07:35
zygamvo: OK07:36
morphiszyga: ok, problem is that libtool needs the full-path to the .a we want to statically link07:37
mupPR snapd#3164 closed: tests: ensure network-bind and core-support are connected <Created by mvo5> <Closed by mvo5> <https://github.com/snapcore/snapd/pull/3164>07:39
mupPR snapd#3165 closed: interfaces: adjust shm accesses to use 'm' for updated mmap kernel mediation <Created by jdstrand> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3165>07:41
mvoI need reviews for 3167 - at leat one, the underlying branch (without the spread test) got a +1 from gustavo already07:43
zygamvo: running tests locally07:52
mvozyga: great, looking forward for this branch07:53
mvoto this branch07:53
zygamvo: I included the small yaml cleanup as I didn't want to tear that out and it is harmless (just variable rename for correctness)07:55
zygamvo: (same that was there originally)07:55
mvozyga: sounds good, push it07:56
* mvo is being pushy07:56
mupPR snapd#3168 closed: .travis.yml: add option to make raw log less noisy <Created by fgimenez> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3168>07:57
pstolowskiwe don't seem to have any spread tests which exercises gadget config defaults, do we?08:03
pedronispstolowski: no, also that functionality is broken in other ways08:03
pstolowskipedronis, how do you mean?08:04
pedronispstolowski: that at first boot it will not always be applied because of order issues08:04
pedronisof things08:04
pstolowskipedronis, oh i see. ty08:06
pedronissomething to fix for 2.25 (I think)08:08
mupPR snapd#3169 opened: many: fix plug auto-connect during core transition <Created by zyga> <https://github.com/snapcore/snapd/pull/3169>08:10
zygapedronis, mvo: ^08:11
mvozyga: could you have a look at 3167 please?08:12
Chipacamorning eurofriends08:12
Chipacaanything particularly lit today?08:12
zygamvo: certainly, looking now08:12
mvota08:13
zygaChipaca: morning separatistic islander, nothing particularly on fire08:13
mvohey Chipaca! good morning08:13
mvoChipaca: I'm having slight tunnel vision to get 2.24 out but otherwise things are fine08:14
mvos/slight/huge/08:14
Chipacamvo— as well you should08:14
Chipacamvo— as long as it's not from getting up too quickly or something :-)08:14
zygamvo: the regexpes there feel too generic, if we grow core-support-apparatus they will still match08:14
zygamvo: but since tests are passing ignore me for now :)08:15
mvozyga: :) happy to do a followup08:15
zygamvo: in 2.25 :)08:15
zygamvo: I just approved it08:15
* zyga is getting hungry08:16
zygaI'll talk to you after some 1-2-1s08:16
mvoChipaca: if you don't mind a review of 3167 would be great, should be very simple08:16
mvozyga: sure, thanks for your help!08:17
Chipacazyga— my whole house is going to be smelling of slow-cooking beans, onions, peppers and bay leaves today. I think I'm having another breakfast.08:17
Chipacamvo— +1; there's a typo in a comment, but you can fix later08:20
mvoChipaca: hahahaa - thats such a freudian slip - cure-support!08:21
Chipaca:-)08:21
Chipacamvo— maybe you're just missing '80s rock08:21
mvoChipaca, ogra_: and now - https://github.com/snapcore/core/pull/33/files08:22
mupPR core#33: the core snap only needs core-support  (not network-bind) <Created by mvo5> <https://github.com/snapcore/core/pull/33>08:22
mupPR snapd#3166 closed: interfaces/builtin: fold network-bind into core-support <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3166>08:22
mupPR snapd#3167 closed: interfaces: fold network bind into core support with tests <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3167>08:22
mvoChipaca: lol08:22
mvopretty please08:22
* mvo is still pushy08:22
ogra_approved08:22
mvota!08:22
Chipacayeah, +1. Bring on the two-line merges.08:22
ogra_heh08:23
mupPR core#33 closed: the core snap only needs core-support  (not network-bind) <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/core/pull/33>08:23
pedroniszyga: does #3169 work from your tests?08:24
mupPR snapd#3162 closed: cmd: use libtool for the internal library <Created by morphis> <Closed by morphis> <https://github.com/snapcore/snapd/pull/3162>08:29
mvoogra_: and one more for core (sorry for that)08:39
mupPR core#34 opened: really remove network-bind-plug <Created by mvo5> <https://github.com/snapcore/core/pull/34>08:39
pedroniszyga: mvo: core-support is interesting because is probably the only? one of the only interfaces where plug and slot that connect are on the same snap?08:41
mvopedronis: yeah, I think so08:41
zygapedronis: network-manager and modem-manager have some smilar properties08:41
zygaor maybe something related to location support, I recall really wacky archtecture08:42
zygabut core-support is certainly most common08:42
fgimenezmm i'm getting a lot of "2017-04-11 04:37:02 Discarding linode:ubuntu-core-16-64 (Spread-06), cannot connect: cannot connect to linode:ubuntu-core-16-64 (Spread-06): ssh: handshake failed: ssh: unable to authenticate, attempted methods [password none], no supported methods remain" this morning https://travis-ci.org/snapcore/spread-cron/builds/220818086#L38208:42
zygaaha08:42
zygamaybe some other spread collected that machine since it was started?08:42
pedroniszyga: if we have more maybe (I say maybe) it would be interesting to consider the concept of self-plugging , instead of abusing autoconnect for this08:43
zygapedronis: implicit or somehow explicitly declared in yaml?08:44
pedroniswell somehow/somewhere we would need to say that core-support plug on core is supposed to plug into the same snap slot08:45
DonAlexDoes anyone know what barriers there are to getting tincd running as a snap?08:45
pedronisanyway if it's just core-support if might be easier to just special case (also because the issue is mostly transition)08:45
zygaDonAlex: we don't know what tincd is so probably you need to tell us more08:47
zygapedronis: I agree we should explore how connecting should work08:47
zygapedronis: including a way to say "this snap requires connection before it is functional"08:48
zygapedronis: something that is currently not possible08:48
mvoChipaca: one more trivial review please https://github.com/snapcore/core/pull/34 - silly me for overlooking this earlier08:51
mupPR core#34: really remove network-bind-plug <Created by mvo5> <https://github.com/snapcore/core/pull/34>08:51
Chipacamvo— hah08:52
Chipaca+1'ed08:52
DonAlexzyga: https://tinc-vpn.org/08:52
DonAlexIf I am using a snap on a server I want to be able to put it on my VPN08:52
mupPR core#34 closed: really remove network-bind-plug <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/core/pull/34>08:56
mupPR snapd#3170 opened: interfaces/builting: allow read-only access to /sys/module <Created by morphis> <https://github.com/snapcore/snapd/pull/3170>08:58
zygaDonAlex: we don't have support for user services08:59
zygaDonAlex: not sure if that is required08:59
zygaDonAlex: I'd recommend building it as a snap and checking what is missing08:59
zygaDonAlex: we will gladly take feedback08:59
zygaDonAlex: as for permissions, you may need to run in devmode initially (not sure)08:59
zygaDonAlex: devmode means that confinement is advisory, not mandatory09:00
zygaDonAlex: but we can add new interfaces quickly09:00
zygaDonAlex: (or extend existing interfaces where appropriate)09:00
zygaDonAlex: stay in the loop, post on forum.snapcraft.io, try things out09:00
mvowe are close to user services, there is a PR, let me try to find it09:00
mvohttps://github.com/snapcore/snapd/pull/275209:01
mupPR snapd#2752: snap: add support user-sessions from snaps <Blocked> <Created by mvo5> <Closed by niemeyer> <https://github.com/snapcore/snapd/pull/2752>09:01
pedronismvo: so 2.25 is probably more likely to be around the 25th, after yesterday discussion?09:01
* zyga is done with breakfast09:01
mvopedronis: correct09:01
zygaand heads to 1-2-109:01
pedronismvo: changing the date on github09:01
mvopedronis: \o/09:01
DonAlexzyga: I guess the biggest problem will be with creating the device or loading the tun module.09:02
DonAlexzyga: That is normally a system action. Though if you use user permission on some system it works.09:02
zygaDonAlex: tun module can be loaded with the kmod interface09:02
zygaDonAlex: essentially snapd will load the module for you09:02
zygaDonAlex: does it take any parameters that need to be tweaked / set09:03
zygaDonAlex: what devices do you need to create?09:03
DonAlexzyga: hmm no i don't think so .. just needs the device to be created09:03
zygaDonAlex: does the module do that or is that done from userspace?09:03
DonAlexzyga: it creates and iterative interface names per network so tun1 tun2 etc.09:04
ogra_mvo, hmmm09:07
ogra_unknown plugs interface name reference 'network-bind-plug' lint-snap-v2_hook_plugs_plug_reference (configure, network-bind-plug)09:07
mvoogra_: yeah, see above09:07
ogra_mvo, thats what the store mailed me for the last round of core buillds09:07
ogra_ah, k09:07
mvoogra_: the fix is in, Chipaca was kind enough to review. silly me for overlooking a plug reference09:07
mvotoo much tunnel vision :(09:08
mupPR snapd#3171 opened: snapstate: normalize gadget defaults <Created by stolowski> <https://github.com/snapcore/snapd/pull/3171>09:08
ogra_mvo, well, i'D appreciate a tunnel vision that distracts me from that awful spreadsheet09:08
mvoogra_: :(09:09
zygaoh09:11
zygadarn, I forgot09:11
Chipacamvo, ogra_, zyga, all the unknowns there are killing me (and there's 2+ weeks to go for those)09:11
ogra_Choh, i thought it was supposed to be done by friday09:12
ogra_Chipaca,09:12
Chipacanope, 2-3 weeks09:12
ogra_sigh09:12
Chipacayep09:12
ogra_mvo, this build got through !09:13
mvoogra_: yeah, I'm running a local test now and fire spread09:14
mvoup09:14
mikeb_Chipaca: In case you didn't see my note yesterday, I've put up that promised demo at https://github.com/mabnhdev/snappy-daemon-demo.09:14
Chipacamikeb_— I didn't, no09:15
Chipacanetwork's been iffy and irc doesn't cope well with that09:15
Chipacamikeb_— why is 'devmode' needed?09:17
woodrowshenmvo: hi09:17
Chipacamikeb_— anyway, thanks, I'll look into this09:18
mvohey woodrowshen09:18
DonAlexOk .. gonna have a go at building it myself. Will let you know what happens via the forums.09:18
mikeb_Chipaca: devmode is force of habit - I mostly play with code that violates containment.09:19
Chipacamikeb_— cheeky :-)09:19
Chipacamikeb_— but seriously, thank you, and I'll be playing with this09:19
Chipacamight get something into 2.25 if it's concise enough09:20
mikeb_Chipaca: I appreciate your time.  Thanks.09:20
Chipaca(and if we all agree on it)09:20
woodrowshenmvo: i built snappy image with armhf, and just found core snap rev. is 1580, is it current rev. in stable ?09:21
mvowoodrowshen: that sounds correct09:23
mvowoodrowshen: 1580 is the stable core on armhf with snapd 2.23.609:24
woodrowshenmvo: ok, thanks. i met the weird case of failure to exec `snap list`09:24
zygare09:25
zygahow can I help?09:25
mvowoodrowshen: what is the failure? can you please pastebin it09:27
mvozyga: mostly waiting for tests now, the new core breaks the interfaces-network-bind spread test testing a fix locally and then we should be good again09:29
woodrowshenmvo: http://paste.ubuntu.com/24359921/09:31
woodrowshenmvo: just output "error: cannot list snaps: cannot communicate with server: Get http://localhost/v2/snaps: EOF"09:32
zygawoodrowshen: let me help you09:32
zygamvo: focus on the fix :)09:32
mvowoodrowshen: Apr 11 08:46:07 localhost snapd[1994]: runtime: out of memory: cannot allocate 258801664-byte block (510001152 in use)09:32
mvowoodrowshen: what system is that? how much ram?09:32
mvozyga: ha! thank you09:32
zygawoodrowshen: how about "snap version"09:32
mvozyga: even better09:32
zygawoodrowshen: and systemctl status snapd.service09:32
woodrowshenzyga: mvo: thanks a lot09:33
woodrowshenzyga: ooo...09:33
mupPR snapd#3172 opened: tests: fix interfaces-network-bind to match the new core <Created by mvo5> <https://github.com/snapcore/snapd/pull/3172>09:34
woodrowshenzyga: all snap commands can't work09:34
zygawoodrowshen: how much memory do you have there?09:36
woodrowshenzyga: 1G09:36
zygawoodrowshen: what is that system, is it a VM?09:37
zygawoodrowshen: what dis09:37
zygadistribution?09:37
woodrowshenzyga: roseapple-pi, a devel board09:38
zygawoodrowshen: aha09:38
zygawoodrowshen: which kernel are you running09:38
woodrowshenzyga: 3.10.3709:38
zygawoodrowshen: and how did you install the system; did you build an all-snap (aka core) image or is this a distro running on your board and you just installed/compiled snapd there09:39
zygawoodrowshen: with 1GB of ram, are you running anything like a graphical UI there?09:39
woodrowshenzyga: https://github.com/xapp-le/SnappyUbuntuCore/blob/master/builder/build-snappy.sh09:41
woodrowshenzyga: i used this script to build it09:41
zygawoodrowshen: let me see09:41
woodrowshenzyga: no any graphics satck09:41
woodrowshenzyga: s/satck/stack/09:41
zygawoodrowshen: aha, so it's an all-snap/core image09:42
woodrowshenzyga: yes, and previous images i had built didn't happen that.09:42
zygawoodrowshen: can you pastebin "top -b -n 1"09:43
woodrowshenzyga: i wonder if we have pastebin snap XDDD09:43
zygawoodrowshen: you can ssh in09:44
zygawoodrowshen: run that command09:44
zygawoodrowshen: and copy-paste09:44
zygawoodrowshen: (into something like pastebin.ubuntu.com09:45
woodrowshenzyga: http://paste.ubuntu.com/24359952/09:45
zygawoodrowshen: does snap version run?09:47
zygawoodrowshen: or is that crashing too?09:47
woodrowshenzyga: no, the system still works normally. just snap commands will get stuck09:48
tvosspedronis: mind having another look here: https://github.com/snapcore/snapd/pull/313009:48
mupPR snapd#3130: overlord/devicestate: switch to ssh-keygen for device key generation <Created by vosst> <https://github.com/snapcore/snapd/pull/3130>09:48
woodrowshenzyga: even snap version09:48
tvosspedronis: switched back ssh-keygen :)09:49
woodrowshenzyga: sorry fix the description, snap commands will get stuck for a while, and output "error: cannot list snaps: cannot communicate with server: Get http://localhost/v2/snaps: EOF"09:49
zygaright09:51
Chipacawoodrowshen— journalctl -u snapd.service09:52
Chipacaplease09:52
mvohm, unreleated -  I think we need spread tests for the core options, I just got  a failure trying to snap set  core ystem.power-key-action - looks like we have no /etc/systemd/logind.conf.d directiory09:52
zygawoodrowshen: and after you get that log, can you systemctl restart snapd.service09:54
zygawoodrowshen: and see if memory usage drops09:54
zygawoodrowshen: and if you can run snap changes or what not09:54
woodrowshenChipaca: http://paste.ubuntu.com/24359985/09:54
mvozyga: do you know if there is a way to allow only a single "mkdir" on a directory via apparmor. i.e. not full write but just mkdir?09:55
Chipacawoodrowshen— there you go then09:55
Chipacawoodrowshen— this is probably bug #167477809:56
mupBug #1674778: snapd hangs with 100% CPU usage when image has a custom gadget snap <gadget> <snapd> <Snappy:Confirmed> <https://launchpad.net/bugs/1674778>09:56
Chipacawoodrowshen— IOW you probably have a bug in your gadget snap, and we have a bug in snapd where it OOMs on gadget snap weirdness09:56
Chipacato be clear: “runtime: memory allocated by OS (0x7286e000) not in usable range [0x965c2000,0xffffffff)”09:57
Chipacaon a 32-bit system09:57
Chipacameans OOM09:57
zygamvo: yes, directoy and stuff inside are separate09:57
zygamvo: e.g. /path/to/dir w,09:57
zygaer09:57
mvozyga: thanks, excellent09:57
zygamvo: e.g. /path/to/dir/ w,09:57
zygathe trailing slash matters09:57
zygatry that as I suspect you need more than w in practice09:58
Chipacamikeb_— you around?09:58
woodrowshenzyga: http://paste.ubuntu.com/24359994/09:58
zygaright09:59
woodrowshenzyga: snapd cna't free the memory09:59
woodrowshenzyga: ok, i see.09:59
mvozyga: thanks, running it locally now. I'm adding a test to ensure that snap set core after the transition *actually* really works and hit a bug :)09:59
zygamvo: good call, outch, what bug?10:00
zygaChipaca: what's the reason for the extra memory use, do you know?10:00
Chipacazyga— no10:00
Chipacasomebody should look into that bug at some point :-)10:01
zygaChipaca: maybe the hook hangs and we buffer something it says into memory?10:01
Chipacamikeb_— I'm trying to reproduce the issues you're seeing, and I'm not being able to10:01
Chipacazyga— we've seen the OOM also because the gadget asks for an interface it hasn't been granted10:01
mvozyga: I push a PR once my local test finishes, but its not super critical, just adding it to really ensure all angles are tested10:01
Chipacazyga— and because its assertion is signed with the wrong key10:02
Chipacazyga— these things happen before the hook afaik10:02
Chipacazyga— also afaict it's not spamming changes; there was a relatively low amount of changes at the time10:02
zygaaha10:02
Chipacaas i say, somebody needs to dig10:02
zygayes, for sure10:02
Chipacamikeb_— ah, i might be understanding one of the issues you mention now10:04
* Chipaca looks further10:04
pedronisChipaca: do we know if it's reproducible on amd64? undoing a first boot install and OOM ?10:05
mupPR snapd#3173 opened: tests: add extra test after the core transition for snap get/set core <Created by mvo5> <https://github.com/snapcore/snapd/pull/3173>10:06
mvozyga: ^- thats the one I talked about10:06
zygaaha10:07
woodrowshenChipaca: the last comment on bug said removing the interface on hook can fix the issue, but my gadget didn't use that like him10:11
Mirvbye bye10:11
MirvI'll rejoin if I'll create snappy products10:11
Chipacawoodrowshen— that comment comes from a different thread and was posted to that bug in error10:11
Chipacawoodrowshen— while it is related, in that on second pass the gadget's yaml was wrong because it asked for that interface, it's not the only cause of the bug10:12
Chipacawoodrowshen— when the bug was first created, the OOM was because of bad signing10:12
Chipacawoodrowshen— at this point I believe any issues with the gadget snap will cause this10:13
Chipacapedronis— I don't know10:13
Chipacapedronis— should be easy to test with a core amd6410:13
woodrowshenChipaca: oh, indeed.10:13
woodrowshenChipaca: how to define the "bad signing"10:14
fgimenezmvo: tests/main/interfaces-network-bind is failing with the latest edge i386 core (rev 1682), not sure if that's expected https://travis-ci.org/snapcore/spread-cron/builds/220883610#L73110:15
Chipacawoodrowshen— model under one account, gadget under another10:15
mvofgimenez: https://github.com/snapcore/snapd/pull/3172 will fix that10:17
mupPR snapd#3172: tests: fix interfaces-network-bind to match the new core <Created by mvo5> <https://github.com/snapcore/snapd/pull/3172>10:17
fgimenezmvo: great thank you!10:17
Chipacahmm, why is 'snap try' setting snapsup.Flags.RemoveSnapPath10:17
zygamm10:18
woodrowshenChipaca: hmmmm, got it.10:18
zygaChipaca: feels wrong, right?10:19
Chipacawoodrowshen— there's an exception there where i think they don't have to match if canonical is the signer of one of those things10:19
Chipacazyga— well, it doesn't break stuff, but prints an ugly warning10:19
Chipaca2017/04/11 11:11:00.366879 handlers.go:299: Failed to cleanup /home/john/canonical/snappy/src/github.com/snapcore/snapd/tests/lib/snaps/test-snapd-service: remove /home/john/canonical/snappy/src/github.com/snapcore/snapd/tests/lib/snaps/test-snapd-service: directory not empty10:19
zygaChipaca: worse, it feels like with a simple slip it could rm -rf your code10:20
Chipacazyga— it's not a -r :-)10:21
zygaright10:21
zygayet10:21
Chipacafound the issue, i think10:22
mvozyga: looks like 3169 is failing, maybe a fluke? could you please have a look (spread still runnig but the failure is in the log)10:22
zygachecking10:24
zygamvo: I have one thing I'd like to add, from last evening10:26
Chipacamikeb_— looking into this is pointing out several little warts even before getting at the issues you're seeing (yay!)10:28
pedroniszyga: mvo: Error executing linode:ubuntu-14.04-64:tests/main/refresh-delta-from-core10:29
Chipacamikeb_— wrt ordering though, there is no implicit ordering other than with the service that flags "the network is up"10:29
Chipacaand the mount unit that mounts the snap into place10:29
zygapedronis: right, I'm looking it at it10:31
mupPR snapd#3172 closed: tests: fix interfaces-network-bind to match the new core <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3172>10:31
zygaApr 11 10:06:39 ubuntu snapd[4401]: 2017/04/11 10:06:39.614845 helpers.go:173: cannot connect plug "core-support" from snap "core", no such plug10:33
zygathis will never go away, we don't have a system where plugs change and we forget past connections10:33
mvozyga: what do you want to add?10:34
mvofwiw, from my POV 2.24 is now ready, 3169 is mostly a bonus for me10:35
zygamvo: fine, not for 2.2410:35
zygamvo: debugging10:35
mvozyga: feel free to add, the tests need to re-run anyway10:36
zygamvo: something like this http://paste.ubuntu.com/24360222/10:36
zygamvo: + for slots, symmetrically10:36
mvozyga: sounds good10:36
mvozyga: and if things are ready after lunch it lands10:36
mvootherwise…10:36
zygamvo: surE :)10:36
zygapedronis: that failed because: Apr 11 10:06:35 ubuntu /usr/lib/snapd/snapd[4213]: store.go:1264: DEBUG: Available deltas returned by store: []10:37
zygaI'm checking what the test is doing now to see if that's expected10:37
woodrowshenChipaca: so how can i help to track the issue ?10:41
zygamvo: hrm hrm hrm, I think we need something for that dangling slot connectiong10:41
zyga*connection10:41
zyganot super critical but we should do somehing about it or it will stay forever10:41
mvozyga: please add it to the 2.25 page10:42
zygaok10:43
zygamvo: so the failure you mentioned10:43
zygamvo: if edge<->beta on core snap had no delta in the store then the failure is a fluke10:44
zygahttps://github.com/snapcore/snapd/pull/3174 <- debugging10:45
mupPR snapd#3174: interfaces,overlord: log interface auto-connection failures <Created by zyga> <https://github.com/snapcore/snapd/pull/3174>10:45
mupPR snapd#3174 opened: interfaces,overlord: log interface auto-connection failures <Created by zyga> <https://github.com/snapcore/snapd/pull/3174>10:45
zygamvo: this is failing now https://github.com/snapcore/snapd/pull/317310:52
mupPR snapd#3173: tests: add extra test after the core transition for snap get/set core <Created by mvo5> <https://github.com/snapcore/snapd/pull/3173>10:52
zygamvo: I think it needs one of the other branches after network-bind was reomved from core10:52
zygare11:04
mvozyga: ta, I add it now11:19
mupPR snapd#3169 closed: many: fix plug auto-connect during core transition <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3169>11:20
zygathanks!11:22
zygamvo: can you also merge https://github.com/snapcore/snapd/pull/312911:23
mupPR snapd#3129: interfaces/mount: add InfoEntry type <Created by zyga> <https://github.com/snapcore/snapd/pull/3129>11:23
zygamvo: it's harmless but I want that extra debug output there11:23
mupPR snapd#3129 closed: interfaces/mount: add InfoEntry type <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3129>11:25
mvozyga: mixing the debug and the entry in a single PR is a bit unfortunate, lets try to have two next time. but its in, its harmless indeed11:26
zygayeah, it's an old PR11:26
zygaI just wanted to merge that deubg output11:26
zygamvo: I can move it to a separate PR if youwant11:26
mvozyga: too much hassle and tests will take too long :/11:26
mvozyga: its ine11:26
mvoin11:26
zygathanks!11:26
zygaok, what's left for 2.2411:27
mvoI prepare 2.24 now, so the window is almost closed if someone has some last minute things11:27
* zyga looks11:27
mvoits all in11:27
zygawoot!11:27
zygagreat11:27
mvoI'm running 3173 locally just to feel good but in parallel prepare changelog tag etc11:28
zygamvo: did you branch off master?11:28
mvozyga: it was probably not current11:28
zygaI mean, for the release11:29
zygaI'd like to land approved thins with 2+1s11:29
zyga(for 2.25)11:29
mvozyga: lets wait a tiny bit, I branched locally so I guess its ok11:29
zygaOK11:30
mvozyga: what branches do you have in mind? I think we need to go over the previous 2.24 now that network-bind is no longer used and fix those11:30
zygahttps://github.com/snapcore/snapd/pull/315311:30
mupPR snapd#3153: interfaces: validate plug/slot uniqueness <Created by zyga> <https://github.com/snapcore/snapd/pull/3153>11:30
zygaI'll just enjoy the sun and get back to update-ns code11:30
mvozyga: sounds good, I will merge master into 3153 in the meantime to ensure we have no surprises (but I think we won't)11:31
pedronismvo: yea, tomorrow I would like to start merging some of the aliases stuff that will need the move completed before we can release again11:41
pedroniszyga: 3145 can be closed now?11:42
pedronismvo: so we didn't rename the plug in the end for 2.24? I see all the rename PRs in 2.2511:45
zygapedronis: checking11:46
zygapedronis: yes, I believe so11:47
mupPR snapd#3145 closed: overlord/ifacestate: fix auto-connect during core snap transition <Created by zyga> <Closed by zyga> <https://github.com/snapcore/snapd/pull/3145>11:47
mupPR snapd#3175 opened: daemon: do not set RemoveSnapPath flag when doing a try <Created by chipaca> <https://github.com/snapcore/snapd/pull/3175>11:47
mvopedronis, zyga: https://github.com/snapcore/snapd/pull/3154 this one got in11:50
mupPR snapd#3154: many: rename two core plugs that clash with slot names <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/3154>11:50
pedronismvo: so only 3160 left ?11:53
mvopedronis: it looks like it yes, but it also still has network-bind in there which needs updating. but I think we can go out with 2.24 without it, or am I missing something?11:54
mvopedronis, zyga: also in 3154 we also rename network-bind, this can now be removed I think11:55
pedronismvo: I don't know :) too many moving parts, maybe zyga has a better idea there11:55
zygamvo: yes, I will follow up and remove it11:55
zygapedronis: haha, you think too highly of me,11:56
zygapedronis: let me see11:56
zygaaha11:56
mvopedronis: I'm pretty sure things are fine (within the limits we set) and the migration works and no surprises, I think we can do the remaining bits for 2.2511:56
mvobut I will let zyga double check :)11:56
zygathat one, I think it's not really needed anymore because we auto-connect the plug correctly now11:56
mvothats my understanding as well11:57
zygaI'd tweak it to remove the core network-bind connection as it's just garbage now (and it will stay annoying forever)11:57
mupPR snapd#3176 opened: snapcraft.yaml can come in many guises now <Created by chipaca> <https://github.com/snapcore/snapd/pull/3176>12:01
Chipacamikeb_— ping12:04
iceyso, the issue I was having with Rust binaries isn't because of linking to the wrong thing: https://pastebin.ubuntu.com/24360512/12:07
iceyif sergio were here, I'd ping him...12:07
pedronismvo: yes I see more clearly what landed, yes seems it's a consistent set12:07
ogra_icey, try rocket.ubuntu.com instead12:08
iceyyeah but that means authing to _one more thing_ :-/12:08
iceyand he doesn't seem to be in there either :_/12:09
iceyfail12:09
Chipacazyga—   run-snapd-ns-snappy\x2ddaemon\x2ddemo.mnt.mount                                           loaded    active mounted   /run/snapd/ns/snappy-daemon-demo.mnt12:09
Chipacazyga— why is that left behind when the snap failed to install?12:09
=== chihchun is now known as chihchun_afk
zygaChipaca: interesting, is anything else left behind?12:12
zygaChipaca: e.g. apparmor profile?12:12
zygaChipaca: this should go away the same way as apparmor profiles12:12
zygaChipaca: but maybe there's a bug12:12
* zyga looks12:12
mvopedronis: thanks a lot for double checking12:12
zygaChipaca: ohhh12:12
zygaChipaca: we don't write .mount files12:13
zygaah12:13
zygasorry12:13
* zyga is so dumb12:13
zygaI confused this entirely12:13
zygaChipaca: that file is harmless12:13
zygaChipaca: we don't remove them because there's no need12:13
zygaChipaca: we discard the namespace but we don't unlink12:13
Chipacaa bunch of /var/lib/lxcfs stuff :-) but that's probably not our fault12:13
zygaChipaca: that file should be empty12:13
zygaChipaca: and should be (if you stat -f it) not nsfs or proc12:14
Chipacaand a lockfile and some apparmor stuff12:14
zygaChipaca: apparmor stuff?12:14
Chipacatype: nsfs12:14
zygaChipaca: interesting12:14
Chipacathat's for /run/snapd/ns/snappy-daemon-demo.mnt12:14
zygaChipaca: so it's a namespace that lives on12:15
zygaChipaca: did we remove the snap?12:15
Chipacazyga, yes, the snap failed to install12:15
zygaChipaca: looks like an omission then12:15
* zyga looks12:16
Chipacaand a bunch of /sys/kernel/security/apparmor/policy/profiles/snap.snappy-daemon-demo.* things12:16
Chipacabut those might be because apparmor is append-only or something12:16
Chipacadunno12:16
zygadoDiscardSnap should remove that12:16
zygaChipaca: those should be removed as well12:16
zygafeels like a bug mr Chipaca :)12:16
Chipacazyga— well it doesn't, at least when a 'snap try' fails12:16
zygaChipaca: can you show me snap change for this number?12:17
Chipacawhich number?12:17
zygaof the change that installed it12:17
Chipacazyga— http://pastebin.ubuntu.com/24360558/12:17
zygaChipaca: so we only discard in doDiscardSnap (discard-snap)12:19
zygapedronis: if the initial install of a snap fails we should clean up after it12:20
zygapedronis: trying to figure out which task should do it12:21
zygaChipaca: what is odd is that we undone setup security profiles12:21
zygaChipaca: but the profile is still there12:21
Chipacaniemeyer— any objection to allowing use of "last" as a change id that gets the last change?12:21
zygaChipaca: is /var/lib/apparmor/profiles/ also full of leftovers?12:21
Chipacazyga— sounds like the undo doesn't12:21
zygaChipaca: well, I bet it does but I bet something is missing :)12:22
Chipacazyga— that directory is empty12:22
Chipaca(i've got 3 snaps installed)12:22
Chipacazyga— i think you meant /var/lib/snapd/apparmor/profiles12:22
Chipacazyga— and i've got some garbage there, but nothing related to this12:23
Chipaca(it seems when i was trying out the bcc snap we weren't cleaning this up after ourselves or something)12:23
zygaChipaca: yes, sorry12:23
pedroniszyga: the undo of each tasks in the install12:24
zygapedronis: here it is tricky, what needs to (maybe) be undone is a result of the configure hook12:27
zygapedronis: but only if this is the only revision12:27
zygapedronis: (discarding the namespace)12:27
pedronisof the hook?12:27
pedronisyou mean sideeffects or running the hook?12:27
zygaof the snap (it's global to the snap)12:27
mupBug #1681833 opened: Devmode Edge Snap not automatically updating <Snappy:New> <https://launchpad.net/bugs/1681833>12:27
zygahere it looks like configure hook failed12:27
zygaso installation stopped there12:27
pedronisyou we undid everything before that12:28
zygabut the bug is that at this time we're essentially erasing the snap existence12:28
pedronisyea12:28
zygawe don't discard the namespace/connections though, apparently12:28
pedronisconnections?12:28
zygawe only do that in discard-snap12:28
zygapedronis: "conns" in state12:28
pedronisah12:28
zygaright12:28
zygawhich is only done if we're removing a snap12:28
pedroniswell something is wrong then12:28
zygaso there's assymetry12:28
pedroniszyga: there's  a discard-conns task actually12:29
zygapedronis: we do that when removeAll is set12:30
pedronisyes12:30
pedronisbut that's not relevant12:30
pedronisit needs to be done in some relevant undo12:30
pedroniswe don't do more tasks when something fails12:30
zygapedronis: I yes, I think som12:30
pedroniswe just undo things12:30
Chipacahttps://forum.snapcraft.io/t/rfc-easy-way-to-get-last-change/246?u=chipaca <- RFC thing12:30
zygapedronis: right12:30
Chipacamup— you could preview forum links, couldn't you12:30
zygapedronis: I think we should graph what tasks are added in install/remove see if something is missing12:31
zygapedronis: I don't fully grok the extra cases that are there12:31
pedroniszyga: well what we do in other places would be do something in remove-profiles if we are the last revision standing12:32
pedronisinstead of an extra task12:32
pedronisI'm not sure why we have the extra task12:32
zygapedronis: I agree it should be something like that12:32
pedronisI don't think I worked on that afair12:32
zygapedronis: I'll spend some time graphing this on paper and post in the forum12:33
pedroniszyga: fwiw clear-aliases is going away in the new world12:33
zygaFYI I simplified https://github.com/snapcore/snapd/pull/3160/files12:34
mupPR snapd#3160: overlord/ifacestate: automatically rename connections on core snap <Created by zyga> <https://github.com/snapcore/snapd/pull/3160>12:34
draglyWhat is the current status of snap dependencies? Is or will it be possible to have a snap depend on a specific version of a different snap as a library?12:37
zygadragly: no, can you tell me why you would like to have that?12:37
zygadragly: the content interface can be used to do that to some extent but I bet some edge cases are still very rough12:38
draglyTo reduce the size of snap packages.12:38
zygadragly: note that the content interface is something only snaps from one publisher can use12:38
zygadragly: with the exception of snaps that are blessed in the store, where anyone can share them12:39
draglyJust curious about how far snaps are thought to go in terms of replacing apt in the long run.12:39
zygadragly: so if you upload a snap12:39
zygadragly: and then a 2nd one12:39
zygadragly: and you want to share some libraries between the two12:39
zygadragly: you can make a third snap with those libraries12:39
jdstrandmvo: allowing write on a dir> the best you can do is '/path/to/dir/ w,' (the trailing '/' is important). that does allow changing the inode data too though (eg, perms, ownership)12:39
zygadragly: and update either or both of the first two snaps to useit12:39
mvojdstrand: thanks, that is what I used now12:40
zygadragly: but, the key is that youare in control of the three snaps still12:40
draglyzyga: I see. That sounds like a reasonable middle way.12:40
zygadragly: the exception is for "blessed" snaps (not a strict term)12:40
zygadragly: where e.g. the qt project publishes a polished snap that they say they will responsibly update12:40
zygadragly: and that the ABIs are stable and what not12:40
zygadragly: and that snap can have an assertion that says anyone can now use it for content sharing12:41
zygadragly: we don't have any better mechansims yet but remember that there was never any plan to do dpkg/apt granularity packages12:41
zygadragly: I think as the content interface matures we'll have more option12:42
draglyQt was exactly the project I was thinking of. We have a couple of large snaps because we include a bit too much of Qt.12:42
zygadragly: but for now what's what we offer12:42
zygadragly: I would encourage you to make your own shared qt snap for now12:42
zygadragly: and experiment with this12:42
zygadragly: it's not perfect12:42
zygadragly: I'm hoping to make big improvement in 2.2512:42
zygadragly: (there are cases now where it will not work well)12:42
zygadragly: but this is the "taste" of the idea12:42
zygadragly: once qt project publishes a snap you could evaluate and switch to it12:43
draglySounds good. What is your take on the issues of bundling say crypto libraries in a snap that might need security updates?12:43
zygadragly: same as everything else12:43
zygadragly: it's just something someone needs to update12:43
zygadragly: if it's not updated it doesn't matter (it's broken)12:43
zygadragly: if it gets updated that's good12:43
zygadragly: it's never perfect12:43
zygadragly: note that some libraries are available in the core snap12:44
zygadragly: if the ssl project starts publishing a ssl runtime snap12:44
zygadragly: and commit to maintaining it12:44
zygadragly: people can use it12:44
zygadragly: otherwise snapcraft can offer some features12:44
zygadragly: where you can just rebuild it12:44
zygadragly: (the snap you are building)12:44
zygadragly: and include updated ssl (again, just an exapmle)12:44
draglySounds like that would solve most issues. I understand that this is a really hard balance to keep between containerized packages and shared packages for reduced size and security updates.12:45
zygadragly: also the impact of an update12:45
zygadragly: maybe the update actually breaks your snap12:45
draglyYes, I guess that has been the biggest issue with shared packages like dpkg or conda.12:46
mupPR snapd#3177 opened: cmd/snap: make users Xauthority file available in snap environment <Created by morphis> <https://github.com/snapcore/snapd/pull/3177>12:47
draglyOne wants the security updates, but not the breaking API changes.12:47
zygadragly: sometimes it's not possible12:47
morphismvo: can you mark https://github.com/snapcore/snapd/pull/3177 for 2.25?12:48
mupPR snapd#3177: cmd/snap: make users Xauthority file available in snap environment <Created by morphis> <https://github.com/snapcore/snapd/pull/3177>12:48
draglyzyga: Do you have some thoughts on NixOS and similar "everything-is-a-package-version" distros?12:48
zygadragly: they advance a lot of the theory and some of the tooling, I'm happy to see them12:48
zygadragly: e.g. reproducible builds initiative in general is very valuable for trust12:49
zygadragly: otherwise I think we are putting a different idea forward12:49
draglydo you think much of that will be merged into Ubuntu's snap+dpkg ecosystem?12:49
zygadragly: not really, not at a whole distro level12:50
zygadragly: I think reproducible builds will spread across all binary distributions though12:50
zygadragly: that part is really generic, important and in progress across the landscape12:50
draglythat's good12:51
morphisSon_Goku: I don't have a good fix yet for the libtool/static linking problem12:51
morphisSon_Goku: the best we can do for now is to drop all other patches and just keep the one for libtool support once we update to 2.2412:51
zygadragly: snaps aim to be practical12:51
zygadragly: ship software now, iterate, improve, learn12:52
draglyAs an application developer, I find the idea of NixOS intriguing, but the target audience is of course way bigger for snap packages.12:52
zygaI think it's like with all research and business12:52
zygadragly: forget snaps, look at all the linux packaging formats and the play store12:52
zygadragly: it's clear that you can ship a zip file and win ;)12:53
zygadragly: and the rest is irrelevant at large12:53
draglyexcactly12:53
draglyzyga: and in terms of security, I guess containerization is of greater importance than many other issues12:55
zygadragly: yes, the old trust model is not realistic, I think12:55
draglyzyga: no. I'm looking forward to be able to download more binaries with less worry about their origin.12:57
zyga(old trust model == manually reviewed software from trustworthy developers)12:58
* zyga -> call12:58
draglyah, I see. I was thinking more along the lines of trusting some random site which gives you a binary to download.12:58
mupPR snapd#3178 opened: Release 2.24 <Created by mvo5> <https://github.com/snapcore/snapd/pull/3178>13:01
zygadragly: that is even worse :) I was referring to the change from trusted source / binary to untrusted binary and sandboxing13:07
mupPR snapcraft#1248 opened: snap: include asset tracking details in snap/snapcraft.yaml <Created by josepht> <https://github.com/snapcore/snapcraft/pull/1248>13:07
mupPR snapcraft#1249 opened: Add Linux Mint support <Created by nefelim> <https://github.com/snapcore/snapcraft/pull/1249>13:16
=== chihchun_afk is now known as chihchun
mvofgimenez: sorry to push more work towards you but do you think you could put the verification for https://bugs.launchpad.net/snapd/+bug/1673568 on your todo please?13:34
mupBug #1673568: snapd 2.23.6 SRU tracking bug <verification-needed> <snapd:New> <snapd (Ubuntu):New> <snapd (Ubuntu Xenial):Fix Committed> <snapd (Ubuntu Yakkety):Fix Committed> <https://launchpad.net/bugs/1673568>13:34
fgimenezmvo: sure np, will let you know how it goes13:36
mvofgimenez: thanks!13:36
mupPR snapd#3176 closed: snapcraft.yaml can come in many guises now <Created by chipaca> <Merged by chipaca> <https://github.com/snapcore/snapd/pull/3176>13:53
mupPR snapd#3153 closed: interfaces: validate plug/slot uniqueness <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/3153>14:09
ChipacaApr 11 15:26:17 fogey snap[29722]: cannot snap-exec: cannot read info for "snappy-daemon-demo": stat /var/lib/snapd/snaps/snappy-daemon-demo_x1.snap: no such file or directory14:27
mupPR snapd#3179 opened: packaging: add `built-using` header for 16.04 packaging <Created by mvo5> <https://github.com/snapcore/snapd/pull/3179>14:27
ChipacaI hope that's not what I think that is :-(14:27
mptHi, in “track/risk/branch” for channel names, what does “branch” refer to? <https://forum.snapcraft.io/t/channels-2-0-implementation/156> facubatista mvo14:28
davidcallefacubatista: ^14:28
davidcalle(oh sorry, didn't noticed you were pinged already)14:29
mvompt: hey, nice to see you! facubatista is probably the better person to answer, but my understanding is that this is a new store feature that allows to open "branches" with arbitrary names (like latest/stable/hotfix-for-lp1334)14:30
facubatistampt, the branch is a kind of "sub channel" for the "stable" channel, that will allow people to release temporary fixes14:31
mvompt: AIUI those will not be surfaced in snap info, someone need to tell you about the branch. but I was not in this paricular design meeting so take it with a slight grain of salt :)14:31
facubatistampt, the names are arbitrary, you can just release into them, but after 30 days they will be removed (or you can remove them before, when the fix is integrated into stable)14:31
=== chihchun is now known as chihchun_afk
facubatistampt, there's a bigger doc explaining better, we're just holding off the formal announcement until all tools properly support them14:32
facubatistampt, in any case, I can answer any question you have14:35
mptmvo, nice to see you too :-)14:42
Chipacajdstrand, daemons of type "notify" need to talk to /run/systemd/notify. Is that added anywhere? Is this anywhere on your radar?14:43
mptfacubatista, thank you. So as I understand it at the moment, snaps are (about to be) four-dimensional: each combination of {channel × track × branch × architecture} can have a different binary in it. Is that correct?14:44
mptOr maybe more accurately, the store is four-dimensional14:44
jdstrandChipaca: it isn't and no14:45
Chipacajdstrand— noted and noted14:45
Chipacaniemeyer— i'm struggling a little bit with when to file bugs in launchpad and when to opne a new topic in the forum14:47
Chipacaniemeyer— so if you see i'm doing it wrong, shout :-)14:47
morphiszyga: I am going to play around with the unshared /etc tomorrow or did you already started that work?14:47
facubatistampt, it's tricky, you don't have a whole "product" on branch, as branches only exist for the stable channel14:47
niemeyerChipaca: If you need coordination across teams, Launchpad.. if you want awareness and a nice conversation about it, forum.. if you want both, both :)14:48
zygamorphis: I have a trivial branch but nothing useful, just comment out /etc and see what happens14:48
zygaer14:48
zygawell, roughly so14:48
mptfacubatista, so you can’t have a branch for a custom channel, then14:48
facubatistampt, we consider it four-dimensional, yes, but channel x track x architecture x series (series == release), being branches a special case of stable channel14:49
facubatistampt, what do you mean with "custom channel"?14:49
facubatistampt, we have pre-fixed channels (edge, beta, candidate, stable) and you can only create branches for "stable" (in any track, though)14:50
mptOh, right, so branches *are* the custom channels14:50
mptOk, I misunderstood14:50
facubatistampt, mmm... I don't know if call it like that... "custom channel" sounds like you could add a fifth or sixth channel to the well defined risk sequence (edge, beta, candidate, stable)14:51
mptfacubatista, I was just copying mvo’s phrase in my link above, “This allow publishers to go beyond the current 4 channels we offer and provide custom channels”14:52
facubatistampt, yes, they're custom in the sense that you can arbitrarily name them, but are more "sub channels from stable"14:52
mptunderstood14:52
facubatistampt, :)14:53
mptfacubatista, but this is the first time I’ve heard of series for the store. What is that?14:53
facubatistampt, the "release": 16, 18, etc14:53
facubatistampt, it's a name mess, because originally you didn't "publish an upload", you "released it", so name colision was high :/14:54
* zyga has mild food poisoning, ttyl :/14:55
mptfacubatista, thank you. One more question for now: Is there an existing UI design doc on how (any of) these should be presented to uploaders?14:56
jdstrandzyga: :( feel better14:56
zygafresh juice, sometimes not healthy14:56
facubatistampt, presented in the web ui or in the command line tools? so far, we're all using the slash-separated names, and everybody seems to understand it perfectly... so, for example, you could "snapcraft release" to 2.2/candidate, or stable/hotfix3, etc14:58
mptfacubatista, Web UI14:58
morphiszyga: ok, will play a bit with that14:59
facubatistampt, for the web ui we're using the slash separated names to present the channels... I don't think the web ui is ready to actually release into tracks or branches, it's holding a little back and not given priority... in any case, there's no design that I'm aware of14:59
mptok, thanks again15:00
facubatistampt, no problem15:00
morphismvo: was there anything which was blocking https://github.com/snapcore/snapd/pull/2592 other than missing time from your side?15:00
mupPR snapd#2592: many: add support for session dbus services via snaps <Created by mvo5> <Closed by mvo5> <https://github.com/snapcore/snapd/pull/2592>15:00
mvomorphis: a little bit of extra work, we need to generate the host /etc/dbus.d configuration automatically for the re-exec case15:01
mvomorphis: otherwise I think its good15:01
mvomorphis: why? is that something you want to see?15:01
qenghofg15:02
qenghobah15:02
morphismvo: would be nice to have, I can have a look if you want15:03
zygamorphis: I think that it would be nice to get to a point where we can run unit tests and spread tests on debian and fedora equally; we still have a lot of catch-up to do15:04
morphiszyga: yeah, I finalizing the first round for a debian setup15:05
morphisfedora is next on my list15:05
morphisjust need some lines of real code in between instead of writing shell scripts all the day .. :-)15:05
morphisniemeyer: by that chance, from what I've heard you are the one who can help me to get a debian-9 image on our linode farm, right?15:06
niemeyermorphis: Yes! Thanks for working on that15:06
morphisniemeyer: np, its time for that :-)15:06
niemeyermorphis: Please open a topic on the forum and I'll follow up with instructions15:06
morphisniemeyer: aye15:06
mvomorphis: I would not say no, I think the way to model this is similar to the appamor host file writing, let me look for the code15:11
mvomorphis: lets talk tomorrow morning, I think there is little left to do for this feature15:12
morphismvo: sounds good15:12
morphisniemeyer: https://forum.snapcraft.io/t/extending-ci-for-snapd-to-debian-fedora/25015:14
niemeyermorphis: Thanks! Will reply after lunch.. biab15:17
morphisniemeyer: thanks!15:17
zygamorphis: some comments on https://github.com/snapcore/snapd/pull/3177/15:21
mupPR snapd#3177: cmd/snap: make users Xauthority file available in snap environment <Created by morphis> <https://github.com/snapcore/snapd/pull/3177>15:21
morphiszyga: thanks15:22
zygamorphis: very rough feedback so far, let's iterate and I'll help you out15:23
morphiszyga: let me rework those tomorrow15:23
zygamorphis: thanks!15:24
zygamorphis: can you please merge master into https://github.com/snapcore/snapd/pull/317015:41
mupPR snapd#3170: interfaces/builting: allow read-only access to /sys/module <Created by morphis> <https://github.com/snapcore/snapd/pull/3170>15:41
=== chihchun_afk is now known as chihchun
=== jgrimm is now known as jgrimm-away
ogra_hey suhamera16:17
suhamerahi16:17
suhamerai'm trying to run Ubuntu Core on my DragonBoard 410c16:17
zygasuhamera: hey16:17
* zyga feels mildly sick but better16:17
ogra_we dont really have any way to install the core image to the MMC.... and the dragonboard is a bit tricky in that regard16:17
suhamera:)16:18
suhamerabut is any way to do it?16:18
zyganiemeyer: hey, can you re-review https://github.com/snapcore/snapd/pull/3095 please16:18
mupPR snapd#3095: cmd/snap-update-ns: add C preamble for setns <Created by zyga> <https://github.com/snapcore/snapd/pull/3095>16:18
ogra_specifically because the little-kernel hardcodes the boot device, so you cant just dd an img to the MMC device16:18
ogra_you would have to dd partition for partition and leave out the lk one16:18
zyganiemeyer: I think that if this lands today I could do a full cycle, for subset of problems, tomorrow16:18
niemeyerzyga: Responding to Simon and have a call in 10 mins, happy to do right after that16:18
suhamerayes, i've tried it with no success16:18
zyganiemeyer: thank you!16:19
zygasuhamera: you'd need an installer that copies a core image to nand16:19
zygasuhamera: otherwise sure, why not16:19
ogra_s/nand/MMC/16:19
suhameraogra_ so what will the difference with dd?16:22
suhamerathe image will be the same?16:22
ogra_suhamera, you would need to dd each partiton from the SD to the equivalent partition on the MMC, leaving out aboot (which holds the lk)  ... and indeed that only works if the partition sizes match (which they probably do not)16:23
ogra_well ...16:23
mptSomeone should make an app that installs a random snap, launches it, and takes a screenshot16:32
mptThey could call it … Snapshot16:32
mptI’m so sorry16:32
=== JanC_ is now known as JanC
morphisdavidcalle: thanks for writing https://insights.ubuntu.com/2017/04/11/snap-support-lands-in-fedora-24-25-26 ?16:39
morphiss/?/!/16:40
morphisniemeyer: didn't read through your reply in detail yet, but do I need access to linode for that?16:43
CroephaHello17:03
=== alan_g is now known as alan_g|EOD
Croephafor Core, is there a bank of debug symbol files? specifically /lib/x86_64-linux-gnu/libm.so.6 with build id: 9247f19167971267b6fadf4ba633290188a5483b core_394.snap doesn't seem to match any version of that file in ubuntu...  (apt-file search b6fadf4ba633290188a5483b yielded no results...)17:07
ogra_394 ?17:08
ogra_thats pretty ancient17:08
CroephaI only update everyone once and a while, its too much of a moving target17:09
ogra_erm ... it auto-updates itself usually17:09
Croephaif you are saying that newer version would have debug symbols then that would be another thing17:09
ogra_no17:09
ChipacaCroepha— how have you disabled updates?17:10
ogra_if we'd ship debug symbols the package would be huge ... :)17:10
CroephaI agree that i should update, but Ive already been burned by an update once before, making me rework some things, so, I haven't made updating a priority, until I get closer to being finished with all of my parts17:11
CroephaChipaca, no DNS entry17:11
Chipacaogra_— how're they handled in ubuntu anyway? i thought they were 'automatic'17:11
Chipacaogra_— but i don't really know what that means17:12
Chipacaother than there not being a -dbg package17:12
ogra_Croepha, well, given that ubuntu core is rolling not upgrading is not really wise17:12
Chipacaogra_— he's not disabled it! just extreme revision vetting17:12
ogra_Croepha, but anyway ... https://launchpadlibrarian.net/291962392/core_16.04.1_amd64.manifest is the manifest file of 402 (we dont have one for 94, but this should have the same libm)17:13
ogra_Chipaca, i thought via DNS hacking ?17:13
niemeyermorphis: You need to have a Linode key.. the same you use for running your spread tests17:13
niemeyermorphis: Do you have one?17:13
ogra_s/94/394/17:13
Croephaim not saying I won't update, or am advocating not updating as a good thing, its just like when you are working on a car, its best if its not rolling down the highway whilst your under it17:14
ChipacaCroepha— aw, where's the fun in that?17:14
ogra_Croepha, what you can do is to bind-mount the libm binary with dbg symbols on top of the actual libm in the readonly core17:14
ogra_Croepha, well, the system is designed in a way that each single part should be upgradeable on its own without breaking17:15
ogra_Croepha, if anything breaks, that is definitely a bug we need to know about17:15
Croephaogra_, I agree completely, but what im saying is that when you are working with custom stuff, sometimes it helps freeze everything that you aren't working on.... its so frustrating when you are working on stuff, and the system is changing beneath you without you knowing... even little things like the default location of a file or the size of something in memory...17:20
ChipacaI agree17:20
Chipacawhen you're building stuff, if something you don't control changes, it sucks17:20
Chipacabecause then you don't know if failures are yours, or some random change in the thing that changed17:21
Chipacaso you separate those: change your stuff until it works, then upgrade the system, repeat17:21
Chipacaright?17:21
ogra_well, but 394 is really ancient ...  updating and noticing that you can throw away half your work because the system changed in large amounts is equally bad17:21
CroephaI am 100% for updates, and I think that Snappy Core is awesome in the way it does updates, and agree that it helps solve a lot of compatibility changes17:22
Chipacayeah, 394 sounds like an iteration takes 6+ months :-)17:22
Croephaogra_, well, I guess, I could update more often :)17:22
ogra_394 was around november ...17:22
CroephaChipaca, yeah, its been a slow ride working on this stuff17:22
Croephaor im really slow...17:23
ogra_http://people.canonical.com/~ogra/core-builds/ ... (doesnt have manual builds, seems 394 was one)17:23
Chipaca394 is probably ubuntu-core, not core17:23
pedronis394, sounds very ancient, wonder what snapd version is inside that17:23
ogra_oh, yeah, even that17:23
Croephacore             16.04.1      394  canonical  -17:24
ogra_ah, phew17:24
Chipacaah! cool :-)17:24
Chipacastill, so many bugs fixed :-D17:24
ogra_but still, what pedronis said applies ...17:24
ogra_snapd might be rather feature-less17:24
ChipacaCroepha— what does "snap version" say?17:24
ogra_or have features that have long changed17:24
Croephasnap    2.17  snapd   2.17  series  1617:25
ogra_woah17:25
Chipaca:-)17:25
pedroniswell, newer than 2.0.1017:25
ogra_heh17:25
Chipacayep17:25
pedronisso middle ages instead of antiquity :)17:25
ogra_pre-re-exec ...17:26
Chipacaogra_— 2.0.10 had re-exec17:26
Croephalol, ok you have convinced me to update at earliest connivence17:26
Chipacaogra_— 2.17 is post-un-re-exec17:26
ogra_Chipaca, and then dropped it17:26
pedronisthere's no pre and after rexecec17:26
pedronisbecause we turned it off and then on again17:26
niemeyerzyga: reviewed17:26
ogra_yeah, only on-off-re-exec17:26
Chipaca5 months, 1 wee ago17:27
Chipacaweek*17:27
ChipacaSubmission date17:27
Chipaca2016-11-02 11:55 - 5 months, 1 week ago17:27
Chipacaogra_— https://myapps.developer.ubuntu.com/dev/click-apps/6021/rev/394/17:27
ogra_yeah17:27
Croephajust to give you guys a peek into why i don't want to update all the time, is that in the past there has been issues with versioning of the core, and the ubuntu-image tool and snapcraft, and right now I know that all of those tools work together with the current versions of things, and when I update, then I will basically have to update all the other things...  Also, I have sort of cobbled together a really odd build iteration routine... instead17:30
Croepha of using snapcraft, I just use a prime directory, and build straight to it, and I rsync over the prime dir to the ubuntu core system.... this is much faster than running snapcraft every iteration17:30
ChipacaCroepha— sergiusens and/or kyrofa might be interested in that17:31
ChipacaCroepha— (otoh i think snapcraft has done some work around making things quicker)17:31
=== chihchun is now known as chihchun_afk
ChipacaCroepha— always interested in pain points around the build process17:31
Chipacawell, I say always. Not *always* always: right now i'm more interested in going AFK for a while17:32
Chipaca:-)17:32
Croephalater17:32
Chipacattfn :-)17:32
morphisPharaoh_Atem, zyga: https://phoronix.com/scan.php?page=news_item&px=Snap-In-Fedora17:53
Pharaoh_Atemmorphis: well, I guess that's what prompted mattdm to email me17:56
Croephathanks for the help Orga! i think I found what I need17:58
ogra_cool17:59
Croephabtw, instead of mounting the symbol files over, you can just use "set solib-search-path"18:00
ogra_ah18:00
ogra_but doesnt that change the path for all libs ?18:01
Croephayou can add a path18:01
Croephajust add a new path18:01
Croephalike, you aren't changing which lib is actually loaded... thats what LD_PRELOAD... does18:02
Croephayou are just helping gdb find the debug symbol files18:02
Croephaso, what I am doing, is I am running some binaries on a core machine and connecitng to it over via gdbserver18:03
Croephaon my local machine, I have a copy of the core snap and the prime dir, and can manually mount the snap and set sysroot in gdb18:04
ogra_ah18:04
ogra_clever18:04
Croephaimho, this is the best debug workflow18:04
Pharaoh_Atemmorphis, zyga: testing scratch build of 2.2418:08
morphisPharaoh_Atem: nice18:09
Pharaoh_Atemhttps://koji.fedoraproject.org/koji/taskinfo?taskID=1893460818:09
Pharaoh_Atemalso a test to see if ppc64 is fixed: https://koji.fedoraproject.org/koji/taskinfo?taskID=1893460818:10
naccis there a way in a snapcraft.yaml to specify that not only do i want a set of packages to be in stage-packages, but any packages they depend on?18:17
naccor do i need to explicitly specify them/18:17
ogra_no18:18
ogra_deps are processed b default18:18
ogra_*by18:18
naccogra_: hrm, i just built a snap that has ptyhon-pygit2 but not libgit218:18
naccoh wait18:18
ogra_but maintainer scripts are not run ...18:18
nacci bet LD_LIBRARY_PATH didn't get set!18:18
Pharaoh_Atem~_~18:18
Pharaoh_Atemisn't pygit2 by default linked statically to libgit2?18:18
naccit does a 'from _pygit2 import *'18:19
naccand that spits a backtrace in the interpreter about not finding libgit2.so.2418:19
nacclet me try with LD_LIBRARY_PATH set18:19
MutterHi, i already ask question about boot Core on Dragonboard and get the reply to make some changes in kernel18:23
naccyeah it worked by specifing LD_LIBRARY_PATH=$SNAP/usr/lib6418:24
naccerr LD_LIBRARY_PATH=$SNAP/usr/lib/x86_64-linux-gnu18:24
naccis this possibly due to using 'classic' confinement? would snapcraft normally have wrapped this?18:24
MutterBut I have to rebuild the kernel from source - right?18:24
MutterSo where I can get the core kernel source?18:26
naccogra_: iirc, the wrapper script generator set it before. Does the /usr/bin/snap method not do that?18:29
ogra_nacc, i dont think there are any wrappers in use when classic confinement is on18:30
naccogra_: ah, so in classic, i need to explicitly specify values in my yaml to use the snapped libs?18:30
ogra_i dont really know ... never did a classic snap ... afaik it functions exactly like a deb18:31
naccah ok18:31
naccyeah maybe i should switch back to devmode confinement :)18:31
ogra_probably a good forum question ;)18:31
naccogra_: yep, i'll try and ask there18:32
naccit's almost certainly just me not having messed with my snap in some time (just been fixing bugs) and trying to refresh it with lots of changes to snapcraft since18:32
Pharaoh_Atemmorphis: pushing snapd-2.24 builds for F24+18:32
morphisPharaoh_Atem: that is wonderful!18:34
morphiswill give it a try tomorrow18:34
suhameraogra_: could you please show the direction to fix issues with .img on eMMC?18:37
ogra_suhamera, well, i doubt it will work with the existing partitioning of the MMC18:39
ogra_http://paste.ubuntu.com/24362438/ ... the aboot partition size seems to be smaller on the MMC18:40
ogra_suhamera, so this will be non trivial ... first of all make a backup of the eMMC aboot partition with dd ...18:41
suhameraOk18:41
ogra_then dd the whole sd image to /dev/mmcblk018:42
ogra_that should force the SD card partition table onto the eMMC18:42
suhameraBut18:42
ogra_then dd the backed up aboot partition content to the aboot partition on the eMMC18:42
ogra_and then ... good luck18:42
suhamera:)18:42
suhameraBut on my eMMC I have the android or Debian partition table18:43
suhameraAnd it could be different18:43
ogra_(by "dd the whole sd image ..." i mean you should use a virgin img, not the Sd you are using indeed)18:43
ogra_suhamera, well, check the size of the aboot partition18:44
suhameraOk, thanx18:44
ogra_that is the only important bit ... the one on the SD has booting from the external port hardcoded ... so you cant use that on the eMMC18:44
Croephaogra_: you may be interested to know, that updating /was/ the answer in the final analysis, its easier to get debug symbols for the newer versions18:50
Croephabut im glad I know about the build logs/manifests so I can find the versions in the future18:51
ogra_:)18:52
Croephabtw, for my debug/dev workflow, this is what I am doing for an rsync server: sudo classic sudo rsync --daemon --no-detach -v --log-file=/dev/stdout --config=./rsyncd.conf18:53
ogra_neat18:55
ogra_(to bad we dont support services inside classic else you could have it auto-start)18:56
Croephaehh, its not a big deal, I just have a text file of stuff to run on a restart18:57
=== elfgoh_ is now known as elfgoh
kyrofazyga, https://stackoverflow.com/questions/43354435/snapd-dead-after-installing-a-snap-with-requested-plugs is that the core/ubuntu-core plug/slot issue?19:32
naccif `snap info usd-nacc` shows a snap (with classic confinement), why would `sudo snap install usd-nacc --classic` say 'snap not found'?19:35
kyrofanacc, because usd-nacc is only available on edge19:36
kyrofanacc, snap install by default uses stable19:36
nacckyrofa: ah so i need --classic --edge ?19:36
kyrofaBingo19:36
nacckyrofa: thanks! wonder if that could be a bit more user-friendly :)19:37
naccbut yeah, pebkac :)19:37
kyrofanacc, yeah I've hit the same issue19:37
tvossniemeyer: hey, thanks for the review. Looking into your remark about using a dynamic name for the key file. would you be okay with a dynamic directory under /run/snapd instead. Easier to just use ioutil.TempDir as opposed to ioutil.TempFile (which returns an open File).19:41
niemeyertvoss: What's the win compared to using the real temporary dir?19:51
tvossniemeyer: assuming that you mean real temporary file: I would have to close the file and figure out its name. code looks nice with ioutil.TempDir: http://pastebin.ubuntu.com/24362847/19:56
Pharaoh_Atemmorphis: updates proposed for snapd to F24, F25, and F2619:59
Pharaoh_Atemmorphis: Wut20:02
Pharaoh_Atemmy name was mentioned in the Ubuntu Insights blog post20:02
Pharaoh_AtemO.o20:02
morphisPharaoh_Atem: congratulations!20:03
* Pharaoh_Atem feels very odd about all this20:03
ogra_a celebrety!20:03
niemeyertvoss: Why do we need to use /run for a temporary file?20:11
tvossniemeyer: I'm following guidance from security here20:12
niemeyertvoss: Okay... can we find that out? :)20:12
tvosstyhicks: ^20:12
niemeyertvoss: There's a directory in the system which is meant to be used for temporary content like this..20:12
niemeyertvoss: It's not about dir vs. file.. it's about /tmp vs. /run20:12
tvossniemeyer: ah, I misread your comment then20:13
tyhicksniemeyer: the code was writing the device key temporarily to $PWD where it wasn't clear what $PWD was20:13
niemeyertyhicks: Yeah, definitely a good improvement to not do that.. the point above is unrelated20:13
tvossniemeyer: I'm fine with putting it into /tmp20:14
tyhicksI'm not20:14
tyhicksit needs to be somewhere where the world can't read the key file, doesn't it?20:14
tyhicksthis is private key material, not public20:14
tyhickswell, public is included20:14
tyhickswe're not wrapping the key with a passphrase so I don't think it should be stored, even temporarily, in a world readable location20:15
tyhickscreating a subdir inside of /tmp/ is fine as long as the perms are sufficient20:15
niemeyertyhicks: Yes, I completely agree it shoudn't be world readable20:15
niemeyerSomewhat obviously :)20:15
niemeyerThat's still unrelated to /tmp vs. /run20:15
tyhicksok20:16
tyhicksI didn't want to dictate where it should go20:16
tyhicksother than the directory permissions part20:16
tyhicksthanks niemeyer :)20:16
niemeyerYeah, I think we're all sort of in agreement, but were talking slightly across purposes20:16
tyhicksI think so, as well20:16
tvosslet's be explicit, because it's late here :) /tmp/snapd{RANDOM} with 0700 would do the trick, correct?20:18
tyhickstvoss: if using /tmp, please use whatever equivalent golang has for securely creating a temp directory (such as what the mktemp utility provides)20:18
tyhickstvoss: that meets my requirements20:18
tvossniemeyer: ^ are you fine with the approach, too?20:21
niemeyertvoss: Yeah, I was assuming simply ioutil.TempDIr20:22
tvossniemeyer: cool, thx20:22
niemeyertvoss: If that's not offering the right mode, then something equivalent that does20:22
tvossniemeyer: mode is not documented for ioutil.TempDir, but I can easily os.Chmod() the tempdir prior to calling ssh-keygen. Or am I missing a potential attack vector here?20:24
niemeyertvoss: Seems better to have a osutil.PrivateTempDir20:25
niemeyertvoss: In snapd itself..20:25
tvossniemeyer: okay, will add it20:27
niemeyerahtvoss: Note we already have a handy strutil.MakeRandomString (which should really be called RandomString simply)20:27
niemeyertvoss: Thank you!20:28
niemeyerI'm going to step out for some exercising.. o/20:28
tvossah, reading code helps, ioutil.TempDir creates with 070020:28
tvosshttps://golang.org/src/io/ioutil/tempfile.go?s=2138:2195#L66 ff20:28
tvosstyhicks: ^20:29
tyhickslooks good to me20:29
tyhickswish it were documented20:29
tyhicksthat's not your problem though20:29
tyhicksthanks tvoss20:30
stokachufacubatista: just ran into that issue again, emailed you a copy of what i see21:09
cholcombethis is prob a silly question but do you have to be logged into the store to install private snaps?21:47
cholcombei ask because i want a juju charm to install a private snap21:47
cholcombei also don't want to put my credentials in the charm haha21:48
mupPR snapd#3095 closed: cmd/snap-update-ns: add C preamble for setns <Created by zyga> <Merged by zyga> <https://github.com/snapcore/snapd/pull/3095>22:21

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!