/srv/irclogs.ubuntu.com/2017/06/01/#snappy.txt

=== chihchun_afk is now known as chihchun
=== chihchun is now known as chihchun_afk
=== chihchun_afk is now known as chihchun
zygao/07:19
pstolowskimorning zyga !07:20
zygamvo: hey, no luck with lock issue yet; what makes me mad is that it happens in real time, every minute there are several reports07:34
zygamvo: it might be one machine doing CI but we just don't know07:35
zygamvo: I will try to inject some possible failures to see if I can replicate the error (yesterday all my attempts failed to reproduce it)07:35
=== chihchun is now known as chihchun_afk
=== koza|away is now known as koza
=== chihchun_afk is now known as chihchun
=== JamieBen_ is now known as JamieBennett
morphis__zyga: I've seen the lock issue multiple times too on my system but lost that state already a while back, will tell you if I see it again08:36
zygamorphis__: during development or just use of snapd?08:37
morphis__use of snapd08:37
morphis__but it was a mixture of me doing multiple things, don't really remember08:37
zygamorphis: do you have it in snap changes?09:13
zygamorphis: any theory would be very valueble today09:13
abeatozyga, hey, anything left for https://github.com/snapcore/snapd/pull/3353 ?09:13
mupPR snapd#3353: Add support for reboot parameter <Created by alfonsosanchezbeato> <https://github.com/snapcore/snapd/pull/3353>09:13
morphiszyga: no, I've cleaned my system after that some time ago09:13
morphiszyga: sorry09:13
zygaabeato: no, let me approve it, sorry09:14
zygamvo: (let's chat here)09:15
zygamvo: interesting observation, the zesty kernel is now at 4.10.0-21 but we see errors with just -1909:15
zygamvo: but snapd is 2.2509:15
zygamvo: this feels like a fresh install but no reboot09:15
abeatozyga, thanks... there is an issue with the tests but seems to be the CI infra09:19
zygaabeato: done09:19
abeatogreat!09:20
mvozyga: yeah09:24
zygamvo: question09:25
zygamvo: is there any way to update with apt/dpkg09:26
Chipacagah09:26
Chipacawhy do we turn a 504 into a 400 :-(09:26
Chipaca503*09:26
zygamvo: that would cause conffiles to be _not_ updated even though the user has not modified his local copy?09:26
Chipaca(you don't need to answer that)09:26
mvozyga: I can't think of anything09:26
zygathanks09:27
mupPR snapcraft#1338 opened: go plugin: Add support for cross-compilation <enhancement> <Created by kalikiana> <https://github.com/snapcore/snapcraft/pull/1338>09:27
mupPR snapd#3385 closed: cmd: add stub new snap-repair command and add timer <Created by mvo5> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/3385>09:51
pedronismvo: ^ I merged the basic snap-repair, I'll start working a bit on top of it today09:52
mvopedronis: great, thank you09:53
Chipacaquick question, team: which of these is better? http://pastebin.ubuntu.com/24735919/10:00
mvoChipaca: I like the second10:07
ogra_Chipaca, i'd take the last one but attach "(503 Service Unavailable)" after "network trouble"10:07
Chipacaogra_: was thinking something similar10:07
Chipaca(in the two shorter ones, the big message is sent to the log)10:08
Chipacaso maybe it's ok not to tell the user anything more than the shortest message10:08
Chipacaas they can dig10:08
Chipacabut dunno10:08
pedronisChipaca: well I would argue that a 500 is not a network trouble10:09
pedronisnetwork trouble would make me think that my local router need a kick10:09
Chipacapedronis: where does it stop being "network trouble"?10:09
pedronisChipaca: anything that gave you a http response is probably not network trouble10:10
Chipacapedronis: at the user's router? their isp's? our isp? our dc? ...?10:10
pedronisit might be cloud trouble tough :)10:10
Chipacapedronis: i'm always open to suggestions :-D10:10
pedronisChipaca: "network trouble" is a completely unactionable message10:10
Chipacapedronis: so is the other two10:11
Chipacaso are*10:11
pedroniswell, sorry, it's probably not just unactionable, it's ambgiously so10:11
pedronisChipaca: if you get a 50x you should probably say server somewhere, not network10:11
Chipacai can change it to 'server trouble' :-)10:12
Chipaca4xx are also server trouble, at this level10:12
pedroniswell usually they are10:12
pedronisor we did something bad with snapd10:12
pedronisbut usually10:12
pedronisnot10:12
pedronisanyway not something the user can fix10:12
ogra_but he can report it10:12
Chipaca'server trouble' works10:12
Chipaca'server trouble (see logs for more info)'?10:13
Chipacasee journal*10:13
pedronisChipaca: anyway  server trouble (something) seems still better to me10:13
ogra_something like that ... if you dont want to show thee error code10:13
pedronisit's either non relevant, but for people that can read it , it avoid an extra hop to the logs for nothing10:13
pedronisChipaca: related  to this we should also remember to fix in client or cmd when we call snapd issues, server issues10:14
morphiszyga: https://build.opensuse.org/request/show/50035510:14
pedronisChipaca: you could also say  "store" troubles in most cases, I think there's also one thing we do that is not quite store but something else (userinfo)10:15
Chipacapedronis: piano piano se va lontano10:15
mupPR snapcraft#1339 opened: python plugin: install six before using setuptools <Created by kyrofa> <https://github.com/snapcore/snapcraft/pull/1339>10:15
Chipacatrue! i like store troubles10:15
zygamorphis: looking10:15
Chipacathis is in store.go after all :-)10:15
* Chipaca looks at auth.go just in case10:15
pedronisChipaca: most stuff we do in auth.go are also to talk to the store in the end, as I said userinfo.go is the only ambiguous one10:16
pedronisis ssh keys in LP "store" ?10:16
zygamorphis: what is the ghost feature?10:17
pedronisChipaca: anyway we might also be about to conflict on this, I have also a big change for store.go (extracting retry to httputil)10:17
Chipacapedronis: this is a really small and silly branch10:18
Chipacaso i don't mind either way10:18
pedronisChipaca: ok, need to fix a conflict and one test issue about testing DNS when we have a proxy around then my branch is reviewabale, will give a pointer soon10:18
Chipacaok10:19
Chipacapedronis: i too have a pr up fwiw10:19
pedronissaw it10:19
pedroniswill look in a bit10:19
Chipacaok10:19
Chipacamentioning it because it touches store10:19
Chipacaalthough changes in store itself are minimal10:20
didrockszyga: hey, it seems you told that you told to aquarius_ that my recommendations wouldn't make them match the desktop theme10:22
didrockszyga: they do10:22
zygadidrocks: not in general, not always10:22
didrocksI'm happy to explain to you how the desktop is working, but don't mislead the users based on our launcher work :)10:22
didrockszyga: x11, any desktop, if you have the theme in the snap, it will10:22
didrocksnot with the dark gtksettings though10:22
didrockswhich is the issue aquarius_ had10:22
zygadidrocks: maybe I misunderstand but can it universally mirror the theme of the classic distro?10:23
didrocks(because they aren't in gsettings, but in another file)10:23
didrockszyga: if your snap embeeded them, yse10:23
didrocksyes*10:23
didrockswith matching version of the gtk one your are linked against10:23
didrockswhich is what the desktop-launcher does (with popular themes)10:23
didrockswillcooke: FYI ^10:23
zygadidrocks: right, but snaps cannot embed any and all themes10:23
didrockszyga: indeed10:23
zygadidrocks: sure, I agree, I just replied about the fact that snaps cannot do it perfect universally, not that it is not good for practical use10:24
didrockszyga: but that wasn't the issue here, aquarius_ knew about that limitation10:24
didrocksyeah10:24
didrockswe will need to have theme snaps10:24
zygayes, I agree10:24
zygaand I have some ideas on how to do them already10:24
zygabut insufficient time to experiment and prototype10:24
didrocksensure you talk with the desktop teams who knows about the exact technics10:25
didrocksbecause there isn't just one gsettings involved in the theme selction10:25
didrocksselection*10:25
zygadidrocks: thank you, I will10:25
zygadidrocks: the idea is more general than any particular technology though,10:25
didrocksmeanwhile, I'll fix that gtksettings not share10:25
didrockszyga: you still need to work with existing toolkits :)10:26
zygadidrocks: I'm sure there are details to explore but the general idea is to offer theme snaps that would work with any snap using a given base10:26
didrocksso, you need to know what the toolkits are reading and basing their theming on10:26
pedronisChipaca: snapd#341710:27
mupPR snapd#3417: httputil,store: extract retry code to httputil, reorg usages <Created by pedronis> <https://github.com/snapcore/snapd/pull/3417>10:27
didrockszyga: hum, where are the interfaces stored now? I apt-get source snapd and grep for "gsettings", but don't find any match10:29
zygamvo: https://github.com/snapcore/snapd/compare/master...zyga:feature/detect-partial-updates?expand=110:30
zygamvo: can you pleae eyeball the paths to ensure that's the right thing (before we waste CI slot)10:30
seb128didrocks, https://github.com/snapcore/snapd/blob/master/interfaces/builtin/gsettings.go ?10:30
zygadidrocks: you mean snapd interfaces?10:30
didrocksinteresting, I just apt-get source snapd…10:30
zygadidrocks: in snapd, in interfaces/builtin10:30
didrocksah, I probably don't have source for -updates10:31
didrocksso very old snapd apt-get sourced ::p10:31
didrocks:p10:31
Chipacapedronis: is dropping context because YAGNI?10:31
seb128zyga, theme snaps ... just need to be able to content-share mount more than 1 content basically10:31
seb128zyga, and auto mount the available themes10:32
zygaseb128: we also need a way to tie this to base snaps10:32
zygaseb128: so those themes will apply to that base and not other bases10:32
seb128why?10:32
zygaseb128: as for sharing many things, yes, it's doable, just I would not do it via content, instead I'd make a new interface using the same internal logic, that handles N themes automatically10:32
zygaseb128: because other bases will use differnet toolchains, libc's and so on (fedora/suse/debian)10:33
zygaseb128: so each theme needs to associate itself with a bse10:33
zygaseb128: as a indicator of ABI10:33
zygaseb128: this will also let us have themes that need different ABIs for series-1810:34
zygaseb128: this is very similar to how flatpack does it now, they tie this to runtimes which is exactly how our bases are10:34
seb128zyga, themes are mostly css files and icons10:34
zygaseb128: in general, they can be anything10:34
seb128that's not specific to toolchains10:34
zygaChipaca, mvo: https://github.com/snapcore/snapd/pull/342110:34
mupPR snapd#3421: errtracker: include hints of partial dpkg update in error reports <Created by zyga> <https://github.com/snapcore/snapd/pull/3421>10:34
mupPR snapd#3421 opened: errtracker: include hints of partial dpkg update in error reports <Created by zyga> <https://github.com/snapcore/snapd/pull/3421>10:35
zygaJamieBennett: ^^ this will help us test the theory on failures, this will also be cherry-picked into the next stable release10:35
zygaJamieBennett, mvo: I will skip standup today, I need to go somewhere and I used up 90% of my mobile traffic by having last few hangouts on them by accident :/10:36
zygamvo: if you are going to land that branch or any fixes, quash them for easier cherry pick please10:37
jjohansenzyga: http://people.canonical.com/~jj/linux+jj/ the kernel there should have a fix for the trace back you were seeing the other day10:40
pedronisChipaca: well, we were passing to TODO mostly to satifsfy doRequest which uses it but only for download10:41
pedronisChipaca: so yes until we have something better to pass than TODO, I think this is saner10:42
pedroniswhen we have we can decide what to do with it10:43
pedronisChipaca: having lunch, will look at your branch afterward10:43
zygajjohansen: is that fix also in stable kernels in ubuntu?10:49
zygajjohansen: hey :-)10:50
=== elfgoh_ is now known as elfgoh
mupPR snapcraft#1340 opened: state: save all the build packages as global <Created by elopio> <https://github.com/snapcore/snapcraft/pull/1340>11:00
jdstrandmvo: hey, when you are ready for it to be reviewed, can you make sure you ask for me to be a reviewer of the bpf changes? also, did I hear something about a kernel traceback or eperm when trying to load the bpf cache?11:17
jdstrandmvo: I mention it cause of no new privs. you have to make sure you get that right11:24
jdstrandI see that yesterday you added a commit surrounding that, so maybe you figured it out already :)11:24
mupPR snapcraft#1339 closed: python plugin: install six before using setuptools <Created by kyrofa> <Merged by sergiusens> <https://github.com/snapcore/snapcraft/pull/1339>11:27
mupPR snapcraft#1341 opened: Release changelog for 2.30.1 <Created by sergiusens> <https://github.com/snapcore/snapcraft/pull/1341>11:33
mupPR snapcraft#1342 opened: nodejs: run install and commands in source-subdir <Created by Saviq> <https://github.com/snapcore/snapcraft/pull/1342>11:39
mupPR snapcraft#1343 opened: go plugin: Cross compile with CGo <Created by kalikiana> <https://github.com/snapcore/snapcraft/pull/1343>11:42
pedronispstolowski: we are not super consistent already about using http.Status* constants, we maybe should be but then I don't know if to fix everything in this branch or do a follow up11:48
pedronisChipaca: pstolowski: this kind of code is interesting httpStatusCode/100 == 411:49
Chipacapedronis: it makes me uncomfortable but that's not an objective objection11:51
Chipacaso it went in11:51
pedronisChipaca: yes, but it cannot stand if we want to use http.Status* consistently11:52
pedronis(I personally don't care too much either way)11:52
Chipacapedronis: sure it can: return httpStatusCode/http.StatusCodeContinue == 411:53
pedronisno11:53
Chipaca:-D11:53
pedronisthe 4 cannot be there11:53
Chipacaah, rats11:53
Chipacapedronis: actually they aren't typed11:53
Chipacaafaik11:53
pedronisso11:53
pedronis?11:53
Chipacamaybe i misunderstand what you mean then11:54
Chipacaanyway, i also don't mind one way or the other tbh (consistency wins)11:54
pedronisI mean that code wants you to know about 40x vs BadRequest11:54
pedronisChipaca: we are not consistent atm either way11:54
mupPR snapcraft#1253 closed: go plugin: cross-compilation support <Created by kalikiana> <Closed by kalikiana> <https://github.com/snapcore/snapcraft/pull/1253>11:54
Chipacai know11:54
pedronisI'm been asked to be a bit more, but is a rat nest11:54
Chipacaso yes something needs to be done :-)11:54
Chipacawell, s/needs to/should/11:55
pedronisto be completely honest I think it is easier to be consistent about not using http.Status*11:55
pedronisbut oh well11:55
=== chihchun is now known as chihchun_afk
mvojdstrand: yeah, I need to polish that code but I think the building blocks are ther enow, the testsuite passes except for the bit where the input name changed12:00
mupPR snapd#3419 closed: interfaces: partly revert aace15ab53 to unbreak core reverts <Created by mvo5> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3419>12:02
pedronisChipaca: pstolowski: so can do but probably it's a separate PR, I spotted about ~20 places that would need to change and they are not already touched by the PR12:03
pedronis(if we don't consider tests, I'm not sure it's worth the effort there)12:03
pedroniss/they are not/they are not all/12:04
pstolowskiChipaca, lol @ return httpStatusCode/http.StatusCodeContinue == 412:10
zygapstolowski, pedronis, mvo: I need a 2nd review on https://github.com/snapcore/snapd/pull/342112:11
mupPR snapd#3421: errtracker: include hints of partial dpkg update in error reports <Critical> <Created by zyga> <https://github.com/snapcore/snapd/pull/3421>12:11
pstolowskipedronis, ok, that's fine, I didn't know there are more places affected12:11
mvozyga: yeah, looking at it now12:11
zygamvo: thank oyu12:13
zygaI have one more on top that detects re-exec12:13
zygaonce those two land I'll propose cherry-picks into release/2.2612:13
mvozyga: re-exec we can infere from the build-ids, but making it explicit is nicer12:15
jdstrandmvo: cool, thanks12:16
zygamvo: I said as much in the commit message :D12:17
pedronispstolowski: Chipaca: I put back the context to retryRequestDecodeJSON12:18
pstolowskipedronis, thank you12:22
mvozyga: haha, ok12:23
zygamvo: replied12:26
zygamvo: I'll gladly iterate if you can look at the response12:32
mvojdstrand: can we do something about the snap-confine apparmor file? could we get it out of /etc/apparmor.d and not make it a conffile?12:34
mvozyga: yeah, just looking and experimenting a bit12:34
mvozyga: curious about the idea that it might be a half-installed snapd12:34
zygamvo: aha, thank you12:34
mvozyga: and I'm trying to reproduce this12:34
mvozyga: I mean, break it intentionally and see what happens12:35
zygamvo: half-updated,12:35
mvozyga: yeah, I wonder if we should have a daemon in this case12:35
zygamvo: (pardon my ingorance of dpkg terms)12:35
mvozyga: no problem12:35
zygamvo: as the problem would be different if the profile was not loaded (at all) yet12:35
mvozyga: I mean, the daemon is started in postinst, so if the upgrade did not quite work it depends on where it breaks etc, this is what I want to check, its an interessting angle to the problem12:36
mvozyga: aha, indeed12:36
zygamvo: would the socket be disabled during update?12:36
pedronisChipaca: I reviewed your branch, but I have a question/wondering there12:36
zygamvo: because if not then snap install will just wake everything up12:36
mvozyga: plus I wonder if we can simply move the file to a different place, the more I think about it, the more I get the feeling no user should mess aorund with it, i.e. it should not be a conffile12:36
mvozyga: yeah, interessting12:37
zygamvo: yes, (except for special cases which could become core config later)12:37
zygamvo: but even moving it around is dangerous12:37
zygamvo: as the presence of any backups, .dpkg-{old,new} files will make apparmor load that on boot12:37
zygamvo: so depending on racing time we may load the wrong order and overwrite12:38
mvozyga: indeed, if we move it we need to pull out the big guns to get rid of it12:38
zygamvo: (hence my initial suggestion to use a classic manager to ensure it is sane)12:38
zygamvo: yes12:38
mvozyga: it seems like the apparmor init.d loads etc first and then the snaps dir12:38
zygamvo: oh, that would be nice, we could just stick it in our directory12:38
zygamvo: anyway, I would appreciate swiftness as release time runs out12:39
zygamvo: we can iterate on making this nicer next12:40
jdstrandmvo: yes, it could not be a conffile. the trick would be to make sure it is loaded before snap-confine is run12:47
zygajdstrand: I think mvo's observation is sufficient, it will be loaded by the same mechanism as today12:49
zygajdstrand: and even presence of any old/stale files will not12:49
zyga... not affect this as it will be over-written shortly thereafter (in the kernel)12:50
jdstrandmvo: not that there are complications associated with moving it-- if the old file is still around, it could be loaded, possibly after the one that is somewhere else, so it needs to be always removed. also, nfs /home and some other users are modifying the profile to workaround issues with the profile. we'd need to introduce a mechanism for people to apply workarounds. Thankfully, we can use the #include local/... ideas for that12:50
jdstrands/^not/note/12:50
mvojdstrand: yeah, I noticed the local/ idea12:50
mvojdstrand: plus it looks like I need to maually add the postinst/postrm snippets that dh-appamor would generate for me?12:51
jdstrandzyga: I'm not 100% sure snapd will be happy with something not named snap.* in that dir12:51
jdstrandmvo: yes12:51
zygajdstrand: aha, interesting,12:52
zygajdstrand: well, we can look for a way12:52
jdstrandmvo: there is a question of upgrades for people who have modified the profile in /etc and what to do with their changes. do we throw them away and just comment in the bug? do we try to migrate? etc12:53
zygajdstrand: I like the local idea, where would that other file be?12:53
zygamvo: yes, I'm afraid so12:53
zygajdstrand: yes, that is thorny12:54
zygajdstrand: my gut says the benefit outweights the costs and I would just migrate it and do a debconf prompt instructing them to migrate to local mechanism if we detect a modified conffile on migratoin12:54
zyga*migration12:54
jdstrandzyga: what other file? the main profile is wherever you decide. then it uses '#include local/snap-confine' (or whatever). local/ is relative to /etc/apaprmor.d, so /etc/apparmor.d/local. The include file could be an absolute path. eg, #include "/path/to/thing/to/include"12:55
zygajdstrand: I must have misunderstood something, I thought we'd axe the /etc/apparmor.d file and place it in /var/lib/snapd/apparmor/profiles (or similar) and in that, immutable, new file we'd offer an include to somewhere writable12:56
zygajdstrand: and since the new profile would always update we'd have to agree on a fixed location where local configuration can still be made12:56
jdstrandzyga: that is this idea. /etc/apparmor.d/local/snap-confine != /etc/apparmor.d/usr.lib.snapd.snap-confine12:57
zygajdstrand: ah, I see12:57
zygajdstrand: makes sense12:57
jdstrandzyga: if you don't like /etc/apparmor.d/local/snap-confine, then use an absolute path include12:57
zygano, I was just confused about the detail, it's fine12:57
jdstrandbut /etc/apparmor.d/local is an established mechanism, so it is perhaps the right location12:57
* zyga sighs at 2fa that he left at ome12:58
zygaand about forgetting "h" due to spanish influence12:58
jdstrandthe nicest thing to do would be to detect additions to /etc/apparmor.d/usr.lib.snapd.snap-confine.real and plop them in /etc/apaprmor.d/local/snap-confine12:59
zygamvo: I cannot join the stand-up12:59
jdstrandhehe regarding 'h'12:59
zygaI don't have my token with me :/12:59
mvozyga: no worries12:59
zygamvo: maybe I could on m phone, one sec13:00
zyganope13:01
zygasame 2fa13:01
zygawell13:01
zygasorry13:01
zygamvo: my update for today: investigating the lock issue, testing and experimenting with those snaps in different environments13:02
mvozyga: thanks!13:02
zygamvo: confirmed with juju team that the snap works ok normally, doesn't run inside docker (runs alongside)13:02
zygamvo: drawfted two branches, the one for dpkg-new detection and a small one on top for did-re-exec detection13:02
zygamvo: I need to test a suse PR that fixes one last thing we wanted to do to enter factory (postrm/purge script)13:03
zygamvo: and that's pretty much it13:03
zygamvo: I looked at your branch from last night but I didn't push it forward yet13:03
mvozyga: I did some small tweaks to my seccomp-bpf branch but still plenty of room for improvements13:04
mvozyga: thanks for the update13:04
zygamvo: yes, I want to iterate on it but it has lower priority than this work for now13:05
zygamvo: please let me know how to proceed on the extra error report data13:21
zygamvo: I'm happy to do everything just let's agree on what13:22
* zyga takes a brief break13:24
mvozyga: md5sum I think we want13:29
mvozyga: i.e. if we have a dpkg-new file we want a md5sum13:29
mvozyga: otherwise I agree with you, nothing is really important and we can iterate later13:30
zygamvo: OK13:31
zygamvo: I'm on this13:31
zygamvo: thank you!13:31
mvozyga: thank you13:32
mvozyga: and then we need to explore what to do to stop making snap-confine.real a conffile13:33
mvozyga: or we just ref it everytime we change it ;) snap-confine.113:33
mvo.213:33
mvoetc13:33
zygamvo: haha, and endure the eternal conffile migrations in the maintscripts :)13:37
zygamvo: but I think this is the path forward to ensure sanity13:38
zyga(not the maintscript, just moving away from /etc)13:38
zygaplus13:38
zygamvo: one less file in /etc :D13:38
mvoexactly13:38
pedronisniemeyer: this is what we concluded I think about status codes:  https://forum.snapcraft.io/t/numeric-http-status-codes-vs-http-status-constants/86013:52
NicolinoCurallihi all: classic-support interface is for ubuntu-core or classic?13:52
pedronisNicolinoCuralli: it's for the "classic" snap  only, used to have a classic enviroment on Ubuntu Core13:54
jdstrandNicolinoCuralli: 'classic' is unfortunately super overloaded. that is only for the 'classic' snap13:54
NicolinoCurallioki13:55
NicolinoCurallithanks a lot13:55
pedronisit's not used on classic system or by classic confinement snaps13:55
NicolinoCuralliok: i understand it13:55
pedronisand yes classic is quite the overloaded term these days13:55
jdstrand:)13:55
pedroniswe should usually add a 2nd word there I suppose as I did here, unless the context is super clear13:57
jdstrandall those terms try to communicate something in the same mental area ('old world usage patterns) but it gets a bit difficult to talk about the different technologies for all the different angles13:57
jdstrandpedronis: indeed13:57
pedronisjdstrand: niemeyer: maybe we should have a "The meanings of classic" forum post14:01
ogra_lol14:01
niemeyerpedronis: That's a good idea actually14:01
ogra_that will end like a philosophical pamphlet :)14:01
* ogra_ thinks we should rename one of the "classics" ... 14:02
niemeyerpedronis: Or perhaps "The meaning of classic"14:02
niemeyerpedronis: It means just one thing really.. we just use it in several different places14:02
mupPR snapd#3422 opened: tests: take into account staging snap-ids for snap-info <Created by fgimenez> <https://github.com/snapcore/snapd/pull/3422>14:12
zygamvo: updated14:32
zygamvo: I simplified it a bit14:34
zygamvo: and the extra hashes will help in de-duplicating issues14:34
zygamvo: we'll know measure hashes of both the current and the .dpkg-new (if any) files14:34
zygamvo: so we can check which profile is really used, which will let us test my theory reliably14:35
zygamvo: I'll start the 2.26 based branches and PRs now14:36
mvozyga: thanks, if we squash the merge we can just cherry pick in 2.26 trivially14:37
mvozyga: lets use md5sum, thats the same that dpkg is using, this way we can easily compare with the dpkg metadata instead of having to unpack it14:38
mvozyga: for snapConfineProfileDigest()14:38
mvozyga: let me comment in the pR14:38
zygaahasure14:40
zygaone sec14:40
zygasmart idea btw :)14:41
mvozyga: thanks, one tiny bikesheed naming suggestion then its good to go14:41
zygamvo: sure, let me look14:42
zygahaha, I called it like that14:42
zygabut I reverted to not reflow the block14:43
zygabut no worries :)14:43
mvozyga: hahaha14:43
zygaI like it better this way14:43
zygamvo: tweaked14:47
zyga_mvo: re, +1 if you like it, I'll work on other branches14:51
zyga_mvo: when do you want to do 2.26.x today?14:52
* Chipaca has returned from the dentist expedition14:55
Chipacapedronis: "50 shades of classic"?14:55
mvozyga_: I'm still keen to do a 2.26.x today14:56
zyga_excellent14:57
mvofgimenez: I think we have a new core in edge, could you please run the ntested test again?14:57
zyga_so we do a .candidate today?14:57
zyga_or beta?14:57
ogra_hmm, can i force re-exec somehow to avoid ever ending up with the deb based setup ?14:57
zyga_mvo: btw, you said you would cherry pick it14:57
ogra_(like i can force no-reexec, just the other way around)14:58
zyga_mvo: I can do that too (but feel free, just want to know if I should open brnaches)14:58
zyga_ogra_: not today, no; we have a preference and we check for viability14:58
zyga_ogra_: look at cmd/cmd.go14:58
ogra_zyga_, i fear the docker stuff with snap-confine will only work if it is actually re-execed ...14:59
mvozyga_: probably only beta14:59
ogra_which works by sheer luck because i force install the edge core now14:59
fgimenezmvo: sure on it thx14:59
ogra_(so i can be sure to be newer than the deb)14:59
mvozyga_: cherry pick should be fine once its in master14:59
ogra_but if i wanted to use the stable core it might jump back and forth on container startup15:00
ogra_(depending if the deb sanpd is newer than the one in core or not)15:01
pedronisChipaca: welcome back, we chatted in the standup about http status codes: https://forum.snapcraft.io/t/numeric-http-status-codes-vs-http-status-constants/86015:12
ogra_ha!15:15
* ogra_ is using the snapcraft snap inside a docker container to build a snap 15:15
ogra_awesome :D15:16
pedronispstolowski: btw when you have a bit of time could you finish the review/revote on snapd#3417 given what we discussed in the standup15:17
mupPR snapd#3417: httputil,store: extract retry code to httputil, reorg usages <Created by pedronis> <https://github.com/snapcore/snapd/pull/3417>15:17
pstolowskipedronis, i approved already a few minutes ago15:17
mupPR snapd#3422 closed: tests: take into account staging snap-ids for snap-info <Created by fgimenez> <Merged by pedronis> <https://github.com/snapcore/snapd/pull/3422>15:21
pedronispstolowski: ah, thank you15:22
pedronisI missed the email15:22
pedronissaw it now15:22
cwayneogra_: but was that docker container from the docker snap :p15:23
pedronispstolowski: btw, related to it, I noticed we use the defaultRetryStrategy also for download, shouldn't we use a slightly longer overall timeout there?15:23
ogra_cwayne, hah, no, i dont think that will work15:23
ogra_cwayne, only the docker.io deb15:24
cwaynenot with that attitude it won't!15:24
ogra_heh15:24
ogra_i need to break all confinement to make that work ... i doubt that can work with the docker snap wrapped around it15:25
pstolowskipedronis, hmm, fair point, although I'd say if we timeout it's at the beginning when download is initiated usually15:25
ogra_though i might .... in an insane moment ... try it :P15:26
pedronispstolowski: yes, I don't think we should make 30 mins because some snaps are big15:26
pedronisjust sayign it might need to be a bit more, some small multiple of the default one15:26
cwayneogra_: that's the spirit :D15:26
fgimenezmvo: core-revert succeeded with latest edge core snap \o/15:38
mvofgimenez: excellent!15:39
fgimenezmvo: http://paste.ubuntu.com/24738597/15:40
mupPR snapd#3421 closed: errtracker: include bits of snap-confine apparmor profile <Critical> <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3421>15:41
mvozyga_: looks like we need a backport of 3421 - it can not be cleany cherry picked, if you could do that, that would be great15:42
zyga_mvo: absolutely, on it15:42
mupPR snapcraft#1344 opened: git: don't use --remote for updating submodules <Created by Saviq> <https://github.com/snapcore/snapcraft/pull/1344>15:42
zyga_mvo: one for your consideration https://github.com/snapcore/snapd/pull/342315:45
mupPR snapd#3423: errtracker: report if snapd did re-execute itself <Created by zyga> <https://github.com/snapcore/snapd/pull/3423>15:45
mupPR snapd#3423 opened: errtracker: report if snapd did re-execute itself <Created by zyga> <https://github.com/snapcore/snapd/pull/3423>15:45
zyga_mvo: the backport https://github.com/snapcore/snapd/pull/342415:49
mupPR snapd#3424: errtracker: include bits of snap-confine apparmor profile (#3421) <Created by zyga> <https://github.com/snapcore/snapd/pull/3424>15:49
mvozyga_: \o/15:49
mupPR snapd#3424 opened: errtracker: include bits of snap-confine apparmor profile (#3421) <Created by zyga> <https://github.com/snapcore/snapd/pull/3424>15:49
mupPR snapd#3424 closed: errtracker: include bits of snap-confine apparmor profile (#3421) <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3424>15:50
cachiomvo, could you please retrigger the failed tests in the econnreset MP?15:50
zyga_cachio: I can15:50
cachiozyga_, tx15:50
zyga_done15:52
cachiozyga_, tx15:53
cachiozyga_, could you trigger this one too?15:53
cachiohttps://github.com/snapcore/snapd/pull/340515:53
mupPR snapd#3405: tests: fix for upgrade test when it is repeated <Created by sergiocazzolato> <https://github.com/snapcore/snapd/pull/3405>15:53
zyga_done15:55
cachiozyga_, tx15:57
zyga_:)15:57
zyga_we need a 2nd review on  https://github.com/snapcore/snapd/pull/342315:58
mupPR snapd#3423: errtracker: report if snapd did re-execute itself <Created by zyga> <https://github.com/snapcore/snapd/pull/3423>15:58
pedronisChipaca: thanks, I was puzzled by the not-found change16:01
morphiszyga_: btw. did you talk with anyone at suse about the global /snap dir?16:01
=== om26er is now known as om26er_
=== om26er_ is now known as om26er
Chipacapedronis: blinkers on16:02
Saviqkyrofa, elopio, https://launchpad.net/ubuntu/zesty/+queue?queue_state=1&queue_text=snapcraft16:02
cjwatsonsergiusens_: did you see the bit of my review about dropping the extra Conflicts: python3-click-cli?16:07
sergiusens_cjwatson: I saw the one from around 10hs ago and pushed a revert of that, haven't seen newer comments, let me check now16:16
sergiusens_cjwatson: yeah, I think I addressed your comment already, thanks for finding that slip16:17
=== sergiusens_ is now known as sergiusens
cjwatsonsergiusens: you did the PkTransactionPast one but not the Conflicts16:18
mupPR snapcraft#1345 opened: deltas: Improved message returned when delta is too big <Created by gsilvapt> <https://github.com/snapcore/snapcraft/pull/1345>16:18
cjwatsonI made two relevant comments :)16:19
=== pbek_ is now known as pbek
sergiusensoh, I didin't seem to notice that one16:23
* sergiusens goes and reads again16:23
zyga_pedronis: replied to your comment16:23
pedroniszyga_: ah,  I woudl return yes and no,  and rename the field , I find the "" one a bit confusing16:25
Facuzyga_, you wrote the "Building the code locally" part in snapd's HACKING.md file... question: is there a way to compile it and run it *from the project dir*, not installing it in the system?16:26
Facuzyga_, all I want to do is to hit staging environment with snapd for some tests16:26
Facu(is there an easier way than re-building?)16:27
=== jcamino100080 is now known as jcamino
cjwatsonsergiusens: thanks, approved now.  it should be landable with bileto if you still remember how to use that :-)16:38
ChipacaFacu: o/16:38
ChipacaFacu: GOPATH=~/canonical/snappy go build -v -i -o /tmp/srv github.com/snapcore/snapd/cmd/snapd && sudo ~/bin/run-snapd-srv16:38
ChipacaFacu: if all you're wanting to do is hit the store, that ^ does it16:38
sergiusenscjwatson: I was lucky to escape it early, but I was going to ask slangasek if it was still functional and the preferred mechanism still16:38
sergiusensthanks for looking16:38
sergiusensI'll work on getting it in16:39
ChipacaFacu: unless what you're tweaking is the client, in which case you can just go run it16:39
cjwatsonyeah, it's how the last version was landed at any rate16:39
cjwatsonI don't know if quadruple landings are a thing though, possibly not, you might need multiple MPs16:39
slangasekbileto is in maintenance mode but still functional16:39
slangasekquadruple landings should not be a thing, the multiple-series landings have always caused a bit of friction against the archive and I think we've done away with them post-zesty16:40
cjwatsonrighto16:40
cachiozyga_, do you know if it is possible to see the all the ci results for a specific branch?16:44
cachioin travis16:44
zyga_cachio: yes, always if it was tested16:49
zyga_cachio: which branch are you thinking about?16:49
zyga_pedronis: sure, I will make the changes, thank you for clarifying that16:49
cachiozyga_, sergiocazzolato:tests-fix-upgrade-basic16:49
zyga_Facu: yes, although there are many loopholes and complexity16:49
zyga_Facu: which branch do you want to try?16:50
zyga_Facu: depending on where the changes are you need to do more or less things16:50
Facuzyga_, just master, but wait, Chipaca is currently helping me (and teaching me some go stuff)16:50
Chipacambuahaha16:51
zyga_Facu: you can just switch to edge :)16:51
zyga_Facu: use the edge channel luke ;-)16:51
zyga_Facu: sure I saw, I just reply in the backlog order16:51
Facuzyga_, snapd from edge (snap install snapd --channel=edge) uses staging?16:52
zyga_Facu: ah, staging store?16:52
pedronisFacu: no16:52
zyga_nope16:52
Facuok16:52
sergiusensslangasek: cjwatson: there seems to be no series registered for click to land in older releases, should I get this in artful with bileto and go the traditional debsource route for the SRU?16:56
cjwatsonsergiusens: that's fine by me17:03
Facuzyga_, for the record, all I needed to do to run snapd against staging (plus some debugging I wanted) is17:07
Facusudo systemctl stop snapd.service snapd.socket17:07
Facusudo SNAP_TESTING=1 SNAPD_DEBUG=1 SNAPD_DEBUG_HTTP=7 SNAPPY_USE_STAGING_STORE=1 /usr/lib/snapd/snapd17:07
zyga_:-)17:13
zyga_nice17:13
Facuzyga_, ...which doesn't really work, because you can not cross assertions from prod and staging, I'm currently learning17:14
Facuzyga_, so or you start a VM that never used prod before, or you clean up somehow what snapd has stored17:15
zyga_Facu: ah, indeed17:15
zyga_Facu: test builds use different key17:15
Facuzyga_, I'm not using a test build, but the system's snapd17:16
zyga_right17:17
zyga_pedronis: updated17:20
zyga_pedronis: I'll land it and cherry pick for 2.26 when it goes green17:21
* zyga_ works on snap-confine patches now17:21
zyga_mvo: backport https://github.com/snapcore/snapd/pull/342517:31
mupPR snapd#3425: errtracker: report if snapd did re-execute itself <Created by zyga> <https://github.com/snapcore/snapd/pull/3425>17:31
mupPR snapd#3425 opened: errtracker: report if snapd did re-execute itself <Created by zyga> <https://github.com/snapcore/snapd/pull/3425>17:32
mupPR snapd#3425 closed: errtracker: report if snapd did re-execute itself <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3425>17:46
jjohansenzyga_: no, that fix is not in any ubuntu kernel, it was done yesterday17:49
zyga_jjohansen: aha, interesting!17:49
zyga_jjohansen: thank you!17:49
zyga_jjohansen: btw, not sure if you noticed but we ran into an apparmor oops, just trying to recall who saw this :/17:50
zyga_ogra_: was that you/17:50
mvozyga_: me17:52
jjohansenmvo: bug?, oops trace back? anything for me to look at?17:54
zyga_mvo: ah, thank you :)17:54
niemeyerFolks, I got a heads up from Linode that they've blocked our use of the API due to volume17:56
niemeyerExpect broken tests until I sort that out17:56
zyga_niemeyer: thanks for the heads up!17:58
mvojjohansen: let me search, I only have the bits that I gave to zyga_ the other day, it was actually me using seccomp inappropriately so it may well be not a real apparmor bug17:58
zyga_niemeyer: volume of calls we make?17:58
zyga_ah17:58
mvojjohansen: http://paste.ubuntu.com/24724666/ this is what I have, I think prctl(PR_SET_NO_NEW_PRIVS, 1, 0, 0, 0)  = 0 was actually the problem, i.e. I was incorrectly using that17:58
zyga_jjohansen: I recall now17:58
niemeyerzyga_: Yep, spread17:58
zyga_jjohansen: aa change onexec would fail and we'd oops17:59
zyga_jjohansen: but looks like a bug in the kernel17:59
jjohansenmvo, zyga_: ah yep the kernel I built yesterday should fix that  http://people.canonical.com/~jj/linux+jj/18:00
mvojjohansen: great, thank you - that is all I have encountered18:00
niemeyerI guess I'll need to write a new spread backend to a cloud where 80 machines isn't much.. :(18:22
cachioniemeyer, are you gonna try with aws? or it is much expensive?18:27
niemeyerIt is more expensive and has other associated issues in terms of book keeping18:27
niemeyerBut everything may be workarounded18:28
cachiorackspace is another good alternative18:28
niemeyerOn Linode we get a machine descent enough to run our tests for a whole month for 10 bucks18:28
cachionot sure about the cost18:28
niemeyerIf I have to leave a non-mainstream provider, I'm not going anywhere else but AWS or GCE18:29
zyga_niemeyer: heh, that's pretty depressing18:29
zyga_niemeyer: did we abuse the API somehow?18:29
niemeyerWhere I'm sure we'll be small bees18:29
niemeyerzyga_: We did in their opinion18:29
zyga_niemeyer: by creating/destroing machines?18:29
niemeyerzyga_: Yep18:30
niemeyerzyga_: It's about volume18:30
niemeyerzyga_: They're being dumb.. it was fine when we had 20 machines18:30
zyga_niemeyer: interesting, I wonder if that has greater impact than just running a vm 24/718:30
zyga_niemeyer: one more option, standardize on qemu18:30
niemeyerzyga_: Now that we have 80, it's 4 times as much18:30
niemeyerFrom the same account18:30
zyga_niemeyer: get a few huge VMs18:30
zyga_niemeyer: and let them proxy our spread protocol18:30
zyga_niemeyer: so instead of hitting linode18:30
zyga_niemeyer: we'll hit any host with a qemu helper18:31
zyga_niemeyer: you already have the backend written18:31
zyga_niemeyer: and it's just the proxying that needs doing18:31
zyga_+/- details ;-)18:31
niemeyerzyga_: Heh.. it's just code that needs doing, yes.. like anything else18:31
niemeyerzyga_: Part of the goal here is for the system to sustain itself without maintenance18:31
niemeyerAlmost entirely, at least18:32
zyga_niemeyer: or do what I did, I bought a 24 thread workstation with 48 GB of ram for a few 100 on ebay (not for me)18:32
niemeyerNobody babysits our machines on a daily basis18:32
zyga_niemeyer: there is no cloud, it's just someone's computer :D18:32
niemeyerzyga_: This needs _maintenance_18:32
zyga_niemeyer: yes that's true :/18:32
niemeyerzyga_: I get news about broken hardware on those 80 machines all the time18:32
zyga_broken hardware?!18:32
niemeyerIt's a non-issue for us18:32
niemeyerYep18:32
zyga_as in virtually broken virtual hardware or really broken linode metal?18:33
niemeyerzyga_: Hardware breaks surprisingly often when you get to high numbers18:33
zyga_wow, linode needs to dust their cloud more often18:33
cachioheheh18:33
zyga_or use less soap and water :D18:33
niemeyerzyga_: Again, this is *normal*18:33
zyga_interesting, I never ran anything of this size18:34
zyga_and actually this is tiny size by cloud standards18:34
niemeyerzyga_: Think about percentages18:34
zyga_I can recall one email I got from my provider when they just told me that they migrated my VM from data centre to data centre for maintenance, without stopping the VM18:34
zyga_but since the performance was slower for that minute it took, they notified me18:35
zyga_(and two months in advance AFAIR)18:35
zyga_anyway18:35
zyga_sad linode day :-(18:35
* zyga_ hugs niemeyer for the amazing spread that lets us do stuff we couldn't dream of before18:35
niemeyerYeah.. I'm not super optimistic]18:35
zyga_remember when every test was written in go and mocking?18:35
niemeyerYeah, I predict a weekend lost here18:36
zyga_and we had x50 fewer of those18:36
zyga_mvo: ^^ you may need to merge manually for the release18:36
zyga_niemeyer: what's the chance of using canoincal cloud for that?18:37
zyga_niemeyer: could we get ~100 machines that just work?18:38
niemeyerzyga_: Pretty low.. we want completely open firewalls18:38
zyga_ah, indeed18:38
zyga_well18:38
zyga_maybe google or azure :)18:38
zyga_I don't know their pricing though18:38
zyga_but yeah, more coding on the glue18:39
zyga_maybe write a blog post18:39
zyga_about linode being terrible and ugly and unfair18:39
zyga_and snapd needing a better cloud provider18:39
zyga_maybe someone will notice18:39
zyga_(we can help spread the news)18:39
cachioI used to create up to 1000 machines for performance test in aws18:40
zyga_niemeyer: out of curiosity, what is the limit (numeric) that we exceeded?18:40
cachioand I never had an internet problem or any other kind of problem18:40
geniiperformance test/botnet18:40
* genii ducks18:40
niemeyerzyga_: None.. "you seem to be creating problems so we blocked you"18:41
niemeyercachio: To be fair, AWS doesn't even let us create 1000 machines in general..18:42
niemeyercachio: We had to get a special permit to do that when we needed that once18:42
Chipacaniemeyer: have you looked at ovh at all?18:42
cachioniemeyer, well, I asked for that18:42
Chipacathey were slightly mean but i think we worked through it18:42
cachioby defaul there is a limit abou 100 or something like that18:43
cachiothe main problem is that I was expensive18:45
cachioit was expensive18:46
cachio80 instances 8 hours/day 2vcpu 4GB ram = $917 monthly18:52
* zyga_ dreams about those ~200 core workstations18:54
niemeyercachio: Yeah, so it's not quite fair to say it was painless :)18:59
niemeyerBan lifted..19:05
niemeyerStill discussing details, but it should be unblocked righ tnow19:05
Chipacaogra_: http://biosrhythm.com/?page_id=145319:13
* zyga_ has to break now19:15
mupPR snapd#3423 closed: errtracker: report if snapd did re-execute itself <Created by zyga> <Merged by mvo5> <https://github.com/snapcore/snapd/pull/3423>19:17
mupPR snapd#3426 opened: release: 2.26.4 <Created by mvo5> <https://github.com/snapcore/snapd/pull/3426>19:18
jdstrandniemeyer: oh my! (blocked our use cause of volume). godspeed19:39
niemeyerjdstrand: Yeah, apparently the API is not very used there..19:52
niemeyerWe'll sort it out..19:53
niemeyerFound someone more accessible and happy to discuss the use case19:53
=== elfgoh_ is now known as elfgoh
azubietahello, I'm having some issues on making an snap that uses kf5-frameworks as a part can someone help me?20:58
Hilikushello23:16
Hilikushow can i enable a local terminal in my raspberry pi. i want to run an XServer in the hdmi port but by default all ubuntu core lets me do is ssh remotely, where i get permission problems trying to open the display23:17
naccHilikus: not sure i understand what you mean by 'local' terminal? I'm guessing that by default there is no x server running, or it's confined possibly?23:31
Hilikusnacc: I installed a chromium package that comes with an X server, but because ubuntu core only lets me connect via ssh, i have the extra problems of authenticating. if i can connect to a local tty instead of via ssh then maybe i'll have better luck23:32
Hilikusbasically, i don'23:32
naccHilikus: 'extra problems of authenticating'? you mean you can't ssh in?23:33
Hilikus't want to deal with the remote XServer issues23:33
Hilikusno, i can ssh just fine23:33
Hilikusbut i can't forward the raspberry X session to my desktop23:33
naccHilikus: i assume you mean you did `ssh -X` ?23:34
Hilikusyes23:34
Hilikusbut even if that worked, i need to be able to show the X session locally, via the HDMI of the raspberry + with a local keyboard and mouse, that's why i want to enable a local terminal. every other server i've used in my life has local terminals but ubuntu core only has this message (without prompt) saying to ssh23:35
naccHilikus: i'm fairly sure by default core doesn't have any ttys (or gettys) running23:37
Hilikusi think so too. but do you know how to enable one? is there something i could install?23:37
Hilikusor do you have another idea how to get a local graphical session with a browser? it doesn't have to be XServer, mir o wayland would be ok. i just need a browser in a local session23:38
naccHilikus: I don't know, sorry23:39
Hilikusok. thank you anyway23:39
naccHilikus: once you ssh in, do you see any X server running? `ps aux | grep X`23:41
Hilikusno23:42
naccHilikus: what snap did you install (what name)?23:43
Hilikushttps://code.launchpad.net/~osomon/+snap/chromium-snap-beta23:43
naccHilikus: it looks like there are a lot of interfaces it depends on, are they all connected?23:45
naccHilikus: something like `snap interfaces`23:45
Hilikusmm actually no23:48
naccHilikus: this is a gray area for me -- i'm not sure running a full desktop is really the target, but it might be possible (I have no idea actually)23:48
Hilikusi didn;'t think iof that23:48
naccHilikus: you might need to connect the various plugs if they weren't connected, so that the snap can run23:48
Hilikusi don't want a full desktop. this is for a kind of kiosk, i do still need a graphical interface23:48
naccHilikus: something like `snap connect <snap>:<plug>`23:49
naccHilikus: oh ok, based upon the marketing on the core page (digital signage), that certainly seems likeit should be possible, but I don't know any of the details :/23:49
naccHilikus: actual snappy folks should be around at some point, though :) you can ask again -- or maybe post on the forum?23:50
Hilikusok, then for sure this won't work. your points made me realize this package wants to plug to unity7, not only X, so this package is for a hybrid system23:51
naccHilikus: yeah, i would expect chromium to be for the full fledged browser (meaning desktop integrated)23:52
naccHilikus: for kiosk, you want to basically write your own snap that is just your kiosk'd application (I think)23:52
naccHilikus: or did you mean your kiosk'd appliation is on a website?23:52
Hilikusyes, on a website23:53
naccHilikus: ah ok -- I don't immediately see any standalone browsers via `snap find`, but it might be worth looking23:54
Hilikusive been looking for a week now with no luck :(23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!