/srv/irclogs.ubuntu.com/2014/08/06/#ubuntu-ci-eng.txt

robruany core devs around for a quick ack ^ ?01:50
robruinfinity, cjwatson ^ ?01:50
infinityrobru: I assume there are appropriate code changes to match the s/python-six/python-pil/ bit?01:57
robruinfinity, I also assume that.01:58
infinity(I'm not sure I agree with the truncated debian-dir-only diff review, it's a blind review, matching packaging changes to upstream bits we don't see)01:58
robruinfinity, yeah, just checked the upstream diff, they rip out six and introduce PIL02:00
infinityrobru: So, the changes look fine, my only complaint is that the changelog doesn't mention python-pil, nor the XDG_RUNTIME_DIR fix.02:00
robruinfinity, k, thanks02:00
imgbot=== trainguard: IMAGE 175 building (started: 20140806 02:05) ===02:05
veebersinfinity, robru: ah rats, I must have missed that change when putting together the change logs02:09
=== Ursinha is now known as Ursinha-afk
=== Ursinha-afk is now known as Ursinha
Mirvgreat that the autopilot got in!03:33
imgbot=== trainguard: IMAGE 175 DONE (finished: 20140806 03:40) ===03:40
imgbot=== changelog: http://people.canonical.com/~ogra/touch-image-stats/175.changes ===03:40
oSoMoNsil2100, good morning! can silo 15 be published?06:58
oSoMoNsil2100, you around?07:21
sil2100oSoMoN: hello! Sorry, was AFK for a moment07:22
oSoMoNsil2100, no worries! would you mind publishing silo 15 for me?07:22
sil2100oSoMoN: sure, one moment07:23
tvossgood morning07:27
tvossdavmor2, you around?07:28
sil2100hmmm07:30
sil2100oSoMoN: ok, we seem to have some problems, one moment07:30
oSoMoNsil2100, what sort of problems?07:31
oSoMoNwoot, this error message doesn’t make sense07:32
sil2100oSoMoN: trying to dig into why CI Train doesn't see the oxide upload07:32
sil2100oSoMoN: this might take a minute...07:34
oSoMoNif it’s only a minute, I’m fine with it :)07:35
sil2100oSoMoN: ok, fixed... I *should* be able to publish your package in the nearest minutes ;)07:55
sil2100oSoMoN: done \o/07:59
tvossSaviq, reading zoltan's update mail and wondering, if the UbuntuShape optimizations have landed in the image, yet?08:03
Mirvtvoss: since 173, yes08:06
tvossMirv, ah, just flashed devel-proposed and I was expecting some visible improvements in the app scope08:07
cjwatsonsil2100: Which package(s) did you push to dogfood?08:08
cjwatsonsil2100: I'm pretty worried that we aren't going to have a recent promotion before the point when it comes time to branch :-/08:09
Mirvtvoss: I guess the app scope perf problems are more complicated than just ubuntushape08:10
sil2100cjwatson: I pushed indicator-location till the end08:18
sil2100cjwatson: yeah... today I'll push more on various fixes to get a promotable image ASAP, but we're a bit worried about that as well08:18
sil2100ogra_: hey, do you remember if plars and jdstrand were able to find someone who can fix the bug causing the AP failures?08:21
sil2100grrr08:22
sil2100Even more failing tests08:22
sil2100I think we need to stop the line and only concentrate on fixes08:22
Saviqtvoss, don't think so08:22
tvossSaviq, Mirv just told me that they landed in 17308:23
ogra_sil2100, in 174 i see the gallery-app test has passed fine ... so there is hope08:24
sil2100ogra_: yeah, but address-book-app has 13 failures, messaging and dialer suddenly got worse as well08:25
sil2100ogra_: while I have been told that the uploads for those were supposed to *fix*08:25
Saviqtvoss, ah correct http://people.canonical.com/~ogra/touch-image-stats/173.changes08:25
oSoMoNsil2100, thanks!08:25
Mirvthe batching of ubuntu shapes was introduced here: https://launchpad.net/ubuntu/+source/ubuntu-ui-toolkit/1.1.1179+14.10.20140804-0ubuntu108:25
Mirvhmm, it seems the changelog was broken08:25
ogra_sil2100, https://launchpad.net/ubuntu/utopic/+source/dbus-cpp/4.0.0+14.10.20140730-0ubuntu1 this landed in 163 ... i wonder if tearing down the dbus daemon could cause such apparmor issues08:25
Mirvin that none of the bugs were actually closed automatically08:26
tvossogra_, it tears down its private instance of the daemon, not the actual daemons08:27
ogra_tvoss, right, but does apparmor know (or care) and could this cause all the denials08:28
tvossogra_, apparmor does not know, the testing buses are used during build time tests only08:29
tvossogra_, and don't run on the image08:29
ogra_tvoss, the denials we see are for a specific autopilot introspection interface08:29
ogra_which could well be the one you have just torn down08:29
tvossogra_, nope, the testing buses are not run during image tests08:30
tvossogra_, they are solely run at package build time08:30
sil2100ogra_: anyway, the address-book-app failures do not seem apparmor related, need to find renato___ or boiko...08:30
ogra_tvoss, we have to call out TRAINCON0 since we have 100s of tests failing due to that ... i'm grabbing for straws here08:30
sil2100renato___: ping08:30
tvossogra_, do you have the denials in a pastebin somewhere?08:30
ogra_tvoss, we have them in every console log for every test run :) one sed08:31
ogra_*sec08:31
ogra_https://jenkins.qa.ubuntu.com/job/utopic-touch-mako-smoke-daily/666/artifact/clientlogs/gallery_app/syslog/*view*/08:31
ogra_either there08:31
ogra_http://jenkins.qa.ubuntu.com/job/utopic-touch-mako-smoke-daily/666/consoleFull or there08:31
ogra_just search for "DEN"08:31
ogra_Aug  6 05:11:51 ubuntu-phablet dbus[2210]: apparmor="DENIED" operation="dbus_method_call"  bus="session" path="/com/canonical/Autopilot/Introspection" interface="com.canonical.Autopilot.Introspection" member="GetVersion" name=":1.88" mask="receive" pid=3704 profile="com.ubuntu.gallery_gallery_2.9.1.1025" peer_pid=3689 peer_profile="unconfined"08:32
ogra_thats a typical one08:32
Saviqsil2100, hey, reconfigure silo 1 please, added unity-api there08:33
tvossogra_, interesting ... the peer calling into gallery is unconfined08:35
tvossogra_, also, apparmor wouldn't deny if the daemon wasn't running08:35
tvossogra_, did you verify that the peer pid actually *is* autopilot?08:35
ogra_tvoss, i dont know what was researched by plars and jdstrand, they spent quite some time on this already (apparently unsuccessfull)08:36
jgdxwhat is the generic-deb job for uss and why can't it find a package that all the other jobs find?08:43
Saviqtrainguards, reconfigure of silo 1 please, added unity-api there08:44
sil2100Saviq: one moment, in a meeting :)08:44
Saviqsil2100, pfft! ;P08:44
tvossSaviq, camako I'm about to set silo 10 to testing done, please make sure to rebuild your qtmir(-gles) silos08:45
Saviqtvoss, kk08:45
camakotvoss, ack.. thanks for the heads up!08:45
mhr3ogra_, is there a known issue with 175? it kinda doesn't boot08:46
mhr3stuck on google logo08:46
ogra_theerare plenty of issues, but booting isnt one08:46
ogra_http://ci.ubuntu.com/smokeng/utopic/touch/mako/175:20140806:20140805.2/9528/ tests run ...08:46
tvossSaviq, also https://code.launchpad.net/~thomas-voss/qtmir/gles-sync-20140804/+merge/22942508:46
mhr3can adb in though08:46
ogra_check with top if apparmor still parses stuff08:47
mhr3ogra_, nope, not doing anything really08:47
ogra_werid08:47
ogra_and thats a normal readonly OTA upgrade ?08:47
mhr3ogra_, no, normal ubuntu-device-flash08:48
mhr3with non-wiped data08:48
ogra_with --bootstrap ?08:48
mhr3no08:48
ogra_that might be your issue, we got new android bits (OTA would have been cleverer here)08:48
ogra_(your kernel/initrd could be out of sync)08:49
mhr3i'll bootstrap then08:49
tvosssil2100, could you check why silo10 never finishes building?08:51
Saviqtvoss, not published on powerpc/ppc64el yet08:51
Saviqtvoss, that's gonna be a problem08:52
tvossSaviq, for which package?08:52
Saviqtvoss, location-service08:52
Saviqtvoss, it was available in all arches before https://launchpad.net/ubuntu/+source/location-service/2.0.1+14.10.20140731-0ubuntu108:52
tvossSaviq, ack ... deps on trust-store08:53
tvossSaviq, which now deps on mir, which is not available on those architectures08:53
Saviqtvoss, yeah, that means some archive guru needs to have a look08:54
tvossSaviq, I will just make the build dep optional08:54
Saviqtvoss, like we need to drop the unsupported arches' packages from archive08:54
Saviqtvoss, or yeah, if you can make it go for other arches still, sure08:54
brendandsil2100, do you have the details on how the apparmor denials were introduced?08:58
=== vila changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: robru, trainguards | Vanguard (general help): vila | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: -
cjwatsonsil2100: awesome, so that made it through proposed-migrationd09:01
cjwatsonsil2100: maybe we should consider branching from not a promoted image ...09:01
MirvSaviq: looking at timestamps you didn't get the reconfiguration yet, so doing that09:15
SaviqMirv, nope, didn't, thanks09:16
sil2100cjwatson: \o/ We're announcing TRAINCON-0 today, as we want to resolve the image situation ASAP09:16
MirvSaviq: sil2100: reconfigure done09:18
SaviqNOOOOOOOOO09:19
Saviqsil2100, is it now?09:19
MirvSaviq: so sad about reconfigure? ;) (I know, I know)09:19
sil2100Saviq: we're announcing it in a moment!09:24
Saviqsil2100, can you wait until I publish silo 1? ;D09:24
sil2100;p09:24
camakoSaviq, I rebuilt qtmir and version changed to 0.4.0+14.10.20140806-0ubuntu1. I need to update the twin. If I use 'dch -v' then your old entry remains. Should I manually update your entry?09:28
Saviqcamako, was the previous version released?09:29
camakoSaviq, no09:29
Saviqcamako, if it was UNRELEASED, then it should get updated, let me have a look09:29
camakoSaviq, qtmir still building armhf though (not completely finished)09:31
Saviqcamako, shouldn't be a problem09:31
Saviqcamako, that's silo 7 is it?09:31
camakoSaviq, yes09:31
Saviqcamako, why did you rebuild btw?09:32
Saviqcamako, if on tvoss's orders then too early ;)09:32
tvossSaviq, getting there with trust-store09:32
camakoSaviq, a lot of packaging changes broke other downstreams, then we changed mir to fix.. thought I'd rebuild qtmir as well09:32
Saviqcamako, ah ok09:33
camakoSaviq, yes... not on tvoss' orders09:33
Saviqcamako, in any case, http://paste.ubuntu.com/7968849/09:34
Saviqcamako, if I go `dch -v 0.4.0+14.10.20140806-0ubuntu1 ""`, only the version and time gets updated09:34
Saviqcamako, is that not what's happening for you?09:35
* camako looks09:35
davmor2sil2100: new blocker I'm just going to dig into when it landed.  The guide swipes away and leaves the phone in a position where none of the apps actually open09:35
cjwatsonsil2100: ok09:37
camakoSaviq, I get http://pastebin.ubuntu.com/7968870/09:38
camakoI guess my identity needs updating09:38
Saviqcamako, yeah, that, too09:38
Saviqcamako, but yeah, *inside* a version entry clear it up to taste09:39
camakoSaviq, ok thanks.09:39
Saviqcamako, export DEBEMAIL="michal.sawicz@canonical.com" in .profile09:39
Saviqcamako, and DEBNAME accordingly09:39
camakoSaviq, ah I see09:39
Saviqwell, export your own email of course ;)09:40
camako:-)09:40
camakoI always wanted to have dreadlocks...09:40
camakoSaviq, the twin needs to be rebuilt after the version update, right?09:53
Saviqcamako, yup09:53
sil2100davmor2: yeah, I added that to the blocker list already09:54
sil2100davmor2: oh, or wait, no, that's something different I gues?09:54
davmor2sil2100: I'm just digging back to find when it landed, Saviq already thinks it is likely the Scope as an app landing but still going to confirm09:57
popeysil2100: you approved the ms2 branch, do you know when that will hit the archive? https://bugs.launchpad.net/music-app/+bug/135052910:03
ubot5Launchpad bug 1350529 in Ubuntu Music App "[music-app] Trunk fails autopilot tests on jenkins" [High,In progress]10:03
=== tvoss is now known as tvoss|test
=== tvoss|test is now known as tvoss
=== ricmm_ is now known as ricmm
=== sil2100 changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: robru, trainguards | Vanguard (general help): vila | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved
* popey lols at sil2100's mail - "incontinences"10:12
davmor2popey, sil2100: inconvenience I bet is the word you were after10:21
sil2100Typooo!10:22
sil2100popey: anyway, hm, let me check ms210:23
sil2100popey: ok, it's in the archive now10:23
mhr3ogra_, could you merge this pls? https://code.launchpad.net/~pete-woods/click-sync/add-youtube-scope/+merge/22906510:24
mhr3it's been sitting there for a week10:24
mhr3ish10:24
slangaseksil2100: how did the apparmor denials shake out overnight?10:24
sil2100slangasek: what do you mean?10:24
slangaseksil2100: did the fixes that plars/jdstrand landed fix things, or are we still broken?10:25
sil2100slangasek: they're still broken, I didn't know that jdstrand/plars had any fixes - I only heard they identified/triaged the problem, but as it's something on the system level they could not do much10:25
slangasekhmm10:26
sil2100slangasek: in any case, 174 is still broken10:26
slangaseknot sure why it being on the system level prevents them from doing things10:26
slangasekbut if they can't, who owns it now?10:26
sil2100slangasek: the problem seems that they don't know how exactly to proceed and in which component the problem lies, and this is something that needs to be done10:26
slangasekright, so, who owns this now?  Given how critical this is, it would be awesome if someone were working on this in European time10:28
sil2100slangasek: it seems that sometimes the system clock is not set correctly at the right time (if I understood it correctly?) and it causes all those apparmor problems with profiles10:28
slangasekyes, that's roughly what I understood but I don't have the details10:28
sil2100We have no idea, we were trying to think of someone during the meeting but we're clueless10:28
brendandsil2100, it looks like most of the failures are down to a uitk change10:28
slangasekhmm ;)10:28
sil2100The only info we have is from the backlogs10:28
brendandsil2100, since messaging, address-book and dialer all share the same cause10:29
sil2100We can provide those to the general public, but that's why I called out for people that could help out with this issue10:29
sil2100brendand: oh!10:29
brendandsil2100, StateNotFoundError: Object not found with name 'UbuntuShape' and properties {'objectName': 'bottomEdgeTip'}.10:29
* sil2100 gives bzoltan the evil eye (again)10:29
sil2100;D10:29
bzoltansil2100:  what?10:29
bzoltanbrendand: is that an autopilot test?10:30
brendandbzoltan, yes10:30
sil2100bzoltan: j/k with that evil eye! But yeah, brendand mentions that all our recent failures are related to the UbuntuShape bottomEdgeTip10:30
sil2100bzoltan: do you know anything regarding that?10:30
sil2100t1mp: hey!10:30
bzoltansil2100: yes10:30
brendandbzoltan, and actually it seems to indicate a functional failure10:30
bzoltansil2100:  that is the fix I sent for the short app...10:31
bzoltanbrendand:  No it indicates that the APs should not use the UbunuShape as objecttype10:31
sil2100bzoltan: ok, so it seems that we'll need the same fixes for the other apps then10:31
sil2100zsombi: hello! Any progress on bug LP: #1351024 ?10:32
bzoltansil2100:  how it did not pop out on the autopilot tests?10:32
ubot5Launchpad bug 1351024 in Ubuntu Calendar App "Date & Time picker is not working on device." [Critical,Triaged] https://launchpad.net/bugs/135102410:32
brendandbzoltan, that's not a justification10:32
bzoltanbrendand:  what is not a justification?10:32
brendandbzoltan, if the tests break, then they need to be fixed10:32
bzoltanbrendand:  What I say that the tests did not break when I run them10:33
sil2100jdstrand, plars: btw. guys, did you have a bug for the autopilot apparmor denials caused by the clock?10:33
sil2100bzoltan, brendand: yeah, so hm, maybe the problem was in some recent address-book+dialer+messaging landing?10:34
sil2100bzoltan, brendand: since when UITK was landing, I remember 1-2 landings of those apps as well10:35
bzoltansil2100:  I have like 3 OK logs for these apps with the UITK I landed10:35
brendandbzoltan, the animationn broke on all 3 apps too10:36
brendandbzoltan, i don't think they could all break in the same way simultaneously10:37
brendandbzoltan, i guess it's possible, but not likely10:37
bzoltanbrendand:  could you please give me some more context10:37
brendandbzoltan, try it on 17510:37
zsombisil2100: just got it, I have an other ugly bug to fix before that10:37
brendandbzoltan, it's a bit hard to explain. basically when you pull the bottom edge up, the motion is all strange10:37
brendandbzoltan, i'll post a video :)10:38
bzoltanbrendand:  try what? I still do not understand whatthe problem is. I can help... but tell me what should I look for10:38
brendandbzoltan, best way to sum it up is the bottom edge tip is not drawn at the top of the page during the animation10:40
brendandbzoltan, but again, only a video, or trying it yourself really does it justice10:40
t1mpsil2100: what's up?10:41
sil2100t1mp: ah, sorry, unping ;) Since I remembered you assigned on the date-picker bug, but then noticed that it got reassigned to zsombi10:41
sil2100t1mp: sorry for the disturbance!10:42
t1mpsil2100: ok :)10:44
bzoltansil2100:  if I understand well the new UITK landed on rev173 and these problems appeared on rev175. So I  think the UITK i snot the prime suspect10:47
sil2100bzoltan: right, as mentioned it might be one of the messaging/dialer/address-book landings, just wanted to make sure it's unrelated as brendand pointed out UITK as a possibility10:49
sil2100Anyway, I will poke boiko once he's up anyway10:49
brendandsil2100, i was pointing at uitk because it was common10:49
brendandsil2100, but since it broke when all those apps got updated then the finger points in a different direction now10:50
brendandsil2100, i'm really curious how people are actually testing stuff10:50
sil2100brendand, bzoltan: yeah, and thanks to this we know more or less where to poke further :)10:50
brendandsil2100, several really bad regressions here10:50
sil2100brendand: indeed... need to make sure boiko runs all his tests on a mako device10:51
bzoltansil2100:  me and the whole SDK team is at your disposal if you need more investigation or bugfix.10:51
brendandsil2100, where can i get more details about those app landings?10:53
brendandsil2100, so i can try and find what might be the cause of the problem10:53
=== MacSlow is now known as MacSlow|lunch
davmor2sil2100: ha that was nice timing I'd already sent out a heads up email for the traincon0 and then your email landed shortly after :)11:02
sil2100brendand: you can use http://people.canonical.com/~lzemczak/landing-team/ to check what landed when :)11:04
sil2100davmor2: hah ;)11:04
jibelbrendand, that issue in dialer/messaging/address-book you're talking about isn't it caused by the 'visual updates' of these applications that landed yesterday?11:10
brendandjibel, well yes - that part we know11:11
brendandjibel, trying to figure out how they missed it11:11
brendandsil2100, anyway i'll get a bug filed for all three projects11:12
sil2100brendand: ok, thanks :) I'll poke boiko when he's up automatically anyway11:12
brendandsil2100, https://bugs.launchpad.net/address-book-app/+bug/135342011:15
ubot5Launchpad bug 1353420 in messaging-app "Autopilot tests that use the bottom edge failing since #174" [Undecided,New]11:15
davmor2sil2100, ogra_, Saviq: so the guide works as expected in 173, trying 174 now11:16
sil2100davmor2: ok, so a recent regression then!11:16
Saviqdavmor2, really, you can stop :)11:16
sil2100brendand: thanks! Adding to teh blockerz11:16
Saviqdavmor2, it's dash-as-app's fault 100%11:16
Saviqdavmor2, I'll be on it just after I eat something11:16
davmor2Saviq: I'm just being thorough it's what we do you know ;)  No worries enjoy your food :)11:18
brendandsil2100, video of the issue :) https://plus.google.com/u/1/110434705244077414661/posts/YVnQPrvmWJE?pid=6044400154069719906&oid=11043470524407741466111:19
davmor2Saviq, ogra_, sil2100: yeap so 174 is the broken landing, I'll write up a bug for it and completely blame Saviq ;)11:25
Saviqdavmor2, there is one already11:26
davmor2Saviq: oh nice11:26
Saviqdavmor2, bug #135335111:26
ubot5bug 1353351 in Unity 8 "Edges intro finishes after right edge is performed and always runs on boot" [Critical,Triaged] https://launchpad.net/bugs/135335111:26
davmor2ah brendand beat me too it :)11:27
zsombibrendand: sil2100: bottom edge swipe problems - seems the apps are using their own one, and seem recently in 174 one app copied the component from teh other...11:30
zsombibrendand: sil2100: so it aint came from UITK11:30
brendandzsombi, yeah - i filed the bug against the apps themselves11:31
zsombibrendand: sil2100: all UITK provides is a Panel component (invisible one) which provides bottom-edge swipe detection, all the rest comes from apps11:31
zsombibrendand: ok, thx!!11:31
renato___sil2100, hi11:54
=== cprov changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: robru, trainguards | Vanguard (general help): cprov | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved
Saviqsil2100, for your viewing pleasure: bug #v12:14
Saviq135345112:14
Saviqbug #135345112:14
Saviqdammit12:14
ubot5bug 1353451 in Canonical Upstream To Distro "build job in train should check whether built version is higher than in silo" [Undecided,Confirmed] https://launchpad.net/bugs/135345112:14
renato___sil2100, the problem with address-book dialer messaging app is that the UbuntuShape has changed the type name, we need to update the autopilot tests for that12:15
brendandsil2100, so it appears that the app updates were never tested with 173, which had the version of UITK that impacted them12:45
brendandbzoltan, ^ - fyi12:45
brendandsil2100, we need to have a tighter test/release cycle12:45
bzoltanbrendand: sil2100: what is the problem?12:46
brendandsil2100, silos must be sure to be tested with the image prior to the one they are to be published in12:46
brendandbzoltan, the apps were broken by the uitk update in 17312:46
brendandbzoltan, but they were never tested with 17312:46
bzoltanbrendand: what apps?12:46
brendandbzoltan, so uitk did break them, but it's not strictly speaking your fault12:47
bzoltanbrendand:  how can I test with an image what does not exist?12:47
brendandjust a faulty process12:47
brendandbzoltan, you can't - i'm not placing any blame on you12:47
bzoltanbrendand:  Than please do not :)12:47
bzoltanbrendand:  The UITK did not break anything ... I have tested the UITK with the  latest and most fresh available image. UITK can not be blamed for failures integrated after it lands.12:48
bzoltansil2100: ^12:48
brendandbzoltan, that's what i said - it's not the fault of uitk or it's release process, the fault is in the general landing process12:49
bzoltanbrendand: I kind of expected that after I run 24 apps autopilot test suites and ~800 tests I will be asked to test against the development branches of the apps too :D12:49
bzoltanbrendand:  what if the apps would test against the latest released UITK at the first place?12:49
brendandbzoltan, they should - and that's what went wrong12:50
bzoltanbrendand:  I am bagging for a staged releasing system for ages... we need an image with the staging UITK and one for the staging Qt  to foresee the possible upcoming issues.12:50
brendandbzoltan - that certainly would be helpful given the present release process12:51
bzoltanbrendand:  we should have channels where we can customize the development branches and possible set PPAs with development versions12:51
bzoltanbrendand:  this is something I am asking for very long time.12:51
ollisil2100, are you guys doing a standup with ppl working on the promotion blockers13:05
sil2100renato___: could you guys take care of those tests? :)13:05
=== Ursinha changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: robru, trainguards | Vanguard (general help): Ursinha | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved
sil2100brendand: hm, so, in other words - the behavior changed in UITK but this did not break the tests, but when the new apps were released those were not tested against the new UITK and tried using 'old' features that got removed in UITK, right?13:07
sil2100olli: we're pushing people about the blockers all the time (except for lunch periods)13:07
jdstrandsil2100: I did not file a bug. I was thinking plars would after his investigations13:08
sil2100zsombi: give me a sign once you have any updates regarding the date-picker in calendar13:08
ollisil2100, are you getting the right attention13:09
brendandsil2100, kind of. i'll explain more in the landing meeting13:09
sil2100jdstrand: ok, since we would like to find someone who could actually work on fixing the root cause - the bug itself is a bit strange (or maybe I lack some understanding here), but do you have any idea who could be the best person or at least which component should be worked on to get this fixed?13:09
sil2100olli: so far yes, everyone's responding to pings when they're available, the only thing left is finding someone who could work on the apparmor-smoketesting problem13:10
plarsjdstrand: sil2100: I don't have one yet, or know yet where to file it. We know "what" is happening, but still have no idea why13:10
sil2100plars: right... this is exactly what I was asking jdstrand now, and we were also thinking about that during the morning meeting13:11
sil2100As we don't really even know 'who' to poke about getting this fixed13:11
sil2100Any ideas?13:11
jdstrandsil2100: honestly, I have no idea. it could be a provisioning issue, it could be a hardware issue, it could be a bug in Ubuntu13:11
ogra_is that the clock issue ?13:12
jdstrandthere is probably something else it could be that I am not thinking of13:12
jdstrandogra_: yes13:12
ogra_so i was wondering ... if the hwclock doesnt get updated (i dont think we do that) ... your clock wil be off until ntpdate is called by /etc/if-up.d13:13
jdstrandit could be worked around in the CI infrastructure, but I agree with plars that it is unwise to paper over it in case it is a bug in Ubuntu since we don't want phones running around thinking it is 197013:13
ogra_that will only be called once NM starts13:13
plarssil2100: I'd be happy to put a placeholder for it somewhere though, do we have a catch-all place for stuff like this on touch?13:14
ogra_if you reboot and the apparmor profiling gets re-run at that point, the clock will still be off13:14
plarsogra_: right, but why is it off by so much sometimes, and not others?13:14
jdstrandogra_: there is a hwclock-save upstart job on the device that runs in runlevels 0 and 6, but aiui, adb reboot (what the CI tools do) doesn't run through those runlevels13:14
ogra_i wonder if making the apparmor upstart job "start on started network-manager" would help here13:14
plarsogra_: for some runs, when the device is installed and boots, it's off by maybe 1-8 seconds. For others, it's gone way back in time to January 12, 197013:14
ogra_plars, because we never set it13:15
jdstrandogra_: it isn't the apparmor upstart job13:15
ogra_plars, you always operate with the same hwclock setting until ntpdate kicks in13:15
plarsogra_: I think we'd still have the race even if we wait to ntpdate after nm starts if that's what you mean13:15
plarsogra_: it might narrow the window a bit, but that's all13:15
ogra_jdstrand, i thought it was the time discrepancy of the generated files13:16
plarsogra_: sure, but it's never set for any of them13:16
plarsogra_: yet some preserve a fairly close time, some are just way off13:16
jdstrandwe have precompiled policy cache on the device with a date of 2014. when the clock is off, aa-clickhook is run with the clock still at 1970. it generates new policy with timestamps of 1970. it tries to load them into the kernel, but see the precompiled cache has  date of 201413:16
jdstrandso it skips them13:16
ogra_jdstrand, right ... and making sure the clock is right first (by starting after NM) might be a (not very good, but usable)workaround13:17
jdstrandthis isn't the apparmor upstart job13:17
jdstrandaa-clickhook is run by the CI tools13:17
jdstrandaa-clickhook -f --include=...13:17
ogra_hmm13:17
sil2100hmmm13:18
jdstrandthat command ^ is run when the clock is at 197013:18
ogra_we could just wrap that with: ntpdate ntp.ubuntu.com13:18
jdstrandthe clock needs to be correct when that runs13:18
jdstrandsure, there are various workarounds13:18
jdstrandwe could after running ntpdate do 'start hwclock-save'13:18
tedgtraingaurds, can I please get a silo for line 26 ?13:18
jdstrandbut that doesn't address why the clock is at 1970 in the first place13:19
pmcgowanjdstrand, right, it should only happen when the battery and the RTC backup are totally depleted13:19
plarsogra_: sure, we can force ntpdate before we do anything, we could even force hwclock as a provisioning step. But we don't want to potentially conceal a bug here that when a user installs and boots a phone, sometimes they could have a good date, other times they won't. Also, if they never shutdown the phone normally they may never run hwclock at all and the whole thing could start over13:19
ogra_we should actually make it fail if $clock < $installation date13:19
plarsogra_: my gut feeling is that most people would never go through a "normal" shutdown, but rather wait until the phone is stuck and hold the power button for a hard reboot13:20
jdstrandplars: pmcgowan had an interesting point. is there a way to detect that?13:20
pmcgowanbut lab devices are all plugged in I assume13:20
plarsjdstrand: sure, hwclock by default will read what it's set to13:20
ogra_plars, that would be sad for the people that implemented the new shutdown/reboot dialog :P13:20
plarsogra_: sure, but do you ever reboot your personal phone for fun? :)13:21
jdstrand(which btw, that dialog comes up every time I touch the power button it seems)13:21
* jdstrand assumes that is a bug fixed in proposed...13:21
ogra_plars, nah, never indeed13:21
tvossjdstrand, plars do you have the kernel logs/logcat available from the lab devices?13:23
ogra_well, hwclock -s/-w both work fine13:23
ogra_so we should simply make sure that we set it on boot13:23
ogra_or if ntpdate retrieved a new time or ... or ...13:23
jdstrandcurrently the upstart job that does that only runs in 0 and 613:24
plarstvoss: yes, one moment and I'll point you at some13:24
jdstrandI was wondering why the hwclock wasn't set after ntpdate13:24
tvossogra_, it still would just hide the issue13:24
jdstrand(just as a matter of course)13:24
plarstvoss: basically anytime you see these apparmor "DENIED" results, it's typically this problem (for now at least): http://ci.ubuntu.com/smokeng/utopic/touch/mako/175:20140806:20140805.2/9528/ubuntu_calculator_app/1496111/13:25
plarstvoss: from there, you can link to syslog below for the full syslog13:25
plarstvoss: and in syslog, you'll find: Aug  6 05:06:31 ubuntu-phablet ntpdate[2787]: step time server 91.189.89.199 offset 1400004685.653897 sec13:25
ogra_tvoss, huh ?13:26
jdstrandplars: interesting, that has a date of Mar 26 instead of Jan 1213:26
ogra_tvoss, the issue is that whenever we set the time we dont set the hwclock13:26
plarsjdstrand: that would at least keep it from recurring on later boots13:26
jdstrands/whenever/has/13:26
plarsjdstrand: oh, didn't notice - yeah the ones we looked at yesterday were all Jan 1213:26
plarswe're moving forward in time at least :)13:26
tvossogra_, are we sure that that is the actual issue?13:26
jdstrandMar 26 is enough behind to cause a problem though13:26
plarsindeed13:27
jdstrandplars: we'll get there!13:27
jdstrandhehe13:27
ogra_tvoss, if the HW clock is permanently at 1970 i'm 99.5% sure, yes13:27
plarssloooowly13:27
tvossogra_, why is that only showing up now?13:27
ogra_tvoss, no idea ...13:27
tvossogra_, that's the point I'm trying to make13:27
plarswell, it is a race13:27
ogra_probably apparmor didnt care about timestamps before ?13:27
plarsbut we are certainly hitting it a lot now, where we didn't seem to at all before13:27
tvossogra_, I'm pretty sure it did13:27
tvossjdstrand, ^13:28
ogra_or it simply ran a nanosecond later13:28
jdstrandthe issue is only showing up now I think because we only started precompiling apparmor policy13:28
ogra_which is the nanosecond that ntpdate runs delayed today13:28
jdstrandrecently13:28
ogra_right13:28
jdstrandI don't know the exact date13:28
ogra_it was before13:28
jdstrandbut within the last couple of weeks I think13:28
ogra_something else changed additionally that causes the race now13:28
ogra_it used to work for like a week13:29
jdstrandah13:29
ogra_the change to pecompiled profiles must have been in 140-150 somewhere13:29
ogra_the issue only started showing in the 160s13:29
* jdstrand isn't sure-- rsalveti enabled it server side13:30
ogra_yup13:30
* ogra_ followed that 13:30
jdstrandbut that seems like plausible timing13:30
jdstrandok13:30
tvossjdstrand, plars so looking at https://jenkins.qa.ubuntu.com/job/utopic-touch-mako-smoke-daily/666/artifact/clientlogs/ubuntu_calculator_app/syslog/*view*/13:30
ogra_anyway, we need to somehow set the hwclock and be happy :)13:30
tedgsil2100, can I please get a silo for line 26?13:32
sil2100tedg: sure thing, assigning13:33
tedgsil2100, thanks!13:35
tvossjdstrand, plars seems like something is setting the hwclock13:35
jdstrandyeah, it sometimes is ok, sometimes isn't13:35
plarsogra_: we'd need to make sure that we don't run phablet-config until ntpdate is synced though13:36
sil2100popey: I see that the music-app test-fix branch from Victor had problems autolanding - do you have direct contact with Victor?13:36
tvossjdstrand, well, it is forcefully set to that time. seems like whatever is setting it considers the wrong value13:36
ogra_plars, we could (ans an interim) hack around it in phablet-network13:37
ogra_plars, simply call "adb shell hwclock -w" after the network interface is known up13:37
plarsogra_: ntpdate ntp.ubuntu.com first, and make sure that succeeds13:39
sil2100Saviq: hi! Soooo... does silo 1 have anything else besides the fixes for those 2 issues? (the welcome tutorial and the icon colors)13:39
ogra_plars, http://paste.ubuntu.com/7970504/13:40
Saviqsil2100, noooo, why would you ask that?13:40
ogra_plars, right, perhaps prefix that13:40
plarsogra_: like we said, the workaround wouldn't be that hard. But we should ensure that we aren't hiding something that we aren't completely sure why it just started happening so frequently13:40
* sil2100 suspects a trap13:40
sil2100;)13:40
Saviqsil2100, it will require a QA sign off if that's what you're asking13:40
Saviqsil2100, but it will fix the two issues as well13:40
sil2100Ok, davmor2 will be our man then13:40
plarsogra_: yeah, we'd need to run ntpdate in a loop until we are sure it's passed first too13:41
Saviqsil2100, I just kicked a rebuild, should be good after that13:41
plarsogra_: in case the network thinks it's up, but still can't resolve yet (as we've seen before)13:41
sil2100davmor2: hey, how busy are you right now? :)13:41
ogra_plars, then http://paste.ubuntu.com/7970518/13:41
davmor2sil2100: I can cover that quite happily :)13:42
ogra_plars, if we are definitely sure network is up (which we are after the ping succeeds) this should work13:42
ogra_or probably stuff it into an else for eth return value check13:43
ogra_plars, we might be hiding something, sure, but for the mooment i really dont care as long as hacking around it brings us out of TRAINCON-013:43
ogra_this is currently more important13:44
=== tvoss is now known as tvoss|test
=== tvoss|test is now known as tvoss
zsombisil2100: I will give a sign once I know what's wrong there, since there hasn't been any changes on the toolkit recently on DatePickers...13:44
ogra_we know we have to re-visit the clock13:44
sil2100zsombi: thanks, will wait with anticipation then ;)13:44
plarsogra_: no, I think we'll exit before we get there if the network is up, right?13:44
plarssil2100: what are your thoughts? do we work around this for now?13:46
plarsogra_: we don't even necessarily have to do it in phablet-network, I can add some safety checks around it too, since it's not strictly related to bringing the network up13:47
sil2100plars, ogra_: just so that I understand it right - first of all, we still don't know what changed that it suddenly became an issue, right?13:49
sil2100plars, ogra_: second, from what I understand, it's not really something that affects normal users, right? As in a normal user workflow the time will get corrected automatically?13:50
sil2100I'm a bit worried about the case of no-network available13:50
plarssil2100: yeah, I think we can get around the no-network with some sensible amount of retrying13:51
plarssil2100: normal users are probably not running aa-clickhook13:51
plarssil2100: so it *could* affect other things for them though, since the time could be really odd at the beginning for them, and could even revert to that early time if they never go through the right shutdown steps13:52
plarssil2100: so I think there are a couple of things at least that should be done13:53
plarssil2100: 1. update hwclock as soon as the time is set as jdstrand suggested earlier I think13:53
plarsthat seems like a no-brainer13:53
plarsit won't fix this issue, but it would make it less likely to keep occuring across boots13:54
boikosil2100: hey, the UbuntuShape causing autopilot failures on dialer, messaging and address-book app, I have fixes for those already13:54
plarsand it would also fix the issue where a normal user would keep seeing this if they never shut down their phone the "right way"13:54
plarssil2100: 2. we should probably open a bug somewhere about the fact that after an install we sometimes have a realistic time, and sometimes not13:55
sil2100boiko: \o/ excellent13:56
plarsif we work around this, that's unfortunately probably going to go to the bottom of the priority list for whoever gets it, and be harder to track down13:56
sil2100plars: hmmm13:56
plarsbut it doesn't make sense to me why it's not at least predictable13:56
sil2100plars: let me think about that for a moment, but first I need to go to UE live13:56
boikosil2100: I was going to propose it for landing yesterday, but CI is taking ages to run nowadays, and in the end almost all autopilot tests failed in the CI jobs for the three apps, something is very broken13:57
plarssil2100: then, at your discretion, we could work around this to get us out of traincon13:57
plarssil2100: that would basically involve just going through a loop a few times to make sure the network is up, make sure ntpdate has run successfully, and hwclock is set. If we really want to be clever, we could even diff it against the host time and make sure it's not off by too much13:58
sil2100plars: so, I think what we could do indeed is work around it until promotion and then remove the workaround to get back to a broken state, to make sure this issue gets the attention it deserves13:59
plarssil2100: any suggestion on where the bug could go? do we have a catch-all category for touch? I haven't seen one I don't think14:01
sil2100plars: hm, I don't think we have one... we can report it for 'Ubuntu' in overall, but not sure if that makes sense ;)14:01
ogra_sil2100, but overall ubuntu would be wrong14:03
sil2100Right, that's what I said, it might not make sense ;)14:03
ogra_sil2100, we are in that situation because we reset the device instead of shutting down14:03
sil2100ogra_: so maybe ci-services-itself or what was that?14:04
ogra_theoretically this isnt even a bug but mis-use of a tool ;)14:04
* sil2100 remembers a project like that once14:04
ogra_"adb reboot" vs "adb shell reboot"14:04
sil2100ubuntu-ci-services-itself14:04
sil2100Maybe this migth be a good place for the bug14:04
ogra_yeah, something like that14:04
ogra_plars, hmm, in fact ... we dont need all this if your first reboot of the device becomes "adb shell reboot"14:05
ogra_i think14:05
sil2100hm, I remember one time when we were actually happy we're doing adb reboot instead of adb shell reboot, but can't remember what that was ;)14:05
ogra_sil2100, it is a lot faster14:06
ogra_like the reset button on your PC is faster than properly shutting down14:06
sil2100Right, but I somehow remember that we had a bug somewhere that was actually triggered and hanging devices in the lab (not rebooting properly) when adb shell reboot was used14:09
sil2100Or something like that..!14:09
ogra_if a proper upstart shutdown is hanging thats a serious bug14:10
ogra_and needs immediate fixing14:10
ogra_iirc we had shutdown issues a year ago ... but not since14:10
sil2100I hope so!14:13
plarsogra_: we actually used to do adb shell reboot quite a while back, and I don't remember what exactly the problem was, but sometimes ran into issues with that. iirc it was you that said we should really be using adb reboot instead14:14
sil2100plars: right, that was the same thing I remembered, but I can't remember the actual problem we had...14:15
plarssil2100: ubuntu-ci-services-itself is certainly not a good place for this bug14:15
ogra_plars, right, that is fine ... but we need to run adb shell reboot once for processing the shutdown bits ... we *used* to have an issue there but that was fixed long agoo14:15
ogra_-o14:15
plarsogra_: but even adb shell reboot would only help us if we're really sure that ntpdate has run successfully. If we're going to do that, we may as well just run hwclock -w14:16
ogra_even if not i think the sw clock wont be at 197014:17
ogra_(we dont read the hwclock on booot i think)14:18
* ogra_ wonders whats up with his "o" key14:18
sil2100ogra_, plars: anyway, let's just have a bug filled in 'anywhere' and _at least_ workaround it for now for one promotion14:37
sil2100As the actual impact on users right now is minimal, it's just critical for our smoketesting14:38
sil2100boiko: so, related to those bottom edge things in messaging etc... you still having problems on getting those passing on CI?14:41
boikosil2100: yes, but renato___ has an idea on how to fix that. I didn't know jenkins doesn't run using all packages up-to-date, so I'll add versioning to the deps that are causing it to fail14:42
sil2100Oh :)14:42
sil2100popey: btw.! Can you use your power somehow to get the new reminders-app released to the store?14:53
popeysil2100: what bzr rev?14:53
sil2100popey: 211, at least this one is said to fix the no-notes-visible bug14:54
sil2100As per https://bugs.launchpad.net/reminders-app/+bug/135104114:54
ubot5Launchpad bug 1351041 in accounts-qml-module (Ubuntu) "App is unable to retrieve notes" [Undecided,New]14:54
popeysil2100: i did.. dunno why the version in store is old14:56
popeyballoons: morning, could you push http://s-jenkins.ubuntu-ci:8080/job/reminders-app-click/lastSuccessfulBuild/artifact/out/com.ubuntu.reminders_0.5.211_armhf.click only to the store ?14:57
davmor2sil2100: A promotion tomorrow are you mad ;)14:57
balloonscertainly14:57
popeythanks14:57
balloonspopey, there's changes waiting review already14:58
popeyhmmm14:58
balloonsI upped it again, but check the whole queue14:58
popeyok14:59
popeythats better, thanks14:59
popeysil2100: approved to store, thanks balloons14:59
davmor2Saviq: so silo1 is ready for testing now right?15:00
=== Ursinha changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: robru, trainguards | Vanguard (general help): cihelp | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved
Saviqdavmor2, not just yet, building unity8 right now15:03
sil2100popey, balloons: thanks guys, one blocker less!15:04
davmor2Saviq: no worries15:04
Saviquh oh15:05
Saviqci-train.ubuntu.com down?15:05
=== plars changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: robru, trainguards | Vanguard (general help): plars | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved
jgdxtrainguards https://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-utopic/2018 fails in publishing like so https://jenkins.qa.ubuntu.com/job/autopilot-testrunner-otto-utopic/2018 – might cause some confusion if it becomes an issue for other jobs as well?15:08
jgdxerr, second link http://pastebin.ubuntu.com/7971078/15:08
sil2100jgdx: I think the otto CI infrastructure is seperate from the CI Train, so most probably something for cihelp ;)15:10
tedgSaviq, Not getting it either15:11
sil2100hmmm15:11
Saviqyeah, train dead :|15:11
jgdxsil2100, okay15:11
sil2100Great :| Jenkins is dead15:12
sil2100Let's get IS on it15:12
sil2100Saviq, tedg: as per topic on IS: 'Known Issues: multiple prodstack services down'15:13
=== sil2100 changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: robru, trainguards | Vanguard (general help): plars | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved. The CI Train jenkins prodstack instance is currently down as well.
=== sil2100 changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: trainguards | Vanguard (general help): plars | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved. The CI Train jenkins prodstack instance is currently down as well.
tvosssil2100, silo 10 is good to go15:17
sil2100tvoss: ok, well, nothing we can do about it now. Jenkins is dead15:17
tvosswtf?15:17
plarssil2100: do you already have an RT with IS on that?15:20
sil2100plars: no, but they say that everyone from IS is working on that, it's some bigger outage15:23
plarssil2100: ah, ok15:23
plarsjgdx: does that happen on every run? I'm looking at the build publisher on s-jenkins and it seems ok15:28
plarsjgdx: hopefully it was a temporary issue, possibly caused by the wider problems mentioned above15:29
plarsjgdx: other runs seem to be ok15:30
jgdxplars, it has happened a couple of times for that branch15:33
robotfuelev: ping, errors.ubuntu.com is not working, it's blank.15:33
evrobotfuel: working here15:34
evthe graph appears broken15:34
evis that what you mean/15:34
robotfuelev: yes the graph is blank :D15:34
kenvandineev it wasn't finding any issues for me a few minutes ago15:34
ogra_ev, is someone looking into the fact that it doesnt work at all on the phone btw ?15:35
evogra_: elaborate please? :)15:35
robotfuelev: it looks like it's working now.15:35
ogra_ev, well opening your own errors.u.c page on the phone has never shown any reports15:35
ogra_ev, via the system-settings UI15:35
evdoes it just go to a blank page, what happens?15:36
plarsjgdx: does it happen every time you run it, or does it just seem to be an occasional failure?15:36
ogra_ev, the browser URL is errors.u.c/user/$whoopsie_id ... but that one is always empty15:36
ogra_ev, we talked about that in malta :)15:36
sil2100Ok, it seems we're back15:36
plarsjgdx: I don't think there's anything specific about that branch that can cause jenkins to have a publishing problem, but I've certainly seen temporary issues with jenkins publishing  before15:37
sil2100Saviq: can you confirm ci-train is back for you?15:37
kenvandineev, it's working now though15:37
plarssil2100: looks up to me15:37
sil2100Excellent15:37
=== sil2100 changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: trainguards | Vanguard (general help): plars | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved
Saviqsil2100, yes \o/15:37
jgdxplars, okay. That build is failing consistently, but AFAICS there's no way to figure out why. I don't know if the publish error is hiding something from me? What do you think?15:38
evogra_: do you have a bug for this? slangasek and I just spoke about it and we don't think it's possible for RTM. This may be a task more for the desktop team though, given that it's in system-settings.15:38
plarsjgdx: ok, so it is every time15:38
ogra_ev, well the whoopsie_id used there is correct ... and there are .uploaded files, that must be a server side thing15:39
Saviqdamn ^W15:39
ogra_ev, it pbviously goes to the right URL, system-settings is fine15:40
pmcgowanev, ogra_ this is what you were helping me with yesterday, the whoopsie id the phone gave me was not the same as the one the report went under15:40
ogra_*obviously15:40
ogra_pmcgowan, !15:40
jgdxplars, well, not sure the publishing fails each time, but that job fails due to tests and timeouts.15:40
ogra_pmcgowan, so i assume there is a bug open already then ?15:40
jgdxeach time15:40
pmcgowanogra_, not yet I think, at least I did not file one15:41
plarsjgdx: ok, I thought you were asking about the publishing failure15:41
sergiusensplars: hey there, can I get ci MP builds for lp:ciborium ?15:41
jibelogra_, likely one of bug 1339916 or bug 134006315:42
ubot5bug 1339916 in whoopsie (Ubuntu) "SystemIdentifier can change between reboots" [High,Confirmed] https://launchpad.net/bugs/133991615:42
ubot5bug 1340063 in whoopsie (Ubuntu) "System identifier returned by GetIdentifier dbus method differs from identifier on errors.u.c" [Undecided,Confirmed] https://launchpad.net/bugs/134006315:42
pmcgowanyeah I did not reboot15:42
plarsjgdx: I'll try to take a look, or find someone more familiar with otto to see if they can determine why it fails. do you have a way to retry this run? I didn't see anything that was clearly an error until the build publishing glitch15:42
plarssergiusens: can you point at where I'd find that?15:42
pmcgowanjibel, that second bug is the one I saw15:43
plarssergiusens: oh, you are asking to add it to cupstream2distro-config?15:43
jgdxplars, thanks. This is above the publish failure http://pastebin.ubuntu.com/7971359/15:43
jgdxplars, you can retry it by going to http://s-jenkins.ubuntu-ci:8080/job/ubuntu-system-settings-ci/1159/rebuild15:43
tvosstrainguards, can I get a silo for line 32?15:44
sil2100Sure, one moment15:44
sil2100tvoss: make sure you rebuild once we land silo 1015:45
=== gatox is now known as gatox_lunch
tvosssil2100, obviously :) me and my alter ego are in contact usually ;)15:46
sergiusensplars: yeah :-)15:46
ogra_jibel, thanks15:46
sergiusensplars: what I tried to imply with MP (Merge Proposal) ci :-)15:47
Saviqough, is this a known issue sil2100 https://launchpadlibrarian.net/181665851/buildlog_ubuntu-utopic-amd64.unity8_8.00%2B14.10.20140806-0ubuntu1_FAILEDTOBUILD.txt.gz ?15:47
plarssergiusens: yeah, just not a piece that I've done much with, so it's not the first thought I have15:47
sil2100huh15:47
sil2100Saviq: that's something new15:47
plarssergiusens: I can give it a shot, but would be good if you could review the cu2d change to make sure I did something sane. which stack would this go in?15:51
sergiusensplars: stacks are not really important since the daily release days ended15:51
sergiusensplars: core, system or a similar name15:52
sil2100RIP daily-release15:56
plarssergiusens: head/services.cfg maybe?15:57
Saviqsil2100, could you please try and restart unity8 builds in silo 1, it built fine locally :/15:58
sergiusensplars: sounds good15:58
sil2100Saviq: ok, let me try that, hmm15:58
Saviqthanks15:58
tedgI'm a bit confused, seems the PPA can't install dbus-test-runner. Anyone else having an issue there?  https://launchpadlibrarian.net/181666621/buildlog_ubuntu-utopic-amd64.pay-service_2.0.0%2B14.10.20140806.2-0ubuntu1_FAILEDTOBUILD.txt.gz16:00
sil2100Saviq: it seems to be a real issue somewhere...16:01
sil2100Let me try looking into that after the meeting16:01
Saviqsil2100, thanks :|16:02
tedgAh, Saviq has the same issue :-)16:02
Saviqtedg, yeah, same for unity816:02
Saviqtedg, weird part is it built just fine in sbuild here16:02
tedgYeah, curious if it's something in proposed. I think the PPAs pull it in.16:03
sil2100plars: meeting!16:03
Saviqtedg, ah indeed16:03
* Saviq enables in sbuild16:04
plarssil2100: argh, brt16:04
Saviqtedg, confirmed16:06
tedgSaviq, Can you see which package changed?16:07
tedgI don't see anything obvious16:07
Saviqtedg, http://people.canonical.com/~ubuntu-archive/proposed-migration/update_excuses.html#systemd16:08
Saviqtedg, there's things that depend on new sysvinit, but it's nowhere to be found16:09
Saviqyeah, missing a sync from debian16:10
popeyballoons: music app seems to be doing something odd, clicking off-screen in this test.. http://91.189.93.70:8080/job/generic-mediumtests-utopic/1314/? from this branch https://code.launchpad.net/~vthompson/music-app/fix-swipe-delete-test/+merge/22971816:13
popeyany ideas balloons ?16:13
* balloons looks16:14
balloonsohhh it's music.. I wonder if there's custom swipe code16:15
balloonspopey, yea looks custom. should probably just migrate to the helper16:25
balloonsohh, nvm.. the failures aren't about wipig16:27
popeyballoons: ☻16:30
balloonspopey, easy to see it fail.. It's odd it finds the object16:33
popeyballoons: can you leave a comment on the branch if you find anything interesting? I need to go afk16:34
balloonspopey, yes, I'll leave a comment.16:35
bzoltansil2100:  I have the fix for the broken UbunuShapes (not for the autopilot bug, but the wrong size) in the line3516:35
Saviqenough today :(16:37
sil2100Ok, let me try looking why PPA builds are b0rken :|16:37
brendandplars, when is the RTM branch opening?16:37
plarsbrendand: don't know, I think someone just said friday perhaps?16:38
plarsbrendand: probably a better question for cjwatson16:39
Saviqsil2100, missing sysvinit merge from debian16:39
Saviqsil2100, pitti's been poked16:39
sil2100Aw come ooon16:39
Saviqsil2100, http://people.canonical.com/~ubuntu-archive/proposed-migration/update_excuses.html#systemd16:39
Saviqsil2100, indeed16:40
sil2100:|16:40
sil2100Ok, so that means no testing for me then16:40
sil2100davmor2: ok, so, do you give a QA sign-off for silo 10 ? :)16:41
sil2100davmor2: you sure it won't break anything? :)16:41
sil2100davmor2: ...triple sure?16:42
davmor2sil2100: it already is signed off :)16:42
sil2100Let me publish then, and let's build a new image once it's in16:42
davmor2sil2100: it just turns the current location stuff into a trusted helper16:42
bzoltansil2100: can a Silo do a build and be reconfigured and start to build an other package? I just added the -gles branch to the Sheet.16:43
=== gatox_lunch is now known as gatox
=== robru changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: trainguards | Vanguard (general help): plars | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved. robru's at the doctor, ping trainguards for help
sil2100cjwatson, slangasek: hi! We would need a core-dev+archive-admin +1 packaging ACK on diffs for silo 1016:48
sil2100cjwatson, slangasek: the diffs: https://ci-train.ubuntu.com/job/landing-010-2-publish/lastSuccessfulBuild/artifact/packaging_changes_trust-store_1.0.0+14.10.20140806.7-0ubuntu1.diff https://ci-train.ubuntu.com/job/landing-010-2-publish/lastSuccessfulBuild/artifact/packaging_changes_location-service_2.0.1+14.10.20140806-0ubuntu1.diff16:48
sil2100cjwatson, slangasek: trust-store adds a new binary package16:50
kenvandineoh sigh... held packages17:14
sil2100kenvandine: yeah ;/17:15
=== sil2100 changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: trainguards | Vanguard (general help): plars | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved. robru's at the doctor, ping trainguards for help. Archive is a bit broken, PPA builds will fail.
kenvandinesil2100, so what's the breakage?  i don't see an upload of gvfs17:17
sil2100kenvandine: so, from what I heard, a sysvinit merge is missing in the archive it seems17:20
sil2100kenvandine: pitti is on it it seems17:20
kenvandineyikes17:20
bzoltansil2100:  would you please reconfigure the silo15?17:22
sil2100bzoltan: sure! About that building, that could be done but remember that the builds will fail17:24
sil2100(like in, PPA builds)17:24
bzoltansil2100: I remember that it failed before. I have no idea why.17:25
kenvandinethe archive is broken17:25
kenvandinenothing will build17:25
sil2100stgraber: hello! If you're around, maybe you could provide some +1 packaging ACK on a main package - we're also adding a new binary package to another one:17:25
sil2100stgraber: https://ci-train.ubuntu.com/job/landing-010-2-publish/lastSuccessfulBuild/artifact/packaging_changes_trust-store_1.0.0+14.10.20140806.7-0ubuntu1.diff and https://ci-train.ubuntu.com/job/landing-010-2-publish/lastSuccessfulBuild/artifact/packaging_changes_location-service_2.0.1+14.10.20140806-0ubuntu1.diff17:25
sil2100stgraber: so we need a core-dev with archive admin powers to review this ;)17:26
sil2100infinity: hey! As you'll be doing trainguarding this month probably, could you maybe review some packaging changes for some main packages? There's one that also adds a binary package, so a +1 from an archive admin is required:17:43
sil2100infinity: https://ci-train.ubuntu.com/job/landing-010-2-publish/lastSuccessfulBuild/artifact/packaging_changes_trust-store_1.0.0+14.10.20140806.7-0ubuntu1.diff and https://ci-train.ubuntu.com/job/landing-010-2-publish/lastSuccessfulBuild/artifact/packaging_changes_location-service_2.0.1+14.10.20140806-0ubuntu1.diff17:43
sil2100robru: could you make sure this gets reviewed, landed and an image kicked after it reaches the archive?17:43
infinitysil2100: Looking.17:46
sil2100infinity: thanks o/17:46
infinitysil2100: The first diff looks fine, except for the part where the changelog really doesn't document half of it. :P17:51
infinitysil2100: And second one is fine.17:52
sil2100hah ;)17:52
sil2100infinity: yeah, we have problems enforcing upstream developers to include all the info that's required in the changelogs... ogra_ was trying to inform developers, but yeah, it didn't seem to work ;p17:53
sil2100infinity: anyway, thanks!17:53
ogra_infinity, i wrote an angry mail already that i wouldnt ACK landings that have incomplete changelogs anymore :)17:54
ogra_it simply makes forensic work (which we have to do at least once a week) nearly impossible17:55
infinityIndeed.17:55
infinitysil2100: The simple way to enforce it is to enforce it.17:55
infinitysil2100: Not being funny, but it's not your job to let everything in, it's your job to let things in when they're correct.17:55
sil2100Yeah, we tend to reject some landings because of that, but today we're a bit less strict due to traincon ;)17:56
sil2100Since time is of the essence17:56
rsalvetisil2100: mind reconfiguring silo 18?17:59
sil2100rsalveti: sure17:59
rsalvetisil2100: thanks17:59
rsalvetiseems it's still building18:00
sil2100rsalveti: reconfigured18:01
rsalvetisil2100: thanks18:01
sil2100robru: ah, and remember to poke ToyKeeper to do QA signing-off, but try keeping the velocity of landings low18:04
sil2100robru: prioritize blocker fixes!18:04
sil2100robru: and remember to keep pushing people for fixes ;) Be as annoying as possible ;p18:06
sil2100robru: (j/k!)18:06
sil2100o/18:07
jgdxplars, I've just updated a dep which was (could be) wrong in https://code.launchpad.net/~jonas-drange/ubuntu-system-settings/expandable-sim-name-editor/+merge/22945018:10
plarsjgdx: ok, cool18:10
plarsjgdx: hopefully that will work18:11
jgdxplars, hopefully!18:11
jgdxplars, can you explain "candidate_revision" to me?18:12
jgdxfor e.g. http://s-jenkins.ubuntu-ci:8080/job/ubuntu-system-settings-ci/1161/rebuild/?18:12
davmor2robru: did sil kick another image in the end?18:13
plarsjgdx: if I had to guess, the candidate revision is the one it's attempting to land, but where are you seeing that?18:13
rsalvetiare we kicking another image now?18:14
ogra_davmor2, silo16 wouldnt mind a QA signoff :)18:14
jgdxplars, ^above link18:14
ogra_bah, the bot was faster than me :P18:14
plarsjgdx: I don't see that anywhere18:14
davmor2ogra_: I'm not sure I trust the dev that threw the code together, can you vouch for him ;)18:15
ogra_davmor2, not sure ... but the code change is one line and some includes ... so i think even that untrustworthy guy cant do much wrong with that :)18:16
plarsjgdx: but yeah, https://wiki.canonical.com/UbuntuEngineering/CI/Playbook/UpstreamMerger?highlight=%28candidate_revision%29#Running_a_ci_.2BAC8_autolanding_job_manually - candidate_revision is the most recently pushed revision number on the mp18:16
plarsjgdx: oh, I wasn't logged in to s-jenkins so the link you sent was redirecting me18:16
jgdxplars, aaa18:17
plarsjgdx: so, yeah that ^18:17
davmor2ogra_: installing if this introduces bugs though I'm sending pitti round to sort you out ;)18:17
ogra_lol18:17
jgdxplars, it seems that value is wrong then.. Could explain everything.18:17
tedgAre things building again?18:19
tedgAh, missed pitti's ping. Cool.18:19
bzoltanrsalveti: do you know th ereason for this failure https://ci-train.ubuntu.com/job/landing-015-1-build/148/console ?18:23
davmor2ogra_: found a bug18:28
ogra_oh ??18:28
ogra_in my code ?18:28
davmor2ogra_: I rang pitti he is on his way ;)18:28
* ogra_ makes coffee18:28
davmor2ogra_: so currently developer mode is on an dthe system is locked as there is no password.  I would of thought it would only lock with the developer mode off18:29
ogra_davmor2, the toggle only reflects the actual state, we will only default to off once the UI bits are landed18:30
ogra_then this state cant be possible anymore18:30
ogra_(we force it to on underneath the UI currently)18:30
davmor2ogra_: ah right in that case I forgive you, don't do it again ;)18:31
ogra_blame sergiusens :P18:31
* ogra_ hides somewhere 18:31
sergiusensogra_: what did i do?18:32
ogra_sergiusens, setting the default for apt :)18:32
sergiusensapt?18:32
ogra_sergiusens, ignore me ;)18:32
ogra_adb18:32
davmor2sergiusens: does it matter?  it's your fault :D18:32
ogra_heh18:32
sergiusenslol18:32
sergiusensI was complaining during lunch with rsalveti about how unfair traincon is to me18:32
sergiusensreally affects me as I don't do the staging branch dance18:32
ogra_sergiusens, its just a matter of bribing the QA guys the right way18:33
sergiusensdoesn't matter, still unfair18:33
Saviqrobru, hey, can you please hit rebuilds of unity8 and indicator-network in silo 1, proposed's been fixed already18:35
rsalvetibzoltan: didn't find the tarball18:35
Saviqor well, trainguards ↑↑18:35
davmor2ogra_: open the lock security, set a 4-digit pin, turn off dev mode then turn it back on again.  Now go back into lock mode and select Swipe (no security)18:36
rsalvetibzoltan: you need to change the changelog header to match the upstream version18:36
davmor2ogra_: It appears you can never go back, the 4 digit pin becomes your password and is recorded there instead18:37
rsalvetibzoltan: https://code.launchpad.net/~bzoltan/ubuntu-ui-toolkit/sync_landing_0608/+merge/22982718:37
Saviqbzoltan, you need `dch -v  1.1.1181+14.10.20140806-0ubuntu1 ""`18:37
rsalvetibzoltan: see you're trying to sync with 1.1.1181+14.10.20140806-0ubuntu1, but the version for this package is 1.1.1181+14.10.20140804-0ubuntu318:37
Saviqbzoltan, the part before -0ubuntu1 has to be the same as the non-gles package18:37
rsalvetiyeah18:37
ogra_davmor2, go back to what ?18:39
davmor2ogra_: nevermind, it was because I had turned the developer mode back on so it wouldn't allow me to unset and go back to swipe18:40
ogra_ah18:40
ogra_i was just wondering ... since i jumped back and forth between all possible combinations all day today18:41
=== tvoss is now known as tvoss|test
=== tvoss|test is now known as tvoss
Saviqogra_, could you please hit rebuilds in unity8 and indicator-network in https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/landing-001/+packages18:46
* Saviq really needs to get in on the ci train drivers, hate having to ask people about things like this :p18:47
davmor2popey: are there autopilot tests for reminders?   should they be landed into the autotesting framework if it is to be a core app?18:52
davmor2ogra_: silo 16 looks good and doesn't interfere with anything else18:53
* ogra_ hugs davmor2 18:54
balloonsdavmor2, yes and yes. As to why they aren't there, we're working on it. They require new tooling for CI18:54
popey^18:54
ogra_Saviq, gimme a bit, just having breakfast (yes i know how late it is :) )18:54
Saviqlol18:54
davmor2popey:  wow you sounded just like balloons then :D18:55
plarsdavmor2: there are, we're working to get them into smoke, but that won't get them into autolanding. Not sure what needs to happen to make that work, but I'd bet fginther has plans for it already since he did a lot of the work to make autopkgtests work in smoke18:55
balloonsmmm.. the full answer ^^18:55
balloonsnow popey is sounding like plars18:55
plarshe's a ventriloquist18:55
plarswhich, I guess makes me a dummy18:56
ogra_yummy  ...18:56
ogra_smoked images18:56
davmor2popey: with a  talent like that you should do a show at the next sprint :D18:56
popeyhttp://drool.popey.com/18:56
balloonsand the kneeslapper of the day award goes to . . . plars18:56
davmor2plars: I'll leap to your defence, being as no one else has,  No your not a dummy :)18:57
davmor2s/your/you're18:57
ogra_Saviq, hmm, i just found out that i have no clue how to trigger a rebuild with the new train UI :/19:06
Saviqogra_, oh no19:06
Saviqogra_, just rebuild in PPA19:06
ogra_ah, seems i found it19:07
Saviqogra_, in the failed builds in https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/landing-001/+sourcepub/4336601/+listing-archive-extra and https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/landing-001/+sourcepub/4336570/+listing-archive-extra19:07
ogra_you want the indicator and unity8. right ?19:07
Saviqogra_, yes please19:07
Saviqogra_, the unity8 ones that are dep wait you can leave out19:07
Saviqthey'll dep-wait anyway19:07
Saviqbut the others were failing because of a proposed issue that's been solved, so no need to reupload, rebuild is enough19:07
ogra_seems to be running19:08
ogra_(if a blinking giant dot means running at least :P )19:08
tvossSaviq, ogra_ can I press merge & clean myself?19:20
ogra_tvoss, no idea19:20
=== plars changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: trainguards | Vanguard (general help): cihelp | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved. robru's at the doctor, ping trainguards for help. Archive is a bit broken, PPA builds will fail.
ogra_tvoss, i guess if it lets you you can :P19:22
Saviqtvoss, sure, it's something you do yourself19:22
ogra_Saviq, silo 1 doesnt look so great now :(19:23
* ogra_ hopes he didnt mess up something 19:23
Saviqogra_, no, you ran a build job, that I can do myself19:23
Saviqogra_, what I need you to do, assuming you actually have the rights to do it...19:24
Saviqogra_, is to press rebuild on https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/landing-001/+build/624700519:24
ogra_oh. you wanted me to click on each and every package in the PPA and click rebuild ?19:24
Saviqogra_, just two packages * arches, something like 9 in total :D19:24
ogra_yeah, i definitely can do that ... i thought you wanted some fancy CI stuff :P19:24
Saviqogra_, thank you :)19:25
ogra_seems to have failed again (pretty quickly)19:26
Saviquuuugh19:26
ogra_fun ... given that diff19:27
Saviqstoopid proposed :|19:27
ogra_The following packages have unmet dependencies:19:27
ogra_ libconnectivity-cpp-dev : Depends: libconnectivity-cpp0 (= 0.0.1+14.10.20140722-0ubuntu1) but it is not going to be installed19:27
ogra_E: Unable to correct problems, you have held broken packages.19:27
Saviqogra_, yeah, trying to reproduce here19:28
Saviqhuh, gvfs-backends should've been fixed by now!19:28
* Saviq is gonna cry19:29
Saviqand I don't get it, it installs fine here by now19:30
brendandrobru, is silo009 going to land today?20:03
Wellarkjust for the record I have not touch libconnectivity-cpp20:07
Wellarkbut I'm going to touch it this night20:07
Wellarkoh, it's already night time..20:07
Wellarkanyway20:07
kenvandineyay, systemd built... maybe the archive is *unbroke*20:10
tvosstrainguards, could you reconfigure silo 32, please?20:22
pmcgowankenvandine, whats holding up jonas dual sim branch, ci run?20:23
kenvandinewhich dual sim?20:23
kenvandinethere's one that has a prereq on the reset branch20:23
pmcgowankenvandine, sim name editor?20:24
kenvandineah, that's just the UI tweaks for the label editor20:24
kenvandinei'll check it out20:24
kenvandinepmcgowan, his other dual sim related branch requires the reset branch20:25
pmcgowankenvandine, ah, ok, man cant wait for all that to go in20:25
kenvandineyeah20:25
kenvandinepmcgowan, ok, the sim name editor branch is still failing CI20:25
kenvandinewhich... we know everything for settings fails CI20:26
kenvandinebut... the failures are in the cellular tests20:26
kenvandineso i'm ok with landing unrelated things knowing the failing tests aren't related to the branch, but not branches that are in the same place as the failing tests20:27
pmcgowanI thought john's layout change went in yesterday but dont see it20:27
kenvandineit did20:27
kenvandinenot in an image yet20:27
pmcgowanok20:27
rsalvetiogra_: robru: mind if a trigger a new image?20:27
rsalvetiwill do once rmadison tells me ubuntu-system-settings is finally in20:29
kenvandinepmcgowan, the broken archive is not going to help us land any of this :/20:36
pmcgowankenvandine, still broke?20:36
kenvandineyeah20:36
pmcgowankenvandine, remind me why we build against proposed?20:37
kenvandinethe systemd/sysvinit fix is in... but still busted20:37
kenvandinebecause other depends may be in proposed :)20:37
rsalveticrap20:37
sergiusensrobru: cjwatson is there a process to unsupport an architecture? I'm switching from gccgo to golang-go (at least temporarily)20:49
pmcgowankenvandine, what is the archive breakage preventing right now, the builds themselves?20:58
kenvandineyeah21:03
kenvandinebuilds fail in the PPA21:03
pmcgowankenvandine,what exactly, the build or making a build environment?21:04
kenvandinebuild env21:04
pmcgowanyeha21:04
kenvandineit can't install the build depends21:04
pmcgowansame as a local build chroot, where the rule is dont use proposed21:04
kenvandinedependency failures, uninstallable packages21:04
kenvandineyup21:04
pmcgowanwhy dont we have a canned build env from known state21:05
kenvandinethat wouldn't be good21:06
kenvandineit would need to be updated every time a package in it gets updated21:06
kenvandineat least libs and stuff21:06
kenvandineat least for archive builds21:06
kenvandineit would be nice for app developers doing builds though21:07
pmcgowanits the same thing we do with local builds21:07
kenvandinebuilding for the archive we need to be sure linking is down against what's in the archive21:07
kenvandines/down/done21:08
pmcgowanI may not have the answer but this is intolerable21:08
kenvandinepmcgowan, extremely frustrating21:09
kenvandinei tried bisecting based on what's hit proposed today21:09
kenvandinesystemd has to be the culprit21:09
kenvandinebut pitti uploaded a fix for that21:09
kenvandineand... Saviq has tried just adding the packages it complains explicitly and it all magicly works21:09
kenvandinemakes me think there is some apt dep resolution bug21:09
pmcgowanI have seen that before yeah21:10
kenvandineit feels like half a day here wasted, which is frustrating21:10
kgunnrobru: hey, i gotta twin i need to add to silo 2, can you help with the reconfig ?21:53
=== robru changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | CI Train support: robru, trainguards | Vanguard (general help): cihelp | CI Train Status: #157 promoted | CI Train Dashboard: http://bit.ly/1mDv1FS | Known issues: Forceful TRAINCON-0! Please work together on getting all blockers resolved. Archive is a bit broken, PPA builds will fail.
robrukgunn, heya21:59
robrucan do21:59
boikorobru: silo 9 has some autopilot fixes and some packaging deps only, it is all tested and working22:00
sergiusensrobru: did you see my question above?22:01
robrusergiusens, yeah, just reading scrollback now. is the problem that golang-go supports fewer arches than gccgo?22:01
sergiusensrobru: yes22:02
robrursalveti, image is fine with me. did you do it yet?22:02
sergiusensrobru: I lose the weird ones basically22:02
sergiusensrobru: so no arm64 or power*22:02
robrusergiusens, right, so that's fine by me, but it's not up to me ;-) you need somebody like cjwatson or infinity to force that through.22:02
sergiusensrobru: won't jenkins fail the silo saying some arches failed to build though?22:03
robruand by "force that through" I mean they need to delete the existing binaries from the archive so that the archive won't block on that arch regression.22:03
sergiusensrobru: or maybe it's buggy, as it says it's building still even though it finished hours ago: https://ci-train.ubuntu.com/job/landing-020-1-build/82/console22:03
robrusergiusens, not if an archive admin fixes it first22:03
sergiusensrobru: ack22:04
sergiusensrobru: so good thing I also ping cjwatson about it :-)22:04
robrusergiusens, yeah22:04
rsalvetirobru: no, not sure if archive is in a proper state22:04
robruoh right22:05
sergiusensrobru: based on doko's reply to my email on canonical tech, I say it should be unblocked easily22:05
robrudavmor2, no an image wasn't kicked22:15
robruSaviq, did you get your rebuild of silo 1? i just got back22:15
Saviqrobru, old news, silos are broken anyway due to systemd being stuck in proposed, 'causing systemd to be stuck in proposed, causing systemd to be stuck in proposed, causing systemd to be stuck in proposed... and so on22:16
robruSaviq, that's a shame, I hope it doesn't cause systemd to get stuck in proposed...22:17
SaviqI'm afraid it might22:17
sergiusensSaviq: we should integrate unity8 into systemd22:18
Saviqsergiusens, to get stuck in proposed?22:18
sergiusensSaviq: to make the archive just one package22:18
Saviqsergiusens, that's stuck in proposed? :D22:18
sergiusensSaviq: well once it's one package, it will be easier :-P22:19
robruracarr, ping about that stuff. how's it going?22:26
slangasekjdstrand, plars, robru: so sil2100's mail seems to have a dangling reference to this bug filed for the apparmor denials.  Does someone have the link?22:38
plarsslangasek: sure, one sec22:39
robruslangasek, hm, i think plars has it ;-)22:39
plarsslangasek: robru: https://bugs.launchpad.net/ubuntu/+bug/135359122:40
ubot5Launchpad bug 1353591 in Ubuntu "Ubuntu Touch devices sometimes come up with hwclock set to 1970" [Undecided,New]22:40
plarsI'll cc it to the email, didn't see that it didn't get pasted22:40
plarsslangasek: oh, no it's in the email. I see it22:41
plarsslangasek: he just put it in an odd place :)22:42
slangasekoh?  I found a [3] footnote but it was a different bug22:42
cjwatsonkenvandine: it's perfectly possible to choose to build against release rather than proposed on a silo-by-silo basis, but I would certainly maintain that it is not generally appropriate22:42
plarsslangasek: yeah, it's further down... confusing22:42
cjwatsonsergiusens: It's possible for us to remove binaries from the release pocket, which would permit that, but I'd need to look into the specifics to see whether there are any consequential problems22:42
cjwatsonsergiusens: what silo is this?22:43
cjwatsonso has the stack of build failures from scrollback been unblocked?22:43
robrucjwatson, as far as I can tell, no, archive is broken due to systemd and builds are failing22:44
cjwatsonrobru: do you have an example?  I saw an upload of systemd that purported to fix it22:44
robrucjwatson, well I'm looking at proposed-excuses and it says systemd not considered due to a regression in udisks222:45
cjwatsonAnd it's only currently blocked in -proposed by some failing autopkgtest or other that isn't hugely relevant for this purpose22:45
cjwatsonThat doesn't affect builds22:45
cjwatsonDo you have a current example of a failed PPA build?22:45
robrucjwatson, sorry I'm not up to speed on all the builds because I've been at the doctor most of the day22:45
Wellarkare the builds working again and if not is there any ETA?22:45
robrucjwatson, but silo 17 and 1 seem to be failing22:46
Wellarkit's almost 2am and I'm thinking if I should to to bed or not22:46
robrucjwatson, also the silo sergiusens was asking about is 2022:46
cjwatsonWellark: they should be working now but I'm just about to check22:46
Wellarkcjwatson: \o/22:46
cjwatsonok, 17 is old, will retry in the PPA22:46
Wellarkhow is silo 1 looking? (haven't checked..)22:46
cjwatsonWellark: I'll check that in a moment22:47
cjwatsonbut that failure's old too22:47
cjwatsonhm, still maybe something wrong, let me see22:49
cjwatsonhuh, what22:51
cjwatsonubuntu-archive@snakefruit:~$ chdist apt-get utopic-proposed-ppc64el install gvfs-backends gvfs gvfs-daemons udisks2 udev parted libpam-systemd procps systemd initscripts22:51
cjwatsonfails22:51
cjwatsonubuntu-archive@snakefruit:~$ chdist apt-get utopic-proposed-ppc64el install gvfs-backends gvfs gvfs-daemons udisks2 udev parted libpam-systemd procps systemd initscripts upstart22:51
cjwatsonsucceeds22:51
cjwatsonthe first failure was "initscripts : Depends: upstart but it is not going to be installed"22:51
robrukenvandine, ^^ can you fill cjwatson in on the details?22:52
cjwatsonrobru: no need22:52
cjwatsonkenvandine: ^-22:52
cjwatsonI saw kenvandine's comments earlier and I seem to be retracing the same steps22:53
cjwatsonIt *might* just need a chroot upgrade to get past this22:54
cjwatsoninfinity: ^- you still around?22:56
cjwatsonhttp://paste.ubuntu.com/7974417/ is the apt debug output from the first command above22:58
ToyKeeperFor traincon, there has been a surprising lack of silos to test.  (I'm not complaining though!)22:58
cjwatsonLooks like it's picking systemd-sysv as a preferred alternative to systemd-shim and then failing to resolve it, but not totally clear on why22:59
cjwatsonso, I can unblock silos 1 and 17 by temporarily switching them to -proposed, but that isn't a long-term solution23:00
infinitycjwatson: I am, ish.23:00
infinitycjwatson: Erm, aren't all silos supposed to have -proposed enabled anyway?23:01
cjwatsoninfinity: Any ideas on the above mess?  I'm not sure if a chroot upgrade will actually help given the debug output there23:01
cjwatsoninfinity: They do.  In this case that's why they're failing.23:01
cjwatson(Though in general I think it's a good thing, otherwise transitions involving anything in a silo would be super-painful.)23:01
infinitycjwatson: It was "so, I can unblock silos 1 and 17 by temporarily switching them to -proposed" I was reponding to..23:02
cjwatsonEr, sorry, braino23:02
cjwatsonBy temporarily switching them to release23:02
* infinity digs a bit.23:03
cjwatson1 and 17 switched, builds retrying23:03
infinityIf this mess is in proposed, manual upgrading won't help, unless I upgrade the chroots to proposed, which I don't usually.23:03
cjwatson(You can always copy what's in 17 to another PPA with -proposed enabled if you want to debug)23:03
cjwatsoninfinity: chdist might not be totally reliable for this, as it's starting from a blank slate rather than from a system with -proposed enabled.23:04
infinityRight, I'm trying a chroot.23:04
infinityIs this failing on upgrade, or build-dep install?23:04
infinityLog somewhere?23:04
cjwatsoninfinity: But a good test is whether "apt-get build-dep content-hub" works with -proposed enabled after upgrading the chroot to current release.23:05
infinitycjwatson: Upgrading to proposed, actually.23:05
cjwatsonI've probably just killed the logs, but it amounts to apt-get build-dep content-hub (or indicator-network, or unity8)23:05
cjwatsoninfinity: Is there anything to upgrade in release first?23:05
infinitycjwatson: I mean, the reproducer would be to upgrade to proposed, since that's what lp-buildd does.23:06
cjwatsonOh true.23:06
infinitycjwatson: There are certainly things to upgrade in release first, which might help work around it, but I'd rather understand the bug first.23:06
cjwatsonI agree, it's just something to experiment with23:06
infinityIf it's another apt issue, fine.  If it's something wrong with the packaging that's going to break upgrades from 14.04, we should fix it, not force it.23:06
cjwatsonI couldn't see anything obvious with the packaging, but that's not definitive23:07
robruToyKeeper, yeah, only things that aren't critical bugfixes require qa signoff, so I guess we had a well-behaved traincon, only silos with fixes were considered so far ;-)23:07
cjwatsonBumped versioned dep systemd-shim, but the target version exists in utopic23:08
infinitycjwatson: Comes down to libpam-systemd forcing curious changes to the install list.23:08
cjwatsonIt does?  That's just bumped systemd version to match the source, added dbus, bumped systemd-shim version (to one available in utopic)23:09
cjwatsonAt least on amd6423:10
infinityhttp://paste.ubuntu.com/7974475/23:10
cjwatsoninfinity: Maybe removing the no-longer-essential init from the chroots would help?23:11
infinitycjwatson: Might do.23:11
infinityNope.23:12
infinitySame result.23:12
cjwatsoninfinity: Adding systemd-shim to your list (without libpam-systemd) also fixes it23:13
cjwatsonWhich matches the apt debug output, which starts going wrong where it tries to install systemd-sysv23:13
infinityhttp://paste.ubuntu.com/7974485/23:13
cjwatsonOh23:14
infinityYeah.  Can be narrowed down, at least, to just trying to install udisks2, which is a lot fewer interacting packages than gvfs.23:14
cjwatsonThe problem is that systemd-sysv now exists in -proposed23:14
cjwatsonIt didn't before, so dependencies didn't pick it23:14
infinityOh, we might need something high enough up the stack to just prefer systemd-shim?23:15
cjwatsonSwitching libpam-systemd's alternative order would probably bodge it for now23:15
infinityTo hint apt in the right direction?23:15
cjwatsonObviously not correct, but I'm pretty sure it would do for the moment23:15
infinityI'm not sure if there is a correct here.23:15
infinityI think the assumption should be that an installed system comes with one alternative or the other already working.23:16
infinitySo, this is only a switching problem.23:16
infinityBut the upgrade is irksome.23:16
cjwatsoninfinity: You're probably right, but it needs more of an expert than I am to get the architecture right.  In the meantime can you review http://paste.ubuntu.com/7974519/ ?23:17
infinityBut yeah, twiddling the order on libpam-systemd would probably do it for now.23:17
infinitycjwatson: lgtm.23:18
infinityAnd now to run off to that late lunch that kept getting later...23:18
cjwatsonAh, good, robru did a watch-only build on those, thanks23:19
cjwatsoninfinity: Cool, thanks23:19
cjwatsonNose held, uploaded23:19
robrucjwatson, you're welcome23:19
cjwatsonAnd I've flipped those PPAs back to their previous configuration before we forget23:20
racarrrobru: Pong...sorry wasnt watching this channel23:24
racarryou mean the bottom edge swipe stuff?23:24
robruracarr, yeah I was told to ping you about that, we want to get that in asap ;-)23:25
racarrIt's difficult23:25
racarrI think i've located it but no chance of a fix today23:25
racarras far as I can tell (and im not 100% sure yet)23:25
racarrthe emulator just doesn't support resizing egl surfaces23:25
racarrin it's egl impl23:25
racarrand we now resize the surfaces on startup as part of a weird dance23:25
racarrto solve a bunch of other bugs23:25
robruracarr, hmmm, ok.23:26
cjwatsonsergiusens: removed now-unbuildable ciborium binaries for you; hopefully that will publish before citrain's current build finishes and it will notice, otherwise abort the build if necessary and do a watch-only build23:26
cjwatson(once rmadison is up to date)23:26
racarrrobru: Should have something more definitive by tomorrow or later today if I get lucky but I think I am unlikely to make much more progress until I can poke someone who knows a little more about the android drivers23:27
robruracarr, before you EOD, can you reply to the landing team email with your findings?23:27
racarrrobru: Is that better than commenting on the bug?23:28
robruracarr, hm, I guess commenting on the bug is better.23:28
racarr:)23:28
racarrI just made one basic comment...hopefully I should find out a little more before EOD23:28
cjwatson^- that's just a build1 upload which we'd normally discard; I'll force23:32

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!