[03:35] === trainguard: IMAGE 60 DONE (finished: 20140602 03:35) === [03:36] === changelog: http://people.canonical.com/~ogra/touch-image-stats/60.changes === [05:05] cihelp jenkins full, can't even launch the clean jobs because also those fail from out of disk space.. :( [05:34] bug 1325467 for anyone on #60 who has an alarm any time soon. [05:34] bug 1325467 in unity8 (Ubuntu) "Alarms appear underneath greeter #60 mako" [Undecided,New] https://launchpad.net/bugs/1325467 [05:34] if you can confirm pls [07:08] Morning! [07:08] hey hey [07:08] Now what the heck happened with test results of the recent images! [07:08] * sil2100 looks at what has changed [07:09] seems there are timeouts in the tests with split greeter [07:09] sil2100, the landing wasnt complete, the unity8 bit only landed yesterday [07:09] hmm [07:10] ogra_: the split greeter one? How was it not complete? Not everything was present in the silo? [07:10] not sure why, but unity8 only made it into the archiove yesterday [07:10] Ah, hm [07:11] Interesting, as I thought the faux-package bumping was no longer required - maybe some autopkgtest failures? [07:12] https://launchpad.net/ubuntu/utopic/+source/unity8/7.87+14.10.20140530.1-0ubuntu1 [07:12] Uh, something broke the CITrain backend I just noticed\ [07:13] not sure what happened, but yeah, could be autopkgtests taking long [07:13] Holy sh... ci-train jenkins seems to be 'broken' [07:13] * ogra_ isnt sure if the "published" date in the proposed pocket entry is actually the date when it entered proposed [07:13] https://ci-train.ubuntu.com/ [07:14] cihelp: hi guys! Does anyone know why all the ci-train executors are dead? [07:14] cihelp: as per https://ci-train.ubuntu.com/ <- [07:15] anyway ... there are now timeouts in the tests ... Saviq was fearing we could have issues with unlocking with the new greeter ... not sure it is that [07:15] (i didnt inspect to deeply yesterday, just made sure we get an image with the landed unity8) [07:16] ogra_, if we affected it, it would be *all* of them, is that the case? [07:16] Saviq: there are like many many test failing now, around 120 failures [07:16] Saviq, nope ... but only -app tests [07:17] ogra_, that shouldn't be the split greeter then, means we're indeed unlocking the screen if we can pass any of them [07:17] Saviq, thats the changeset after which it started ... seems the ailo only half migrated on friday ... http://people.canonical.com/~ogra/touch-image-stats/59.changes [07:18] sil2100: bug 1325467 is interesting [07:18] bug 1325467 in Unity 8 "Alarms appear underneath greeter #60 mako" [High,Triaged] https://launchpad.net/bugs/1325467 [07:18] I don't see anything else that could have caused the failures [07:18] in that snap decisions appear underneath the greeter [07:18] In the changes [07:18] popey, commented on it already [07:18] popey: oh! [07:18] sil2100, well not sure if dbus-x11 is a dep of the greeter split [07:18] morning Saviq ☻ [07:18] ogra_, it is [07:18] popey, that's indeed fallout of split greeter [07:18] ok [07:19] nice one [07:19] Saviq, and the xlibs ? [07:19] * sil2100 is too tired today to feel any pressure regarding the test results [07:20] ogra_, I believe so, it did bring some weird things with it [07:20] hmm, probably deps of the dbus-x11 package [07:20] * Saviq looks [07:22] ogra_, my apt history.log entries from testing the silo: http://pastebin.ubuntu.com/7571253/ [07:22] ogra_, so yeah, the x things are pulled in by split greeter [07:23] yeah, looking at the dependency chain of dbus-x11 shows similar results [07:23] ogra_: yeah, and in the ubuntu-touch-session changelog I only see the greeter added, so no new explicit deps have been filed [07:24] ogra_, direct dep for dbus-x11, too http://bazaar.launchpad.net/~unity-team/unity8/trunk/revision/933/debian/control#debian/control [07:24] I was chatting a lot with Mike on Friday, but I can't remember if he'll be around today or not... [07:24] Since he might be traveling [07:24] sil2100: I reported the jenkins problem to cihelp in the morning [07:25] sil2100: it's out of disk space, and also trying to free up disk space with that one job fails with not enough disk space.. [07:25] i havent seen him at the bomb evacuation ... so he might not have hit one of the delays [07:25] (but he might just have been at another part of the airport) [07:26] so we have chances he traveled fine and is around later today [07:26] sil2100, my suspicion is more towards the infrastructure though [07:27] that we are either lacking something for these failed runs or that something is different from how mterry and Saviq tested [07:27] * ogra_ bets on the latter [07:27] t1mp / bzoltan do you have an ETA on when the fix for 1322527 will land in the image? [07:27] (morning btw) [07:27] popey, it is ready ... [07:27] bzoltan, pinged yesterday (assuming you talk about gallery) [07:27] Ready != on my phone ☻ [07:28] ogra_, now that I look through the diff, I'm not sure why dbus-x11 is a direct dep, we'll have to wait for mterry to comment :| [07:28] wheer is the bot ? [07:28] but then dbus-test-runner is used in a test, and isn't a build-dep... [07:28] Saviq, well, did you run all AP tests or just a selection ? [07:29] ubot5 is here. [07:29] then it doesnt like you :) [07:29] bug #123456 [07:29] bug 123456 in xine-lib (Ubuntu) "podcast crashes amarok" [Undecided,Fix released] https://launchpad.net/bugs/123456 [07:29] Mirv: morning! Now this is unexpected! Didn't he had the 'free disk space' job set up to be ran periodically? [07:29] common [07:29] hmm [07:29] Mirv: I suspect it was in plans and never happened, right? [07:29] bug 1322527 [07:29] bug 1322527 in Ubuntu Terminal App "Terminal app shows no text in #44 on mako" [Critical,Triaged] https://launchpad.net/bugs/1322527 [07:29] sil2100: I don't know, the apt-get clean job was at least disabled. that's probable. [07:30] Saviq, if you ran them all it must be something that is different in the infrastructure ... [07:31] Let's wait for CI to appear and resolve the problem [07:31] ogra_, indeed, we didn't run the whole suite with the latest builds, I got pressed for pushing the button... [07:31] Mirv: for now I disabled auto-refresh of the spreadsheet as it was failing because of the backend being broken [07:31] ogra_, in any case, http://q-jenkins.ubuntu-ci:8080/job/autopilot-release-gatekeeper/140/ was a run some time before, but nothing much changed that would warrant an all-over-the-place fail [07:31] (mostly because of jenkins dying in the middle of some configuration save operation) [07:33] Saviq: do you know of any differences in how tests are ran at the gatekeeper and in smoketesting? [07:33] sil2100, in theory there shouldn't be [07:33] sil2100, they all use phablet-test-run by now [07:34] Since psivaa is not around today, we also basically have no CI to support us [07:34] sil2100, did you have a chance to try and reproduce the issue locally? [07:34] Saviq: not yet, but will try in a moment once my image flashes [07:34] sil2100, doing the same [07:34] Saviq, it seems to hit largely the same tests/app that fail in both image that have the full landing (59 and 60) [07:35] sil2100, ^^^ [07:36] the only one i dont see in the first image is clock app ... all the others are roughly the same [07:38] hmm "via upstart-app-launch", are we monitoring tedg's rename? it didn't happen yet did it? [07:39] looks like launch_click_package got screwed somehow [07:39] the common denominator [07:40] dialer fails on phonesim, so another issue [07:41] gallery has a sh*tload of sqlite errors and then an SDK exception ?? [07:47] popey: t1mp: ogra_: the fix is in the silo3 [07:47] Saviq: yeah, so the name change didn't land yet if anything [07:48] hm, grrr, device problems [07:54] sil2100, ogra_, btw python2 is gone from the device, but phablet-test-run seems to be using it still [07:54] oh jeez [07:57] Saviq, for some deb tests thats ok ... it should pull it in [07:57] (if needed) [07:57] ogra_, well, sure, unity8-autopilot pulls it in... until it won't :P [07:57] Saviq, gallery is something else ... thats older, ignore it [07:59] aargh this whole click test setup is just crazy complex and delicate :| [08:01] Saviq: you mean, the downloading, looking up versions etc? [08:01] sil2100, yeah [08:01] Saviq, and thats fully in sergios hands ... who is on vac iirc [08:01] fun ... [08:02] huhm [08:02] and i think rolling back is also no option ... [08:02] my phablet-test-run is being prevented by apparmor ?! [08:02] oh ? [08:03] balloons mentioned that happened to him too last week iirc [08:03] although that would have ended up in the smoke logs if that was the case [08:03] yeah [08:03] Saviq: have you run "phablet-config autopilot --dbus-probe enable" ? [08:03] popey, ah [08:03] :) [08:03] this shit is CRAZY [08:03] may I remind https://bugs.launchpad.net/ubuntu-ci-services-itself/+bug/1262879 [08:03] Ubuntu bug 1262879 in Ubuntu CI Services "There should only be one, documented, way to run tests on devices" [Undecided,Confirmed] [08:04] heh [08:04] and yeah, phablet-config just hangs... [08:04] https://wiki.ubuntu.com/Touch/Testing is the "canonical" page [08:04] * Saviq reboots [08:04] it takes a while [08:04] patience [08:05] ah probably rebuilds apparmor policies? [08:05] yes [08:05] so worse if you have lots of apps installed [08:05] Saviq: yeah, it can take even a minute sometimes [08:06] well, we usually only test preinstalled apps [08:06] takes more than a minute here [08:06] for these it should take 20-30sec only [08:06] alan@deep-thought:~$ time phablet-config autopilot --dbus-probe enable [08:06] real 1m36.286s [08:06] woah [08:07] but takes less time on subsequent runs [08:07] alan@deep-thought:~$ time phablet-config autopilot --dbus-probe enable [08:07] real 0m4.027s [08:07] yeah [08:07] it is the initial profile creation that takes ages [08:07] security has plans to ship some pre-created ones in the future [08:08] * ogra_ goes to make meeting coffee [08:09] well seeing ToyKeeper's mail it seems the issues are really AP centric ... doesnt look like she found many issues in dogfooding [08:09] (a unity crash though) [08:11] I wonder if the unlock script is used at all in the end... and if it works... [08:11] maybe it's unreliable [08:11] Saviq: you mean like during the app tests? [08:12] Since there it should unlock the screen once I guess, if it would fail then all tests should fail [08:12] sil2100, I know :| [08:12] Mirv: where are you seeing ENOSPC? https://prodstack-nagios.admin.canonical.com/cgi-bin/nagios3/extinfo.cgi?type=1&host=ue-prodstack-ci-train-jenkins-0 suggests we have plenty, so maybe this is in a tmpfs? [08:13] so yeah... of course it's fine locally :| [08:16] well, all tests do fail for the affected apps [08:16] the 4 that you see passed there are systemsettle, setup and teardown [08:17] they always work [08:18] its not "all apps" but if it fails its "all tests" of an app [08:19] sil2100, teds renaming didnt land yet, did it ? [08:19] ogra_: no [08:19] 04:27:02.746 INFO _launcher:116 - Attempting to launch application 'com.ubuntu.calendar_calendar_0.4.296' with URIs '' via upstart-app-launch [08:19] ok [08:19] ogra_: after Mike's landing it required a rebuild [08:19] ogra_: so no one published it afterwards yet - it's not marked as tested even [08:19] because i see this for all failing tests [08:20] RuntimeError: Timed out while waiting for application to launch [08:20] Yeah, I was suspecting this to be the problem as well, but it doesn't seem so [08:20] ... [08:20] right, but the apps dont seem to start properly [08:20] Saviq, another thing i noticed is that your ram usage is quite high with the new greeter [08:21] its stable ... but high [08:21] 200M for unity8 ... another 90 or so for the greeter [08:21] How did it look like before? [08:22] calendar is OK locally ;| [08:22] i think i remember far below 200 for unity8 ... [08:22] 170 or 180 or so [08:22] ogra_, if anything, it should go down in unity8 [08:22] and we didnt have a greeter [08:22] ogra_, can you file a bug please? we'll investigage [08:23] yeah [08:23] investigage... [08:23] nice word === Ursinha-afk is now known as Ursinha [08:23] :) [08:23] Ursinha, go away ! you are on vacation !!! [08:23] lol [08:23] :) [08:23] I'm not here :) [08:24] * ogra_ pretends he hasnt seen anything [08:24] *whistle* [08:24] :P [08:24] ;p === Ursinha is now known as Ursinha-afk [08:25] ev: https://ci-train.ubuntu.com/computer/%28master%29/executors/5/causeOfDeath [08:26] ev: and first it was in this job output before the jobs also started failing to even start: https://ci-train.ubuntu.com/job/landing-010-2-publish/8/console [08:28] clientlogs touch (run.py:2245): WARNING **: Unable to connect to Upstart bus: Cannot autolaunch D-Bus without X11 $DISPLAY [08:28] hmm [08:28] 04:27:01.320 DEBUG __init__:187 - Patched home to fake home directory /home/phablet/autopilot/fakeenv/tmpyt7h1kxo [08:28] error: XDG_RUNTIME_DIR not set in the environment. [08:28] oha ! [08:29] Uhh? [08:29] WTF [08:30] there seem to be more env issues [08:31] dialer = OK [08:31] initctl: Rejected send message, 1 matched rules; type="method_call", sender=":1.22" (uid=32011 pid=2242 comm="/sbin/initctl set-env HOME=/home/phablet/autopilot") interface="com.ubuntu.Upstart0_6" member="SetEnv" error name="(unset)" requested_reply="0" [08:31] rejected ... [08:32] ogra_: meeting [08:32] yeah [08:35] ogra_, sil2100, not sure what to say... I followed the standard testing process and everything's fine over here :| [08:35] Saviq, yeah, as i suspected ... most likely the infra [08:37] 04:27:01.079 WARNING emulators:26 - The ubuntuuitoolkit.emulators module is deprecated. Import the autopilot helpers from the top-level ubuntuuitoolkit module. [08:38] yeah, that's just a deprecation warning, though, should not affect anything [08:38] yeah, i was just mentioning it in the meeting :) === alan_g_ is now known as alan_g [08:38] (abusin IRC for copy/paste) [08:53] popey: I'm checking the bug and our landing.. [08:53] * ogra_ wonders if dbus gets started differently with the new greeter [08:53] not using the upstart job ... [08:57] bzoltan: what's the status of this landign? https://code.launchpad.net/~bzoltan/ubuntu-ui-toolkit/landing_28-05/+merge/221199 [08:57] popey: ^ the fix for terminal-app is included there^. We are currently trying to land it [08:57] kk [08:57] in silo3 bzoltan said earlier? [08:58] bzoltan: ^ the changelog of that landing is not complete, since we merged staging more stuff is in there [08:58] popey: yes, that's the one. trying to land it since last week. [09:00] popey: feel free to try a phablet-config writable-image --ppa ppa:ci-train-ppa-service/landing-003 [09:02] lots of ap test failures today [09:03] t1mp: will do! [09:08] sil2100, oh, are we in traincon until we get proper tests again ? [09:08] i think we shouldnt land anything til thats resolved [09:08] ogra_: for now we can't land anything anyway ;) [09:08] :D [09:08] (jenkins b0rken) [09:08] (well, probably the gallery fix, but i wouldnt go further) [09:08] yep, i know [09:09] but it might come back during the day [09:09] t1mp: what do you miss there? [09:10] brendand, yeah, some issue with the environment in the infrastructure ... and everyone who could help is either traveling, on vacation or otherwise not around [09:12] I wonder if Paul will be around today, or he also got stuck somewhere in transit [09:13] ev: do you know if Paul will be able to pop up today? [09:13] bzoltan: r1087, 1088 of staging [09:13] sil2100: I'm not sure which day he is taking as swap. What do you need him for? [09:14] ev, 150 failing AP tests :) [09:14] seems the environment is messed up and we need someone to help investigating ... tests pass fine locally [09:15] ah, well, i'm lying ... only 120 [09:15] bzoltan: I think only those two are missing [09:17] ev: right, we would need someone with smoketesting infra experience/access to help us figure out what's wrong with the environment in smoketesting [09:17] ev: which is causing many app failures (which are false positives) [09:18] the whole team is meant to have access and understanding. We're constantly fighting against the silo effect. Unfortunately though we are very short staffed today. [09:18] yeah, like almost everyone [09:18] Siva is on swap. Vincent is out sick. I suspect a fair amount of the US contingent will be taking swap, but it's hard to tell without the new HR system :) [09:19] 04:27:01.287 INFO logging:45 - str: Set the value of an initctl environment variable. Arguments ('/home/phablet/autopilot/fakeenv/tmpyt7h1kxo',). Keyword arguments: {}. [09:19] initctl: Rejected send message, 1 matched rules; type="method_call", sender=":1.22" (uid=32011 pid=2242 comm="/sbin/initctl set-env HOME=/home/phablet/autopilot") interface="com.ubuntu.Upstart0_6" member="SetEnv" error name="(unset)" requested_reply="0" destination="com.ubuntu.Upstart" (uid=0 pid=1 comm="/sbin/init") [09:19] error: XDG_RUNTIME_DIR not set in the environment. [09:19] clientlogs touch (run.py:2236): WARNING **: Unable to connect to Upstart bus: Cannot autolaunch D-Bus without X11 $DISPLAY [09:19] thats a summary of th re-occuring errors we see ... usually its these three lines [09:20] it started with the split greeter ... we assume the infra needs something updated for the new setup [09:21] t1mp: I will fix it [09:21] (not sure what though ... and which versions of which tools are installed there) [09:23] ogra_: sil2100: Mirv: is there any news about the UITK landing from the Silo3? [09:23] bzoltan, well, jenkins is dead ... nothing can land [09:23] ogra_: what an excuse :) [09:24] bzoltan, and we have issues with the AP tests for the last two images [09:24] bzoltan: as per description on the spreadsheet, waiting on it to be resolved :) [09:24] so even if jenkins was working we would need to stop the line to get the infra back in shape [09:24] No worries, we'll land as soon as we can! We want to have the infra working and some test doubts solved first [09:25] sil2100: ogra_: ohh.. I missed the yellow cell ... and added a new landing line. Should I delete it? [09:25] no, but you wont get a silo atm [09:25] adding entries is fine, they just wont be processed [09:26] oh, wait [09:26] well, probably better remove it so you get auto-update if you add it the next time [09:27] sil2100, does the "please dont fill new landings" apply to the pending page too ? [09:27] (/me thought we just cant process silos) [09:30] bzoltan: no no, leave it :) We'll just assign it once possible [09:30] ogra_: how long this stop will last? Do I have time to rebuild the landing MRs in the silo? [09:31] sil2100, the text should be more clear ... it sounds like you shouldnt even add to the pending page [09:31] ogra_: you can fill in new landings, let me change the description as it's well... from the moment I didn't know what happened [09:31] yeah [09:31] sil2100: ok we should be more alive now..I'm restaring a few threads [09:32] t1mp: that fixes terminal for me, thanks. [09:32] bzoltan, up to sil2100 what and if he wants to land stuff even after jenkins is back up [09:32] bzoltan, we cant really get test results atm ... thats the second stopper imho, though sil2100 might still want to move ... he's the authority here :) [09:33] Mirv: so, what was the problem in the end? [09:33] ogra_: sil2100: a full rebuild would need an hour [09:34] sil2100: old backups cleaning not working correctly [09:34] bzoltan, well, i think you have time ... it will take a while til we can get someone from the infra team who knows the AP testing infra enough ... [09:36] bzoltan: you can rebuild, it'll give me some time to try and recover from our earlier problems [09:38] (just remember that the SS does not auto-update itself for now) [09:39] hmm, i see a dbus-launch process on my flo ... we never used dbus-launch before [09:40] seems we are running two dbus-daemon processes for the phablet user [09:40] one from the dbus upstart job, the other started via ssh-agent by the greeter [09:41] phablet 1350 0.0 0.0 2700 188 ? Ss Jun01 0:00 /usr/bin/ssh-agent /usr/bin/dbus-launch --exit-with-session ubuntu-touch-session [09:41] phablet 1354 0.0 0.0 3360 604 ? Ss Jun01 0:00 //bin/dbus-daemon --fork --print-pid 4 --print-address 6 --session [09:41] phablet 1450 0.0 0.0 4308 1540 ? Ss Jun01 0:08 dbus-daemon --fork --session --address=unix:abstract=/tmp/dbus-wwyt1Zs6rI [09:42] the first two are spawned by the greeter ... the last one is our normal dbus ... [09:46] popey: great, thanks for testing :) I hope it will land today === vrruiz_ is now known as rvr [09:49] heh, the boot animation is quite tiny on the flo screen [09:49] * ogra_ just enabled it [09:50] * sil2100 sighs [09:51] * sil2100 has to hack through jenkins to get the backend back to some usable state [09:55] sil2100: so the file that got corrupted is causing problems? [09:56] Mirv: yeah, I need to use the temporary jenkins job to at least recover some parts of the config so that I can reassign it once again :) Doing that [09:56] ogra_: could you say 'ack' on another "drop using the transitional package, instead use the real one that has been there since trusty": https://ci-train.ubuntu.com/job/landing-010-2-publish/lastSuccessfulBuild/artifact/packaging_changes_signon-ui_0.16+14.10.20140530-0ubuntu1.diff .. [09:57] Mirv, ackedy ack :) [09:57] ack! :) [09:57] Mirv, we still need to go over the seed one day ... i meant to do that at the sprint with you before i realized you wouldnt be there the same week [09:58] ogra_: indeed. so many renames. [09:59] yeah [09:59] ogra_: I was going to be there on the same week, but I got moved.. [09:59] which probably made sense ... [10:01] ev, hey, do you need guinea pigs for the airline maybe? [10:02] * sil2100 is grateful for the "cyphermox test" jenkins job [10:02] :) [10:03] sil2100, are we any closer to finding the issue in smoke? [10:03] Saviq: absolutely. Shall I get you on the list of people we need to engage with once we have the kinks knocked out of staging? [10:03] ev, please do! [10:03] Saviq, i see two sessuon dbus daemons ... [10:04] ogra_, oh [10:04] ogra_, well, wait [10:04] ogra_, the greeter has one, the session has one [10:04] Saviq: a little bit... but I guess it would be best if we had someone wit haccess here [10:04] ogra_, or are you seeing two on the usser? [10:04] Saviq, http://paste.ubuntu.com/7572007/ [10:05] there is also one running as lightdm ... that should be the greeter owned one [10:05] the ssh-agent one is new [10:05] i'm just re-flashing 60 to get a clean env ... [10:05] (another 15min to download over my slow line) [10:07] ogra_, I don't have ssh-agent here [10:07] does there happen to be a way, currently, that we can duplicate a test run from a jenkins job? [10:07] Saviq, on 59/60 ? [10:07] ogra_, 60, yes [10:07] hmm [10:07] that was 59 above [10:07] oh wait [10:07] FUX [10:07] ps aux|grep dbus|grep session|grep phablet [10:08] greyback, remember what I did in the room on Friday afternoon that we said it's gonna become interesting the next time I try to use it? [10:08] i think thats from lightdm ... i cant find any change in the landing that would make it use dbus-launch [10:08] ogra_, ignore everything I said since this morning... I had 55 flashed all the time :| [10:08] don't ask [10:08] oh my [10:09] Saviq: yep! [10:10] greyback, guess what :P [10:10] Saviq: noooo [10:10] OOoh [10:10] * sil2100 runs some tests on his 59 then [10:12] i think we could easily go with dbus-launch but would need to drop the upstart job in the session *and* make sure that the dbus socket address ends up in the file in ~/.cache/upstart/dbus-session ... thats what the tests rely on [10:13] sil2100, can you check on 009? prod it so it gets into proposed? [10:15] seb128, do you remember of the top of your head where dbus-launch is called from in a lightdm session startup ? ... we end up with http://paste.ubuntu.com/7572049/ after the new greeter landed on the phone ... and somehow the AP tests get confused not finding the right dbus [10:16] mhr3_: hi, the hud one? Let me try :) [10:16] i fail to find where dbus-launch is called [10:16] ogra_, I would say Xsession.d scripts [10:17] oh, i dont even have the dir on the old image ! [10:17] ? [10:18] do you have it on the new one? [10:18] ah, no ... i'm to sleepy still ... its there [10:18] root@ubuntu-phablet:~# grep dbus /etc/X11/Xsession.d/* [10:18] root@ubuntu-phablet:~# [10:18] dbus-x11 ships /etc/X11/Xsession.d/75dbus_dbus-launch [10:18] but no dbus stuff [10:18] but I guess that binary is not installed on touch [10:18] not sure how it's started there then [10:18] seb128, right, that landed together with the new greeter stuff [10:18] http://people.canonical.com/~ogra/touch-image-stats/59.changes [10:19] ok [10:19] so that explains why you get a new one [10:19] in the old world we use an upstart job [10:19] now there are both [10:19] right [10:19] though i wonder why the apps work fine ... they should get confused too [10:20] * ogra_ waits for the flash to finish to try some things [10:20] well, do the apps need to use the session bus? [10:20] AP tests do [10:20] and they get the address from a fil that is pointing to the secondly started dbus [10:20] *file [10:20] i guess the session ises theone dbus-launch started [10:21] *uses [10:21] and the secondly started one is just cruft [10:21] seb128, thanks ! that got me on the right track i think [10:21] yw! [10:22] good luck debugging it [10:22] heh [10:22] well, i'm fine with dropping the upstart job ... but we need to create that file somehow so AP can read it to find the bus [10:23] But hm... [10:24] I'm running clock-app tests here now on my device and so far they seem to look ok (we'll see once they're finished) [10:24] Shouldn't it also make them fail on my device? [10:24] Oh, wait [10:25] hm, I got 5 failures, it's still less than what I should expect [10:25] * ogra_ disables the dbus upstart job [10:25] lets see if the session still comes back [10:26] hmm [10:26] doesnt [10:26] so lets try the other way round [10:27] disabling the Xsession.d script [10:29] yeah [10:29] thats fine [10:30] fun, i still get two dbus-daemon processes ... but they use the same address [10:31] sil2100, mount -o remount,rw / && mv /etc/X11/Xsession.d/75dbus_dbus-launch /home/phablet/ && mount -o remount,ro / && reboot [10:31] sil2100, then run your tests again === pete-woods is now known as pete-woods-away [10:36] hah, ok, running [10:37] not sure what it uses dbus-x11 for ... i think we need mike to tell if it is important [10:38] sil2100: I'll probably mark line 9 as Landed manually, since it didn't pick that up [10:39] Ok :) [10:39] Mirv: thanks! [10:39] bzoltan: did you see the error in silo 003? [10:39] also, that means that the first Qt SRU to trusty finally is available to users <- bzoltan [10:41] sil2100, ogra_, in any case, tests work locally on 60, too [10:41] and whoa new calendar! [10:41] ☻ [10:41] Sans vomit. ☻ [10:41] Saviq, right ... but in the infra i think the tests try to connect to the wrong session dbus [10:41] lol [10:42] Saviq, i'm pretty sure /etc/X11/Xsession.d/75dbus_dbus-launch confuses them [10:42] mhr3_: do you have any better sightings than we do about the hud trusty SRU? it's nowhere to be found. it's not rejected either according to the queues. [10:42] mhm :| [10:42] i'm just not sure how to solve that without dropping the dbus-x11 dep [10:42] I did ask mterry whether it's correct that it pulls all that [10:42] and he said yes, didn't dig more, though [10:43] my session works just fine removing that file [10:43] Here it works fine as well, but tests didn't finish yet [10:44] i also see a session dbus running for lightdm [10:44] (which used dbus-launch before) [10:45] phablet@ubuntu-phablet:~$ ps aux|grep dbus|grep -v upstart|grep session [10:45] lightdm 1193 0.0 0.0 3892 1260 ? Ss 10:29 0:00 //bin/dbus-daemon --fork --print-pid 4 --print-address 6 --session [10:45] phablet 1395 0.1 0.0 4320 1612 ? Ss 10:29 0:01 dbus-daemon --fork --session --address=unix:abstract=/tmp/dbus-vrhmrTD7DQ [10:46] Mirv, how would i know? [10:47] mhr3_: just in case it has been discussed before by eg. sil2100. I think I saw already last week that the line claimed "in no known space or time" for the hud 14.04+14.04.20140528, and it's surely isn't on its way to trusty at the moment [10:48] hmm [10:48] interesting [10:48] Mirv, i rebuilt it since, but no idea what happened to it [10:48] if i put the file back in place i see that the greeter session doesnt use dbus-launch at all [10:48] sil2100: I have seen and I still see... But I do not get it [10:49] Mirv: I rejected hud from trusty unapproved last week because its changelog delta made no sense and was no good for SRU tracking [10:49] I talked to Pete Woods about it [10:49] cjwatson: ok, I thought this "round 2" was already after that, but maybe not [10:49] this was published on Thursday [10:50] Mirv: hm, I don't remember dates, but I don't see it in unapproved, at least [10:51] cjwatson: does that changelog sound to you as not making sense or better: https://launchpad.net/~ci-train-ppa-service/+archive/landing-009/+sourcepub/4202156/+listing-archive-extra ? [10:51] Saviq, sil2100 ... so with dbus-x11 in place it not only starts one by dbus-launch and one via upstart ... it also starts the upstart driven daemons twice ... http://paste.ubuntu.com/7572218/ [10:52] Mirv: looks more plausible though I haven't diffed it against the old one [10:52] Mirv: LP logs suggest that this package was copied from silo 9 to an "sru-staging" PPA [10:52] ogra_, ok, so obviously that's not good, we should get rid of the dbus-x11 dep [10:52] Saviq, right, but i dont know what else this could break [10:52] Mirv: https://launchpad.net/~ubuntu-unity/+archive/sru-staging apparently [10:53] cjwatson: yes, the SRU:s have went through that and then it'd be copied from there to archives [10:53] Saviq, i see no ill effects when using teh system but i suspect some new greeter features i dont know about might be broken then [10:53] Mirv: no sign of any copies after that [10:53] I wonder if that step never really happened [10:53] cjwatson: that's what I thought too [10:53] there must be a reason why dbus-x11 was added as a dep [10:53] maybe didrocks could again find it this time... [10:57] (moved to #ubuntu-touch) [10:58] ogra_: we need mterry to explain himself then... [10:59] sil2100, well, it would most likely only break new greeter features ... not existing ones [11:00] sil2100, so if he is off and doesnt show up today we should remove the dep and he can add it himself later again [11:00] that would prevent us from rolling back the whole ... in case he is off the whole week or some such [11:02] this is to big to easily roll it back ... but we also cant live without working AP tests for multiple days [11:02] (or even a week) [11:03] I wouldn't want to roll it back [11:03] sigh sigh sigh ... and *none* of his changelogs mention *any* of the dependency changes [11:03] Especially that it doesn't cause visible regressions on the phone itself [11:03] geh [11:04] I'm really considering automating this dependency changes [11:04] note that i wont ack any packages anymore where there are dep changes that are not mentioned ... [11:04] I mean, including a forceful changelog entry about deps being changed [11:04] this really makes life to hard [11:04] Right [11:04] * sil2100 adds this to his todo list for today [11:04] sil2100, right, the ci should preferably do that ... but until thats possible people really need to care for tehir shit [11:05] ogra_: I wonder if we would have any means (if we got the right people) to try and you know, forcefully remove the dbus-x11 package from one of the machines and running some failing tests again [11:05] sil2100, first of all we need to find people where it breaks for them at home :p [11:06] seems Saviq cant reproduce the failures at home [11:06] Yeah ;) I can't as well [11:06] The 5 failures I got seem to be unrelated [11:06] right [11:08] and additionally i might even be on the wrong track ... while it is wrong to have multiple session dbuses running that might not cause the infra issue at all (it is very likely but we can only prove it when fiddling with the infra) [11:08] i would like to have at least some proof ... [11:09] * ogra_ hopes plars is not off today ... that would help a lot [11:09] as he can log in to a device, manually remmove the file and re-run [11:14] Right [11:15] We would need at least one person with direct access to some of the machines [11:17] yep [11:17] hmm, so looking at the greeter code mike makes a lot use of gdbus [11:20] o/ line 39 for a new silo request [11:20] aha ... [11:21] /usr/bin/unity8-greeter-wrapper ... line 55 to 58 ... there he needs to use dbus to set some ofnono/pulse stuff ... and for that he uses the session bus [11:21] (which is the wrong session bus anyway i guess) [11:22] ah, no, that talks to the lightdm session bus [11:26] sigh, that landing is so gigantic [11:27] * ogra_ tries to read the unity8 source changes but thats a *lot* [11:34] Yeah... I wonder if it wouldn't just be better to wait for mterry [11:34] But hm, we have no means of checking if he'll be around today [11:34] well [11:34] Robert or Kevin would know [11:34] sil2100, so here is another quick and dirty idea [11:35] since the silos and landing are stuck anyway ... how about i do a dput upload that only drops the dep ... we build an image and see if it fixes it [11:35] that costs 3-4h and we'll know for sure after that [11:35] and is easy to roll back [11:36] sil2100: have you droped mterry a mail? He replied to one of my bugs 4 hours ago. [11:36] would need Saviq to merge my change back and forth i guess ... [11:36] popey: oh, let me try that, he might be in transit now though [11:36] calendar shows him being a patch pilot today. [11:36] ogra_: hmmm... right, but this seems REALLY dirty [11:36] Not sure if it's worth it? [11:37] well, it wastes the least time [11:37] mterry should be around soon [11:37] * ogra_ was just thinking we could do something while no landings can happen anyway [11:37] ah, cool [11:37] like within an hour or two [11:37] ogra_: let's wait a little bit then [11:37] then ignore my hackish idea :) [11:37] Ok, I have to jump now for that lunch [11:38] let me see what were his travel plans [11:38] oh actually [11:38] sil2100: hey, not sure if you saw my request above [11:38] he only *just* flew out of Malta [11:39] dbarth: let me get back to you after lunch [11:39] mterry is here: http://flightaware.com/live/flight/DLH1277/history/20140602/1100Z/LMML/EDDF [11:39] :| [11:39] Might take a bit [11:39] ogra_, back to your idea [11:39] Saviq: *sigh* [11:39] heh [11:40] Ok, ogra_ I leave the decision up to you if you think it's worth it, I would try getting some info on if Paul will be here today [11:40] i could quickly drive to frankfurt and ask him in person :) [11:40] he _will_ have 3h layover in FRA [11:40] Since if Paul would be around, we could do this without any hacks even [11:40] sil2100: ok [11:40] * sil2100 goes now REALLY [11:41] I knew landing this on a Friday evening was not a great idea! [11:41] even if he has a 3h layover expecting him to do any work during travelling is evil [11:41] of course [11:42] I just meant that he might pop in, not that we should rely on that [11:42] Saviq, yeah, thats why i wanted to land on mon/tue ... execting fallout [11:42] (i think i told you in the bar already) [11:42] ogra_, when sil2100 and robru rounded me up at Friday afternoon, it didn't look like they wanted to wait :D [11:43] heh, yeah, my pusyness infected everyone ... sorry for that [11:43] i should have stopped asking for it on thursday [11:43] ogra_, in any case, I can't identify the need for dbus-x11 in that merge [11:43] *pushyness ... not pussyness [11:43] :P [11:43] ;) [11:43] ogra_, so let's just go for it - upload a dbus-x11-- version, I'll merge around [11:43] ok [11:47] sil2100, Mirv, bzoltan tells me that the UITK fix for https://bugs.launchpad.net/ubuntu/+source/ubuntu-ui-toolkit/+bug/1322630 is already in the archives. Am I correct to assume it'll land in the next image (61)? [11:47] Ubuntu bug 1322630 in ubuntu-ui-toolkit (Ubuntu) "Setting i18n.domain breaks translation" [Undecided,Confirmed] [11:48] dpm, if it is not in 60 it wont be in 61 either ... landing is broekn [11:48] we are in TRAINCON-0 [11:48] (see the ML) [11:53] ogra_: sil2100: I'm off today, but I'll be around on and off. I'll get a run going right now on 60 with that. Basically I should just remove dbus-x11 right? [11:53] plars, rm /etc/X11/Xsession.d/75dbus_dbus-launch [11:53] ogra_: ok, will do [11:53] plars, that should be sufficiaent [11:54] removing the package would get you dependency issues i guess [11:55] plars, i think sudoku_app should be a good test to re-run ... it was rock solid before for quite some time and only broke after this landing [11:55] Saviq, i'll hold back the upload for that ^^^ === alan_g is now known as alan_g|lunch [11:55] ogra_: do you want a full rerun or just a few to spot check it? [11:55] since we can get some real data [11:56] ok, thanks ogra_ [11:56] plars, whatever causes theleast work for you [11:56] ogra_, I'll do a run too [11:57] plars, if a full re-run is easier do that ... just one app that was known stable before the split would do too though [11:58] ogra_, sil2100: ok, I have sudoku running on one with that file removed right now [11:58] great [12:02] looking good so far :) [12:03] yay [12:05] ogra_, sil2100: sudoku passed completely [12:05] ok [12:06] i guess that proves the theory [12:07] dpm: sil2100: nope, there's just some confusion, the UITK build is still in the silo [12:09] I'll run a few other tests but looks good [12:10] thanks ! [12:40] ogra_, sil2100: I tried a couple more and it seems good still :) [12:41] ok, i'll upload the dependency change and we can roll a new image [12:41] mterry can then sort out any possible fallout when he is back at work === tedg is now known as ted === ted is now known as tedg [12:54] ogra_, With the dependency change do we drop out of traincon-0 ? [12:54] tedg, if we see the tests pass ... but even then there are jenkins issues with the silos [12:55] Uhg, okay. [12:55] yeah, it came all together :) [12:55] (if the shit hits the fan it pours ... or how they say) [12:56] murphys monday ;) [12:59] Heh, I just want to finally land the UAL name change. [12:59] Tired of blocking other fixes. === alan_g|lunch is now known as alan_g [12:59] tedg: I haven't quite landed click yet for that but it should hopefully be on its way soon; there's an entry in the spreadsheet now [12:59] cjwatson, Why don't you put it in silo 18? [13:00] cjwatson, Then we can land them all at once. It has to be retested anyway. [13:01] I'm guessing that silo will be blocked by traincon though. So that'll have to get resolves. [13:01] resolved [13:03] tedg: have a couple of other things in the same landing, ideally [13:04] tedg: would rather test it independently [13:04] cjwatson, Okay, if you want to test with the ubuntu-app* binaries you can get them in silo 18. === tedg is now known as ted === ted is now known as tedg [13:12] thostr_: landing-015 TESTING DONE. [13:13] now, we would really need that landed even though we are on TRAINCON-0 [13:13] dpm and cwayne are preparing an image for upcoming expo [13:13] and getting that MP in would update the translations for chinese (tested that also) [13:13] the MP's are really small [13:14] so getting them through QA review would be easy [13:14] Wellark, even if we wouldnt be in TARINCON-0 ... jenkins is messed up [13:14] :( [13:14] dpm: ^ [13:14] he knows [13:15] thanks Wellark, it seems we'll need to wait until the infrastructure is back online [13:15] the unity8 fix to lift TRAINCON-0 is already building ... once we have test results we can lift TRAINCON-0 [13:15] Wellark, dpm phablet-config writable-image --ppa ppa:ci-train-ppa-service/landing-018 for the demo images? [13:16] not ideal.. [13:16] (but thats still a few hours) [13:16] * Wellark sees what is in landing-018 [13:17] dpm: but anyway. once landing-015 lands you will have the chinese translations [13:17] I tested them and they at least seem to work :) [13:17] ok, excellent, thanks [13:18] dpm: seems that the pin unlock dialog is not translated though [13:18] but all those strings are coming from unity8 ATM [13:19] + I'm sure you have the sims unlocked anyway at the expo [14:02] Jenkins messed up again? [14:05] sil2100, dunno, was it ever fixed ? [14:06] * ogra_ hanst heard any info on it except that it was broken this morning [14:06] sil2100, but worse, the archive is broken ... unity8 FTBFS due to broken deps of dbus-test-runner on gvfs-backends [14:06] ogra_: Mirv mentioned later that it got fixed, so I updated the header to indicate it being fixed [14:07] oh, ok [14:07] Well, before changing to TRAINCON-0 ;p [14:07] uh [14:07] seems -proposed is briken [14:07] *broken [14:08] the archive isn't broken, ldb/libsmbclient is broken [14:08] Sucks, since I would like this to propagate already! [14:08] just you know to clarify [14:08] i dont really get the relation when looking at the excuses page but accoing to pitti and cjwatson it has to do with libsmbclient [14:08] cjwatson: thanks :) [14:08] well, cant propagate something that doesnt build [14:08] you can see it on http://people.canonical.com/~ubuntu-archive/proposed-migration/update_output.txt by searching for ": ldb" [14:08] this sort of thing is not on excuses [14:09] ah [14:13] You can see the real error by attempting "apt-get install dbus-test-runner gvfs-backends libsmbclient samba-libs" in utopic-proposed [14:13] samba-libs : Depends: libldb1 (< 1:1.1.17~) but 1:1.1.17-1 is to be installed [14:14] => samba merge needed [14:14] :( [14:14] ans zul just mentioned he wont have time to do that soon [14:14] but if you can get a silo working then we can do a unity8 build that way [14:14] *and [14:14] well, according to sil2100 silos are working again [14:14] seems i missed the announcement [14:14] it'll need webops assistance [14:15] Saviq, could you merge and push my diff to unity8 trunk ? [14:15] get them to go to /+edit-dependencies on the relevant PPA and change "Ubuntu dependencies" to "Basic" [14:15] We have 2 silos free, so if needed we can assign [14:15] and VERY IMPORTANT remember to get that switched back to "Proposed" before using the silo for anything else [14:15] sil2100, right, but i suppose we need that merged into the tree first === oSoMoN_ is now known as oSoMoN [14:16] or should i just dput ? [14:16] ogra_: oh, why? Can't we propose a MR, assign a silo with it and build? [14:16] ogra_: since it's unity8, right? [14:16] the vanguard in #webops should be able to sort you out with that [14:16] sil2100, well, there sits a source package in proposed now [14:16] Ah, k, right [14:16] you'll have to make it be a newer version than the one currently in -proposed, I expect [14:17] but -0ubuntu3 would do, dput to a silo [14:17] right [14:17] no change rebuild ... [14:17] ogra_: let me create a silo with unity8 as a source package then [14:17] well, maybe you could do a source copy from the primary archive, and copy binaries back, but not 100% sure that would work [14:17] sil2100, yeah [14:17] ogra_, sil2100, so I'm not doing anything in trunk yet, right? [14:17] as I say you should just need to get the silo reconfigured by a webop first [14:18] Saviq, right, lets do itt dput all the way [14:18] +1 [14:18] or actually, if you're in the team that owns the silo you can do it yourself [14:18] Saviq, and you merge back once we are successfull [14:18] https://launchpad.net/~ci-train-ppa-service/+archive/landing-NNN and there's an "Edit dependencies" link in the top right [14:18] hi, I have a webbrowser-app branch that has debian packaging changes, I’d welcome a review of those particular changes if a qualified ubuntu developer could take a look: https://code.launchpad.net/~osomon/webbrowser-app/official-api/+merge/221436 [14:18] cjwatson: oh, let me check after assignment if I can do it then [14:18] sil2100: Yeah, you should be able to [14:19] sil2100: Like I say, just make sure it's reverted before reusing the silo [14:19] oSoMoN: hi! Will try taking a peak in a moment [14:19] cjwatson: right, will write it down as a 'must do' somewhere [14:19] sil2100, excellent, thanks! [14:20] cjwatson: switching to 'Basic' then [14:20] ++ [14:20] yep [14:20] sil2100: May we release the SIlo8, as it is only a desktop package [14:20] i'm ready once you blow the horn :) [14:20] bzoltan: sure, on it! [14:20] Just trying to finish everythig else [14:21] ogra_: so, https://launchpad.net/~ci-train-ppa-service/+archive/landing-019 should only have Basic deps [14:21] ogra_: you can try dputting there [14:21] on its way :) [14:21] (takes a bit over 2Mbit) [14:22] unity8 grew quite a lot since i touched the package last [14:22] (which was admittedly quite a while ago) [14:23] ogra_: can I have a packaging +1 from you? Custom make check for testing, seems ok: https://ci-train.ubuntu.com/job/landing-008-2-publish/lastSuccessfulBuild/artifact/packaging_changes_qtcreator-plugin-ubuntu_3.0.1+14.10.20140602-0ubuntu1.diff [14:25] sil2100, hmm, not mentioned in the changelog ... but ack for now [14:26] asac: so, it might be a bit hard with the TRAINCON-0 situation, since I see that Omer is not here, same for Julien [14:26] we really need to train people more that they mention their packaging changes in the changelogs ... we will never be able to find such stuff in a year in case we need to [14:26] asac: (since he's on his way back home it seems) [14:26] sil2100: well, today is fine [14:26] sil2100: just dont land things that are not fixing the issues [14:26] ogra_: yeah, I guess the changelog entry about 'unittests' is more or less covering it [14:26] today most are on swap or something, so we just dont land stuff [14:26] ogra_: could be more explicit I guess [14:27] asac: right, not a big deal as we have a fix for the issue [14:27] sil2100, yeah, since it only talks about adb and lsb-release [14:27] Since ogra_'s suspicion seemed to be the right one :) [14:27] sil2100: TRAINCON-0 has the QA availability explicitely designed to be restricting landing capacity [14:27] if they are not available it means landing capacity is even more reduced :) [14:27] asac: ;) [14:27] guess just the fix for this issue can land [14:27] and tomorrow we can see [14:27] if selen comes on we can check [14:27] asac, we need a unity8 build and an image build/test to prove it ... then we can resume normal operation [14:28] maybe she can test 1 or 2 other silos that folks think are good and impotrtant [14:28] ogra_: sure, but that is part of the fix for the regression [14:28] no? [14:28] yes [14:28] if so it can land, but we should try to get extra testing on it [14:28] at best selene [14:28] but a regression that only affects the infra [14:28] if not someone of us should take it and test the hell locally [14:28] ogra_: doesnt matter, we are blind [14:28] she wont be able to test anything [14:28] she can test that nothing regressed further [14:29] e.g. zero test failures locally [14:29] the only thing that could (and did) help was plars trying the fix on the infra directly [14:29] and then we can land this and see if infra recovers [14:29] sure [14:29] so try land the fix, wait for plars [14:29] asac, that will just waste time, we have a plan already ... selene can test the imge we need for testing the infra fix [14:29] but ensure that we dont regress locally [14:30] ogra_: she can also test the landing silo [14:30] but if its just the fix landing, then we can also it after [14:30] especially if the landing can be backed out [14:30] pushing another block in that keeps us from producing an image with the fix will just delay everything for no good reason [14:30] if it creates further destructivty [14:30] well [14:30] not sure who is the lander [14:30] that guy should triple test the APs [14:30] until we have someone like plars we cannot test in infra anyway [14:31] asac, i'm the lander [14:31] as we have to resurrect that [14:31] well, then you should run all APs [14:31] that might get affected [14:31] as usualy [14:31] go through the landing plan etc. [14:31] dude [14:31] and if we are scared [14:31] we can double test [14:31] we wont be done before wed. if you follow that plan [14:31] there is a process [14:31] of landing [14:31] we have hadd plenty of testers already [14:31] we shouldnt skip that process [14:31] of the build you made? you ran through the testplan? [14:32] verified in the lab that the issue is fixed [14:32] there is no build yet [14:32] well, do a package build [14:32] it took half the day to even get to this point [14:32] ensure that that thing doesnt regress the image [14:32] it just started [14:32] if the component touched is unity8 [14:32] https://wiki.ubuntu.com/Process/Merges/TestPlan/unity8 [14:32] thats the plan [14:32] i cant do a package build because the archive is screwed [14:32] if its an isolated fix for the regression you dont need QA sign off [14:32] during TRAINCON-0 [14:33] ogra_: so we have to wait till archive is fixed anyway, no? === alan_g is now known as alan_g|tea [14:33] no, the archive is not screwed [14:33] * ogra_ has the feeling asac doesnt understand the coomplexity [14:33] you are right, i dont know what the landing is about [14:33] one important package is broken and gets in the way, but we have a workaround permitting a package build [14:33] maybe elaborate [14:33] please stop saying the archive is screwed :) [14:33] well, for me it is :P [14:33] points in the wrong direction [14:33] so whats the 10k summary of the situation?\ [14:33] asac, there is a wrong dependency in the split greeter landing [14:34] all i knwo is that unity8 got broken ... and that last week we had systemd related issues in archive [14:34] dropping that makes everything work as expected [14:34] nothing to do with systemd [14:34] ogra_: so unity8 has to land with a new dependency? [14:34] asac, the prob is that a build dep is broken in proposed so we need to sneak around the issue to not FTBFS [14:34] asac, no, with the old dep model it used before [14:35] well [14:35] in fact the new package unity8-greeter has to drop an X11 dep [14:35] the test has been verified on all sides [14:35] asac: yeah, so once we get unity8 released, we can kick a new image and get stable test results [14:35] ok, i leave it to cjwatson and you to land the dependency fixes [14:35] right [14:35] the point is that we can only verify it against the leb [14:35] *lab [14:35] just dont start other landings until we have seen that the stable image is stable in infra too [14:36] or if that doesnt work, apply traincon-0 rules for other landings going forward [14:36] asac: right, no worries [14:36] having some QA guy install the package locally wont reveal a thing [14:36] That's why I'm actually waiting [14:36] until we have the infra ready :) [14:36] we need an image that runs through the full lab testing [14:36] right [14:36] sure [14:36] then do that [14:36] I'll work in the meantime on the changelog thing [14:36] and other landings are not happening unless QA is there :) [14:36] the future setup will give us exactly whet we need [14:36] and we can apply TC0 [14:37] so the current issue is that we wait for plars? [14:37] no [14:37] ok, but would be good if we get the devices resurrected today still, right? [14:37] plars, actually jumped in today (even though he is on vac.) and helped us to verify the fix works [14:37] ok cool [14:37] now we just need an image with the fix [14:38] the rest will be automatic [14:38] plars: just take the swap day later this week then. [14:38] plars: even if you dont work fully [14:38] swap day for interrupted swap day [14:38] ogra_: ok, so we are just waiting for the image? [14:38] :) [14:38] right [14:38] not sure what the panic mode is about then [14:38] well, first for the package build [14:38] sounds all going well [14:38] hehe [14:38] Do I need to test something else? I can be around for whatever's needed to get this going [14:38] * ogra_ slaps asac [14:38] plars: guess later some hand holding ones we have the image and want to see it going through infrA [14:39] plars: but definitely go off for a while :) [14:39] hmm, I think the samba build failure may be as simple as a missing build-dep [14:39] asac: thanks, but not necessary. It didn't take that long [14:39] plars: your call. for me it would be valid to take another day or at least half due to heroic actions [14:39] * asac stops distracting folks [14:40] asac, its all fine ... stop stirring up :P [14:40] So far the build is going well, I see i386 and amd64 finished already === alan_g|tea is now known as alan_g [14:40] sil2100, yay [14:40] It's not a big deal. I had already planned to at least keep an eye out for results today [14:40] asac, come to the landing meeting if you want details [14:40] we'll give you a summary ;) [14:40] well, sil was concerneda bout lack of QA presence... so answer to that is: no big deal, landings dont continue unless we either have working infra or QA shows up to double check [14:40] L( [14:40] ogra_: thanks! [14:41] :) [14:42] Righto ;) [15:06] sil2100, hmm seems the silo has build all needed bits [15:06] ogra_: you want to use silo publishing? Or copy it yourself? [15:06] :) [15:06] lets use publishing [15:06] ogra_: since we can run the 'watch only' build and then press publish [15:06] Let me do that then [15:07] ah, i missed the watch-only part [15:07] sorry, could have done that while waiting [15:07] sil2100: I won't be around for the landing call, feel free to ping me after if there's some testing needed [15:07] Yeah, well, no problem as it will finish almost instantly now [15:08] popey, well, dogfooding 61 would be nice (once thats built) [15:08] ogra_: published [15:08] popey: ok, sure :) [15:08] great ... i'll kick an image as soon as it migrated [15:08] popey: we'll drop you an e-mail if anything [15:08] ogra_: thanks! [15:09] fire it at the list, I'll see it [15:23] sil2100: CI-SNCF claims unity-notifications is not part of any silo, but it's in landing-015 [15:23] Wellark: let me take a look [15:24] hm, right [15:24] sil2100: and same for indicator-network === pete-woods-away is now known as pete-woods [15:37] Damn, Didier's code is sometimes a bit complicated [15:53] i might be 5min late to the meeting ... some real life issues ... [15:53] unity8 is still in proposed ... [15:54] waiting for the next publisher i guess [15:55] Ok [15:55] I'm trying to add that auto-dependency changelog mention [15:56] In principle it should be easy, but in the end it's a bit hard! [15:56] does anyone know if the VPN configuration for Jenkins has changed? I can't connect anymore. Was working fine on Friday [15:58] bfiller: did you try reconnecting? I remember once I had a similar issue which resolved itself after a reconnect (but that might have been temporary bogus) [15:59] sil2100: I've tried multiple times and restarted network-manager as well [15:59] Ok, then unrelated [15:59] bfiller: I guess pinging cihelp might help, but not sure if there's anyone available as for today [16:00] sil2100: ok, can you connect? [16:00] bfiller: q-jenkins seems to work fine for me [16:01] s-jenkins as well [16:02] bfiller, you don't happen to have two VPN connections open do you? I have seen something similar when trying to establish a second VPN connection. [16:02] It works with the first connection but not so much with a second connection. [16:03] sil2100, retoaded: finally connected after 10 or so tries :) I did not have any other connections open [16:03] bfiller: phew, good to hear that! [16:03] bfiller, ack. was just throwing that out there as a possibility. glad to hear it's working now. [16:07] retoaded: fwiw, I just had to restart openvpn in order to access.. [16:07] cjohnston, ack. [16:07] ogra_: let's skip today's meeting, as no one seems to be around - robru is still in transit, plars is awayish etc. [16:08] (no one else connected after 7 minutes) [16:08] I'll still stick-around until we get the image unblocked, and besides we also basically don't have any US support today [16:08] sil2100, ok ... i'll just kick the image once unity migrated [16:08] So I'll try extending my stay a bit [16:08] ogra_: excellent, I'm watching rmadison as well :) [16:09] (and i'm alone in the meeting ... had just connected when you pinged) [16:09] Yeah ;) [16:09] I've been alone there for like 7 minutes [16:10] Felt really sad and lonely [16:10] heh, yeah, lots of tumbleweed [16:20] there we go [16:20] build triggered [16:27] ogra_: \o/ [16:29] just added a click landing to the spreadsheet, would be great if we could get a silo (so we can get it built and tested, landing would have to wait until things are resolved) [16:30] === trainguard: IMAGE 61 building (started: 20140602 16:30) === [16:48] bug 1325649 anyone else getting that? [16:48] bug 1325649 in indicator-messages (Ubuntu) "Notification displays phone number instead of a name" [Undecided,Confirmed] https://launchpad.net/bugs/1325649 [17:01] sil2100: still around for that line 39 silo? [17:01] dbarth: righto! I guess it's safe now [17:01] Assigning in a moment [17:01] ah cool [17:01] sil2100: thanks sir! [17:05] dbarth: it seems assigned o/ [17:07] cjwatson: how does the ldb/libsmbclient situation look like right now? Since I see it's still causing problems [17:09] ok, building now [17:14] can someone help me figure out why my HUD silo packages are "in no known space and time"? :) [17:14] https://ci-train.ubuntu.com/job/check-publication-migration/17381/console [17:14] (silo #9) [17:18] did they assign you the multidimensional silo ? :) [17:19] I guess I got the twilight zone silo :) [17:19] hehe [17:20] are you sure your package actually built ? [17:20] pretty sure, yeah [17:20] https://launchpad.net/~ci-train-ppa-service/+archive/landing-009/ === alan_g is now known as alan_g|EOD [17:23] sil2100, i have a weird job failure in jenkins - can you have a look? [17:23] brendand: which jenkins and what kind of failure? :) [17:24] sil2100, https://jenkins.qa.ubuntu.com/job/generic-deb-autopilot-runner-mako/1026/console [17:25] Saviq: i have a unity8 crash... "Your computer does not have enough free memory to automatically analyze the problem and send a report to the developers" - what can I do? [17:25] brendand: I think I can't help out here, you would need someone from CI I guess [17:25] brendand: try poking cihelp [17:26] sil2100, cihelp doesn't seem to be in the channel [17:28] brendand: when you say cihelp anyone in the CI team on the channel will get a ping [17:28] So if there's no vanguard, cihelp is the way to ping [17:28] :) [17:28] * sil2100 jumps out to the apothecary [17:29] but you said cihelp plenty of times [17:29] that will have pinged cihelp a lot already :P [17:32] ans this cihelp person will take a look at it but makes no guarantees :-) [17:43] rsalveti: hi, I was trying to build telepathy-ofono in landing-002, but it failed with a dbus-test-runner dependency fail, do you think that could be a temporary issue and thus I should try a rebuild? [17:50] :) [18:00] boiko, a lot failed on that today [18:00] boiko, foundations seems to be working on a fix ... [18:01] Right, it still seems to be an issue [18:02] well, the proper fix would be to merge samba [18:02] but seems the server team doesnt have time for that yet [18:04] Ok, I go do some house cleaning in the meantime, hope the image will be done soon :) [18:04] well, i havent gotten a build failure mail [18:05] so i suspect its still building fine :) [18:24] uh, init crash [18:26] geez, dons say "crash" now you scared imgbot [18:26] hah [18:27] with a few apps open, basically the phone became completly unstable, unity crashed, then init, mediascanner.. [18:27] well, might be related to bug 1325580 [18:27] bug 1325580 in unity8 (Ubuntu) "after split greeter landing unity8 and the greeter consume a lot more memory" [Undecided,New] https://launchpad.net/bugs/1325580 [18:27] could be === tedg is now known as ted [18:29] phone is red hot [18:42] sil2100, there seems to be an issue with the image builder ... might take a bit longer til we get an image [18:42] ogra_: thanks [19:07] ogra_: thanks... [19:23] sil2100, new build running [19:23] ogra_: ah, so we had to start from scratch? [19:23] * ogra_ is surprised imgbot copes with that ... i dont think i have added any logic for that [19:24] sil2100, the builder was hung tonight and left a stale lockfile around [19:24] so the builds only got queued but never processed [19:25] you can sadly only see that if you dig deep into its guts ... which i only started when i noticed that it hadnt processed for a while ... [19:25] ugh [19:25] (well, in fact infinity dug ... i just moaned :P ) [19:25] Thanks! :) [19:25] Ah that infinity..! [19:25] :) [19:26] if i ever talk about "murphys monday" on a monday morning, please kill me [19:26] this has certainly become true ... [19:26] what could go wrong went wrong :P [19:27] Murphys Monday and Fridays [19:27] Murphys weeks! [19:28] heh === ted is now known as tedg [20:34] imgbot, how is 61 coming [20:34] haha [20:34] pmcgowan, should be there soon [20:34] it worked! [20:34] ;) [20:34] imgbot, stunt [20:34] * imgbot rolls on its back and purrs [20:34] lol [20:34] thats the only command it knows :) [20:35] (to check if its alive... beyond that its a dumb shellscript ... well a few) [20:36] after that disaster day and *all* infrastructure steps (from silos, to package builds to image builds) failing for that one fix i'm not watching it closely til it is done though [20:36] s/not/now/ [20:36] brilliant typo :P [20:44] === trainguard: IMAGE 61 DONE (finished: 20140602 20:45) === [20:44] === changelog: http://people.canonical.com/~ogra/touch-image-stats/61.changes === [20:44] \o/ [20:45] * ogra_ falls dead after 12h of handholding that sh*t [20:57] * popey notes #61 is a bit broken in the welcome screen. bug 1325738 [20:57] bug 1325738 in unity8 (Ubuntu) "indicators don't show on #61 mako" [Undecided,New] https://launchpad.net/bugs/1325738 [20:59] thats weird [20:59] i have them here with dbus-x11 removed [20:59] (on flo though) [21:00] ah, try nexus 4 [21:00] popey, sigh [21:00] i see telephony-service-indicator crashes [21:00] oh man [21:01] so even though we might get working AP results now we will likely have to revert [21:01] :((( [21:02] this is depressing [21:02] especially after investing so much time [21:03] popey, same here, telephony-service-indicator and indictor-network-service crashes [21:04] yes [21:04] filing bug now [21:04] bug 1325740 [21:04] bug 1325740 in telephony-service (Ubuntu) "Telephony service crash on #61 mako" [Undecided,New] https://launchpad.net/bugs/1325740 [21:07] * ogra_ waits for the OTA on flo to finish [21:08] i definitely didnt have any indicator issues with 60 [21:08] me either [21:08] when removing the dbus-x11 activation [21:08] 61 has the same issue [21:08] sorry, flo 61 has the same issue [21:08] and manta [21:09] could you try reverting urfkill ? [21:09] got a deb I can use? [21:09] https://launchpad.net/ubuntu/+source/urfkill/0.5.0+20140512.223520.8d05071-0ubuntu1/+build/6006821 [21:09] ok [21:10] yeah, flo has it here too [21:10] do i need all 4 files? [21:10] guess i dont need the -dev [21:11] nvm, done [21:11] * popey reboots [21:12] only urfkill [21:12] sigh [21:12] nope [21:12] nope, that didnt fix it [21:14] SIGH [21:14] istalling dbus-x11 does though [21:14] ok... so that's why ;| [21:15] phablet@ubuntu-phablet:~$ ps ax|grep -c dbus [21:15] 12 [21:15] GRRR [21:15] (well, a lot false positives) [21:15] phablet@ubuntu-phablet:~$ ps ax|grep -c dbus-daemon [21:15] 7 [21:15] Saviq, i guess we need to roll back tomorrow then :( [21:16] i dont get why the heck removing the dbus starting helped then [21:17] /usr/bin/dbus-launch and /etc/X11/Xsession.d/75dbus_dbus-launch are the only relevant files dbus-x11 shiips [21:17] ogra_, well, there's a bunch of deps that installing dbus-x11 brings isn't there? [21:17] http://people.canonical.com/~ogra/touch-image-stats/61.changes [21:17] only dbus-x11 was dropped [21:18] the only explanation i have that mterry somehow abuses dbus-launch to start the indicators [21:18] ogra_, hmm that's weird http://people.canonical.com/~ogra/touch-image-stats/59.changes [21:18] * ogra_ removes /etc/X11/Xsession.d/75dbus_dbus-launch [21:19] ogra_, leave it, I'll dig a bit, and if nothing comes up, we'll roll back first thing tomorrow (if only we had a big "roll back" button somewhere) [21:20] yeah, that might take another two days :( [21:20] Saviq, so i definutely have the indicators when removing /etc/X11/Xsession.d/75dbus_dbus-launch [21:20] ogra_, so it might be part of dbus-x11 is good, but the second part isn't? [21:20] that points definitely to some code that abuses dbus-launch for the indicator start [21:21] ogra_, yeah, I'll be looking through the MPs now [21:21] ogra_, I dont have that file here? [21:21] well, dbus-x11 is for starting x11 sessions with dbus attached [21:21] pmcgowan, no, beacuse this image build was solely to remove it [21:21] pmcgowan, since it breaks the world ... [21:22] pmcgowan, but it seems the other relevant file from that package is in use [21:22] I see. will wait for the fix then [21:22] " /usr/bin/dbus-launch and /etc/X11/Xsession.d/75dbus_dbus-launch are the only relevant files dbus-x11 shiips" [21:22] * ogra_ doesnt belive there is a fix ... unless someone implements dbus-launch standalone [21:23] the only thing I'd like to know is how no-one experienced those issues before... :( [21:23] Saviq, there must be code using dbus-launch [21:23] in the new greeter [21:24] in one of the gazillion packages that landing consiste of [21:24] *consisted [21:24] ogra_, only mention I could find so far https://code.launchpad.net/~mterry/unity8/split/+merge/213149 - in a test :| [21:25] right, i was digging this morning and couldnt find anything either [21:25] 54 +emits indicator-services-start [21:25] that's how indicators are started [21:25] http://paste.ubuntu.com/7575846/ [21:25] i dont see any other relevant file except these two [21:28] Saviq, hmm, did that actually get emitted ? [21:29] and did unity8-greeter-init actually get executed (before the actual session started) [21:31] ogra_, start on unity8-greeter-started [21:31] i would guess "unity8-greeter-started" never gets emitted [21:31] if (!QProcess::startDetached("/sbin/initctl emit --no-wait unity8-greeter-started")) { [21:33] does it reach that point ? [21:34] yeah, it's just in main() [21:34] * ogra_ wonders how to even acess the lightdm init env [21:35] ogra_, /proc/foo/environ [21:36] ogra_, on unity8-greeter [21:36] well, i want to get initctl output ... [21:36] yeah, get UPSTART_SESSION from there [21:36] ogra_, also, /var/lib/lightdm/ is persistent now - is home of the greeter (for upstart logs etc.) [21:36] yeah [21:37] ogra_, but yeah, there's just no dbus in the greeter session [21:38] ps axu |grep dbus-daemon|grep lightdm [21:38] i see one [21:38] properly started [21:38] but !! [21:38] gdbus may use dbus-launch [21:39] so the calls in the script might not work [21:39] yeah, I was thinking this might be a dbus auto-triggered activation or so [21:40] yeah ... [21:40] so we would need to split dbus-x11 into dbus-launch and a package that only contains the Xsession.d file [21:41] ogra_, or well, not rely on Xsession to launch dbus for us... [21:41] which would be a) super silly and b) cause a lot of other work to make sure X11 sessions dont break [21:41] we cant ... [21:41] ogra_, the greeter wrapper already manually starts upstart... [21:41] we can't? [21:41] /etc/X11/Xsession.d/ scripts will be processed if they exist [21:42] right, but if we only need them for the greeter session to have dbus (which seems to be the case now) [21:42] if we start dbus ourselves in the wrapper script, why can't we do that? [21:42] they will be processed by *any* non system upstart session [21:43] still don't get it [21:43] unity8-greeter-wrapper [21:43] the prob is not to get dbus up ... [21:43] Hi, is it just me that cannot change the volume while the screen is locked on #61? [21:43] it starts fine as long as dbus-launch is there [21:43] ahayzen, no. it is broken [21:43] ahayzen, there's all kinds of issues with images 58+, it's not recommended to use (or report bugs against, for that matter) [21:44] Saviq, our prob is that Xsession.d processing starts a second dbus [21:44] ogra_, Saviq, ah thanks just wanted to check it was an known issue, i'll check it has a bug [21:44] ogra_, yes, let's remove x11-dbus, as we did [21:44] ogra_, and then start dbus manually in the greeter session (so Xsession.d processing isn't involved) [21:44] Saviq, splitting the dbus-x11 package into dbus-launch and the Xsession script in separate packages would be the solution [21:45] and make dbus-x11 depend on dbus-launch [21:45] ogra_, ok, I punt, you obviously know better about this [21:45] then make the greeter depend on dbus-launch [21:45] the greeter works fine with only the dbus-launch binary [21:46] kgunn, yeah, we're analyzing here [21:46] (re: dbus-x11 dep)_ [21:48] ogra_, ok, shall I start preparing rollback packages? I assume we don't want to try and do that split right now, but instead prepare for it and do another round of testing to land the split again? [21:49] camako: ^ [21:49] Saviq, yeah, i fear we have to ... even though it looks like the AP tests are all fine now [21:50] or at least the ones that have run yet [21:50] (gallery breakage is unrelated, the fix is stuck due to traincon) [21:50] AlbertA, thanks [21:51] ogra_, ok, I'm doing that, there's just too much time wasted on this already [21:52] ogra_, I'll go through the MPs and prep reverts and put them in a sile [21:52] yeah [21:52] silo [21:52] ok, sil can process that tomorrow, i'll explain to him in the meeting [21:52] since I don't have dput into silos anyway, and that'll be cleaner than to dput anyway [21:52] -anyway [21:55] Saviq, the issue will be that proposed is wonky ... [21:55] same thing we had with the dep dropping today [21:56] the workaround of not building against proposed worked for one package ... not sure if thats a clever idea for a whole silo [21:56] (filled with multiple packages) [21:57] did the silo you used earlier get reconfigured back to normal? [21:58] ogra_, well, at least the rollback will be ready for when that's fixed? [21:58] not sure, sil2100 did handle that side of things [21:59] Saviq, true [21:59] you can look in "Edit dependencies" from the PPA's page on LP [21:59] i still wonder if we shouldnt just split dbus-x11 [21:59] it should have been set back to "Proposed" [21:59] its ugly to split for a single file [21:59] but it seems to be the most appropriate fix [21:59] and we might end up with it anyway [22:00] cjwatson, points to default [22:00] better set it back to Proposed [22:00] doing now [22:00] otherwise it'll confuse somebody later [22:01] done [22:01] thanks [22:07] man this is depressing [22:07] http://ci.ubuntu.com/smokeng/utopic/touch/mako/61:20140602.3:20140530/8360/ [22:08] :( ... all formerly broken tests pass [22:19] I think I have a workaround for samba - uploading shortly [22:26] ogra_, ok, this is silly... like 90% of these MPs can safely live without the split greeter in unity8... I'd want to be thorough and actually revert all of them, but that will only piss people off more to have to land the changes again... [22:26] yeah, its an awful mess [22:27] all that should've landed by itself :| [22:27] * Saviq hits head with hammer, deserves it [22:27] * ogra_ sends a mail [22:27] hopefully https://launchpad.net/ubuntu/+source/samba/2:4.1.6+dfsg-1ubuntu6 will help [22:27] whee ! [22:27] just saw it on -changes [22:28] (hidden in the haskell spam :) ) [22:28] I blame Clint [22:29] for the limit or for haskell ? [22:29] :) [22:29] the latter [22:30] ogra_, let's do: I'll prepare all the reverts, but if the respective owners reject them by the time of the landing, we pull them out? [22:31] well ... can we be *sure* pulling them out wont break anything [22:31] or well... I can do the work to reinstate the changes for a separate landing in any case [22:31] ogra_, yeah, I know what you mean [22:31] ok, reverting all [22:31] i think we are in a messed up enough situation to consider moving forward [22:32] you mean with the split? [22:32] and fixing the bugs while doing the dbus-x11 split [22:32] in a joined effort [22:32] sure, I'd like that, too, is definitely better use of time, but who's to make the call [22:33] dunno, speak up on the ML :) [22:34] if all parties could agree we can do that ... but i would want bfiller and kgunn to at leas comment to the plan [22:35] *least [22:35] after all bills team seem to have the most bugs with it [22:35] indeed [22:36] (and he sounded really grumpy in his mail ... not actually bill-like) [22:36] had perfect reason, too [22:37] indeed [22:37] I only wonder how we did not see these when testing [22:37] I really pounded at calls and messages at some point [22:37] something must've moved below our feet, or we're just lame QA [22:38] well, with what image did you test ? [22:38] 55 ? [22:38] http://people.canonical.com/~ogra/touch-image-stats/57.changes had many telephony related changes [22:39] not as extensive, since nothing changed )we thought) in between [22:39] 58 had the greeter ... but was missing unity8 [22:40] so yeah, I dropped the ball, did the most extensive testing beginning of the first Malta week [22:40] 59 then had unity8 [22:40] wow [22:40] and then we were just pounding out issues in greeter itself [22:40] you worked on that the first week already ? [22:41] yeah, that's when we started to want to land it, timezone split didn't really help [22:42] Saviq, right, i had discussed with mike before and had planned to help with the fallout after we landed on monday [22:42] ogra_, yeah, I know [22:43] i really feel bad that i was pushing it til the end of the week (though i was surprised when rob and sil wanted to land it on friday ... i should have spoken up) [22:44] ogra_, every one of us could have done something better [22:44] yeah, perhaps [22:44] that didn't sound right [22:45] but kinda true [22:45] definitely ... still i was kind of on top of that trying to keep the overview [22:47] and in that role i should have raised my hand in the landing team meeting on friday evening ... but i was so happy to finally get it in that i didnt ... it simply took so long [22:47] ogra_, yup, it tricked all of us [22:48] i dont belive you did bad QA ... not with that investment of time [22:49] it was just an elephant-ass of an architectural change [22:50] if anywhere - stuff like this will kick us in exactly those situations [22:50] and truth be told, we need to allow ourselves that [22:50] IMO [22:50] that's why we have image promotion as a fail safe [22:51] right [22:52] I quite agree [22:53] Nothing must ever go wrong => no velocity - there's a sensible middle ground to be had there [22:53] right [22:54] dear samba builds, please beat the publisher [22:55] in any case #61 is back down to only 22 failures [22:55] (of which 19 are gallery for which we have a held back landing) [22:56] which would support the "let's only pull back real split greeter out" [22:56] UGH [22:56] and "split dbus-x11", too [22:56] otoh ... flo has tons of new failures [22:56] including all UITK tests [22:56] that makes no sense ! [22:56] :| [22:57] must be an infra issue ... [22:57] manta and mako are back to normal seemingly [22:57] ogra_, message is the same as with the mako failures from 59/60 [22:57] failed to start app [22:58] yeah [22:58] * ogra_ checks if flo actually flashed 61 [22:59] hmm, looks like [22:59] that really makes no sense ... why would one arch behave so much different [23:02] hmm, seems not all makos ran their tests [23:02] (but the relevant ones all passed) [23:03] ogra_: can you delete your u1 account (I can't) [23:03] dunno, havent added it yet [23:04] ugh [23:04] my flo is pretty stuck [23:05] well, not stuck but a slideshow [23:05] no obvious processes consuming CPU [23:06] * popey files bug [23:06] * ogra_ reboots flo [23:07] #61 is quite broken [23:07] can't install apps either [23:07] guessing this is all dbus related [23:07] sigh [23:07] whaaaa? I tested flo, too, even ran ap tests on it ;( [23:08] aha¬ [23:08] Your home partition has less than 0.0 MB of free space available, which leads to problems using applications and installing updates. Please free some space. [23:08] could be that! [23:08] ok, I think ldb/samba will fail to migrate due to a gvfs autopkgtest regression, but that shouldn't actually matter - things that need it will be buildable in -proposed again after this publisher run [23:09] and as far as the phone was concerned it was mostly being used as a build tool so that shouldn't have knock-on effects on migration of other builds [23:09] ricmm: ^- [23:09] what's happening with the landing in silo 3? [23:10] t1mp, TRAINCON-0 [23:10] ok, thanks === ogra_ changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | Vanguard: cihelp - sprinting this week, slow to respond | CI Train support - US: robru, rsalveti - EU: sil2100, Mirv | CITrain support no answer: use mup bot after 30 minutes, but choose right timezone | Known issues: TRAINCON-0 [23:11] popey, wow, we have such a message ? [23:12] popey, adding/removing U1 account works fine ... and i just installed Here Maps [23:12] so yeah, could be that :) [23:18] ogra_: when i tried filing a bug [23:23] yes ? [23:23] yay! deleted some files [23:23] now I can remove my u1 account [23:24] good [23:24] here maps is pretty cool [23:25] apart from the fact that it misspells my hometown [23:28] hehe [23:28] file a bug [23:28] funny, seems all other germany cisties are correct [23:29] *cities [23:29] this town was called Cassel abut 1100 years ago ... but since then it has always been called Kassel ... [23:29] they probably just looked at an old map :P [23:33] ☻ [23:35] there's a guy on fb who posts loads of old pics from our local town [23:35] https://www.facebook.com/photo.php?fbid=583639105067396&set=gm.10152192444665963&type=1&theater [23:35] ye olde map [23:35] 1611 [23:35] fences ! [23:36] ye olde fences! [23:39] :) [23:41] http://de.wikisource.org/wiki/Kassel#mediaviewer/Datei:M%C3%BCllerplan_Kassel_1547.jpg [23:41] we had walls already :) [23:42] (1547) [23:51] get you with your walls [23:52] lol [23:57] * ogra_ &