| imgbot | === IMAGE 101 building (started: 20150216-02:05) === | 02:05 |
|---|---|---|
| imgbot | === IMAGE RTM 235 building (started: 20150216-03:05) === | 03:05 |
| imgbot | === IMAGE 101 DONE (finished: 20150216-03:30) === | 03:30 |
| imgbot | === changelog: http://people.canonical.com/~ogra/touch-image-stats/101.changes === | 03:30 |
| imgbot | === IMAGE RTM 235 DONE (finished: 20150216-04:25) === | 04:25 |
| imgbot | === changelog: http://people.canonical.com/~ogra/touch-image-stats/rtm/235.changes === | 04:25 |
| Mirv | all CI Train workers seem dead | 07:11 |
| Mirv | cihelp , robru: ^ (ci train dead) | 07:11 |
| Mirv | because of the 0 free space | 07:11 |
| robru | Mirv: checking | 07:11 |
| robru | Mirv: uh-huh | 07:12 |
| robru | Mirv: gunna need webops for that one | 07:12 |
| Mirv | robru: ok :( any general ideas where the free space can be freed up? | 07:12 |
| robru | Mirv: yeah, you can delete 5GBs right out of /var/lib/jenkins/silos/ubuntu/landing-005/ubuntu | 07:13 |
| robru | Mirv: also there's a 5GB backup in /var/backups that can get killed | 07:13 |
| robru | Mirv: shit, I had prepped a cyphermox-test job to clear some stuff out, didn't anticipate the workers dying and the job being unable to run. awesome. | 07:13 |
| Mirv | robru: ok. | 07:14 |
| Mirv | yeah, workers dying makes things a bit more... problematic | 07:14 |
| robru | Mirv: the workers apparently can be brought back online, but I can't edit the job to actually run the command to delete the files | 07:17 |
| Mirv | robru: yep. filed RT ticket since no vanguard. | 07:17 |
| robru | Mirv: ok, good luck! I guess we should look into increasing the size of that nova volume if possible. amusingly the ephemeral storage is 50GBs and only 5% used. | 07:18 |
| Mirv | robru: thanks! indeed I'll bring that idea to the ticket handling once contacted | 07:18 |
| robru | Mirv: maybe call the emergency number? "a critical web service going offline" seems like an emergency to me. | 07:18 |
| Mirv | robru: I guess it's not critical for an hour or two, since I'm mostly the only one affected (and I can do stuff while waiting) and I'm sure a vanguard appears when the lazy rest of the Europe wakes up :) | 07:19 |
| robru | Mirv: haha, ok, your call then. I'm not really here ;-) | 07:20 |
| Mirv | robru: yes, sure, you're having your relaxing Sunday evening with no computers involved! | 07:20 |
| === Mirv changed the topic of #ubuntu-ci-eng to: Need a silo or CI Train support? ping trainguards | Need help with something else? ping cihelp | Train Dashboard: http://bit.ly/1mDv1FS | QA Signoffs: http://bit.ly/1qMAKYd | Known Issues: CI Train out of disk space, ticket filed | ||
| robru | Mirv: I apparently don't have permission to read your RT, but I got the email with the details. you should add the directory to delete to the ticket, might speed up their response. | 07:36 |
| Mirv | robru: ok. yes I'll tell them the dirs. | 07:48 |
| robru | Mirv: oh and if they ask, the juju env is ps4ci-train and the offending disk is the one attached to ci-train-jenkins/0 | 07:49 |
| Mirv | ok | 07:49 |
| sil2100 | Mirv: any news on the disk space issue? | 08:29 |
| Mirv | sil2100: not yet, waiting for some vanguard in UK to wake up | 08:29 |
| Mirv | sil2100: this is like almost critical issue but I know it's mostly hitting me at the moment, UK will be up soon and even I have stuff to do while waiting | 08:29 |
| Mirv | so I didn't make any emergency calls :) | 08:30 |
| sil2100 | Mirv: is this blocking other silo landings, or just the big Qt one? ;) | 08:30 |
| Mirv | sil2100: this is blocking the whole train | 08:30 |
| Mirv | sil2100: all workers are dead, the machine is out of space | 08:30 |
| Mirv | sil2100: we can't even run our own cleanup job | 08:30 |
| Mirv | so yes it'll start blocking others as soon as people wake up, but let's hope the vanguard wakes up too.. | 08:31 |
| sil2100 | I see, damn, if we had access to the jenkins jobs we might have been able to at least clean up parts of it | 08:31 |
| sil2100 | But it's all dead | 08:31 |
| davmor2 | ogra_: hippo birdy 2 ewes, hippo birdy 2 ewes, hippo birdy deer ogra_, hippo birdy 2 ewes :) | 09:19 |
| ogra_ | tweek tweek | 09:19 |
| Mirv | UK seems slow to wake up :( | 09:25 |
| sil2100 | Mirv: do we need webops or IS? | 09:27 |
| Mirv | sil2100: webops I believe | 09:28 |
| sil2100 | ogra_: and you should party today! | 10:00 |
| ogra_ | haha, i will | 10:00 |
| === vrruiz_ is now known as rvr | ||
| sil2100 | \o/ | 11:15 |
| sil2100 | Mirv: \o/ | 11:15 |
| Mirv | :) | 11:16 |
| Mirv | sil2100: so, we have around 32GB of space now. after cleanup now 16GB free but all of that was gone relatively easily with Qt + backups. | 11:18 |
| Mirv | sil2100: so maybe asking for 50GB or 64GB? | 11:19 |
| sil2100 | Mirv: were you able to check how much we have assigned for the train in overall? | 11:20 |
| Mirv | sil2100: well I'd guess most of the train is under that /var/lib etc? / has 50G of which only 8G is used, https://ci-train.ubuntu.com/job/cyphermox-test/644/console | 11:21 |
| Mirv | sil2100: I mean, under that juju volume to which apparently /var/ stuff symlinks to | 11:21 |
| sil2100 | I suppose a bump to 64GB wouldn't hurt, but we'll have to somehow deal with those backups anyway | 11:23 |
| sil2100 | Limit them in size as well, not to a point in time | 11:23 |
| Mirv | yes | 11:23 |
| sil2100 | Mirv: anyway, so far great job with releasing Qt 5.4 o/ | 11:24 |
| Mirv | sil2100: let's see how the migration goes and if there are any surprises, but yes so far so good. | 11:26 |
| === _salem is now known as salem_ | ||
| === Mirv changed the topic of #ubuntu-ci-eng to: Need a silo or CI Train support? ping trainguards | Need help with something else? ping cihelp | Train Dashboard: http://bit.ly/1mDv1FS | QA Signoffs: http://bit.ly/1qMAKYd | Known Issues: - | ||
| === MacSlow is now known as MacSlow|lunch | ||
| sil2100 | Mirv: oh! And one thing I forgot to mention | 12:55 |
| sil2100 | Mirv: remember the problem you had with that MP that you had to change into a source upload on Friday in the train? | 12:56 |
| sil2100 | Mirv: robru explained on the meeting how to deal with those in the new build job now, it seems all you need to do is to perform a normal (not watch_only) build with the additional source package name listed in the rebuild list | 13:00 |
| sil2100 | Mirv: the job will notice it's a source upload and not do anything, but it will rebuild its .project file | 13:01 |
| Saviq | trainguards, can you please remove unity-system-compositor from vivid silo 18 | 13:05 |
| sil2100 | Saviq: from the PPA you mean? | 13:05 |
| Saviq | sil2100, yes | 13:05 |
| sil2100 | Saviq: sure, let me do that now | 13:05 |
| === alan_g is now known as alan_g|lunch | ||
| Mirv | sil2100: right! yes, he emailed me as well telling just that. good to know. | 13:17 |
| sil2100 | o/ | 13:56 |
| Mirv | sil2100: we've one autopkgtest regression (symbols changing), fix in archives already by mitya | 14:01 |
| Mirv | so more waiting now | 14:01 |
| sil2100 | \o/ | 14:02 |
| om26er | bzoltan_, needed to ask you, was the test result for silo 14 published somewhere ? | 14:04 |
| bzoltan_ | om26er: the same pleace, as the CI sheet says | 14:04 |
| Mirv | sil2100: see webops | 14:04 |
| bzoltan_ | om26er: no regression at all | 14:04 |
| om26er | bzoltan_, thanks for that. So I didn't find anything out of normal. But there was no systematic pattern followed to verify the fix as there was no way to verify the fix. | 14:07 |
| om26er | I guess we can count on the unittests there :) | 14:07 |
| === MacSlow|lunch is now known as MacSlow | ||
| bzoltan_ | om26er: that is what I would do :) | 14:08 |
| sil2100 | Attention! CI Train jenkins going down! | 14:14 |
| sil2100 | ^ will publish the silo once jenkins is back | 14:17 |
| === sil2100 changed the topic of #ubuntu-ci-eng to: Need a silo or CI Train support? ping trainguards | Need help with something else? ping cihelp | Train Dashboard: http://bit.ly/1mDv1FS | QA Signoffs: http://bit.ly/1qMAKYd | Known Issues: CI Train jenkins down temporarily, should be back soon | ||
| oSoMoN | trainguards: can someone please update oxide-qt in silo 3 to 1.5.2-0ubuntu1 by doing a new binary copy from the phablet-team PPA (https://launchpad.net/~phablet-team/+archive/ubuntu/ppa/+packages)? | 14:48 |
| sil2100 | oSoMoN: on it | 14:54 |
| sil2100 | oSoMoN: just remember that the train jenkins is still down | 14:54 |
| oSoMoN | sil2100, thanks man | 14:54 |
| oSoMoN | oh, is it? | 14:55 |
| oSoMoN | I must have missed the announcement | 14:55 |
| sil2100 | It's up ^ | 14:55 |
| sil2100 | I mean, it's announced up in the backlog ^ | 14:56 |
| Mirv | oSoMoN: sil2100: Qt 5.4 has landed / is landing, you'll need a rebuild instead of binary copy. I already had a rebuild ongoing in silo 3 for you compiling against 5.4 | 15:11 |
| Mirv | Qt is still in proposed pocket for a little while, so I temporarily added landing-005 as a dependency to 003 (with my own todo item to remove it) | 15:13 |
| oSoMoN | Mirv, ah, thanks for that. I guess I’ll wait for oxide 1.5.3 to be ready then, as it has the fix for QVariants wrapped in QJSValues | 15:13 |
| === alan_g|lunch is now known as alan_g | ||
| oSoMoN | sil2100, so no need for any action on your part for now, I’ll let you know when I need a rebuild | 15:14 |
| Mirv | oSoMoN: alright then. | 15:14 |
| Mirv | I'll remove the dep then now from there so it doesn't linger | 15:15 |
| sil2100 | Eeek | 15:20 |
| sil2100 | I already copied the binaries over to the silo PPA | 15:20 |
| sil2100 | And we exceeded the size of the PPA | 15:21 |
| dbarth | sil2100: while jenkins reloads ;) | 15:21 |
| dbarth | sil2100: so if i go ahead with asking for a re-seed of that extension package, how to have it be spotted by qa again? | 15:22 |
| dbarth | an empty silo to hold the request with the bug ref. for example ? | 15:22 |
| sil2100 | dbarth: hm, I think we can use the new experimental functionality of tracking non-citrain landings | 15:23 |
| sil2100 | dbarth: for now please fill in a landing request for that and I'll turn it into a real one :) | 15:23 |
| dbarth | ok | 15:23 |
| sil2100 | Then QA will see it on their trello board | 15:23 |
| dbarth | sil2100: see line 75 | 15:31 |
| dbarth | ogra_: fyi, this is that extension seed request again ^^ (signon-apparmor-extension) | 15:34 |
| ogra_ | dbarth, vivid or rtm ? | 15:35 |
| sil2100 | RTM | 15:37 |
| sil2100 | But don't submit it yet | 15:38 |
| sil2100 | We want QA to sign it off first | 15:38 |
| ogra_ | sure | 15:38 |
| cjwatson | sil2100: Which PPA do you need expanding? | 15:39 |
| cjwatson | Ah, I guess somebody did it, assuming this is https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/landing-005/+packages | 15:44 |
| rvr | rsalveti: ping | 15:46 |
| Mirv | cjwatson: 003, with oxide. no worries though, the current packages will be deleted. | 15:46 |
| ogra_ | rvr, off today ... doing his samba duty as brazilian citizen ... | 15:46 |
| cjwatson | Oh, maybe it's https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/landing-003/+packages - bumped to 20GB | 15:47 |
| rvr | ogra_: Ahh | 15:47 |
| rvr | mandel: ping | 15:47 |
| Mirv | cjwatson: thanks! | 15:47 |
| rvr | Meh, mandel seems to be also away | 15:47 |
| dbarth | ogra_: rtm, it's already on in vivid | 15:54 |
| ogra_ | ok | 15:55 |
| om26er | boiko, Hi! | 16:09 |
| boiko | om26er: hi | 16:11 |
| om26er | boiko, regarding silo 12, the fix needs to have some kind of automation. | 16:12 |
| om26er | Probably an autopilot test will do | 16:12 |
| boiko | om26er: that's a cherry-pick from code already landed into vivid | 16:13 |
| om26er | boiko, right. then I guess we can add a test in both places :) | 16:14 |
| boiko | om26er: I would prefer not to add more code to rtm than what's in vivid, so, maybe I can add a test for that in the testplan for now? | 16:14 |
| boiko | om26er: well, if time permits, we have other priority stuff to work on :/ | 16:14 |
| om26er | boiko, jibel instructed to not land Apps without tests | 16:15 |
| om26er | and in this case it looks like an easy one | 16:15 |
| === sil2100 changed the topic of #ubuntu-ci-eng to: Need a silo or CI Train support? ping trainguards | Need help with something else? ping cihelp | Train Dashboard: http://bit.ly/1mDv1FS | QA Signoffs: http://bit.ly/1qMAKYd | Known Issues: - | ||
| sil2100 | CI Train jenkins is back! | 16:16 |
| boiko | om26er: well, that will have to wait a bit then, if we manage to get some time I can write the test, but can't do right now | 16:17 |
| om26er | jibel, what do you think ^ | 16:18 |
| Mirv | yay, train back | 16:33 |
| Mirv | Saviq: 018 unity8 will need a rebuild since Qt 5.4 has been in -proposed for the last 6 hours or so. we're expecting release pocket migration any moment now. | 16:36 |
| jibel | om26er, agreed, we cannot continue landing code without tests, relying on QA only to do testing doesn't scale. | 16:36 |
| Saviq | Mirv, well, wil it actually? hasn't it built against 5.4 already? | 16:43 |
| Mirv | Saviq: yeah, it looks like it took from 5.4 from proposed, good. no need to rebuild: https://launchpadlibrarian.net/197827352/buildlog_ubuntu-vivid-amd64.unity8_8.02%2B15.04.20150216.1-0ubuntu1_UPLOADING.txt.gz - I think I saw a silo before that didn't have proposed enabled. | 16:51 |
| Mirv | and yes! Qt 5.4 seems to migrating to release pocket just now | 16:51 |
| Mirv | sil2100: ^ | 16:52 |
| Mirv | aha | 16:53 |
| sil2100 | Mirv: \o/ | 17:01 |
| Mirv | ok, now merging also successfully | 17:05 |
| Mirv | kgunn: 000 will need a rebuild of qtsystems-opensource-src, qtmir, qtubuntu and unity8 due to Qt 5.4 having landed | 17:11 |
| Mirv | kgunn: oh, and ubuntu-system-settings | 17:11 |
| kgunn | Mirv: thanks, mzanetti ^^ for tomorrow as i likely won't get to it | 17:12 |
| boiko | om26er: jibel: ok, once I get some time I will write those tests | 17:23 |
| robru | sil2100: https://code.launchpad.net/~robru/cupstream2distro/delete-distro-versions-after-diffing/+merge/249864 can I get you to review? ;-) | 17:48 |
| john-mcaleely | http://people.canonical.com/~jhm/barajas/ubuntu-rtm-14.09/device_krillin-20150216-fe747ac.changes | 17:51 |
| john-mcaleely | http://people.canonical.com/~jhm/barajas/ubuntu-rtm-14.09/device_krillin-20150216-fe747ac.tar.xz | 17:51 |
| john-mcaleely | http://people.canonical.com/~jhm/barajas/ubuntu-rtm-14.09/device_krillin-testresults-20150216-fe747ac.ods | 17:51 |
| john-mcaleely | sil2100, davmor2 ^ device tarbll (also in citrain spreadsheet) for rtm | 17:51 |
| john-mcaleely | QA signoff requested | 17:51 |
| sil2100_ | Geh, GPU hang... | 17:59 |
| robru | sil2100_: did you see my ping? https://code.launchpad.net/~robru/cupstream2distro/delete-distro-versions-after-diffing/+merge/249864 can you review this merge? ;-) | 18:02 |
| robru | it's trivial | 18:02 |
| davmor2 | thanks john-mcaleely | 18:03 |
| john-mcaleely | sorry it's a bit later than advertised | 18:03 |
| sil2100_ | robru: thanks! Missed it due to the GPU-hang, looking | 18:04 |
| === alan_g is now known as alan_g|EOD | ||
| sil2100_ | robru: +1 | 18:16 |
| robru | sil2100_: thanks | 18:16 |
| === sil2100_ is now known as sil2100 | ||
| robru | Mirv: Saviq: awesome, silo 5/18 published with conflicts. | 18:50 |
| === salem_ is now known as _salem | ||
| robru | Mirv: Saviq: not sure how this happened, the train should have prevented publication. but basically saviq's silo 18 published unity8 which did not contains Mirv's no-change rebuild, so I guess unity8 is now built against the wrong version of qt that's in the archive. probably needs a new no-change rebuild, somebody should check that. | 18:58 |
| robru | Mirv: Saviq: https://bugs.launchpad.net/cupstream2distro/+bug/1422465 bug filed | 19:10 |
| ubot5 | Launchpad bug 1422465 in CI Train [cu2d] "Management of conflicting packages is sub-optimal." [Undecided,Triaged] | 19:10 |
| Saviq | robru, my silo *did* contain the no-change rebuild, and it actually built against qt 5.4 that was already in proposed | 19:37 |
| robru | Saviq: oh, ok. well something goofed up during the merge then. I manually merged it myself, so it should be fine then. | 19:38 |
| Saviq | robru, yeah, we could've ended up with a conflict, that's possible, because Mirv merged the MP on top of our trunk manually | 19:41 |
| Saviq | robru, although I'd have thought bzr would resolve it | 19:41 |
| robru | Saviq: yeah, bzr was saying 'Nothing to do.' but somehow ci train was just puking all over it. no idea why | 19:43 |
| kgunn | Mirv: so Qt5.4 is actually part of vivid now ? | 20:18 |
| robru | kgunn: yes | 20:21 |
| seb128 | but seems to be somewhat buggy or incomplete | 20:24 |
| robru | boiko: https://code.launchpad.net/~boiko/dialer-app/fix_autopilot_multi_pagestack/+merge/249366 need your approval. | 21:41 |
| boiko | robru: yeah, just saw it, sorry, as I did the MR myself, I think it is better that someone else from the team take it a look, but that will have to wait until tomorrow | 21:41 |
| boiko | robru: sorry about that | 21:42 |
| robru | boiko: no worries. | 21:42 |
| === _salem is now known as salem_ | ||
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!