[02:05] <imgbot> === IMAGE 101 building (started: 20150216-02:05) ===
[03:05] <imgbot> === IMAGE RTM 235 building (started: 20150216-03:05) ===
[03:30] <imgbot> === IMAGE 101 DONE (finished: 20150216-03:30) ===
[03:30] <imgbot> === changelog: http://people.canonical.com/~ogra/touch-image-stats/101.changes ===
[04:25] <imgbot> === IMAGE RTM 235 DONE (finished: 20150216-04:25) ===
[04:25] <imgbot> === changelog: http://people.canonical.com/~ogra/touch-image-stats/rtm/235.changes ===
[07:11] <Mirv> all CI Train workers seem dead
[07:11] <Mirv> cihelp , robru: ^ (ci train dead)
[07:11] <Mirv> because of the 0 free space
[07:11] <robru> Mirv: checking
[07:12] <robru> Mirv: uh-huh
[07:12] <robru> Mirv: gunna need webops for that one
[07:12] <Mirv> robru: ok :( any general ideas where the free space can be freed up?
[07:13] <robru> Mirv: yeah, you can delete 5GBs right out of /var/lib/jenkins/silos/ubuntu/landing-005/ubuntu
[07:13] <robru> Mirv: also there's a 5GB backup in /var/backups that can get killed
[07:13] <robru> Mirv: shit, I had prepped a cyphermox-test job to clear some stuff out, didn't anticipate the workers dying and the job being unable to run. awesome.
[07:14] <Mirv> robru: ok.
[07:14] <Mirv> yeah, workers dying makes things a bit more... problematic
[07:17] <robru> Mirv: the workers apparently can be brought back online, but I can't edit the job to actually run the command to delete the files
[07:17] <Mirv> robru: yep. filed RT ticket since no vanguard.
[07:18] <robru> Mirv: ok, good luck! I guess we should look into increasing the size of that nova volume if possible. amusingly the ephemeral storage is 50GBs and only 5% used.
[07:18] <Mirv> robru: thanks! indeed I'll bring that idea to the ticket handling once contacted
[07:18] <robru> Mirv: maybe call the emergency number? "a critical web service going offline" seems like an emergency to me.
[07:19] <Mirv> robru: I guess it's not critical for an hour or two, since I'm mostly the only one affected (and I can do stuff while waiting) and I'm sure a vanguard appears when the lazy rest of the Europe wakes up :)
[07:20] <robru> Mirv: haha, ok, your call then. I'm not really here ;-)
[07:20] <Mirv> robru: yes, sure, you're having your relaxing Sunday evening with no computers involved!
=== Mirv changed the topic of #ubuntu-ci-eng to: Need a silo or CI Train support? ping trainguards | Need help with something else? ping cihelp | Train Dashboard: http://bit.ly/1mDv1FS | QA Signoffs: http://bit.ly/1qMAKYd | Known Issues: CI Train out of disk space, ticket filed
[07:36] <robru> Mirv: I apparently don't have permission to read your RT, but I got the email with the details. you should add the directory to delete to the ticket, might speed up their response.
[07:48] <Mirv> robru: ok. yes I'll tell them the dirs.
[07:49] <robru> Mirv: oh and if they ask, the juju env is ps4ci-train and the offending disk is the one attached to ci-train-jenkins/0
[07:49] <Mirv> ok
[08:29] <sil2100> Mirv: any news on the disk space issue?
[08:29] <Mirv> sil2100: not yet, waiting for some vanguard in UK to wake up
[08:29] <Mirv> sil2100: this is like almost critical issue but I know it's mostly hitting me at the moment, UK will be up soon and even I have stuff to do while waiting
[08:30] <Mirv> so I didn't make any emergency calls :)
[08:30] <sil2100> Mirv: is this blocking other silo landings, or just the big Qt one? ;)
[08:30] <Mirv> sil2100: this is blocking the whole train
[08:30] <Mirv> sil2100: all workers are dead, the machine is out of space
[08:30] <Mirv> sil2100: we can't even run our own cleanup job
[08:31] <Mirv> so yes it'll start blocking others as soon as people wake up, but let's hope the vanguard wakes up too..
[08:31] <sil2100> I see, damn, if we had access to the jenkins jobs we might have been able to at least clean up parts of it
[08:31] <sil2100> But it's all dead
[09:19] <davmor2> ogra_: hippo birdy 2 ewes, hippo birdy 2 ewes, hippo birdy deer ogra_, hippo birdy 2 ewes :)
[09:19] <ogra_> tweek tweek
[09:25] <Mirv> UK seems slow to wake up :(
[09:27] <sil2100> Mirv: do we need webops or IS?
[09:28] <Mirv> sil2100: webops I believe
[10:00] <sil2100> ogra_: and you should party today!
[10:00] <ogra_> haha, i will
=== vrruiz_ is now known as rvr
[11:15] <sil2100> \o/
[11:15] <sil2100> Mirv: \o/
[11:16] <Mirv> :)
[11:18] <Mirv> sil2100: so, we have around 32GB of space now. after cleanup now 16GB free but all of that was gone relatively easily with Qt + backups.
[11:19] <Mirv> sil2100: so maybe asking for 50GB or 64GB?
[11:20] <sil2100> Mirv: were you able to check how much we have assigned for the train in overall?
[11:21] <Mirv> sil2100: well I'd guess most of the train is under that /var/lib etc? / has 50G of which only 8G is used, https://ci-train.ubuntu.com/job/cyphermox-test/644/console
[11:21] <Mirv> sil2100: I mean, under that juju volume to which apparently /var/ stuff symlinks to
[11:23] <sil2100> I suppose a bump to 64GB wouldn't hurt, but we'll have to somehow deal with those backups anyway
[11:23] <sil2100> Limit them in size as well, not to a point in time
[11:23] <Mirv> yes
[11:24] <sil2100> Mirv: anyway, so far great job with releasing Qt 5.4 o/
[11:26] <Mirv> sil2100: let's see how the migration goes and if there are any surprises, but yes so far so good.
=== _salem is now known as salem_
=== Mirv changed the topic of #ubuntu-ci-eng to: Need a silo or CI Train support? ping trainguards | Need help with something else? ping cihelp | Train Dashboard: http://bit.ly/1mDv1FS | QA Signoffs: http://bit.ly/1qMAKYd | Known Issues: -
=== MacSlow is now known as MacSlow|lunch
[12:55] <sil2100> Mirv: oh! And one thing I forgot to mention
[12:56] <sil2100> Mirv: remember the problem you had with that MP that you had to change into a source upload on Friday in the train?
[13:00] <sil2100> Mirv: robru explained on the meeting how to deal with those in the new build job now, it seems all you need to do is to perform a normal (not watch_only) build with the additional source package name listed in the rebuild list
[13:01] <sil2100> Mirv: the job will notice it's a source upload and not do anything, but it will rebuild its .project file
[13:05] <Saviq> trainguards, can you please remove unity-system-compositor from vivid silo 18
[13:05] <sil2100> Saviq: from the PPA you mean?
[13:05] <Saviq> sil2100, yes
[13:05] <sil2100> Saviq: sure, let me do that now
=== alan_g is now known as alan_g|lunch
[13:17] <Mirv> sil2100: right! yes, he emailed me as well telling just that. good to know.
[13:56] <sil2100> o/
[14:01] <Mirv> sil2100: we've one autopkgtest regression (symbols changing), fix in archives already by mitya
[14:01] <Mirv> so more waiting now
[14:02] <sil2100> \o/
[14:04] <om26er> bzoltan_, needed to ask you, was the test result for silo 14 published somewhere ?
[14:04] <bzoltan_> om26er:  the same pleace, as the CI sheet says
[14:04] <Mirv> sil2100: see webops
[14:04] <bzoltan_> om26er: no regression at all
[14:07] <om26er> bzoltan_, thanks for that. So I didn't find anything out of normal. But there was no systematic pattern followed to verify the fix as there was no way to verify the fix.
[14:07] <om26er> I guess we can count on the unittests there :)
=== MacSlow|lunch is now known as MacSlow
[14:08] <bzoltan_> om26er: that is what I would do :)
[14:14] <sil2100> Attention! CI Train jenkins going down!
[14:17] <sil2100> ^ will publish the silo once jenkins is back
=== sil2100 changed the topic of #ubuntu-ci-eng to: Need a silo or CI Train support? ping trainguards | Need help with something else? ping cihelp | Train Dashboard: http://bit.ly/1mDv1FS | QA Signoffs: http://bit.ly/1qMAKYd | Known Issues: CI Train jenkins down temporarily, should be back soon
[14:48] <oSoMoN> trainguards: can someone please update oxide-qt in silo 3 to 1.5.2-0ubuntu1 by doing a new binary copy from the phablet-team PPA (https://launchpad.net/~phablet-team/+archive/ubuntu/ppa/+packages)?
[14:54] <sil2100> oSoMoN: on it
[14:54] <sil2100> oSoMoN: just remember that the train jenkins is still down
[14:54] <oSoMoN> sil2100, thanks man
[14:55] <oSoMoN> oh, is it?
[14:55] <oSoMoN> I must have missed the announcement
[14:55] <sil2100> It's up ^
[14:56] <sil2100> I mean, it's announced up in the backlog ^
[15:11] <Mirv> oSoMoN: sil2100: Qt 5.4 has landed / is landing, you'll need a rebuild instead of binary copy. I already had a rebuild ongoing in silo 3 for you compiling against 5.4
[15:13] <Mirv> Qt is still in proposed pocket for a little while, so I temporarily added landing-005 as a dependency to 003 (with my own todo item to remove it)
[15:13] <oSoMoN> Mirv, ah, thanks for that. I guess I’ll wait for oxide 1.5.3 to be ready then, as it has the fix for QVariants wrapped in QJSValues
=== alan_g|lunch is now known as alan_g
[15:14] <oSoMoN> sil2100, so no need for any action on your part for now, I’ll let you know when I need a rebuild
[15:14] <Mirv> oSoMoN: alright then.
[15:15] <Mirv> I'll remove the dep then now from there so it doesn't linger
[15:20] <sil2100> Eeek
[15:20] <sil2100> I already copied the binaries over to the silo PPA
[15:21] <sil2100> And we exceeded the size of the PPA
[15:21] <dbarth> sil2100: while jenkins reloads ;)
[15:22] <dbarth> sil2100: so if i go ahead with asking for a re-seed of that extension package, how to have it be spotted by qa again?
[15:22] <dbarth> an empty silo to hold the request with the bug ref. for example ?
[15:23] <sil2100> dbarth: hm, I think we can use the new experimental functionality of tracking non-citrain landings
[15:23] <sil2100> dbarth: for now please fill in a landing request for that and I'll turn it into a real one :)
[15:23] <dbarth> ok
[15:23] <sil2100> Then QA will see it on their trello board
[15:31] <dbarth> sil2100: see line 75
[15:34] <dbarth> ogra_: fyi, this is that extension seed request again ^^ (signon-apparmor-extension)
[15:35] <ogra_> dbarth, vivid or rtm ?
[15:37] <sil2100> RTM
[15:38] <sil2100> But don't submit it yet
[15:38] <sil2100> We want QA to sign it off first
[15:38] <ogra_> sure
[15:39] <cjwatson> sil2100: Which PPA do you need expanding?
[15:44] <cjwatson> Ah, I guess somebody did it, assuming this is https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/landing-005/+packages
[15:46] <rvr> rsalveti: ping
[15:46] <Mirv> cjwatson: 003, with oxide. no worries though, the current packages will be deleted.
[15:46] <ogra_> rvr, off today ... doing his samba duty as brazilian citizen ...
[15:47] <cjwatson> Oh, maybe it's https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/landing-003/+packages - bumped to 20GB
[15:47] <rvr> ogra_: Ahh
[15:47] <rvr> mandel: ping
[15:47] <Mirv> cjwatson: thanks!
[15:47] <rvr> Meh, mandel seems to be also away
[15:54] <dbarth> ogra_: rtm, it's already on in vivid
[15:55] <ogra_> ok
[16:09] <om26er> boiko, Hi!
[16:11] <boiko> om26er: hi
[16:12] <om26er> boiko, regarding silo 12, the fix needs to have some kind of automation.
[16:12] <om26er> Probably an autopilot test will do
[16:13] <boiko> om26er: that's a cherry-pick from code already landed into vivid
[16:14] <om26er> boiko, right. then I guess we can add a test in both places :)
[16:14] <boiko> om26er: I would prefer not to add more code to rtm than what's in vivid, so, maybe I can add a test for that in the testplan for now?
[16:14] <boiko> om26er: well, if time permits, we have other priority stuff to work on :/
[16:15] <om26er> boiko, jibel instructed to not land Apps without tests
[16:15] <om26er> and in this case it looks like an easy one
=== sil2100 changed the topic of #ubuntu-ci-eng to: Need a silo or CI Train support? ping trainguards | Need help with something else? ping cihelp | Train Dashboard: http://bit.ly/1mDv1FS | QA Signoffs: http://bit.ly/1qMAKYd | Known Issues: -
[16:16] <sil2100> CI Train jenkins is back!
[16:17] <boiko> om26er: well, that will have to wait a bit then, if we manage to get some time I can write the test, but can't do right now
[16:18] <om26er> jibel, what do you think ^
[16:33] <Mirv> yay, train back
[16:36] <Mirv> Saviq: 018 unity8 will need a rebuild since Qt 5.4 has been in -proposed for the last 6 hours or so. we're expecting release pocket migration any moment now.
[16:36] <jibel> om26er, agreed, we cannot continue landing code without tests, relying on QA only to do testing doesn't scale.
[16:43] <Saviq> Mirv, well, wil it actually? hasn't it built against 5.4 already?
[16:51] <Mirv> Saviq: yeah, it looks like it took from 5.4 from proposed, good. no need to rebuild: https://launchpadlibrarian.net/197827352/buildlog_ubuntu-vivid-amd64.unity8_8.02%2B15.04.20150216.1-0ubuntu1_UPLOADING.txt.gz - I think I saw a silo before that didn't have proposed enabled.
[16:51] <Mirv> and yes! Qt 5.4 seems to migrating to release pocket just now
[16:52] <Mirv> sil2100: ^
[16:53] <Mirv> aha
[17:01] <sil2100> Mirv: \o/
[17:05] <Mirv> ok, now merging also successfully
[17:11] <Mirv> kgunn: 000 will need a rebuild of qtsystems-opensource-src, qtmir, qtubuntu and unity8 due to Qt 5.4 having landed
[17:11] <Mirv> kgunn: oh, and ubuntu-system-settings
[17:12] <kgunn> Mirv: thanks, mzanetti ^^ for tomorrow as i likely won't get to it
[17:23] <boiko> om26er: jibel: ok, once I get some time I will write those tests
[17:48] <robru> sil2100: https://code.launchpad.net/~robru/cupstream2distro/delete-distro-versions-after-diffing/+merge/249864 can I get you to review? ;-)
[17:51] <john-mcaleely> http://people.canonical.com/~jhm/barajas/ubuntu-rtm-14.09/device_krillin-20150216-fe747ac.changes
[17:51] <john-mcaleely> http://people.canonical.com/~jhm/barajas/ubuntu-rtm-14.09/device_krillin-20150216-fe747ac.tar.xz
[17:51] <john-mcaleely> http://people.canonical.com/~jhm/barajas/ubuntu-rtm-14.09/device_krillin-testresults-20150216-fe747ac.ods
[17:51] <john-mcaleely> sil2100, davmor2 ^ device tarbll (also in citrain spreadsheet) for rtm
[17:51] <john-mcaleely> QA signoff requested
[17:59] <sil2100_> Geh, GPU hang...
[18:02] <robru> sil2100_: did you see my ping? https://code.launchpad.net/~robru/cupstream2distro/delete-distro-versions-after-diffing/+merge/249864 can you review this merge? ;-)
[18:02] <robru> it's trivial
[18:03] <davmor2> thanks john-mcaleely
[18:03] <john-mcaleely> sorry it's a bit later than advertised
[18:04] <sil2100_> robru: thanks! Missed it due to the GPU-hang, looking
=== alan_g is now known as alan_g|EOD
[18:16] <sil2100_> robru: +1
[18:16] <robru> sil2100_: thanks
=== sil2100_ is now known as sil2100
[18:50] <robru> Mirv: Saviq: awesome, silo 5/18 published with conflicts.
=== salem_ is now known as _salem
[18:58] <robru> Mirv: Saviq: not sure how this happened, the train should have prevented publication. but basically saviq's silo 18 published unity8 which did not contains Mirv's no-change rebuild, so I guess unity8 is now built against the wrong version of qt that's in the archive. probably needs a new no-change rebuild, somebody should check that.
[19:10] <robru> Mirv: Saviq: https://bugs.launchpad.net/cupstream2distro/+bug/1422465 bug filed
[19:10] <ubot5> Launchpad bug 1422465 in CI Train [cu2d] "Management of conflicting packages is sub-optimal." [Undecided,Triaged]
[19:37] <Saviq> robru, my silo *did* contain the no-change rebuild, and it actually built against qt 5.4 that was already in proposed
[19:38] <robru> Saviq: oh, ok. well something goofed up during the merge then. I manually merged it myself, so it should be fine then.
[19:41] <Saviq> robru, yeah, we could've ended up with a conflict, that's possible, because Mirv merged the MP on top of our trunk manually
[19:41] <Saviq> robru, although I'd have thought bzr would resolve it
[19:43] <robru> Saviq: yeah, bzr was saying 'Nothing to do.' but somehow ci train was just puking all over it. no idea why
[20:18] <kgunn> Mirv: so Qt5.4 is actually part of vivid now ?
[20:21] <robru> kgunn: yes
[20:24] <seb128> but seems to be somewhat buggy or incomplete
[21:41] <robru> boiko: https://code.launchpad.net/~boiko/dialer-app/fix_autopilot_multi_pagestack/+merge/249366 need your approval.
[21:41] <boiko> robru: yeah, just saw it, sorry, as I did the MR myself, I think it is better that someone else from the team take it a look, but that will have to wait until tomorrow
[21:42] <boiko> robru: sorry about that
[21:42] <robru> boiko: no worries.
=== _salem is now known as salem_