[00:37] plars: bfiller_afk: tomorrow I will investigate those crashes [03:03] t1mp: I made one minor but important change to that branch, so you might want to repull it. I've proposed a merge for it, and it ought to land in trunk of lp:ubuntu-test-cases/touch tomorow [03:05] === trainguard: IMAGE 262 building (started: 20140326-03:05) === [04:25] === trainguard: IMAGE 262 DONE (finished: 20140326-04:25) === [04:25] === changelog: http://people.canonical.com/~ogra/touch-image-stats/262.changes === [05:13] good morning [05:58] now I realize I forgot to ask sergiusens for click credentials yesterday, after ball_oons taught me how to publish click packages. on the other hand, I'd like to go through the first time by double-checking the steps anyway. [05:58] (regarding the gallery-app) [06:07] nice to see 100% green again http://ci.ubuntu.com/smokeng/trusty/touch/mako/261:20140325.3:20140304/7375/ [07:39] tvoss: were you planning to test+land dbus-cpp ppc64el fix before the process-cpp one? I mean, you are not having a problem of not having a silo for process-cpp yet? [07:39] nope [07:40] Mirv, coming back to you in ~30 [07:40] I take that as a positive answer to my triple negations etc ;) [07:40] cool [07:42] Mirv: 3rd day of the week, triple negations… Tomorrow, four? :) [07:44] :) [07:55] Morning! [07:56] didrocks: so, I checked the dch parameters, and found the difference between precise and now - in precise we need to use "--release-heuristic changelog", as by default it uses 'log' [07:56] didrocks: it works differently as the default heiristics looks for dput upload files, not the changelog contents ;/ [07:56] sil2100: oh, I was overleading that in the directory [07:56] but as we moved CI Train, I guess we missed that [07:56] yeah [07:56] you're more than right [07:57] so the fix is easy! [07:57] morning sil2100 :) [07:57] sil2100: want to propose a branch? ;) [07:57] didrocks: ok ;) [07:57] sil2100: with some unit tests will be bonus! [07:57] Mirv, hey, I'm confused :) https://code.launchpad.net/~thomas-voss/dbus-cpp/fix-ppc64-el/+merge/211894 [07:57] says that it is merged [07:57] Will try, guess it won't be that hard ;p [07:58] sil2100: shouldn't, thanks! [07:59] tvoss: err. let's see.. it seems to have been published by robru (somehow) https://lists.ubuntu.com/archives/trusty-changes/2014-March/013069.html [08:00] Mirv, it used to be in silo 001 before [08:02] tvoss: it looks to me that sil2100 published it on Monday http://162.213.34.102/job/landing-001-2-publish/59/ :D maybe he can explain something to this confusion [08:02] I'm not seeing a line in CI Train where it got published [08:02] hmm, I remember publishing that in CI train [08:03] tvoss: and yes it build for ppc64el, and we got 100% pass on CI Train too from image #261 so I guess that counts as tested.. https://launchpad.net/ubuntu/+source/dbus-cpp/2.0.0+14.04.20140322-0ubuntu1 === vila changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | Vanguard: vila | CI Train support - US: robru, cyphermox, rsalveti - EU: sil2100, Mirv, didrocks | CITrain support no answer: use mup bot after 30 minutes, but choose right timezone | Known issues: - [08:03] Mirv, so you don't need me to do anything, correct? :) [08:03] Mirv: I guess something racy happened, let's set it to landed I guess ;) [08:04] tvoss: yeah no need, let's get that silo to your newest process-cpp line then :) [08:04] sil2100: only free silo? [08:05] Mirv: yes, only free silo in the m&c, and then let's set it to Landed manually :) [08:05] running [08:05] Thanks o/ [08:05] Mirv, hang on, I need to bump build deps before we can do that [08:05] Mirv, give me ~15 [08:05] tvoss: ok [08:07] FYI we'd have the gallery-app click package built too, if we'd just have someone to push it to the store together with publishing landing-009 [08:18] cjwatson, for https://code.launchpad.net/~thomas-voss/process-cpp/fix-death-observer/+merge/211996 and your comment on build deps: Do I have to bump the build deps and make them versioned? [08:20] cjwatson, as in: requiring libprocess-cpp-dev (>= 1.0.0) in dbus-cpp for example [08:22] thomas has a silo now, so he can click build when the brances are double-checked to be ready [08:23] Oi, it has been a long day. I just realized I marked all my test results with image 261, but it was really image 262. [08:26] ToyKeeper: just update on the spreadsheet, thanks for the testing! [08:26] I already did. [08:26] Mirv, can I just add trunk branches to the silo as well? To check that everything still works together? [08:26] sil2100: hi [08:27] sil2100: there seems to be an issue with landing silo 002 [08:27] a message about a package in the unapproved queue [08:28] dbarth: let me take a look [08:28] dbarth: ah, might be due to the freeze [08:29] didrocks: btw. looking at the unit tests ;p When and where do we run those unit tests? As I already see a zillion unit tests that should fail in our case! ;) [08:29] tvoss: if you're not planning to publish those trunks, maybe just build the silo and then update to the silo locally and to the test builds? I mean, it becomes slightly tricky if there are "just out of interest" builds/branches in the PPA which need to be cleaned before publishing. [08:30] sil2100: hum, are you sure they are failing? I run them recently and they don't [08:30] tvoss: if you want non-x86 PPA builds, I can help by building in another PPA against the landing PPA after it has built [08:30] sil2100: nosetests tests/unit/ [08:30] sil2100: Ran 190 tests in 18.055s [08:31] didrocks: they wouldn't fail for me here, would have to modify it to 'do the wrong thing' - but looking code wise they should just fail, as all the test_refresh_symbols_files_* compare the resulting changelog with the 'right' one, and this should fail - let me experiment ;) [08:31] Mirv, alternatively, I could setup MPs for the packages that have a build and runtime dep on process-cpp, bumping the build-dep to libprocess-cpp-dev (>= 1.0.0) [08:31] Mirv, does that make sense? [08:32] sil2100: I don't use a mock dch, but let me check [08:33] sil2100: ah, so what's the way forward? [08:33] sil2100: yeah, only bzr, dput and sudo are mocked [08:33] tvoss: do they need the rebuild and the bumping of build-dep? if so, yes it makes sense, but if there is no need other than testing that they WOULD build against the new process-cpp, again I'd use another PPA that builds against that landing PPA [08:33] Mirv, I think I'm a fan of versioned build-deps here, so I would prefer bumping them [08:34] dbarth: I think we'll have to poke the release team and try to convince them that it's something we need to get pushed through [08:35] tvoss: if you can get approvals for the version bump MP:s similar to the other MP:s, sure I don't object :) [08:35] Mirv, ack :) [08:37] Mirv, could you have a look at http://162.213.34.102/job/landing-014-1-build/40/console [08:37] didrocks: so, when running the unit tests locally by emulating what's going on on the citrain device (i.e. a precise system with heuristics default to log), then I get all the test_refresh_symbols_* tests failing [08:37] didrocks: so on the citrain machine it has to be failing as well! [08:37] sil2100: ah, so making sense! [08:38] sil2100: let me see if I can install nosetest on the machine [08:40] didrocks: anyway, I was shocked on how many tests you wrote for this :o There's like almost every case supported :o [08:40] sil2100: I told you it's not some small scripts :) [08:40] ;) [08:40] Ran 190 tests in 21.974s [08:40] FAILED (failures=7) [08:40] sil2100: confirmed! [08:40] and the diff contains this :p [08:41] http://paste.ubuntu.com/7155572/ [08:41] which confirms the theory [08:41] sil2100: so yeah, my fault was to only run the test on my machine :p [08:41] didrocks: \o/ the branch for a quick-fix is here: https://code.launchpad.net/~sil2100/cupstream2distro/dch_heuristics/+merge/212788 [08:41] not a precise one [08:42] didrocks: yeah, who would have guessed there would be these subtle differences ;p [08:42] sil2100: excellent :) [08:42] sil2100: well, TBH, I've seen it while putting the train in production [08:42] and you can see I changed that when generating the changelog [08:42] didn't thought about the symbols file [08:42] though [08:42] tvoss: I checked them out and it looks like lp:~marcustomlinson/unity-scopes-api/scope_process_lifetime would need another sync with the trunk to have the latest changelog entry included too before bumping the version [08:43] sil2100: so approved! [08:43] tvoss: there was a release on Monday of it [08:43] sil2100: we'll put that in prod at the same time than the other changes (continuing on the spreadsheet refactoring for the request id support) [08:43] sil2100: feel free to merge manually to cu2d [08:44] didrocks: ah, we don't have an auto-merger? [08:44] sil2100: unfortunately, not [08:44] Ok :) [08:53] Mirv: are you handling Bill's gallery-app landing, or can I pick it up and publish? === tvoss is now known as tvoss|afk [08:59] sil2100: it needs the simultaneous click publishing, so we need someone that can push the (already built) click package too [08:59] sil2100: and I can't do that even though I was taught how to, since I forgot to ask sergiusens for crendentials yesterday [08:59] additionally, the Python publishing thing fails to run for me for some reason (it downloads random modules from the internet so maybe that's why) [09:02] seb128: morning! sorry to grab you as you arrive [09:02] but what you were worried about with the HUD sync has happened [09:02] seems my boss was immediate in following my instructions to clean the PPA [09:03] do you have any advice about what I should do? [09:03] hey pete-woods, I guess you need to put a new landing ask for the same vcs-es and do a new landing :/ [09:04] infinity, slangasek, ^ (silo cleaned while the copy was in trusty unapproved queue, is there any way around redoing a build/upload)? [09:06] I do actually have another MR I'd have liked to add, so I can just request another silo (and not clean this time) if that would work [09:06] then maybe just reject the sync? [09:06] sil2100: should i just go here on the channel and ask the release tema? [09:08] pete-woods, yes, rejecting the sync is fine [09:09] pete-woods, if you need a landing feel free to give me the merge requests urls, I can put one for you (I think thostr is off today) [09:09] seb128: the silo's in a weird state now, though, the branches have been merged, but the spreadsheet doesn't know it's clean [09:10] seb128: https://code.launchpad.net/~unity-api-team/hud/dbusmenu-safety-valve/+merge/212668 is the one [09:10] that branch is based on top of the merged trunk, though.. [09:10] sil2100: i'd like to flush the siloi to get started with the more important oxide branches for webbrowser-app [09:11] pete-woods, the weird state is because thostr stopped the clean job [09:11] pete-woods, but the ppa was already cleared [09:11] seb128: ah, he must have got my "wait, don't clean the PPA" ping too late [09:12] sil2100, Mirv, didrocks: what's the proper way to deal with that ^? [09:12] dbarth: yeah, sorry, let's try doing that - was busy with something [09:13] seb128: so, something was cleared, but the job was stopped? [09:13] seb128: and so unassignement didn't work? [09:13] pete-woods, seb128: so, branches are merged but packages still not released? [09:13] Or is everything in the archive and merged in properly, just the silo is still there? [09:13] didrocks, sil2100: right, the clean job was started, it merged back and send the clean ppa order, then the job was stopped [09:13] sil2100: yes, the packages ended up in the unapproved list [09:13] so things are merged&cleaned [09:14] seb128: wonder why people are doing that [09:14] hum [09:14] which silo #? [09:14] didrocks, because we overlooked that "sync to unapproved" are not copies [09:14] 11 [09:14] didrocks: silo 11 [09:14] seb128: what the link with sync to unapproved? [09:14] didrocks, those syncs are links to the ppa, so when you clean the ppa the item in the unapproved queue becomes void/can't be accepted [09:14] merge and clean will have failed with that [09:15] telling don't merge, things are in unapproved [09:15] didrocks, well, we didn't want to block the silo until beta freeze [09:15] otherwise we are going to be out of silo and locked down today [09:15] so override? [09:15] that's what happened [09:15] nice… :/ [09:15] until we realized that cleaned the ppa makes the upload unvalid [09:15] since the queue doesn't have a copy [09:16] just a pointer to the ppa librarian [09:16] everything was blocked or some components passed? [09:16] you mean? [09:16] didrocks: hud didn't make it, the other package did [09:16] ok [09:16] (libqtdbustest) [09:16] oh, right [09:16] I suggest that you bzr push --overwrite HUD trunk to the previous status [09:17] to reconcile with what's in the distro [09:17] then, we force m&c [09:17] and redo a landing [09:17] didrocks: should I go and reopen the MRs then? [09:18] pete-woods: yeah, rewrite history basically! :) [09:18] okay, cool, I'll do that then [09:18] pete-woods: seb128: if that request is set to landed, that's fine? [09:18] didrocks, can't we just add a landing for a new mp? [09:18] (that's what will happen) [09:18] that would do trunk + that new change [09:18] seb128: depends, is there any? [09:18] yes [09:18] ok, that can work as well [09:18] https://code.launchpad.net/~unity-api-team/hud/dbusmenu-safety-valve/+merge/212668 [09:18] if you don't let the ball dropping and we are not in a middle-state [09:18] pete-woods: ^ [09:19] * didrocks runs m&c with "only free silo" [09:19] didrocks: I'm happy with whichever way you guys think will work [09:19] let put a landing ask for ^ [09:19] * seb128 does that [09:19] pete-woods: yeah, so just file a new request with that branch, but please mention that the rest in the decription will land as well [09:20] it's just frustrating being "unapproved" for bug fixes while if I had a phone FFE I could land anything [09:20] anyway, I'm not interested in moaning, I will get that landing request in [09:20] pete-woods: we are in beta freeze, that's why desktop updates are blocked [09:20] I think the release team is making that more difficult that it should [09:20] they should let stuff in proposed and britney block [09:20] yep [09:22] and then people complain about Touch process ;) [09:24] didrocks, pete-woods, sil2100: l48 [09:24] sil2100: letting you assigned once the current silo is freed? [09:24] (should be refreshed in less than a minute) [09:25] sil2100: done, please assign [09:26] pete-woods: seb128: set manually the previous status to "Landed but HUD" [09:26] didrocks: should I explicitly specify that silo, or just leave citrain to decide which silo to use? [09:26] sil2100: let CI Train deciding [09:27] nothing remained in the silo [09:27] it's really freed and gone [09:29] dbarth: hmmm... [09:29] dbarth: actually, give me some time to think about how to proceed ;/ [09:30] sil2100: sure [09:30] sil2100: i just want to clear decks as much as you do i guess [09:30] Yeah, it's a sticky situation [09:30] seb128, didrocks, sil2100: thanks for sorting me out here , guys :) [09:31] |HELP [09:31] pete-woods: yw :) [09:32] ah interesting [09:32] So deletion and queues don't interact very well [09:32] popey: coming? [09:32] sorry, yeah [09:33] |HELP [09:33] I am the firendly image watchbot [09:33] :) [09:33] Laney, no they don't, pocket copies are not actual copies, they are pointers to the librarian [09:33] Laney, so when you clean the source you loose the data and the unapproved entry becomes invalid [09:33] firendly indeed [09:33] ogra_: I don't believe you [09:33] seb128: I see [09:33] heh [09:34] Not sure if that would be fixable in LP [09:34] but you could use an intermediate PPA [09:34] lol [09:34] more crazyness isn't the answer :p [09:34] just let thing in proposed and review there? [09:35] This argument is already hitting a wall, so I'll go and do something more useful [09:35] yeah, same here [09:35] I guess I don't care enough [09:36] let's hit the silos lockdown situation [09:36] I do, but if there is no option to change anything CI is doing then it's pointless even talking about it [09:36] but I guess that's going to come down back from management on why we lock everything then [09:36] Laney, I guess there is the option, but why isn't release open to consider changes as well? [09:39] Essentially I think that any process designed to work with the archive has to be able to deal with what it does, and that includes freezes sometimes [09:39] It could just be that LP can actually be fixed to work how we want it to here, but I don't know enough to say that [09:39] * Laney EOD :-) [09:39] * wgrant wakes up [09:40] o hai [09:40] Haven't ready all of scrollback, but is the problem that a copy sitting in the queue will fail if the source PPA has the source removed? [09:40] That should work if it's accepted within a week or so [09:41] Yeah [09:41] I assume there was an actual incident, but ... [09:41] infinity warned that if we clean the ppa we screw the items in the queue [09:41] we just took his words on it [09:42] Well [09:42] That was a problem back when stuff would sit in unapproved for weeks [09:42] But stuff is copiable until at least seven days after it was deleted from the origin. [09:42] Would it be possible to notice the reference made by a copy record? [09:43] Not in the current model. [09:44] Fair enough [09:44] There's a redesign in progress, but it's currently blocked on a couple of other big projects. [09:44] Well anyway, I think 7 days should actually be alright for our purposes [09:44] People start pinging after 7 hours, anyway. ;-) [09:44] right [09:50] sil2100: ^^^ you should be alright === tvoss|afk is now known as tvoss [09:53] didrocks: ^ [09:55] ok, then, just m&c with "ignore package in dest" [09:56] tvoss: I would tend not to unless the changes require the new APIs [09:57] cjwatson, yup, same here. But with that, we cannot easily add trunk for the build deps to the silo as per what Mirv said [09:57] dbarth: we might have a solution! [09:57] tvoss: or just wait until the new process-cpp is in trusty and then it won't matter [09:58] dbarth: let me get back to you in a some minutes [09:58] tvoss: bumping the build-deps isn't *wrong*, I wouldn't spend much time agonising about it, but it does impede situations where you might otherwise be reasonably able to backport things [09:58] cjohnston, ack and thanks [10:00] sil2100: ok [10:00] sil2100: Mirv: FYI, when I'll be in a little bit of a quieter place, I'll be able to finish the spreadsheet part and then switch to the new assignement silo/reconfiguration process [10:00] I'll keep you posted [10:03] ok [10:13] davmor2: can you give me the new bug # ref? [10:13] so that I can +1, set the appropriate priority as well [10:14] didrocks: ok ;) [10:17] didrocks: https://bugs.launchpad.net/ubuntu/+source/unity8/+bug/1297770 [10:17] Ubuntu bug 1297770 in unity8 (Ubuntu) "Scopes scroll down till header goes seems to lock the scope in place" [Undecided,New] [10:19] didrocks: I added the secondary icons visible in header as I assume the two are linked [10:22] davmor2: yeah, I think they are [10:22] sil2100: this is the bug to give to the unity8 team as well ^ [10:23] davmor2: please mention it's a regression from latest promoted image and the image # [10:39] dbarth: ok, so, what we'll do - I'll merge and clean your silo (as we need to do some special handling) and then I can assign a new silo for your features [10:39] dbarth: it seems that we can do it now even [10:49] Mirv, Marcus and me are testing silo 14, would be great if you could setup a ppa for testing the process-cpp build-deps [10:51] sil2100: perfect [10:52] sil2100: need me to push some buttons? [10:52] dbarth: no no, all is handled from our side ;) [10:52] dbarth: which landing from your list is now the highest priority? [10:55] Mirv: so, you're going to publishin landing-002 as we discussde? [10:55] seb128: hi, the HUD silo has been tested (and succeeded) now, would you be able to mark it as such for me? [10:56] Mirv: I'll publish the gallery-app silo in the meantime [10:56] tvoss: you can set one at https://launchpad.net/~thomas-voss/ or I can push builds to some PPA when you give me a list of packages to build against the landing PPA [10:56] sil2100: thanks [10:57] Mirv, ack [10:58] seb128: thanks :) [10:59] pete-woods, yw ;-) publishing as well (just not cleaning this time) [10:59] :) [11:00] tvoss: so which way, your PPA or my PPA? :) [11:00] sil2100: uh sorry; it's line 18 [11:00] Mirv, your PPA :) [11:01] tvoss: does this happen to be the correct set: connectivity-api dbus-cpp platform-api platform-api unity-mir unity-scopes-api ? (reverse-depends -b libprocess-cpp-dev) [11:01] dbus-cpp unity-mir and unity-scopes-api are sufficient [11:03] didrocks: so it looks like the header in it's current format will be removed so what do you want to do about it? [11:03] davmor2: I won't take any decision, I guess it's your/QA decision to take [11:04] for it being a promotion blocker or not [11:04] like, are we happy to have users with such bugs on their phone [11:04] Oh I wouldn't block on it [11:09] tvoss: rebuilds of those against landing-014 visible now at https://launchpad.net/~canonical-qt5-edgers/+archive/qt5-beta-proper/+packages?field.name_filter=&field.status_filter=published&field.series_filter=trusty [11:09] Mirv, thank you [11:20] dbarth: oh, but line 18 is still not set to ready - is it ready? [11:24] Mirv, what's up? How were you shown the process? [11:31] sergiusens: morning! Could you release a new gallery-app to the click store? :) [11:31] sil2100: ah wait, yes i was putting on hold [11:31] sil2100: just re-checking the branches real quick [11:32] sil2100, yeah [11:32] sil2100: oh and they're stacked on each other, so i need to flatten that first [11:33] dbarth: ok, just give me a poke once it's ready and I'll assign a silo then :) [11:33] sergiusens: thanks [11:40] sergiusens: the gallery-app would need publishing as sil2100 said. balloons showed me the jenkins job(s) that can be used to build click packages, and explained lp:click-toolbelt having a tool to push those packages [11:44] Mirv, yeah, can you install click-toolbelt into a vitualenv? [11:45] sergiusens: nope, since the install fails at some point to "TypeError: dist must be a Distribution instance" [11:46] Mirv, yeah, make the virtualenv python2 [11:46] Mirv, we need to tell pindonga about that py3 bug === vila changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | Vanguard: cprov | CI Train support - US: robru, cyphermox, rsalveti - EU: sil2100, Mirv, didrocks | CITrain support no answer: use mup bot after 30 minutes, but choose right timezone | Known issues: - [12:21] sergiusens: (first time using virtualenv) even if I use virtualenv --python=python2.7 I get the same error. installing python-stevedore from archives instead of fetching it via the easy_install resolves that problem at install time, but I still get some DistributionNotFound error when trying to execute the resulting bin/click-toolbelt [12:21] hm, I don't have that error [12:22] some pastebin instructions on how you install lp:click-toolbelt could be enlightening [12:23] Mirv, all I did from trusty was; virtualenv [path]; [path]/bin/activate; bzr branch lp:click-toolbelt; cd click-toolbelt; python setup.py install [12:25] Mirv, anyways, direct uploads is broken... talking to pindonga about it and he confirmed... http://paste.ubuntu.com/7156378/ [12:26] manual uploads seem broken too :-/ [12:27] sergiusens: tried http://pastebin.ubuntu.com/7156410/ [12:27] sergiusens: right [12:28] Mirv, try installing oauthlib locally [12:28] popey: are you getting the welcome screen locking for a while most times you wake the device? [12:28] yes [12:28] suspected it's the queuing issue [12:29] yeah [12:29] it seems to take longer the longer it was suspended [12:29] which kind of points to the queue issue [12:29] sergiusens: both python-oauthlib and python3-oauthlib seem already installed, or do you mean locally as in force its installation to the virtual env too? can try. [12:29] takes nearly 30sec in the morning for me [12:30] that's the answer I was hoping for atleast :) [12:30] sergiusens: thanks for the e-mail anyway, in case I'm required to do some publishing at some point [12:30] i guess there is a lot of sensor events and such that pile up [12:31] * davmor2 must remember to try ringing his phone after it has been off for a while, now where did I put that pad [12:31] heh, did anyone try the new scopes on flo already ? [12:32] the font in my Apps header is slightly moved to the center after boot [12:32] only moves to the left once i switched back and forth between scopes [12:32] Mirv, sure, just copy that into~/.config/click-toolbelt/click_toolbelt.cfg [12:34] Mirv, ok, with python3 (and yes this feels broken), just do python setup.py install in a loop until it works (just tried myself) [12:36] sergiusens: ... [12:36] sergiusens: works :S [12:36] ;) [12:37] Mirv, ugly; but the dev told me to do this; it's one of the reasons I asked for proper packaging on the list... [12:37] this fits well in my (granted, very limited) experience of "easy" install, ruby gems and so on [12:38] sergiusens: ok, I'm set up then, in case the uploads start working at some point and something in addition to the currently pending gallery app is needed during EU timezones [12:39] * davmor2 has poached popey 's excellent idea of a pad for quick notes/bugs you need to file :) [12:40] unfortunately it's now filling up :) [12:40] geez, just dont add stuff then ! [12:42] Mirv, sil2100 so I can't upload the new gallery until the store gets fixed [12:42] popey: erm what. On the desktop pull down the system inidcator what is lock now called :) [12:44] sergiusens: ok... any ETA on that? [12:46] davmor2, not sure what you describe, the indicator-session items didn't change [12:47] sil2100, I don't have one [12:50] Mirv, I would like to the unity-scopes-api branch out of the silo [12:50] sergiusens: Mirv: ok, the spreadsheet is ready… I'm going for a run now. However, we'll see depending on ping crazyness if I deploy it today or tomorrow [12:50] Mirv, take it out [12:50] tvoss: you can do that yourself [12:50] tvoss: just reconfigure with the list of MP and remove the unity-scopes-api from it [12:51] (but we need to remove the package if there is no more MP associated to it) [12:51] didrocks, in the silo tab? [12:51] tvoss: yeah, if unity-scopes-api has been built from a MP [12:52] tvoss: if you do that ^ I can remove the package fro the PPA [12:53] didrocks, Mirv when I try to alter in the silo tab, I only get a formula [12:53] * tvoss is scared [12:53] tvoss: hum, see the "reconfigure" button? [12:53] seb128: in the live session it's called start screensaver I'm assuming because there is no password for lock. I was just double checking that it was lock on a real desktop rather than rebooting [12:54] davmor2, real desktop is fine [12:55] seb128: okay cool [12:58] didrocks, Mirv I reconfigured here: http://162.213.34.102/job/landing-014-0-reconfigure/9/ [12:58] great :) [12:59] tvoss: looks good :) I removed the unity-scopes-api from the PPA now [13:00] Mirv, thanks [13:02] sil2100, seems the bug is soon to be solved; given it's backened it might take a bit to propagate === alan_g is now known as alan_g|lunch [13:04] sergiusens: excellent! [13:08] didrocks: hello, we are discussing adding a staging branch for the ubuntu-ui-toolkit [13:08] didrocks: I have a proposal here https://docs.google.com/a/canonical.com/document/d/1rgXqqCeGg9JjHEHmDHOfhBJOGTgk7luBuBbpzNTMMLk/edit# [13:08] didrocks: it would be good to get your feedback/approval on that :) [13:09] * sil2100 goes for a longer lunch [13:21] Mirv, okay, with silo 14 reconfigured, and the rebuild packages from your ppa, things still work. Could you give it a quick spin, too? [13:31] didrocks: hello there. How can I become a lander for ubuntu-push? :) [13:32] tvoss: ok I updated my phone with those two PPA:s and even removed the libprocess-cpp0, indeed I don't notice anything different [13:33] Mirv, okay, that's good in this case, so I will set the silo to tested [13:33] Mirv, thanks for the help :) [13:33] Mirv, done [13:34] is there an easy way to point at a /usr/lib/{multiarch}/yadda/yadda from an upstart script? [13:38] tvoss: ok. I'm going to run "watch only" build job now first since it seems the spreadsheet doesn't update correctly. [13:38] oh, right there's an eternal build job running already [13:39] so, let's see if watch only correctly notices just the process-cpp [13:40] tvoss: darn, you've a small ppc64el problem that would prevent the package from migrating to release pocket since it built there before: https://launchpadlibrarian.net/170746201/buildlog_ubuntu-trusty-ppc64el.process-cpp_1.0.0%2B14.04.20140326.1-0ubuntu1_FAILEDTOBUILD.txt.gz [13:41] why that is only on ppc64el I don't know [13:44] tvoss: and the build problem wasn't visible on the dashboard since there was a stalled build job running for the silo that waited eternally for unity-scopes-api [13:44] should be trivial to change anyway [13:53] Mirv, cjwatson updated the symbols file [13:53] sergiusens: are you able to find time to drive (test) your landings in silos 010 (phablet-tools) and 005 (usensord, platform-api) soon? just wondering since they've been built for quite some time now. [13:53] still weird ... [13:53] tvoss: ok! kick a rebuild then. now it shouldn't stall on unity-scopes-api anymore. [13:54] sil2100: silo-13 ready to be released [13:54] Mirv, I thought usensord and platform api were unassigned already two weeks ago+ [13:55] Mirv, for silo 10; I can deal with that today if doanac has a minute to spare [13:55] Mirv, kicked [13:55] doanac, can you rerun a full ci with the phablet-tools from silo 10? [13:55] sergiusens: ok. does that mean the usensord/platform-api silo should be cancelled? [13:56] sergiusens: I think the silo was temporarily freed, but the line was not removed so it got a new silo since it still looked like it would be wanted to be landed [13:57] Mirv, needs some fixing from ricmm; I'll talk to him today [13:59] sergiusens: ok, I'll let the silo then be still there but add a comment with that info === alan_g|lunch is now known as alan_g [14:09] davmor2, popey, hey you english speakers ... is there a bug open for all translations missing for the new scopes ? :) [14:09] dpm, ^^^^do you know if anything is in the works here ? [14:10] ogra_, no, I don't know, I've just realized this myself [14:10] I think the new scopes don't support translations [14:10] lol ? [14:11] oof [14:11] but perhaps Saviq knows more on whether the translations for the new scopes are still provided by the shell or by the scopes themselves ^ [14:11] dpm, scopes [14:12] dpm always backends, we in unity8 can't even dream to be able to hold all the translations for all the possible scopes etc. [14:12] in that case, they need to add i18n support [14:12] thanks Saviq [14:12] yup [14:12] sergiusens: sure thing [14:13] is unity-scopes-api the best place to file the bug? [14:14] dpm, basically each scope in question needs to enable i18n for its own strings, -api might facilitate a bit, but there's also smart scope server that we need to make sure gets the locale from the device and communicated to the scopes [14:14] dpm, so probably a bug with real many tasks - unity-scopes-api, unity-scope-click, unity-scope-scopes, unity-scope-mediascanner2, $smart-scope-server [14:15] oh dear [14:15] dpm, given that went completely unnoticed ansd we want to be regression free in the future, i wonder if it makes sense to have translateability as a landing criteria ... i.e. if something lands that was possible to translate before it has to fulfill that requirement too before being allowed to land [14:16] ogra_, that sounds sensible (and great!) to me, but I'm easy to convince when it comes to internationalization :) [14:16] heh [14:17] i think it isnt necessary to require translations, but at least the code need to keep the ability to be translated in a new iteration when it lands [14:17] +1 [14:17] ogra_: no idea [14:17] doanac, if that works we are going to finally be able to get some traction :-) [14:17] didrocks, asac ^^^^ i wonder how to put that down as a "policy" [14:20] sergiusens: http://q-jenkins:8080/job/andy-smoke-daily-test/4/console === cprov changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | Vanguard: retoaded | CI Train support - US: robru, cyphermox, rsalveti - EU: sil2100, Mirv, didrocks | CITrain support no answer: use mup bot after 30 minutes, but choose right timezone | Known issues: - [14:22] seb128: Why are you taking my name in vain? I'm not the one who warned against silos and freezes. :P [14:23] infinity, do I get to take a penalty card? and a few more for lying? :p [14:23] seb128: Have a whole deck. [14:24] :-( [14:24] but yeah, checking logs, it was stgraber who said that [14:24] ogra_: dpm: I have list of projects not loading translations [14:24] infinity, my apologies [14:25] didrocks, right, i think we should make it a policy that formerly translated code still needs to be translateable, even after a major rewrite before it lands [14:25] Chipaca: ask to asac, he's giving the landers card (but I think your team already have 2 ;)) [14:25] didrocks: from your POV, who is my team? [14:25] t1mp: well, I can give a look. Won't approve as discussed at UDS as you're shooting in your own feet IMHO [14:26] t1mp: I just want that if one day there is a regression, I don't want to have to pull whole trunk to have a fix. So the more work to get the fix will be on you [14:26] Chipaca: I didn't followed last tractation, but I thought you were moved to phonfundation [14:27] ogra_: agreed [14:27] (this is why i pinged asac too, not sure where we should put down such things ) [14:27] didrocks: at that granularity, I was teamless for a while; now I'm in "dash-server" [14:27] didrocks: how are we shooting in our own foot? Because we add an extra layer between the initial MP and landing in the image? [14:28] didrocks: I mean, you think we can have problems there that will cost us more time to fix? [14:28] t1mp: yeah, and no focus on getting things fixed, no automated feedback on the AP tests and so on [14:28] t1mp: and yeah, on the cost to fix [14:28] didrocks: what do you mean with automated feedback on AP tests? is that something we have now? [14:29] t1mp: you have in your trunk, with manual testing [14:29] didrocks: the standards still stay high. Before landing we run all the AP tests just like now [14:29] t1mp: I don't think you will afford the same testing on every commit in your trunk [14:29] all AP tests on all your dependencies? [14:30] didrocks: commit to trunk comes from the landing. You mean that we do less testing on each MP before it is approved to be merged in staging? [14:30] Chipaca: I'm fine with it, however, you would need some pre-training, do you think ralsina or anyone you feel close to being a lander can help there? [14:30] didrocks, Chipaca: haappy to help, I did a bunch of landings before [14:30] t1mp: right, I don't think you will be able to run manually all AP tests on all your rdependencies on every single MP + the test suite of manual tests [14:30] some of them even succesful! ;-) [14:30] ralsina: heh :) [14:31] didrocks: that is exactly what we are doing now for each MP [14:31] t1mp: you run like dialer-app AP tests for each MP? [14:31] t1mp: and all click apps? [14:31] didrocks: yes [14:31] ralsina: you're a lander? [14:31] didrocks: we discussed that as a requirement in the SDK team, but it does not seem feasible now that's why we are discussing an alternative [14:31] Chipaca: I think I still am, yes [14:31] :) [14:32] t1mp: on the device? waow, I'm unsure why we got this complain when you needed to do that at each landing then [14:32] didrocks: yes we do it on the device [14:32] t1mp: great then, I have no objection, you just do manually what the airline will do automatically [14:32] didrocks: maybe we are putting the standards for the MPs too high? [14:33] didrocks: it sounds great, but it is a big burden, especially since we decided not to top-approve an MP if not all tests pass [14:33] t1mp: I guess it's costly, but I prefer that the contrary :) [14:33] didrocks: and some times tests/apps are broken, so we are slowed down a lot in top-approving MPs [14:33] Saviq, ogra_ bug 1297889 (I still need to find out the project for the remote scopes, though) [14:33] bug 1297889 in unity-scope-scopes (Ubuntu) "Add i18n support to scopes" [Undecided,New] https://launchpad.net/bugs/1297889 [14:33] ++ [14:34] ogra_: hmm. not sure if and how we should really try gating translatability. we might want to include it in the upstream checklists so the reviewers know about this. [14:34] didrocks: so the problem is, like this we get a backlog of MPs [14:34] Chipaca: gave you the rights. Please check with ralsina on the process and test plan requirements :) [14:34] didrocks: the idea is to relax the requirements a bit for MPs to merge into staging, so we proceed with staging, and then before landing it in image and the trunk we keep the same requirements of 100% passrate [14:34] * Chipaca sets everything on fire [14:34] t1mp: what is preventing you to land all the approve one? [14:34] dpm, thanks [14:34] asac, i think its a regression if formerly translated apps come without i18n support after an update [14:35] asac, so code that had it before needs to also have it after upgrade ... [14:35] didrocks: nothing, but because we require 100% OK before approving, we don't have approved ones now [14:35] didrocks: just a lot of MPs that are basically approved, but need to pass all the tests before top-approving [14:35] t1mp: so you lower your standards to be faster? [14:36] (doesnt mean there need to be translations immediately, but the gettext support, the .pot file etc should be there) [14:36] didrocks: for staging, we will no longer require 100% OK for all app tests if we don't have an image at that moment for which we know that all tests are OK [14:36] didrocks: and then when we get 100% OK for all apps in staging, we do a landing [14:37] t1mp: how will we not come back in a situation where you don't land anything for 2 months and half? [14:37] bzoltan / zsombi / kalikiana ^ please correct me if I am saying something that you don't agree with [14:37] which happened in the past [14:37] didrocks: we kind of are in that situation now, and we are thinking of ways to avoid that, [14:38] didrocks: so if there is no image that we can use for testing, we can still decide to approve MPs to go to staging [14:38] t1mp: seems you need to find a way to think why you can't land your MPs now [14:38] as you don't have any lock [14:38] or pend on us [14:38] didrocks: perhaps now with image 262 it will work, [14:39] didrocks: but the past week there was no image with which I could get 100% OK from all the tests [14:39] t1mp: well, as told you the other day, compare with just latest proposed image dashboard [14:39] t1mp: and see if you reproduce the same issues or not [14:39] didrocks: I was told we should use the proposed image, but there can always be some tests of which we are not sure they will pass without even having changes in UITK that we want to test [14:39] t1mp: you don't need to be 100%, you need to not regress the dashboard [14:39] meaning, each failure to be analyzed [14:39] didrocks: that would be relaxing our current standards of 100%. [14:39] if already in the proposed image -> ignore [14:40] t1mp: yeah, nothing into that involve using another branch though [14:40] didrocks: we have a lot of MPs, and we would have to analyze it for each MP? in the staging proposal, we would have to do that for each landing, not for each of the MPs that are part of the landing [14:40] t1mp: no, get one landing with a bunch of MP [14:40] test that [14:41] and reiterate [14:41] didrocks, can I have silo for row 49? [14:42] didrocks, in lieu of thostr I took over click scope landings [14:42] Saviq: sure, looking [14:42] Saviq: btw, any progress on the crashers? [14:43] didrocks, yours is still not reproducible [14:43] didrocks, davmor2 [14:43] didrocks: ok, so we drop the high standards for the MPs and move those to the landing only [14:43] Saviq: theone in the dashboard? [14:43] didrocks, does not retrace [14:43] didrocks, /me needs to up kill timeout again... [14:43] Saviq: can you add a longer timeout? [14:43] yeah [14:43] didrocks, but! [14:43] Mirv -> http://paste.ubuntu.com/7157039/ <- popey can you test [14:43] Saviq: as we have it at every image test run, it's quite high [14:43] didrocks, since that doesn't affect tests, I say that's an exit crash [14:44] sil2100: any news from bfiller on the telephony-service crash? [14:44] Saviq: we have one test which failed [14:44] in which case it'd be bug #1256360 [14:44] bug 1256360 in Mir "unity8 crashed with SIGSEGV in glDeleteTextures() from mir::scene::GLPixelBuffer::~GLPixelBuffer() from mir::scene::ThreadedSnapshotStrategy::~ThreadedSnapshotStrategy()" [High,New] https://launchpad.net/bugs/1256360 [14:44] didrocks, yeah, not a crash but a flakyness that we thought was fixed [14:44] Saviq: see 2 images ago [14:44] Saviq: argh [14:44] ok [14:44] Saviq, didrocks: I've not been able to reproduce it [14:46] Saviq: let's keep it on the radar, shall we? We'll downgrade it if we don't see more issues tomorrow, ok? [14:46] Saviq: still, bump the timeout [14:46] seb128: if it was in the trusty unapproved queue, it should still be there, shouldn't it? A silo clean shouldn't have rights to remove packages from the unapproved queue [14:46] Saviq: assigned btw [14:46] didrocks, thanks [14:46] didrocks, yeah, would be nice if we had a "kill timeout none" [14:46] seb128: (which packages, and did this already get sorted while I was sleeping? :) [14:46] Saviq: +1 [14:46] didrocks, I can't find the failed test in smoke? [14:47] slangasek, that got sorted out thanks [14:47] Saviq: didn't you say you already analyzed it? [14:47] didrocks, yeah, but wanted to give it to Albert [14:47] Saviq: argh, it's been rerun, maybe vila would have the link [14:47] slangasek, well, a silo clean does clean the ppa, or pocket copies are not actual copies for librarian pointers, so the target is cleaning and the queue item becomes buggy [14:48] slangasek, though wgrant said it takes a week before the librarian data actually get cleared [14:48] slangasek, so it's still ok if things are reviewed on a timelined fashion [14:48] Right, you have at least a week. [14:48] otherwise, I'll have to reuse the same tricks than for SRU [14:48] meaning, copying to another ppa [14:48] seb128: oh, right. stupid unauditable pocket copies. :P [14:48] and requesting the sync from that [14:49] (this is the SRU mode of cu2d) [14:49] yeah, that's what Laney suggested earlier [14:49] well, the code is already there just in case [14:49] seems like the release team would like that [14:49] involves more complexities I guess if we kick something from unapproved and want to reland the same day [14:50] didrocks, Saviq : context ? [14:50] vila: the unity8 AP test failing, you mentionned you rerun it IIRC? [14:50] vila: do you have a link to it in any case? [14:51] on q-jenkins probably, on ci.u.c harder, let me check [14:52] didrocks, Saviq : https://jenkins.qa.ubuntu.com/job/trusty-touch-mako-smoke-daily/185/testReport/junit/unity8.shell.tests.test_emulators/DashAppsEmulatorTestCase/test_open_preview_Native_Device_/ [14:52] vila, thanks [14:52] thanks vila ;) [14:53] didrocks: boiko looking at crashes, one due to qtubuntu/mir crash. he's trying to fix the indicator related crash - looks valid [14:53] . o O (I wish I understand how my memory kept track of 185...) [14:57] didrocks: I'd hope the >7 day case is rare enough that we can reupload if that happens [14:57] should be able to fish the code out of the tag in bzr anyways [15:00] bfiller: thanks! (what's the one due to qtubuntu/mir crash?) [15:00] Laney: yep [15:01] didrocks: don't know exactly, boiko can give the details [15:01] boiko: ? ;) [15:01] vila: human mystery… [15:01] didrocks: I believe he said dialer-app is crashing becuase mir crashes [15:01] didrocks: let me paste the backtrace [15:01] oh, the dialer-app crash we have for so long? [15:02] didrocks: not sure, might be a different one: http://paste.ubuntu.com/7157131/ [15:02] didrocks: but I would bet the root cause is the same: starting the application from command line instead of using upstart [15:03] boiko: interesting… I thought AP was using upstart though [15:03] didrocks: nope, at least not for the telephony-apps [15:03] boiko: on silo 013, I never remember if address-book-app is click [15:03] boiko: ah, would make sense [15:04] didrocks: not yet, still a deb [15:04] thanks bfiller, boiko, publishing it [15:04] didrocks: yesterday cwayne was showing me an MR to change the addressbook to be launched using upstart [15:04] didrocks: thanks [15:04] boiko: I will file a bug for this MIR issue, looks to be a legimate bug [15:04] yw [15:04] (migrating now) [15:05] bfiller: I think I will give it a try on making autopilot use upstart to launch the app [15:06] boiko: wouldn't that be an infrastructure change needed across all of the tests for all apps? [15:06] yeah, seems weird to be it needs to be defined on each app [15:06] the default should be to use upstart [15:06] with a possible override for very special cases [15:06] bfiller: if the changes cwayne did for his address-book-app are correct, that's not really a big change [15:08] boiko: that stack trace you pasted was from the dialer-app.crash file? [15:11] didrocks, boiko, kgunn : here is a bug for the qtubuntu crash causing the dialer to crash: https://bugs.launchpad.net/ubuntu/+source/qtubuntu/+bug/1297900 [15:11] Ubuntu bug 1297900 in qtubuntu (Ubuntu) "crash QUbuntu: Could not create application instance" [Undecided,New] [15:12] note, this seems to be a different issue than the previous mir related crashes that were causing dialer to crash [15:12] bfiller: ah, interesting, so do you think it should be in a high priority list? [15:12] or do we put that as the other dialer-app crash "don't impact user experience, so no mention" [15:13] didrocks: well, I think it's high priority in that it possible would affect all apps during launching [15:13] ok, noting it down then [15:13] didrocks: not specific to dialer, but a platform bug that should be addressed I think [15:14] bfiller: yeah, understood [15:14] didrocks, Saviq: jfunk has agreed that the header issue shouldn't be a blocker as long as the bug remains tracked and isn't an issue in the new header code, so treat it as a bug against the new header. [15:14] didrocks: the good news is that on the device itself apps are launched via upstart-app-launch and won't go through this code path I believe [15:14] bfiller: yeah, so just high priority, not blocker [15:14] didrocks: yup [15:14] davmor2: so, he's going to track it? [15:15] didrocks: well I'll possibly need to track it and test it on the new header but yes it will be monitored [15:15] ok [15:19] dbarth: just one merge in the landing :o ? [15:20] sergiusens: looking good for the first autopilot test: http://q-jenkins:8080/job/andy-smoke-daily-test/ws/clientlogs/friends_app/test_results.xml/*view*/ [15:21] based on my simple computer science experience if it works for x=1, it should work for x=infinity :) [15:21] i'll let you know when its done though === alan_g is now known as alan_g|tea [15:23] doanac, the concerning ones are music, calendar and gallery iirc; good to know it didn't break [15:24] doanac, not sure if after this runs you want to do some subunit things [15:24] sergiusens: yep. i'll start working on using subunit in our daily image testing after we get this landed [15:24] Mirv, the build succeeded \o/ === alan_g|tea is now known as alan_g [15:27] ogra_: if you continue to troll on the ML, I'm about the send the "let's do a pool" argument! [15:27] haha [15:29] sil2100: ok, good now [15:29] sil2100: yes, just 1 [15:29] dbarth: let me see if we can assign [15:30] tvoss: publishing then ;) [15:31] dbarth: in the meantime, please include some test plans for the landing :) [15:39] popey, hey, sorry for reping, but did you see my message about a new gallery in the store? [15:39] sergiusens: i did not [15:39] so thank you [15:40] sil2100: yeah, the test plan must be huge, but i will put something together [15:40] sil2100, thx [15:41] dbarth: ok ;) If anything, a silo is assigned [15:41] popey, then Mirv might have not see it either :-) [15:42] sil2100: saw that; thanks a lot [15:42] bfiller: I didn't get an update on bug #1297395 btw [15:42] bug 1297395 in mediaplayer-app (Ubuntu) "mediaplayer-app crashed with SIGABRT in __libc_do_syscall()" [Medium,Confirmed] https://launchpad.net/bugs/1297395 [15:43] bfiller: do you think it's the same qtubuntu one? [15:47] robru, double question; can you review the MR in line 50 and also provide a silo? [15:47] am I the only one that is now tired of not being able to hear calls cause the volume was turned down for the Music app. Please can we have different volumes for all the sections pretty please :D [15:48] sergiusens: it's a new package, yes? [15:49] sil2100, yes === gatox is now known as gatox_lunch [15:51] sergiusens: not sure if robru is around yet - in the meantime I'll take a look at the packaging as well [15:52] didrocks: haven't looked at this yet [15:52] bfiller: ok, keeping on the list, feel free to answer on it [15:53] didrocks: will look into it today [15:53] sure, thanks! [15:58] sergiusens: commented on two issues that I noticed on first glance - thanks! [15:58] thanks, will look [16:01] sil2100, how do I demangle symbols? [16:01] c++filt I know [16:01] but in one shot [16:02] sergiusens: I have a nice line prepared for that, one moment [16:03] and it's in the wiki! [16:03] sed 's/ \(_.*\) \(.*\)/ (c++)"\1" \2/' symbols | c++filt >new_symbols (I use this) [16:03] didrocks, yeah, I give that reply and it never works ;-) [16:03] :-P [16:04] sergiusens: I also commented on the branch with a proposition more to the upstream about restricting which symbols they export ;p [16:04] sergiusens: since I see the symbols files are huge, not sure if we need all of those visible to the whole world! [16:04] sil2100: man that sed has such glinty eyes [16:04] It also makes managing symbols files much easier [16:05] sil2100, that's jhodapp's problem I asked him about that and he said it should be abi stable [16:08] sergiusens: yeah, indeed that's why I mentioned it's more of a proposition for upstream, but still [16:09] sil2100, yeah, I understand, it's going to be his problem and he will likely fix it if it comes to it [16:13] sil2100, ok, I've pushed, thanks; let's wait for the bot to say I didn't screw up those symbols [16:14] sergiusens: ok, thanks for the fixes! I'll double check again, but I guess otherwise the packaging looks ok [16:15] sergiusens: approved gallery [16:20] tvoss: hi! So, regarding that process-cpp landing - there was no ABI break, right? [16:20] tvoss: just the soname got bumped? [16:21] sil2100, there was an ABI break, but no one used that API thus far [16:21] sil2100, that's why I bumped the so name [16:21] tvoss: since sadly, I discussed it with Mirv right now on what tests he did, and I think sadly we'll have to add to the silo some no-change rebuilds of all the rdeps for this package [16:22] sil2100, I discussed that with cjwatson, too [16:23] sil2100, why would we have to trigger the rebuilds if things still work? we tested it from Mirv's ppa [16:23] tvoss: what was his opinion on this? He also thinks it's needed? Since from my understanding, if I'm thinking correctly, this might lead to a situation where all the rdeps will be uninstallable [16:24] tvoss: since basically libprocess-cpp0 stops existing in the archive, and now dbus-cpp and the others are still depending on that package, can't find it and cannot be installed [16:24] tvoss: Mirv said he used his PPA with no-change rebuilds of all rdeps [16:24] sil2100, okay, I asked for that and people told me that there is no need for the rebuilds [16:24] So basically his PPA had the thing that we would need to have in the archive, I guess [16:25] hmm... I might misunderstand something, but I think this is how it would logically work [16:25] sil2100, okay, so we need empty mp's for all rdeps? [16:25] didrocks: ^ can you help me and tell me if I understand correctly? ;p [16:26] tvoss: probably, but let's wait for a packaging-master to comment, since Mirv also agreed on my concerns but we're both a bit weary === tvoss is now known as tvoss|afk [16:32] sil2100: I'm in a meeting [16:32] so just do what you think is the best [16:33] ACK ;) [16:42] bfiller: sorry, I went for lunch, yes, it is from the dialer-app crash file [16:43] sergiusens: well, it seems that the package doesn't want to build on my system when using bzr bd - symbols file problem [16:56] popey: install an app and see if it is still listed in the Available section === bfiller is now known as bfiller_afk [16:59] sil2100: will stay in meeting, please lead that one [17:00] didrocks: ok [17:02] sil2100, yeah, demangling broke [17:02] sil2100, same can be seen on ci [17:06] sil2100, can I just revert the demangling? [17:10] didrocks, ^^ [17:10] * sergiusens doesn't like this part [17:16] C++ symbols are really a PITA to tell the truth, I think non-demangled symbols would result in a NACK from core devs though [17:16] sergiusens: who's upstream for this? [17:16] jhodapp [17:17] sil2100, the qt landings have non demangled symbols though [17:17] The more I read the C++ FQA (sic) the more I think providing C++ interfaces at all is a mistake :-) [17:17] (Not that I expect people to agree) [17:18] sil2100, didrocks: I have to step out, will be back in ~30 minutes. feel free to email me with anything you want me to take care of [17:18] sergiusens: you would have to ask some core dev if it's ok to provide mangled names in symbols files, but I would certainly not want something like that - I would opt for poking upstream, getting a nice symbols map and exporting only needed demangled symbols [17:18] robru: ok [17:18] heh; while c++ is nice to write, it's really hard infra wise [17:19] sil2100, well rsalveti gave me a review and said it was ok; he's a core dev [17:19] cjwatson, sergiusens: I noticed that once you restrict what you export in C++ then the symbols can be a bit less painfull ;) [17:20] Absolutely [17:20] Ok then, I guess we can proceed with reverting the demangling [17:20] Good idea in any library of course, it's just more obvious in C++ [17:20] sil2100, can you guide jim into doing that? [17:20] sergiusens: sure, let me send him an e-mail [17:21] We can take care of that in a separate landing then, I won't argue with a decision of a core-dev ;) [17:23] didrocks: so, from our meeting - a bug worth mentioning in our landing e-mail: https://bugs.launchpad.net/ubuntu/+source/unity-scope-click/+bug/1297965 [17:23] Ubuntu bug 1297965 in unity-scope-click (Ubuntu) "If I install an app it still shows in Available section" [Undecided,Confirmed] [17:23] didrocks: Alan found another one that might be related: #1297436 [17:23] ok [17:23] oh, ubot5 didn't react [17:23] LP: #1297436 [17:23] sil2100: who is working on it? [17:23] Launchpad bug 1297436 in unity-scope-click (Ubuntu) "Blank preview when click not on store server" [High,Triaged] https://launchpad.net/bugs/1297436 [17:24] didrocks: no one yet, proceeding to ping someone, it was filled in during the meeting [17:24] ok [17:24] sil2100: last upload did that? [17:25] didrocks: we're suspecting it has something to do with the scopes transition === jasoncwarner___ is now known as jasoncwarner [17:25] davmor2: did you try bisecting when it appeared? [17:25] sil2100: ping pawel [17:35] didrocks: ok, it seems a fix for that bug is in the works, dobey knows about it and alecu has a branch fixing that in-progress [17:35] didrocks: hey, so on silo landing-013 I have this message that account-plugins is in the UNAPPROVED queue, do I have to take any action on that? [17:35] huh? [17:36] boiko: no, sadly, it's because of the beta freeze [17:36] boiko: we have to wait - we can force a release of the silo if needed, but we're only doing that when there is some high-priority needs [17:37] boiko: let me check the landing in mention [17:37] sil2100: I just wanted to merge the changes on address-book-app and address-book-service to their respective trunks [17:37] boiko: or you can bribe the release team [17:38] didrocks: that depends on how desperate renato is to get his stuff landed :) [17:38] ;) [17:38] heh [17:38] boiko: #ubuntu-release for such requests [17:39] didrocks: ok, I will join there and ask [17:39] thanks [17:40] yw [17:41] boiko: if you commit to really look at it, you can m&c with "ignore package in dest" [17:41] boiko: but please, look if it's getting block anywhere for no reason [17:41] didrocks: sil2100: so, just to make sure, the address-book-{app,service} upload was ok, right? it is only the account-plugins that is unapproved === fginther changed the topic of #ubuntu-ci-eng to: Ubuntu CI Engineering Team | Vanguard: fginther | CI Train support - US: robru, cyphermox, rsalveti - EU: sil2100, Mirv, didrocks | CITrain support no answer: use mup bot after 30 minutes, but choose right timezone | Known issues: - [17:41] boiko: yes, everything else landed in the archive [17:41] boiko: right!, those should have go to the destination if it doesn't say anything about it [17:41] boiko: they are fine without account-plugins btw? [17:42] boiko: just this one is in the unapproved queue [17:42] didrocks: yes, they are [17:42] didrocks: the account-plugins change is going to be needed later when we merge contact syncing support [17:42] ok, feel free to run "m&c with "ignore package in dest" [17:43] didrocks: yep, will do [17:43] didrocks: sil2100: thanks [17:43] boiko: just be sure to look at if it gets blocked somewhere or not later :) [17:43] boiko: don't overuse that option please :p [17:43] After the freeze [17:43] didrocks: up to now I didn't even knew it was possible, and sure I don't plan to overuse that :) [17:45] until when the freeze is going to be in effect? [17:47] boiko: if you have stuff blocked in UNAPPROVE and you know that the rest which transition is fine [18:07] sil2100, can we get a testing landing silo for jhodapp even if the MRs aren't final? [18:25] sergiusens: guess we can get a silo with the mrs we currently have [18:25] and keep iterating that once we get the other ones [18:25] they will be around later today afaik anyway === bfiller_afk is now known as bfiller [18:25] reconfigure && build for every additional mr we get [18:26] rsalveti, yeah, I can't reconfigure when new projects (trunk/source packages) show up; but that's the gist of it [18:26] hooray! [18:26] sergiusens: I can, just ping me [18:27] at least I could last time I tried [18:27] but we have robru :-) [18:27] he's like a landing machine [18:27] rsalveti: sure am! what needs doing? [18:27] robru: nothing now, but might need help reconfiguring a silo later today [18:28] rsalveti, robru well we can get one assigned for starters :-) [18:28] rsalveti: sure just ping me. I'll try to be responsive (I'm currently on a network that is blocking IRC, so I'm using the web client, so I may not see pings as promptly as I normally do) [18:31] sergiusens: at https://code.launchpad.net/~sergiusens/media-hub/packaging/+merge/209926, don't we need to change the changelog version entry to be compatible with CI as well? [18:31] plars: I see the --no-provision landed :) [18:31] like we had for ofono [18:32] t1mp: yep [18:33] rsalveti, it already is; ci train adds the +$(date) by itself [18:33] sergiusens: got it, great then [18:33] plars: ok, I'll try it now. [18:34] plars: provisioning now. When its done, I install the debs from the MR, and then I try run-smoke. Still have to see which parameters to use [18:35] kalikiana: ^ [18:37] robru: btw, in case sil2100 didn't mention it… [18:37] robru: the bug in CI Train was covered by test [18:37] yes? [18:37] plars: ImportError: No module named yaml [18:37] but dch changed between precise and trusty [18:37] plars: do I need python-yaml or python3-yaml? [18:37] and of course, I run the tests on my machine :p [18:37] didrocks: ahhhhhh [18:38] so the fix is in, not deployed (as trunk contains the requestid change) [18:38] which is all ready [18:38] spreadsheet-side as well [18:38] just not enabled [18:38] and I won't do that and bye bye :) [18:38] so my tomorrow morning :) [18:38] didrocks: good call [18:38] t1mp: python-yaml, but I think you might also need utah-client [18:38] robru: supposively, the change will result in: [18:38] - display an ID [18:38] - you copy and paste that ID [18:39] didrocks, you need to start using golang :-) [18:39] lol [18:39] if you reconfigure a silo: [18:39] - just click on the build [18:39] t1mp: I don't recall for sure, I know you need utah though [18:39] nothing else needed :p [18:39] sergiusens: yeah, I'll do that for the bot :) [18:39] didrocks: humm, still copy&paste? well as long as the ID is displayed without quotes the copy&paste will be easier ;-) [18:39] t1mp: you can try just python-yaml first if you like [18:39] no abi breakage, symbol exposure issue or where did I build and run issue [18:39] so much easier to back port a package [18:39] robru: yeah, unfortunately, still no plugin to "inject" that [18:40] t1mp: I know at one time utah-client was needed for the utah (non-autopilot) tests though [18:40] plars: what is the difference between run-smoke and run-autopilot-tests? [18:41] t1mp: run-smoke handles the whole process, run-autopilot-tests does... just the individual autopilot tests [18:41] plars: ./run-smoke --help at least doesn't say it needs yaml [18:41] t1mp: it imports it [18:42] plars: how/where do I get utah? I don't see a package in the archive [18:43] t1mp: ppa:utah/daily [18:43] t1mp: sorry, I mean ppa:utah/stable [18:43] t1mp: I doubt there would be much difference, but you just need the stable one [18:44] kalikiana: ^fyi, the provision.sh script is downloading the autopilot tests from lp for me :) [18:44] robru, rsalveti ok, can we get a silo setup for line 50 then? [18:45] sergiusens: sure [18:46] kalikiana: I started with this ./provision.sh -n ~/network-manager-conf -w [18:48] thanks robru [18:48] sergiusens: ok, got you silo 6. for future reference, please space-separate the list of packages (just like the MP list, it needs to be copy&pasted into a jenkins form that parses based on spaces) [18:48] jhodapp: you're welcome [18:51] plars: ./run-smoke adds the --no-provision option, but in ./run-smoke --help that option is not listed [18:51] plars: is that intentional? [18:52] sergiusens, you might want to add a comment that says to land libhybris and gst-plugins-bad first [18:53] sergiusens: the silo test completed for phablet-tools: http://q-jenkins:8080/job/andy-smoke-daily-test/4/ [18:53] seems pretty good [18:53] jhodapp: why first, will it fail if not there? [18:53] rsalveti, yes [18:53] if so, then we need to bump the build-dep version requirement for them [18:54] in a way that they will not be built because the latest libhybris and gst packages are not there yet [18:54] rsalveti, makes sense [18:54] t1mp: it should be there, are you sure your bzr tree is up to date? [18:55] t1mp: I see it in --help with mine [18:55] rsalveti, there's a tool to bump that right, I forget what it's called [18:55] jhodapp, I'm actually in charge of that and have your list [18:55] sergiusens, ok cool [18:55] thanks [18:55] jhodapp: you need to change debian/control and add that build version requirement in there === alan_g is now known as alan_g|EOD [18:55] for whatever packages that are depending on libhybris and gst-bad [18:56] plars: you are right, I am blind [18:56] doanac, are those two failures just random ones? [18:56] it is there [18:56] robru: hey...after some discussion, i'm giving up line 40 (which is using silo16)....we decided to do it later with some other mp's post beta [18:56] not sure what the protocol is there.... [18:56] doanac, seems so to me [18:56] sergiusens, need me to do that? [18:57] plars: I installed utah-client, but I still get a failure: http://pastebin.ubuntu.com/7158414/ [18:57] kgunn: ahh, thank you [18:57] jhodapp, do what? sorry, context switching is broken for me :-) [18:57] sergiusens, from what rsalveti said: "if so, then we need to bump the build-dep version requirement for them [18:57] in a way that they will not be built because the latest libhybris and gst packages are not there yet" [18:57] robru, you'll be happy to hear we are close to landing silo 10 [18:58] sergiusens: always happy to hear from you! [18:58] sergiusens: build version requirements for whatever packages that are depending on a newer hybris/gst [18:58] in debian/control [18:58] t1mp: looks like you installed utah-client, but not utah [18:59] jhodapp, yeah, that's not in the branch I have control over (media-hub) but the other ones [18:59] plars: I'll install utah-all then [18:59] sergiusens, ok [18:59] rsalveti, yeah, media-hub doesn't depend on hybris [18:59] sergiusens, actually it does [19:01] sergiusens: just a heads up: you might run into a snag with silo 6 because you're attempting to rename the source package. in the past I've seen citrain not deal well with that. give it a shot for now, but you might end up having to push the source package rename directly to trunk first, then rebuild in the silo [19:02] robru, if it comes to it, I'll wipe the changelog completely; music-hub never landed in archives [19:02] robru, oh, I see what you mean [19:03] robru, I'll manually merge it and use the second MR proposed [19:03] jhodapp, I don't see any hybris packages in build-depends for media-hub [19:03] sergiusens: yeah, you might have to. [19:03] plars: it is still failing IOError: [Errno 2] No such file or directory: '/home/tim/dev/ubuntu-test-cases/touch/scripts/clientlogs/all/utah.yaml' [19:03] sergiusens, yeah it needs to be added, libhybris-dev [19:03] plars: after I installed utah-all [19:04] jhodapp, I'll wait for rsalveti's version of choice then [19:04] plars: is something missing? http://pastebin.ubuntu.com/7158446/ [19:05] sergiusens, you could just say the version > what is currently built for trusty [19:07] t1mp: 'ALL' is case sensitive i think [19:08] plars: I think I'm calling it wrong tim@ideapad:~/dev/ubuntu-test-cases/touch/scripts$ TESTS=all APPS=all ./run-smoke --no-provision [19:08] plars: so TESTS=ALL APPS=ALL ./run-smoke ? [19:08] sergiusens: just put current+1 [19:08] ubuntuX where x = previous + 1 [19:08] t1mp: -n [19:08] :) [19:08] rsalveti, ack; there's no hurry anyways; it needs to build in the silo as well [19:08] true [19:08] plars: ok, let's try that :) [19:09] t1mp: doesn't apply to you in this situation obviously, but if you do ever want to run without -n and have it provision for you, make sure that you have ubuntu-device-flash installed. It uses that instead of phablet-flash now [19:11] plars: cool. [19:11] robru, https://docs.google.com/a/canonical.com/spreadsheet/ccc?key=0AuDk72Lpx8U5dFlCc1VzeVZzWmdBZS11WERjdVc3dmc&usp=drive_web#gid=28 [19:11] plars: I've been using ubuntu-device-flash for a while already :) [19:11] robru, please take a look at the link tests as well [19:11] robru, but there is no better test than a full ci run [19:11] :-) [19:11] sergiusens: oh I agree! ;-) [19:12] takes like 6 hours though :-P [19:12] sergiusens, you can use this for media-hub, I just tested it: libhybris-dev (>= 0.1.0+git20131207+e452e83-0ubuntu13) [19:13] sergiusens, I'll let you make that change to your branch, and I'll make the proper changes in the other branches [19:14] jhodapp, yeah, just wait for it; I need to manually merge mine anyways [19:14] sergiusens, that cool, we can change media-hub when you're ready then [19:14] sergiusens, the other ones are almost updated [19:15] sergiusens: published [19:15] plars: there still seems to be a problem with utah :s http://pastebin.ubuntu.com/7158497/ [19:16] rsalveti, so the correct version of gst-plugins-bad will need to be seeded, there's no build-dep version to check for for that [19:17] jhodapp: it's already seeded, so no worries, if not needed for build-time, then we're good [19:17] rsalveti, right, ok [19:18] robru, thanks [19:18] rsalveti, how about gst-plugins-bad having the right libhyris-dev? [19:18] robru, now I'm not holding the oldest silo anymore :-) [19:18] jhodapp: that I'll change when uploading both to the silo ppa [19:18] rsalveti, ok excellent, thanks [19:19] plars: shouldn't the script create the the utah.yaml file? [19:20] sergiusens: ;-) [19:21] t1mp: yeah, but utah is crashing for some reason before it gets there: OSError: [Errno 2] No such file or directory: '/var/cache/utah/autorun/inprogress' [19:21] t1mp: "it works on my machine" :) [19:23] t1mp: my best guess is there's some sort of utah setup step you're missing, doanac any ideas? http://pastebin.ubuntu.com/7158497/ is what he's seeing [19:23] sergiusens, ok, other than the media-hub libhyris build-dep update and the one rsalveti will do for gst-plugins-bad depending on libhyris-dev, the other packages should be ready [19:23] oh [19:24] alright [19:24] t1mp, plars: is utah installed on this system? [19:24] plars, doanac I'm running the script without root priviliges [19:25] if TESTS=ALL you'll need utah. [19:25] doanac: yes utah: Installed: 0.15+20140305~ubuntu14.04.1 [19:25] doanac: I believe he's installed both utah and utah-client [19:25] t1mp: so am I [19:25] t1mp: I think utah might need to be run as root [19:25] doanac: I think that's why it prompts him for sudo though [19:25] doanac: http://pastebin.ubuntu.com/7158497/ line 41 [19:26] will it ask the password more ofteh? [19:26] *ofthen [19:26] *often [19:26] :s [19:26] :) [19:26] I'll try sudo TESTS=ALL APPS=ALL ./run-smoke --no-provision [19:27] i bet that doesn't fix it [19:27] i'm thinking you are missing a utah package [19:27] I installed utah-all [19:27] or you need to create this directory by hand: /var/cache/utah/autorun/inprogress [19:28] same error with sudo [19:28] doanac: I don't have that dir either, but it doesn't complain about it with me [19:28] so I'm not sure why it's looking for it [19:29] plars: did you try with TESTS=ALL APPS=AL and -n ? [19:29] t1mp: yep [19:29] oh, hang on [19:29] *APPS=ALL [19:29] t1mp: did you provision your device with provision.sh before making the modifications? [19:30] plars: yes, first I ran provision.sh, and then I installed some deb files [19:30] mkdir -p /var/cache/utah/autorun/inprogress seems to help [19:31] something is running now [19:31] robru: hey, is it known that sometimes the MRs are not marked as merged after clicking merge and clean? [19:32] plars: nuclearbob recently made some client changes to utah near that area. I wonder if it now requires that directory and you and I are just on an older utah [19:32] oh [19:32] yeah t1mp you are on a much newer utah than me - I guess you got the daily after all? [19:32] boiko: no? it doesn't happen immediately... [19:33] robru: it landed two hours ago [19:33] plars: sudo apt-add-repository ppa:utah/stable && sudo apt-get install utah-all [19:33] robru: only one of the MRs didn't get marked as merged, the other ones are OK [19:33] robru: the code got merged though [19:34] I'll need to tweak the script probably for our use case. I don't need to run the idle tests that are running now [19:34] but first lets see if everything works without additional parameters/changes :) [19:35] robru: no big deal, just checking if you want to debug something before I manually mark it as merged [19:36] I think maybe I'm just on the one I had before upgrading to trusty on this box [19:36] robru: it is the https://code.launchpad.net/~renatofilho/address-book-app/optimize-app/+merge/210199 MR from row 17 [19:37] boiko: did anything unusual happen, like was there a reconfig that dropped that MR? one MR merged into another MR or something? [19:37] robru: nope, not that I know of, just regular MR dependency [19:37] t1mp: did you try just creating the directory? === gatox_lunch is now known as gatox [19:38] robru: if that's of no use for debugging, I can just mark it as merged manually [19:40] plars: yes I created the directory, and now the tests are working [19:40] plars: 20:30:50 < t1mp> mkdir -p /var/cache/utah/autorun/inprogress seems to help [19:40] t1mp: ok, sounds like a bug in recent utah versions then [19:40] t1mp: let me know if you run into any more issues [19:41] plars: shall I report the bug or will you? [19:41] t1mp: if you could file one, that would be great [19:42] boiko: yeah just mark it merged for now. how often does it happen? just the once? [19:42] robru: first time this happened since I started landing stuff using the CI train [19:42] ~/dev/ubuntu-test-cases/touch/scripts/clientlogs/ is filling up.. next challenge is how to parse all the log files to see what passed/failed [19:43] boiko: first guess would be that it's more a bug in launchpad. i don't think citrain has any code for explicitely marking branches as merged. my understanding is that citrain just merges the branches and then launchpad is the one that notices the merge commit and marks the MP merged. [19:43] boiko: or at least, the few odd times I've done manual merges, lp automatically mared the MPs for me after I pushed the merge commit, so I assume the same applies to jenkins/citrain [19:44] robru: ah ok, got it, yeah, now that you mentioned, I remember having MRs marked as merged automatically in launchpad [19:47] plars: https://bugs.launchpad.net/utah/+bug/1298026 [19:47] Ubuntu bug 1298026 in UTAH "/var/cache/utah/autorun/inprogress needs to be manually created" [Undecided,New] [19:47] robru: btw, I have just added line 52 to the spreadsheet, whenever you get a free silo, would you mind assigning it? [19:47] boiko: sure thing! [19:49] boiko: ok you got silo 12 [19:50] plars: is my pipeline correct? if I use provision.sh and then install UITK deb files, and then run-smoke, will all the AP tests be ran against the UITK version that I installed? Or will something be overwritten? [19:50] robru: thanks! [19:50] boiko: you're welcome! [19:50] plars: and the UITK AP tests come from the ubuntu-ui-toolkit-autopilot package that is installed on the system right? Or from lp or a click package? [19:52] t1mp: hmm, well the toolkit tests do try to install (and thus remove) the autopilot tests for u1tk - ubuntu-ui-toolkit-autopilot [19:53] t1mp: hopefully that won't affect you? [19:53] plars: I installed ubuntu-ui-toolkit-autopilot myself, so I like to use that version [19:54] t1mp: will the version in the archive supersede it? or does yours have a higher version number [19:55] plars: I installed ubuntu-ui-toolkit-autopilot_0.1.46+14.04.20140321.1bzr948pkg0trusty892-0ubuntu1_all.deb [19:56] t1mp: as long as yours has a higher version number, then I would think that apt-get install ubuntu-ui-toolkit-autopilot would just do nothing [19:56] t1mp: otherwise, you'll get "upgraded" [19:56] plars: currently I have this on the device http://pastebin.ubuntu.com/7158704/ [19:57] it looks like I still have the versions matching the .debs that I downloaded [19:58] so if 20140321.1bzr938... > 20140321.1-ubuntu1 I think I'm safe [19:59] IF that is the case. Seems logical but I'm not sure if b > - [20:23] plars: do you know how long a full test run like this will take? [20:24] t1mp: ~3 hours [20:24] t1mp: one thing to be aware of, even if your package doesn't get upgraded, it will get uninstalled after the toolkit tests run [20:24] robru, hey, upon reconfiguring I now get this http://162.213.34.102/job/landing-006-0-reconfigure/18/console [20:25] t1mp: you may want to run *just* those tests after reinstalling and watch it very carefully [20:26] robru, ah it seems it was never configured (from the prior build logs) [20:26] plars: oh, ok [20:26] plars: after the toolkit tests finished I don't need them anymore... but [20:26] plars: the other tests use the uitk-autopilot emulators. Are those part of the uitk-autopilot package? [20:29] sergiusens: yeah, that looks like what I mean about the source package rename not working. did you merge the MP manually yet? [20:32] t1mp: no idea [20:32] sergiusens: ok, looks good after a reconfigure. please build [20:35] robru, yup, that's what I did, reason I wanted to reconfig :-) [20:40] robru, just did m&c on silo 10 [20:41] sergiusens: sweeeeeet, thanks [21:06] robru: landing-012 tested [21:07] boiko: thanks! [21:08] boiko: published! [21:09] robru: thanks! [21:09] boiko: you're welcome ;-) === jhodapp is now known as jhodapp|afk [21:37] boiko: please merge & clean silo 12 ;-) [21:37] robru: yep, I was just waiting for rmadison to show the right version on trusty [21:38] (not sure it is really necessary to wait for that, but in any case) [21:39] boiko: nope, citrain goes by what launchpad says, it's only necessary to wait for rmadison if you are intending to kick an image build shortly after and you want the new image to include your recently published silo. as I learned the hard way with image #257 ;-) [21:39] robru: ah ok, got it, thanks :D [21:39] boiko: you're welcome! [21:40] robru: well, I will keep on watching rmadison anyways, as I want to rebuild some messaging-app jenkins jobs using this version of history-service [21:40] boiko: ah, no worries [21:40] boiko: we're not crunched on silos like i was afraid we'd be [21:41] robru: I guess people are rebasing/retesting stuff before submitting [21:41] (at least that's what is happening in the apps team) [21:41] robru: silo being cleaned already [21:41] robru, I have a fast track landing; is there a bullet train :-P [21:42] robru, kidding, but would be good to get phablet-tools/line 53 a silo [21:42] sergiusens: you better believe it! (well, aside from the beta freeze that's outside my control) [21:43] sergiusens: ok, you got silo 10 [21:43] boiko: thanks [21:43] robru: you're welcome! [21:55] robru, heh, phablet-tools is trending on silo 10 [21:55] sergiusens: it's a happy place. [23:23] alright everybody, I'm off for dinner, should be back in 3-4 hours, if anybody needs anything just shoot me an email and I'll get back to it later tonight.