[00:33] <lifeless> benji: please don't land that python-pgbouncer branch.
[00:33] <lifeless> benji: until the question I raise in the review is resolved.
[00:36] <lifeless> benji: pinging here incase you didn't see the email is all.
[00:51] <NCommander> WHere did launchpad-buildd move to? Its no longer under lib/canonical/buildd nor can I find it in the source tree
[00:57] <StevenK> It was split out
[00:57] <NCommander> lp:launchpad-buildd
[00:57] <NCommander> Found it, thanks
[00:58] <StevenK> NCommander: lib/canonical is also emptyish too
[00:58]  * NCommander notes the wiki pages really could use an update
[00:58] <StevenK> That was known.
[01:16] <NCommander> StevenK: so for doing livecd builds on the buildds, I already determined we need a new custom livecd type (raw-livecd). My current idea is to have the CD build infrastructure connected to a devirtualized PPA, and it merely needs to dput a dummy package to spin the livefs's. Does this sound sane? (alternatively, I can have it work in the main archive, but then we have to deal with releasing live images through the queue which will be k
[01:16] <StevenK> You got cut off
[01:16] <NCommander> 21:16:02 < NCommander> StevenK: so for doing livecd builds on the buildds, I already determined we need a new custom  livecd type (raw-livecd). My current idea is to have the CD build infrastructure connected to  a devirtualized PPA, and it merely needs to dput a dummy package to spin the livefs's. Does  this sound sane? (alternatively, I can have it work in the main archive, but then we have to
[01:16] <NCommander>  dall with releasing live images through the queue which will be kinda annoying)
[01:17] <NCommander> alternatively, I could write a new API to the buildds to build the squashfs's indpendently, but that sounds like a *lot* more pain than its worth.
[01:17] <StevenK> NCommander: So, I'm not sure.
[01:18] <lifeless> NCommander: doing a dummy package to trigger builds is fugly and unneeded.
[01:18] <lifeless> NCommander: where will the [d]debs for the livecd come from ?
[01:18] <StevenK> ftpmaster.internal, I guess
[01:18] <NCommander> lifeless: ftpmaster.internal. I already managed to spin a squashfs in a PPA
[01:18] <lifeless> ok
[01:19] <lifeless> so, there are already 3 sorts of builds
[01:19] <NCommander> (I needed a helper package so I could run livecd.sh as sudo, but other than that, no headaches (right up until I hosed the uploader :-))
[01:19] <lifeless> recipes, translations, packages
[01:19] <lifeless> add a forth type
[01:19] <NCommander> recipes?
[01:19] <lifeless> recipes run on the buildds
[01:19] <NCommander> is this documented somewhere? :-)
[01:20] <StevenK> It's probably under buildmaster
[01:20] <StevenK> lib/lp/buildmaster, that is
[01:21] <NCommander> Actually most of it is in launchpad-buildd :-/
[01:22] <StevenK> NCommander: buildd-manager needs to know about the types of build at least
[01:22] <NCommander> (and at least for TRANSLATIONTEMPLATES its in lp/translations; this code is all over the $#!@# place)
[01:22] <NCommander> Yeah, ther'es a enum.py which is usually the first place you go so your test cases don't explode with unknown identifer
[01:22] <StevenK> SPRecipe is probably in lib/lp/code too
[01:23] <StevenK> I've forgotten its identifier
[01:23]  * NCommander feels like he's about to be in a lot of pain
[01:23] <StevenK> Well, duh
[01:23] <StevenK> Doing CD builds *properly* via LP is a lot of work.
[01:23] <StevenK> And you have LoC constraints
[01:24] <NCommander> LoC?
[01:24] <StevenK> Lines of Code
[01:24] <NCommander> lines of code?
[01:24]  * NCommander looks at the wiki
[01:24] <StevenK> NCommander: New features now have to be LoC neutral
[01:24] <NCommander> WTF?
[01:25] <NCommander> what does LoC neutral mean?
[01:25] <StevenK> NCommander: If you want to add 500 lines of feature code, you have to find 500 lines of something to remove first.
[01:25] <NCommander> ...
[01:26] <NCommander> rm -r lp-branches/devel/lib/lp/soyuz/tests :-P
[01:27] <StevenK> Hah
[01:27] <StevenK> NCommander: We have a tool that cjwatson wrote. For example:
[01:27] <StevenK> steven@undermined:~/launchpad/lp-branches/devel% loc-contributions 'Steve Kowalik'
[01:27] <StevenK> -835
[01:27] <lifeless> You can get LoC waivers if appropriate
[01:28] <NCommander> so, let me get this straight. To successfully commit code to Launchpad, I need to step back and delete something else?
[01:28] <StevenK> Or you get an exception from lifeless.
[01:28] <NCommander> I rather just modify ubuntu-cdimage to build a deb in a PPA and then wget the deb. a *lot* less pain
[01:28] <lifeless> or in some other way offset the increased cost of running and maintaining launchpad that the new code brings.
[01:29] <NCommander> lifeless: adding one machine of every architecture to the buildd pool increasing relaibility and decreasing live image build time?
[01:29] <NCommander> (the livecd builders can be decommisioned and turned into regular buildds if we don't need dedicated machines)
[01:29] <lifeless> StevenK: flacoste hands out exceptions too IIRC>
[01:29] <lifeless> NCommander: as  afraction, how much is the increase there?
[01:30] <lifeless> NCommander: how does it decrease live image build time ?
[01:30] <NCommander> lifeless: allows parallization of images across flavors, load balancing, and decreases issues if a buildd machine needs to go offline for service
[01:31] <NCommander> As it stands, we can build one flavor across all architectures at any given time (ARM has two livebuilders with a rather nasty hack to use both)
[01:31] <lifeless> whats the utilisation % of the current livebuilders ?
[01:32] <NCommander> 6-8 hours per day on dailies. Can go up to 100% during freezes if large amounts of respins are required
[01:32] <NCommander> Spread across 6(?) machines, one per arch one an additional one for armhf
[01:32] <lifeless> how many machines are there in the current buildd pools ?
[01:32] <StevenK> For LP, or livebuilds?
[01:32] <NCommander> two minimium per architecture (I believe we're down a hppa builder, I'll check)
[01:32] <lifeless> LP
[01:32]  * NCommander checks the current numbers)
[01:33] <StevenK> hppa is dead to us
[01:33] <lifeless> Will Ubuntu want move flavors or more liveimage builds once the latency is reduced ?
[01:33] <lifeless> StevenK: don't tell lamont
[01:33] <NCommander> lifeless: that is a discussion the tech board must make. Currently we're allowing new live images on all archs aside from ARM
[01:33] <NCommander> (the ARM builders barely keep up with the load as is)
[01:34] <StevenK> 5 i386, 3 powerpc, 3 amd64, 2 ia64, 2 sparc, 1 hppa, 1 lpia and 12 armel, 7 armhf
[01:34] <StevenK> Hell, lpia is more dead to us than hppa
[01:34] <NCommander> ARGH, BAD MEMORIES
[01:34] <StevenK> NCommander: Worse for me
[01:35] <NCommander> StevenK: well yes but lpia wasn't as bad as psb
[01:35] <StevenK> Don't use that language with me.
[01:35] <NCommander> >;-)
[01:35] <StevenK> Crown Beach is so toally dead to me.
[01:35] <StevenK> *totally
[01:36] <NCommander> StevenK: I recommend high explosives personally. Helps get rid of the burn
[01:36] <lifeless> Ok, so we're looking at 16 hours more build time/day across the board
[01:36] <lifeless> which is 15% or so on i386, 20% on amd64
[01:36] <NCommander> lifeless: offset by the fact that every architecture will almsot certianly get an additional buildd (once the livebuild pool is decommissioned)
[01:36] <lifeless> NCommander: that *is* the additional buildd
[01:36] <lifeless> NCommander: 24-8 = 16
[01:37] <NCommander> d'oh
[01:37] <lifeless> this will make it easier to argue for more scalable capacity too perhaps.
[01:38] <lifeless> I'm inclined to grant an exception with a caveat: Please *try*, after the project, to reduce LoC impact.
[01:38] <lifeless> but if you can't, that will be ok.
[01:38] <NCommander> lifeless: I will, but I'm a heavy commenter
[01:38] <NCommander> SO as long as its only code I need to elimate, I will try
[01:38] <lifeless> NCommander: cjwatson is at about -4K lines.
[01:38] <StevenK> NCommander: refactoring tests is a big win
[01:38] <lifeless> NCommander: there is a huge amount of FAT in the LP code base.
[01:39] <NCommander> StevenK: personally, I'd like to add more tests to Soyuz
[01:39]  * NCommander sucks
[01:39] <NCommander> *ducks
[01:39] <NCommander> fuck
[01:39] <StevenK> Hahaha
[01:39] <lifeless> NCommander: lots and lots and lots of places that things are redundant, or wasteful.
[01:39]  * StevenK quotefiles NCommander 
[01:39] <NCommander> lifeless: personally, I'd love to see LP not use 300+ queries to upload a package, but that's just me
[01:39] <lifeless> NCommander: see above under fat.
[01:40] <NCommander> yeah
[01:40] <NCommander> Thanks for the LoC exception.
[01:40] <StevenK> NCommander: From our OOPS reports, statement counts: 1350  OOPS-1db714aef8b3b55ac9a7a58cc336ebc4  BugTask:+index
[01:40] <NCommander> Ow
[01:41]  * NCommander notes he uses launchpad as proof that postgresql will scale just as well as oracle
[01:41] <StevenK> 1054  OOPS-861cfa9611c5fbb82f3b97998ea1dcf1  Archive:+copy-packages
[01:41] <StevenK> But Colin is working on that one
[01:41] <StevenK> 10000  OOPS-bfc5975ff6ecfe11483e9b28b0f772bf  Unknown
[01:41]  * StevenK blinks
[01:41]  * StevenK looks up that OOPS
[01:41] <lifeless> NCommander: so strictly, we don't insist on before-landing-credit, just that folk keep themselves honest and work on overall shrinking the maintenance burden.
[01:42] <NCommander> StevenK: why do I feel like that OOPS hit some sorta query limiter
[01:42] <lifeless> NCommander: what I'm saying to you is I accept the argument that the project is itself a burden reduction, but you should still try to address code fat as you do stuff :)
[01:42] <StevenK> We don't have a query limiter
[01:42] <NCommander> lifeless: I may submit mini-branches on the side to delete cruft on the side
[01:42] <NCommander> That's an oddly round number then
[01:43] <StevenK> Right
[01:43] <StevenK> I'm loading the oops
[01:43] <StevenK> Well, trying to
[01:43]  * StevenK prods neem
[01:43] <lifeless> it will take a little
[01:43] <lifeless> 10K backtraces.
[01:43]  * NCommander will see StevenK at UDS still waiting :-)
[01:43] <StevenK> NCommander: I wish
[01:45] <lifeless> NCommander: for instance:
[01:45] <lifeless> https://code.launchpad.net/~cjwatson/launchpad/uefi-ppa-no-unapproved/+merge/119542
[01:45] <StevenK> steven@undermined:~/launchpad/lp-branches/force-ibug-into-line% bzr di -r 14918.. | diffstat -s
[01:45] <StevenK>  14 files changed, 519 insertions(+), 753 deletions(-)
[01:45] <lifeless> NCommander: -5 LoC, clearer tests, and bug fix.
[01:46] <StevenK> That's one of mine. I fixed IBug so it no longer read like a bad romance novel and made the ZCML clearer.
[01:47] <StevenK> HAhaha
[01:47] <StevenK> lifeless: Just got a ISE from neem
[01:47] <lifeless> \o/
[01:48] <StevenK> "Please contact the server administrator, [no address given]"
[01:50] <StevenK> Hah, and the error log is useless
[01:50] <StevenK> Thanks for being so helpful, WSGI
[01:50] <lifeless> StevenK: it should have oopsed
[01:51] <lifeless> StevenK: it may still be processing though.
[01:51] <StevenK> I have no idea, I got a generic ISE page
[01:51] <StevenK> The error log just says "Premature end of script headers"
[01:54] <lifeless> yay. Not.
[01:55] <StevenK> lifeless: So, I guess it didn't OOPS?
[01:55] <lifeless> I guess not.
[01:55] <lifeless> the oops occurs when the thing propofates up
[01:55] <lifeless> no script headers means the app didn't send any before apache flicked it off
[01:56] <StevenK> wgrant: Can haz review? https://code.launchpad.net/~stevenk/launchpad/no-oops-request-daily-build/+merge/119654
[01:58] <wgrant> StevenK: Busy now, sorry.
[01:58] <wgrant> Possibly this afternoon
[02:33] <StevenK> lifeless: Why more OOPS summaries?
[02:34] <lifeless> StevenK: Why indeed?
[02:34] <lifeless> StevenK: I have nil idea.
[02:34] <lifeless> Ask -ops
[03:50] <StevenK> wgrant: Are you unbusy now?
[03:51] <wgrant> StevenK: Not really
[03:51] <StevenK> :-(
[03:52] <wgrant> Busy benchmarking paranoia
[04:23] <StevenK> lifeless: AH, come here
[04:37] <lifeless> StevenK: ?
[04:39] <StevenK> lifeless: http://pastebin.ubuntu.com/1148122/
[04:40] <StevenK> lifeless: Not sure why mailman is there, given lib/mailman.
[04:41] <StevenK> lifeless: But the main reason I grabbed you is because the last time I tried to rip subvertpy out of sourcecode, things went bang.
[04:45] <lifeless> trlololol https://plus.google.com/109613336078485786201/posts/1mC8Wm37W2g
[04:45] <lifeless> oh sorry. right.
[04:45] <wgrant> StevenK: lib/mailman is built code
[04:45] <wgrant> StevenK: (yes, our build system writes into lib/)
[04:45] <lifeless> StevenK: you can't remove mailman like that.
[04:45] <lifeless> StevenK: :(
[04:46] <lifeless> StevenK: but testresources should be fine.
[04:49] <StevenK> lifeless: So I put subvertpy into download-cache, add it into versions.cfg, remove it from sourcedeps.conf, and make, and then nothing can import subvertpy
[04:49] <lifeless> What steps have you taken t debug this ?
[04:49] <StevenK> None, because I'm not sure what steps to take.
[04:50] <lifeless> ok
[04:50] <lifeless> so when something can't be imported
[04:50] <lifeless> it may mean its not on the python path
[04:50] <lifeless> or it may mean that something is broken in the thing
[04:50] <lifeless> is there an egg?
[04:50] <StevenK> It's a tarball
[04:50] <lifeless> is the egg on the path when you look at sys.path under bin/py ?
[04:50] <lifeless> StevenK: tarball is whats distributed.
[04:51] <lifeless> eggs are what live in eggs/
[04:51] <StevenK> eggs/subvertpy-0.8.10-py2.7-linux-x86_64.egg exists
[04:51] <StevenK> Oh, wait, that's the old one
[04:51] <StevenK> So, no, no egg
[04:51] <lifeless> well
[04:51] <lifeless> tried running bin/buildout ?
[04:51] <StevenK> make clean && make should do that, no?
[04:52] <lifeless> have you removed lib/subvertpy ?
[04:52] <StevenK> I didn't know that was there. Sob.
[04:52] <lifeless> I note your pastebin is missing the remove of lib/testresources
[04:52] <StevenK> Right
[04:52] <StevenK> I'll do that too
[04:52] <lifeless> (this is why removing sourcedeps is such a great idea :))
[04:53] <StevenK> I noticed mustache quietly died from sourcedeps
[04:53] <lifeless> I nuked.
[04:53] <lifeless> I think.
[04:53] <lifeless> Therefore I delete.
[04:53] <wgrant> Well
[04:53] <wgrant> Um
[04:53] <wgrant> It was better in sourcedeps than where it is now :)
[04:54] <StevenK> lifeless: Deleted lib/subvertpy and no dice. Still no egg
[04:54] <lifeless> no, it was rick that did it.
[04:54] <lifeless> StevenK: ok, and you ran bin/buildout ?
[04:55] <lifeless> StevenK: (don't answer by talking about make :))
[04:55] <lifeless> StevenK: does 'python -c "import subvertpy"' work for you ?
[04:55] <StevenK> Just ran bin/buildout and still no egg
[04:55] <lifeless> StevenK: ok, and is subvertpy listed in setup.py ?
[04:56] <wgrant> StevenK: Did you define it as a dep?
[04:56] <wgrant> Yaeh
[04:56] <wgrant> in setup.py
[04:56] <StevenK> Ah
[04:56] <StevenK> Let me do that
[04:56] <lifeless> Now, you may say 'why?' and thats a good question. But until we get the *bzr deps* into setup.py, buildout won't traverse through them to find subvertpy.
[04:58] <StevenK> lifeless: Right, so indeed, putting it in setup.py was the answer.
[04:58] <lifeless> cool.
[04:58] <lifeless> I would add a comment explaining why.
[04:59] <StevenK> But this branch is at -3/+3 :-(
[07:41] <adeuring> good morning
[08:14] <NCommander> How do I get a local LP instance to accept a 3.0 (quilt) source package?
[08:20] <StevenK> There's a table
[08:21] <StevenK> NCommander: Have a look for InitializeDistroSeries, it copies stuff into a table that ends with or contains 'Format'
[08:22]  * NCommander just patched soyuz-sampledata-setupo to give me a precise
[08:22] <wgrant> Hm, didn't I already fix that?
[08:22] <NCommander> You go natty->oneiric and forgot precise
[08:22] <wgrant> Apparently not
[08:22] <wgrant> Well
[08:22] <wgrant> I have onerous :)
[08:22] <wgrant> From before the name was announced
[08:22] <wgrant> So I haven't updated it in a while.
[08:22] <wgrant>         ('Onerous Ocelot', SeriesStatus.FUTURE, '11.10'),
[08:27]  * NCommander remembers how much 'fun' it is to setup LP from scratch
[08:29] <StevenK> NCommander: Impossible. The brain suppresses bad memories, which is exactly what we are counting on.
[08:31]  * NCommander misses dak sometimes
[08:31] <NCommander> s/sometimes/g
[08:34] <NCommander> seems soyuz dev really wants a SMTP server setup
[08:34] <NCommander>   File "/usr/lib/python2.7/smtplib.py", line 284, in _get_socket
[08:34] <NCommander>     return socket.create_connection((port, host), timeout)
[08:34] <NCommander>   File "/usr/lib/python2.7/socket.py", line 571, in create_connection
[08:34] <NCommander>     raise err
[08:34] <NCommander> error: [Errno 111] Connection refused
[08:34] <StevenK> I get the same issue, ignore it
[08:35] <NCommander> StevenK: then my GPG key doesn't import
[08:35] <StevenK> Are you using utilities/make-lp-user?
[08:36] <NCommander> documentation for soyuz sampledata says it should add my key to ppa-user
[08:36] <NCommander> It imports my SSH key just fine
[08:37] <NCommander> there
[08:40]  * NCommander does a test build
[08:42]  * NCommander discovers Launchpad rejects uploads to security if the archive is in DEVELOPMENT, and goes to modify the changelog to try again
[08:46]  * NCommander groans
[08:46] <NCommander> deb http://archive.launchpad.dev/ubuntu precise main
[08:46] <NCommander> What do I need to fix that? :-/
[08:47] <NCommander> nm found the magic UI page with the value I had to change
[08:49]  * NCommander has the basic framework in launchpad-buildd to build live images, and is just making sure he didn't break the world when I wasn't looking
[08:58] <StevenK> NCommander: I do wonder how you're going to implement for-project
[09:02] <NCommander> StevenK: flavor argument passed into the xmlrpc for launchpad-buildd
[09:02]  * NCommander already has that done and working
[09:03] <StevenK> I meant inside LP
[09:04] <NCommander> StevenK: new API in all likelyhood controlled by a celeberity
[09:04] <StevenK> Ew, celebrity
[09:04] <NCommander> StevenK: I wanted to use dummy packages, much easier :-P
[09:06] <StevenK> NCommander: And then Colin will drive to your house and stab you.
[09:07] <NCommander> But basic design idea I had with ubuntu-cdimage uses launchpadlib to tell LP to kick a build for a given architecture/flavor/series/etc, get the librarian URL for the image file when done, wget it, continue as normal
[09:07]  * NCommander *loves* we have three different livefs image builders
[09:07] <NCommander> live-build/livecd.sh/ubuntu-defaults-image
[09:08] <NCommander> here's what the arguments look like for a LiveImage build: http://paste.ubuntu.com/1148377/
[09:09] <NCommander> StevenK: if celeberities are bad, what should I key squashfs's builds off of? We don't want people willy-nilly being able to smack to respin API
[09:11]  * NCommander could connect it to the distro driver (~ubuntu-drives)
[09:11] <NCommander> *drivers
[09:11] <StevenK> Probably ~ubuntu-cdimage in the short term
[09:12] <NCommander> I was personally thinking ubuntu-release
[09:12] <NCommander> or a new team, since I though hardcoding ubuntu stuff in LP was a bad thing
[09:13] <NCommander> though then again, ubuntu itself is a Celebrity ...
[09:41] <lifeless> wgrant: busy?
[10:06] <wgrant> lifeless: Hi
[10:06] <lifeless> hi
[10:10] <wgrant> lifeless: You pinged?
[10:11] <lifeless> I did
[10:11] <lifeless> cgoldbergs thing; I'm interviewing folk for 3 of the 4 hours I'm working tomorrow - half day
[10:11] <lifeless> I'd really like it to get a paranoid once over.
[10:11] <wgrant> Ah. I might look tomorrow, if you're busy
[10:12] <lifeless> I'm running in place.
[10:12] <lifeless> (yes, am busy, or wouldn't be asking)
[10:14] <wgrant> k
[10:23] <NCommander> wgrant: StevenK what dispatches things like TranslationTemplate builds?
[10:24] <lifeless> builddmaster
[10:24]  * NCommander has a fairly decent grasp on how jobs go from LP->slaves now, but isn't quite sure what triggers the jobs (aka, how we geting */model/*buildbehavior.py)
[10:24] <lifeless> NCommander: not sure why you talk about a celebrity above.
[10:25] <lifeless> NCommander: any permissions you need should be distro centric, to support derived distros (e.g. linaro).
[10:25] <NCommander> lifeless: building a livefs will require building on devirtualized builders, and not connected to any package
[10:25] <lifeless> and?
[10:26] <NCommander> lifeless: what team should it be connected to. There's isn't exactly a nice place where to hang it (first though was ~ubuntu-drivers but that team is already overloaded as is)
[10:26] <NCommander> Unless I add a new Image Builder or Release Team thingy somewhere in a distroseries
[10:26] <lifeless> any published distro driver would be my starting point; creating distros is a privileged operation.
[10:27] <lifeless> don't overthink this.
[10:27] <NCommander> lifeless: right, but the driver team currently has 60+ members in it and is being used for fun things like UDS managers
[10:27] <lifeless> you don't need to limit it to 'just the people that have to do it', what you need to do is to 'exclude folk that might abuse or attack it'
[10:27] <lifeless> these are wildly different problems.
[10:27]  * NCommander is about halfway getting launchpad-buildd to understand livebuilds, and suspect I'll need help when we get to the plumbing side in LP
[10:28] <lifeless> If a UDS manager spins an extraneous livecd build, who cares. Tell them off. Problem solved.
[10:28] <NCommander> Good point
[10:28] <NCommander> lifeless: thanks for your help
[10:29] <StevenK> lifeless is just bored because he can't play CS:GO.
[10:29]  * NCommander personally recommends civ 5 :-)
[10:29] <StevenK> I was playing that a few nights ago. Bloody hell, it's *enormous*
[10:29] <NCommander> That game is a soul-sucker.
[10:30] <NCommander> Works amazingly well under wine though. Was pretty suprised when the demo just went
[10:33] <lifeless> StevenK: helping and being bored are not mutually exclusive ;)
[10:35]  * NCommander notes his end goal is to have a nice webpage that completely replaces nusaken with all image building tasks being done on LP
[10:36] <NCommander> vs. the arcane voodoo required now
[10:36] <NCommander> *nusakan
[10:37] <NCommander> so flavors can click a button and presto; respun images
[10:48]  * NCommander grumble
[10:48] <NCommander> *s
[10:48] <NCommander> my builder went to an ABORT state and I can't figure out where the log file is
[10:55] <wgrant> NCommander: There's no build log for an ABORTed builder
[10:55] <wgrant> NCommander: Check /var/log/launchpad-buildd/default.log on the slasve
[10:59] <NCommander> wgrant: thanks. So my build succeeded and uploaded but running the test cases for launchpad-buildd sent it straight into OMG broken mode
[10:59] <jam> mgz: did your patch make it to prod?
[11:02] <jam> mgz: ah, looks like it is in 15805 waiting for the next NDT
[11:02] <NCommander> exceptions.ValueError: Slave is not BUILDING when told build is complete - *grumble*
[11:08] <wgrant> NCommander: Ah, yeah, running the test suite on a machine with a live launchpad-buildd is a good way to die.
[11:09]  * NCommander doesn't really feel like setting up a second machine at the moment to run as a slave :-/
[12:05] <wgrant> NCommander: VMs :)
[13:32] <rick_h_> deryck: ping for standup
[13:32] <deryck> rick_h_, coming now, sorry
[14:17] <rick_h_> anyone have a link handy for using the people.canonical space?
[14:18] <rick_h_> I think I just sent a test .png file to the middle of no where
[14:21] <czajkowski> rick_h_: jpds might know
[14:22] <rick_h_> thanks czajkowski
[14:23] <czajkowski> np
[15:16] <deryck> yay for stable wifi at the wife's shop finally.
[15:21] <rick_h_> yay
[16:06] <czajkowski> sinzui: what happens when you click sub someone else https://answers.launchpad.net/launchpad/+question/205885
[16:07] <sinzui> czajkowski: js failed to init on the page I think
 is a 404 (js-less) alright
[16:11] <czajkowski> sinzui: odd it's happening on https://answers.launchpad.net/launchpad/+question/205854 also
[16:11] <sinzui> czajkowski: because is a js error
[16:11] <czajkowski> nods
[16:11] <czajkowski> just randomly happened
[16:11] <sinzui> js fails every where, not on one page
[16:11] <mgz> well, the page not existing isn't a js error... if there's no non-js mode, there shouldn't be a href pointing to lies
[16:12] <sinzui> czajkowski: The subscribe someone else is shared with bugs and mp reviews
[16:13] <sinzui> since js is broken, we can see that answers does not support that via a html view
[16:13] <sinzui> The error in the page related to comments. maybe jcsackett can understand the error on questions
[16:15]  * sinzui adds a comment to a question to see if the js starts to work
[16:16] <jcsackett> sinzui: with a comment it should.
[16:16] <sinzui> yep
[16:16] <rick_h_> yea, there's no .boardComment and the JS doesn't allow for that to not exist so it's dying
[16:16] <jcsackett> looks like a goof in the cl setup--it assumes (and our test provides) a boardcomment.
[16:16] <rick_h_>             var container = Y.one('.boardComment').get('parentNode');
[16:16] <jcsackett> sinzui: i can whomp up a fix for that today.
[16:16] <rick_h_> assume it must exist
[16:16] <sinzui> czajkowski: subscribe js on answers is broken when there is not comments
[16:16] <sinzui> I added a comment, reloaded the page and js worked
[16:17] <czajkowski> oh most odd
[16:17] <czajkowski> thanks
[16:17] <sinzui> I will report the bug. The js just needs to return early if there is no work to do
[16:17] <jcsackett> sinzui, rick_h_: looks like the cl can just not exist if it doesn't find boardcomment, since there's nothing for it to do in that situation anyway. agree/disagree?
[16:18] <rick_h_> jcsackett: yea assuming there's no way to ajax add comments
[16:18] <sinzui> jcsackett: this is true for answers, Mp and bugs start with comments I think
[16:18] <rick_h_> jcsackett: that would blow up if a CL wasn't there for it to get added to
[16:19] <jcsackett> rick_h_: there's no interaction like that to worry about; there is an ajax add comment form, but when you add a comment on the page you can't immediately hide it anyway. that may be a defect, but it's a separate one as it's long been the case.
[16:19] <sinzui> jcsackett: This has been broken for weeks. I think subscribing before commenting is rare
[16:19] <jcsackett> sinzui: i concur. and re: bug's having comments off the bat, that's correct, but i don't believe they are shown as boardComment--the first "comment" is the description.
[16:20] <sinzui> ah, correct
[16:20] <sinzui> jcsackett: you can report the bug and optionally choose to fix it. "disclosure information-type regression"
[16:21] <jcsackett> sinzui: ok, i can create a fix for this pretty easily.
[18:28] <sinzui> jcsackett: since there re no reviewers today, I pre-emptively ask you to review a branch. I am not asking you to review it now
[18:43] <jcsackett> sinzui: no problem.
[20:11] <jcsackett> sinzui: r=me.
[20:19] <sinzui> thank you jcsackett
[21:01] <jam> lifeless: you might be interested in: https://code.launchpad.net/~jameinel/launchpad/loggerhead-clear-cache/+merge/119793
[21:02] <jam> calling '.clear_cache()' on all the versioned file objects has a pretty big impact on the 'spider loggerhead' peak memory.
[21:03] <lifeless> does this impact performance? was the cache getting used before ?
[21:04] <jam> lifeless: every request gets a new bzr_branchd
[21:04] <jam> so no
[21:04] <lifeless> cool then
[21:04] <jam> (we could try to re-use them, but that is much hairier than not :)
[22:22] <lifeless> see you guys on the flip side.
[23:35] <NCommander> so how do files leave librarian?
[23:35]  * NCommander is trying to figure out how old squashfs's will poof out of librarian
[23:37] <StevenK> NCommander: They are garbage collected when they are not referenced.
[23:37] <NCommander> StevenK: what defines a reference? (or is there a minimium age before they get GC'ed?)
[23:37] <NCommander> Mostly I want squashfs's to stick around for a day or two then I don't care if they get deleted
[23:38] <StevenK> NCommander: So, stuff in the the librarian is an LFA and a correspending LFC (LibraryFileAlias, and LibraryFileContent)
[23:38] <StevenK> NCommander: Things like BugAttachment link to LFA.
[23:38] <NCommander> Sounds like squashfs's need a LFC when they're uploaded that points to the most recent squashfs
[23:39] <StevenK> If the attachment is deleted, the row in BugAttachment is dropped, and the LFA now has nothing pointing to it
[23:39] <StevenK> And it will get GC'd after a stay of execution, which is a week or something
[23:40] <StevenK> NCommander: Your custom upload will create the LFA and LFC. Don't worry about that.
[23:40] <NCommander> eh, in that case, its mostly then I don't care. I just need to be able to find the latest squashfs in librarian, download it, and let it get executed whenever its time rolls around
[23:40] <NCommander> StevenK: er? I though non-package uploads just go straight into librarian and bypass the queue. I can't have a custom upload without an assiocated source package, no?
[23:41] <NCommander> (aka, how translations are handled currently)
[23:42] <StevenK> NCommander: Just because they're directly ACCEPTED does not mean there isn't a PackageUpload for them.
[23:43] <NCommander> so launchpadlib call to trigger a build -> live-build job runs on buildds -> live-image upload to Soyuz -> PackageUpload?
[23:43]  * NCommander was thinking the system worked trigger->buildd job->librarian
[23:44]  * NCommander does have launchpad-buildd at the point where it now can do a live-image build
[23:44] <StevenK> I
[23:44] <StevenK> Sigh
[23:45] <StevenK> I'm trying to remember if the translations stuff has a PackageUploadCustom associated with it
[23:45] <NCommander> raw transitations do, which then via some automagic process get queued up by buildd manager to be executed. THere seems to be *very* little code in soyuz about it
[23:45] <NCommander> The processed translations, I'm not so sure
[23:46] <StevenK> NCommander: The revelant code would be in buildmaster
[23:46] <NCommander> there's also very little code there :-/
[23:46]  * NCommander has heard of trying to find a needle in a needlestack before ...
[23:46] <StevenK> Perhaps archiveuploader
[23:47]  * NCommander thinks he needs to run a translations job and watch to see where the files go
[23:47] <NCommander> If they go into soyuz, its easier because then I can simply iterate on an archive for the proper custom upload type (per docstories)
[23:48] <StevenK> NCommander: I think you need to write a LEP
[23:49] <NCommander> There's a partial one for this usecase
[23:49] <NCommander> https://dev.launchpad.net/Soyuz/Specs/BuilddGeneralisation
[23:50] <bigjools> you want a new build type?
[23:50] <NCommander> I implemented a new build-type. live-image
[23:50] <huwshimi> rick_h_: Just found some internet, if you're available for a call sometime. Otherwise I'll send you an email.
[23:50] <NCommander> WHich partially works
[23:51] <NCommander> I think its stuck in an infinite loop ATM though
[23:51] <bigjools> it's not an easy task
[23:51] <NCommander> bigjools: well, my build-type works, the trick is getting ways to trigger the builds via launchpadlib, and getting those files somewhere useful
[23:52]  * NCommander originally was just going to have a source package + custom upload 
[23:52] <StevenK> wgrant: http://pastebin.ubuntu.com/1149798/
[23:54] <wgrant> NCommander: Why are you trying to use a packageupload?
[23:54] <wgrant> It's not a packageupload
[23:54] <wgrant> And I'm not sure there's any reason for it to be.
[23:54] <NCommander> wgrant: I didn't think it was, StevenK was the one who brought it up
[23:59] <wgrant> :(