[01:28] * wallyworld hates "An updated diff will be available in a few minutes. Reload to see the changes. " My reload button is all worn out [01:28] You still have F5 [01:29] StevenK: oh, i was wondering what that keyboard button was. The "F5" has all worn off from overuse :-P [01:31] and another review for someone https://code.launchpad.net/~wallyworld/launchpad/remove-mp-relatedbugs/+merge/52069 [01:46] :( [01:46] dumb windows email clients [01:50] Oh? [01:50] Dumber than Gmail? [01:51] what does the mail RFC say about encoded email headers? [01:51] we are getting some with windows-cp1252 [01:53] * wgrant checks 2047. [01:53] Ah, it permits anything IANA-registered. :( [01:54] But windows-cp1252 doesn't appear on IANA's charset registry... [01:54] wgrant: meaning? [01:55] Its proper name is apparently windows-1252, not windows-cp1252 [01:56] yeah, I'm getting that one [01:56] * thumper sighs [01:56] my problem, not the code [01:56] Oh? [01:56] the email['from'] field is encoded with windows-1252 [01:57] * 2513 Exceptions [01:57] :( [01:57] ~500 more than I expected. [01:57] Ah, MP job breakage. [01:57] timeouts are down! [01:57] Content-Type: text/html; charset=windows-1252 [01:57] -woo- [01:57] that is what the email says [01:57] ScopedCollection:CollectionResource:#person-page-resource is new [01:57] thumper: That's valid. [01:57] but the headers are encoded with that charset too [01:57] as is Product:+filebug-show-similar [01:58] thumper: Hm, do you have the librarian URL for that email? [01:58] it's spam [01:58] 88/176 for BugTask:+index. That's nice. [01:58] http://launchpadlibrarian.net/65554538/9a948026-45ee-11e0-86fc-001e0bc3957e.txt [01:58] freaking awesome [01:59] thumper: Ugh. [01:59] lifeless: Aren't you on a plane? [01:59] I would have thought so. [01:59] boards at 10 past [01:59] in wellington [01:59] Oh, right. [01:59] thumper: So, catch the lack of encoding and reject, I suppose :/ [02:00] wgrant: well, at the moment it gets rejected through the oops :) [02:00] Unless we have a convenient way to apply UnicodeDammit to MIME. [02:00] Damn. [02:00] The exception summary doesn't quite get to single-ocurrence OOPSes yet. [02:01] Tomorrow! [02:01] RootObject:+recently-registered-branches is a little slow [02:02] wgrant: 131 OperationalError: FATAL: Ident authentication failed for user "person-merge-job" FATAL: Ident authentication failed for user "person-merge-job" [02:02] OOPS-1888REPORTIFSEEN109, OOPS-1888REPORTIFSEEN110, OOPS [02:02] should be easy [02:02] wallyworld, in https://code.launchpad.net/~wallyworld/launchpad/mp-related-bugtasks-webservice/+merge/52004 [02:03] would that also work, and be cleaner, as just a collection link? [02:03] wgrant: you might like to remind folk setting up jobs that they *must* make a new config and *must* have the losas set it up : we *cannot* [because of oops ids] just use the default config [02:03] lifeless: Sure, if we had a LOSA :) [02:03] or is that already what it does? [02:03] wgrant: I say you, because I'm on a plane :> [02:03] poolie: we should talk about collections vs queries. [02:03] poolie: It may be my failing, but I rather dislike the billion-collections approach. [02:03] we you and me? [02:03] poolie: can collection links take parameters? [02:03] we you and me [02:03] i don't think so [02:04] no, they can't [02:04] but this doesn't seem to take parameters [02:04] it takes the user [02:04] oh? [02:04] bug 726803 [02:04] <_mup_> Bug #726803: not possible to export a method as a collection with bound parameters < https://launchpad.net/bugs/726803 > [02:04] thumper: https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1888BZR102541 needs looking at. [02:05] wallyworld, i thought that meant it depends on the implicit request user? [02:05] poolie: we need the user since getRelatedBugTasks() needs it so that it can see what bug tasks are allowed to be exposed [02:05] thumper: It's a single user running a script against a single branch, AFAICT always looking for the next revno. [02:05] in that case, yes, of course collections can look at that [02:05] >< http://news.cnet.com/8301-17938_105-20028475-1.html [02:05] thumper: Happens a few hundred times a day, and gets logged as an OOPS. [02:05] do we know who? [02:06] poolie: we set a default user to be the request user but i think we still need to allow other users to be specified? [02:06] thumper: It was easy enough to track down, but I don't remember. [02:06] thumper: Regardless, it should not OOPS. [02:06] hmm... [02:06] agreed [02:06] I wonder why it does [02:06] thumper: Oh, right: [02:06] user_id: 1689259 [02:06] wgrant: is there a bug [02:06] thumper: I don't believe os. [02:07] wallyworld, oh, i see, it makes an optional parameter [02:07] http://trpdsaya.tumblr.com/post/3463810356/omg-this-app-is-so-restful [02:07] also http://trpdsaya.tumblr.com/post/3600386585/the-url-structure-on-this-site-is-so-pretty for that matter [02:07] poolie: yes. i think i have done it the right way [02:07] but i'm happy to be told i need to do it another way [02:08] I think its fine for now [02:08] its in devel [02:08] if we want to impove it we can :) [02:08] later y'all. [02:08] much better to have it there at all [02:08] i was just wondering [02:08] np. always good to ask questions [02:09] StevenK: I wonder if mawson is going to survive publishing all of natty, seriously this time. [02:09] Haha [02:09] StevenK: Will parallel a-f with all of the files present OOM it, I wonder? [02:09] You tell funny jokes [02:09] it would be kind of nicer if it was not a ws.op thing, but rather [02:09] StevenK: It has finished downloading all the files, so is now calculating lists for a-f. I guess that will take another couple of horus. [02:10] https://api.launchpad.net/devel/~wallyworld/launchpad/mp-related-bugtasks-webservice/+merge/52004/+related-bug-tasks [02:10] and then you could filter it etc [02:10] but that probably needs more infrastructure elsewhere [02:11] poolie: you suggesting that that api be added? [02:12] wgrant: cocobanana and mawson have roughly the same amount of RAM [02:13] wgrant: *and* cocobanana runs rsyncd, which eats babies. [02:14] StevenK: I thought cocoplum would have more. [02:14] Plus cocoplum doesn't have 223GB of DB. [02:14] No, it has a 400GB archive instead :-) [02:15] But it doesn't need to keep a big chunk of that in RAM. [02:15] Also, mawson now has 120GB of that archive :P [02:15] Haha [02:15] * StevenK looks at changing the db user for a garbo class [02:16] Hi there. When a merge request comes in I'd like to do a bzr export, fire it into my build farm, then update the merge request with the automatic build results. Are there existing tools past launchpadlib I can reuse? [02:24] Rargh, TunableLoop can't do that? [02:26] michaelh1: not as far as I'm aware [02:27] thumper: ta. [02:29] wgrant: I don't know if the populate job can run under garbo, just due to DB perms [02:32] jcsackett, really still here? If so, got a review for you! https://code.launchpad.net/~jtv/launchpad/bug-623391/+merge/52114 === michaelh1 is now known as michaelh1|away === michaelh1|away is now known as michaelh1 [02:36] jtv: ah no, actually. can't seem to change channel info though. could you change it to take me off? === StevenK changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: - | https://code.launchpad.net/launchpad-project/+activereviews [02:36] thanks StevenK :) [02:37] StevenK: You know that you can change DB perms, right? [02:37] Assuming allenap is sleeping [02:37] He should be! [02:37] Looks like we need to get memcached killed on the lucid_db_lp slave :( [02:38] And no LOSAs :( [02:38] wgrant: Sure, but we don't change db perms on prod. Or am I out of date? [02:38] StevenK: If a script needs more permissions, give it more DB permissions. [02:38] We grant new permissions during nodowntime rollouts. [02:39] wgrant: I can do that. I'm still wondering how the heck to test it [02:42] thumper: you able to review any of my branches? [02:42] https://code.launchpad.net/~wallyworld/launchpad/remove-decoratedbug/+merge/52003 [02:42] wallyworld: aye [02:42] * thumper looks [02:42] and https://code.launchpad.net/~wallyworld/launchpad/remove-mp-relatedbugs/+merge/52069 [02:42] thanks :-) [02:43] this one should also be good to go since i fixed the issue raised https://code.launchpad.net/~wallyworld/launchpad/mp-related-bugtasks-webservice/+merge/52004 [02:44] wallyworld: 710 lines? [02:44] which one? isn't the limit 800? [02:45] thumper: much/most of the line count is removing stuff [02:45] there's lots of red there [02:53] hi thumper [02:53] are you going to fix 728827 by downgrading the message from warning to info or something? [02:54] * wallyworld has to take kid to train station [02:57] poolie: yeah [02:57] great [02:57] done even [02:58] sorry, i didn't realize just having a warning message caused an oops [02:58] i guess it makes sense [02:58] neither did I [02:58] I had to hunt to work out where it was happening [02:58] It only started a few months ago. [02:59] only started giving a warning then? [02:59] Warnings and errors only became OOPSes then. [02:59] ok [02:59] i wonder how much it is worth documenting that vs just having people gradually know it [03:12] * wgrant kicks buildbot-poller [03:12] wgrant: Hm? [03:12] StevenK: It pulled devel->stable but did not merge stable->db-devel. [03:12] Possibly because db-devel was testfixed. [03:13] Mmmm, the deployment report makes me happy. [03:13] Yes. [03:13] But there are several more revs that would be nice. [03:14] eg. 12522 [03:14] Which is in stable, and cuts a couple of seconds off binary copies. [03:15] We're just waiting for qastaging, then? [03:15] https://code.launchpad.net/~thumper/launchpad/mail-header-oops/+merge/52156 anyone? [03:15] I'm just pushing the conflict resolution merge [03:18] i will do that [03:18] do the review [03:22] thumper, how does the x-launchpad-original-to header get into the mail? [03:22] by an incoming gateway? [03:25] Yes, an MTA adds it somewhere. [03:30] poolie: yeah [03:31] i can't retrieve any of the sample urls like http://launchpadlibrarian.net/62571148/916041d6-2558-11e0-b038-001e0bc3957e.txt [03:31] did they expire or something? [03:33] I think they were garbage collected [03:33] I'm not sure exactly how that works [03:36] anyhow i commented === Ursinha is now known as Ursinha-afk [03:55] poolie: I replied [03:56] oh, blah [03:56] i just got a "Your message was rejected" from launchpad-bugs-owner@lists.canonical.com [03:57] :) [03:58] https://code.launchpad.net/~thumper/launchpad/strip-email-attachment-path/+merge/52159 anyone? [04:07] thumper: i'll take a look [04:09] thumper: with my 3 mp's, they all follow on from each other. do i have to give them to ec2 one at a time, or can i just land the last one? [04:09] wallyworld: you can just do the last one [04:10] thumper: can i approve the middle one even though it says needs fixing - i've addressed the requested change (to export to the "devel" ws api not 1.0) but lifeless i don't think is online atm [04:11] wallyworld: socially, no [04:11] yeah thought so :-) [04:11] i'll wait [04:11] wallyworld: programatically, yes [04:20] jtv: got a question for you if you are around [04:20] wallyworld: I'm around, as long as you're not planning to bother me with questions [04:21] oh :-( [04:22] jtv: bug 407260 [04:22] <_mup_> Bug #407260: Translations export branch can't be team-owned < https://launchpad.net/bugs/407260 > [04:22] ah that [04:22] (clever of you not to use question marks) [04:22] i tried to write a test case to reproduce it [04:22] but my test worked [04:22] so clearly i'm missing something [04:22] Yes, IIRC the problem is with the branch picker [04:23] wgrant: It seems I can't do self.getCandidateSPRIDs(0).count() == 0 [04:23] i tried to adapt test_translations_export_to_branch [04:23] and made the branch owner a team [04:23] wgrant: FeatureError: Single aggregates aren't supported after a GROUP BY clause [04:23] StevenK: No, since some of them will fail. [04:23] That too. [04:23] But the garbo job will probably never end, since some will fail to unpack. [04:24] This may put an end to that idea. [04:24] Until we remove it [04:24] wallyworld: perhaps more precisely, my recollection is that we have no vocabulary for "a branch that I'm *an* owner of" [04:24] jtv: oh, so it's a gui problem [04:24] StevenK: But there may be enough that every run only processes the broken ones, without reaching the end. [04:25] jtv: the back end code works regardless, but the gui doesn;t allow the desired branch to be selected [04:25] wallyworld: pretty much—it only occurs when setting the branch [04:25] jtv: thanks. i thought it was a back end problem [04:25] but the test worked, so clearly not :-) [04:26] wgrant: I'll reimplement the finish_at bit then [04:26] wallyworld: Not that I can think of, no… we decided not to check for ownership during actual commit, IIRC; as an owner you get to write out a permanent license for LP to commit to it. [04:26] jtv: i'm doing this one because a user brought it up on #launchpad and it seems a good one to fix, since it affects a few people and has been around for a while [04:26] StevenK: How do you plan to preserve this across garbo sessions? [04:26] thanks for the clarification [04:27] wgrant: I don't [04:27] StevenK: The problem will still exist. [04:27] wallyworld: yes, I've been wanting to do that for ages. [04:28] jtv: cool. see, me asking questions wasn't so bad after all :-) [04:28] Only because I wasn't around. [04:29] wgrant: How many do you expect won't unpack? [04:30] StevenK: Potentially thousands. [04:31] That makes me sad. [04:31] * thumper is getting the muchies [04:31] or munchies even [04:31] But it's only 5:30pm? [04:34] yup [04:34] after beer o'clock on a Friday [04:35] thumper: have a beer for me too [04:35] wallyworld: ack [04:35] or a nice red even [04:35] i can't tonight - have to go out in the pouring rain and coach soccer :-( === Ursinha-afk is now known as Ursinha [04:37] StevenK: something I'm wondering… [04:37] …if you're still here. [04:38] Yippie, build fixed! [04:38] Project devel build #501: FIXED in 5 hr 9 min: https://hudson.wedontsleep.org/job/devel/501/ [04:38] jtv? [04:38] this bot is so happy [04:38] Haha [04:38] StevenK: as you know I'm generating DistroSeriesDifferences directly based on SPPH/SPR comparison between two DS. [04:39] I create the DSDs with source_version set to SPR.version from the derived series, and parent_source_version set to SPR.version from the parent series. [04:39] Up to one of those can be null, if the difference type is not different_versions. [04:40] (And on a sidenote, I suspect that unique_to_derived_series could be very subtly misleading and that specific_to_derived_series might be better) [04:41] I just thought I'd ask if there is still substantial work to do for the case where a package is only in the parent or only in the derived series. [04:42] jtv: If it's only in the parent or only in the child, we don't want a DSD [04:42] Err [04:42] Then why are there DSDTypes for those cases? [04:43] jtv: I have no idea -- but there *no* *point* generating diffs for them [04:43] two or three critical bugs closed today as they code paths no longer exist and oops hasn't happened in ages :) [04:43] * thumper EODs [04:43] StevenK: then maybe all you want is to block the things? [04:43] bye thumper [04:43] have a good weekend y'all [04:43] same to you [04:43] thumper: Have a good weekend [04:43] TGIF & ODIM [04:44] The Yin & Yang of the business world. [04:45] StevenK: I meant, maybe the only thing we really want from packages that only exist on one of the two sides is the ability for the owner to either block or synchronize? [04:46] jtv: Exactly [04:46] Because if that is the case, and it can be done entirely in SQL, then we have no need to bother the DSD script with those cases. [04:47] The way the script works now, figuring out the differences between a DS and its parent and creating all the DSDs all happens in SQL—none of the data ever gets pulled into the python code. [05:08] jtv: Does http://paste.ubuntu.com/575313/ mean anything to you? We didn't see anything like that in the old code, but everything looks fine anyway. [05:11] wgrant: are we sure that the old code would have reported output like that in the first place? [05:11] jtv: I am not entirely sure. [05:12] ISTR the old code being a bit iffy in that department. [05:12] Anyway, once I've run the publisher twice with this to get timings, I will rerun with the old one to compare the time and diff the trees. [05:12] Hopefully the next run will not take 24 hours :) [05:12] Well it'll be weekend for you either way won't it? :) [05:13] A good point. [05:16] With luck this weekend will have fewer production incidents than the last. [05:26] jtv: OutputLineHandler has a bug. [05:26] ? [05:27] >>> s = OutputLineHandler(sys.stdout.write) [05:27] >>> s('foo') [05:27] >>> s('bar\n') [05:27] foobar>>> s('bar\n') [05:27] foobar>>> s('bar\n') [05:27] It never empties the buffer if the input ends with \n. [05:28] Not critical, but explains some of the ridiculous output I've been getting. [05:45] wgrant: damn, I thought I'd covered that specifically. [05:45] IIRC the \n was stripped out somewhere _before_ it got to the OutputLineHandler [05:50] hi [05:50] Yay, netsplits. [05:59] wgrant, do you agree with me on https://code.launchpad.net/~thumper/launchpad/mail-header-oops/+merge/52156 [05:59] jtv: just to check i understand, "you" still handle translation approvals? eg blue squad now on maintenance, and there's a queue entry waiting approval. do i need to do anything? [06:00] wallyworld: do you have a translations veteran on the team? [06:00] jtv: our team is me, tim, leonard, and steve but steve is on loan to the red team at the moment [06:00] so no :-( [06:01] (By the way, I can't tell you how much it means to me for another developer to tell me there is "a" queue entry awaiting approval) [06:01] wallyworld: jtv is on red, so he is aware of what I'm working on :-) [06:01] jtv: i filtered on the suggested "ANy Project" and "Pot only". was that not correct? [06:02] Yes, it is—and presumably on the also-correct Needs Review as well. [06:02] wallyworld: want to walk through it with me? [06:02] I don't think it'll be very hard. [06:02] jtv: yes please, so i can communicate back to the blue team [06:02] Just click on the edit icon next to "no import target selected yet." [06:02] * wallyworld clicks [06:02] Well I say "just," but I mean "for starters." :) [06:03] poolie: I've wondered that myself. For the field to be inserted after a blank line, our MTA would presumably have to be buggy. [06:03] jtv: there is no edit icon [06:03] poolie: I agree that investigation is required. [06:03] for me [06:03] wallyworld: then we haven't added you to the rosetta-admins team yet. Let me fix that. [06:03] ok [06:03] it seems kind of unlikely to me that that bug would be triggered iff the message is spam [06:03] indeed if it's reliably doing that, we should sell it ;-) [06:04] it's possible it's some interaction between a spam scanner and something else [06:04] It is a reasonable assumption that something with header fields in the body is spam. [06:04] But I cannot see why *this* field would be there. [06:04] note that we're not checking for a body that looks like it contains headers [06:04] just for that string, anywhere in the body [06:05] i should say so on the mp i suppose [06:05] Yes. [06:08] wallyworld: I've invited the launchpad-chr team to rosetta-admins, as per my email to the list. But now we need that invitation accepted. [06:09] I'll email Diogo about it. [06:09] jtv: thanks. can we walk through an approval another time? [06:09] Absolutely. I'll just do this one for now. [06:09] i'd still like to learn how to do it [06:09] thanks [06:10] jtv: i think that's the key thing to know about while on maintenance? anything else critical to be aware of? [06:14] wallyworld: plenty of recurring questions, but for most things IMHO it's best to find out as you go along. [06:14] jtv: ok. thanks again [06:14] We have lots of CHR documentation on the internal wiki, so you could try reading through that and following some of the links. But I wouldn't recommend trying to keep up with all the FAQs. On-demand caching is the ticket. [06:17] jtv: yeah, there was so much material i'd thought i'd try and cheat a bit by asking about the "viewing highlights" [06:17] Sensible. [06:17] :-) === jtv is now known as jtv-eat [06:35] Have a good weekend people [06:57] bye huwshimi [07:30] Still no reviewers available? Got two dependent branches blocked… starting with https://code.launchpad.net/~jtv/launchpad/bug-623391/+merge/52114 === jtv-eat is now known as jtv === soren_ is now known as sorne === sorne is now known as soren === almaisan-away is now known as al-maisan [09:07] good morning === al-maisan is now known as almaisan-away === almaisan-away is now known as al-maisan [09:28] Still no reviewers in the house? Need a critical pair of eyes for https://code.launchpad.net/~jtv/launchpad/bug-623391/+merge/52114 [09:28] (And then I'll try to get someone else for the follow-up branch :) [09:30] adeuring: ^ Aren't you reviewing today? [09:30] Hi jtv! ;-) [09:31] hi! [09:31] jtv, henninge, yes. I'll look at your branch. jtv [09:31] Wunderbar! === adeuring changed the topic of #launchpad-dev to: https://dev.launchpad.net/ | firefighting: - | On call reviewer: adeuring | https://code.launchpad.net/launchpad-project/+activereviews === al-maisan is now known as almaisan-away === almaisan-away is now known as al-maisan [10:11] hello [10:13] I have a problem to build launchpad [10:13] when I do maake schema I get an error [10:14] with zc.buildout [10:16] "couldn't find index page for zc.buildout [10:18] I think the program is trying to download zc.buildout but I get ***BLOCKED*** by --allow-hosts [10:53] adeuring: I've been having some system & connection problems… did I miss any questions? [10:54] jtv: no, and, btw, no complaints so far. nice to read the diff [10:54] ... but i need some more time ;) [10:54] sure === al-maisan is now known as almaisan-away [11:22] Hello jtv, I have a problem with the "make schema" command [11:22] Give me a name for a marker instance for something that might be a Storm subclass, or an instance of a Storm subclass. Besides IFooStormObjectOrClass. [11:23] maxwell69: I may be able to help, but it's Friday night here and I'm putting out some fires. :) What's the problem? [11:23] nm. got one. [11:24] stub: a marker interface you meant? [11:24] yes [11:24] IUseSessionStore is what I'm actually after. [11:25] I'm trying to buils launchpad but I have an error: [11:25] "couldn't find index page for zc.buildout" [11:26] the program try to download zc.buildout but I have this error: ***BLOCKED*** by --allow-hosts [11:26] jtv: r=me [11:26] thanks adeuring! I ought to find someone else to bother with the follow-up branch I guess… [11:27] but my connction wors well and the website is aviable [11:27] jtv: nah, i'll take that too :) [11:27] adeuring: thanks again! [11:27] maxwell69: How did you check out the source? [11:27] maxwell69: it sounds horribly like a zope + system setup problem… which I wouldn't know much about. [11:28] maxwell69: Did you use rocketfuel-setup? [11:29] I suspect not. [11:29] wgrant: yes, I followed instructions on https://dev.launchpad.net/getting [11:31] Now, --allow-hosts sounds vaguely familiar [11:31] Maybe I'm just thinking hosts.allow. [11:32] It should be getting buildout from download-cache. [11:32] maxwell69: What is in the download-cache directory inside your LP branch? [11:37] wgrant: I have "dist" directory [11:37] maxwell69: Does that contain a few hundred files? [11:37] wgrant: and I manually put zc.buildout-1.5.1 dir [11:39] wgrant: in dist I just have setuptool***.egg [11:40] maxwell69: There should be several hundred eggs in there. [11:40] Is download-cache a symlink? [11:41] wgrant: I'm affraid not [11:42] adeuring: Hi. [11:44] hi wgrant [11:44] adeuring: Could you please review https://code.launchpad.net/~wgrant/launchpad/turn-off-parallel-a-f/+merge/52185? [11:45] wgrant: sure; let me just finish another review for Jeroen [11:45] adeuring: Sure. [11:45] Thanks. [11:53] wgrant: should I re-execute rocketfuel-setup? [11:53] maxwell69: What do you have in ~/launchpad/lp-sourcedeps? [11:54] There is no lp-sourcedeps... [11:55] maxwell69: Hmm. Did rocketfuel-setup give any errors? [11:56] jtv: r=me again [11:56] adeuring: and thanks again [11:58] wgrant: there is warnings: DocumentRoot [/var/tmp/archive] does not exist [11:59] maxwell69: That's fine. [11:59] and ./rocketfuel-setup line 362: cd: /usr/local/bin: no such file or directory [12:00]