lifelessjono: is the broken run running lucid ?00:00
jonolifeless, no, on Precise00:00
jonobut I think I sourced the issue00:00
jonoI have a loop which runs any outstanding scripts and it was running it again after the first script had started00:01
jonowhen changed the loop to wait enough time for the script to complete, it worked fine00:01
jonolifeless, so it looks like I am still getting this SSLError about the read timing out00:19
pooliejono, this is from a launchpadlib script?00:24
pooliedo you have a proxy?00:24
jonopoolie, yes, in a lplib script, and no proxy00:24
jonosometimes it runs fine, sometimes I get the SSLError00:25
pooliemtu problem perhaps?00:25
poolieplease pastebin the traceback?00:25
lifelessjono: butfirst, make a new gpgkey (don't!, I'm teasing)00:25
jonolifeless, lol00:26
jonopoolie, one sec00:26
jonopoolie, http://pastebin.ubuntu.com/845199/00:27
pooliehm, it's failing when starting to read the request00:27
poolieit's possible it's timing out on the server00:28
pooliei wonder if you have old code that's connecting to edge.l.n?00:28
jonoI only wrote this yesterday00:29
jonoI don't think it talks to edge00:29
pooliei would probably try getting a packet capture next, i guess00:31
pooliedo you know how to do that in tcpdump or wireshark?00:31
jonopoolie, sorry, no00:33
pooliebtw are you jono bacon or some other jono? :)00:33
poolieok try00:34
pooliesudo tcpdump -i eth0 -p ip net and tcp port 443 -w /tmp/lp.dump00:34
poolie(you might need to install it)00:34
pooliethen put that file somewhere00:34
jonopoolie, jono bacon00:34
poolieyou're intentionally running the .py~ version?00:35
jonono, that is a backup file, but it is the same00:35
jonolet me double check00:35
jonopoolie, I am on wireless, is that wlan0 ?00:36
poolieoh right00:36
pooliethere is another thing you can do which is00:36
pooliemaybe a bit easier00:36
pooliein your script, before you import launchpadlib00:37
poolieimport httplib2;httplib2.debuglevel = 200:37
jonook I just ran it and it worked00:40
jonowill run a few more times until the problem happens00:40
pooliethat may help and be easier00:41
pooliegetting a capture when it does occur could be helpful00:42
pooliein telling whether it's a client, server or network error00:42
jonogot it00:42
jonowant me to pastebin it?00:42
StevenKThat sounds good00:42
jonook, here is the output from the script first: http://pastebin.ubuntu.com/845209/00:43
jonowhat should I do with the dump file?00:44
poolieput it on chinstrap or something00:45
pooliethere's nothing obvious to me00:49
pooliewhat is different between the machine where it works and where it doesn't?00:50
jonopoolie, same machine00:51
jonoalthough I have tried it on two machines also00:51
jonoit seems to happen randomly00:51
poolieoh ok00:51
jonowhich would suggest it is a server issue00:51
poolieyeah i guess it is00:51
pooliejono,  i guess you should write your app to just catch the exception and retry00:56
jonothanks poolie00:56
jonopoolie, do I need to file a bug about this?00:56
* lifeless suspects another client side SSL bug00:56
lifelesslike the last one that had some bzr users in a tizzy00:56
lifelessare we using openssl or gnutls ? There was a gnutls issue recently IIRC00:57
pooliethat has different symptoms01:01
poolieit's possible it's the same bug01:01
poolieactually that seems unlikely but it's possible it's a similar bug, or a reflection of a similar deep problem01:02
pooliejono it would be worth filing a bug01:02
poolieeven if we don't know what the target should be :)01:02
pooliewhat would be awesome is if you can write a program that just loops until it fails01:03
pooliethen we can try it on different clients, or a developer can reproduce it01:03
jonosure, will see what I can do01:03
pooliemm it would be interesting too to know whether it's always the same url or set of urls01:03
pooliewhich would perhaps indicate an lp fault01:03
pooliejono, i don't think this is the problem but, after you write that script, it would be a bit interesting to see if01:07
pooliesudo sysctl -w net.ipv4.tcp_mtu_probing=101:07
pooliefixes it01:07
=== SamB_ is now known as SamB
benonsoftwareczajkowski: Thank you very much for your response08:11
czajkowskibenonsoftware: no promblem08:11
* benonsoftware is proberly going to stay up tonight reading each license :P08:12
=== david is now known as davidcalle
=== czajkowski changed the topic of #launchpad to: https://launchpad.net/ | Help contact: czajkowski | Launchpad is an open source project: https://dev.launchpad.net/ | This channel is logged: http://irclogs.ubuntu.com/ | User Guide: https://help.launchpad.net/ | Support: https://answers.launchpad.net/launchpad | For packaging help: join #ubuntu-packaging
danhgHallo mrevell09:20
mrevellHey there danhg09:21
danhgHow's Yam Yam Land?09:21
mrevellPretty good. How's Barthelona?09:22
nyuszika7hHi, is it possible to remove an OpenPGP key from my Launchpad account (not only deactivate)?09:35
nyuszika7hI lost that key and I generated a new one.09:35
* benonsoftware has lost keys many times :P09:36
czajkowskinyuszika7h: you should be able to remove it yourself there on your lp ac09:39
nyuszika7hczajkowski: I can only deactivate it09:40
czajkowskinyuszika7h: and your lp ac is ?09:40
nyuszika7hczajkowski: ~nyuszika7h09:40
nyuszika7hKey that I deactivated is 2048R/6A9D469C09:41
odonyczajkowski: hi Laura, I have a question about batch validation of translations import when you have a minute (I'll wait in line ;-))09:41
czajkowskinyuszika7h: let me look09:42
maxbYou can't fully remove keys. This is apparently by design09:44
czajkowskinyuszika7h: if you upload the new one you can replace it09:44
nyuszika7hczajkowski: I already uploaded the new one.09:44
benonsoftwareczajkowski: I'm just wondering why does launchpad not remove things like that, or let a normal user do it? (I'll hope in line :P)09:44
maxbThen again, there's little need to remove keys09:44
nyuszika7hI also signed the Ubuntu Code of Conduct with the new key, and removed the old signature.09:44
maxbnyuszika7h: Is there a reason deactivating the old key is not good enough?09:45
nyuszika7hmaxb: I lost it, and I can't get it from anywhere because I don't have any backups of it.09:46
maxbright. so deactivate it, which you've already done09:46
czajkowskinyuszika7h: which is enough09:47
czajkowskiodony: how can I help09:47
odonyczajkowski: we've just branched off a new trunk->stable branch for our project and created a new series for it, then enable bidi auto-sync of translations on it, in order to preserver our trunk translations09:48
maxbThe only reason you might need a key removed entirely was if you wanted to move it to a different Launchpad identity09:48
odonyczajkowski: so the initial import has run, but it filled the translation queue with hundreds of PO files that we have to validate one by one (confirm language auto-detection and translation domain)09:48
maxbAnd if that was the case, you're stuck, because it's not possible (without raw SQL, which the admins now refuse to do)09:48
odonyczajkowski: the thing is, all those PO files were already approved and reviewed in out trunk, but now we have to do it all again manually.... is there any way to speed this up?09:49
czajkowskiodony: i'm about to find out from jtv09:49
* jtv reads backlog09:49
jtvmaxb, odony: There should be no need whatsoever to approve PO files manually.09:50
odonyjtv: perhaps it is because our PO layout is not 100% standard?09:50
maxbI'm not part of the PO conversation, I'm only a part of the PHP conversation09:50
jtvThe layout makes all the difference, yes.09:51
jtvThe standard layout is:09:51
jtvEach PO file in the same directory as its template,09:51
odonyjtv: e.g. our main branch has about 200 translation domains and this is the layout:   /domain/i18n/xx.po09:51
jtvand named after the language code.09:51
jtvThat in itself should be fine,09:51
jtvas long as the template is /domain/i18n/yyyy.pot09:52
jtvI used yyyy; bad example.  I mean "your domain name"09:52
odonyjtv: and the templates are  /domain/i18n/domain.pot09:52
jtvnot "4-digit year" :-)09:52
jtvThen that should work.09:52
odonyjtv: actually I'm not too sure what happened, some of the PO files are stuck in the queue in Needs Review state, but the translations seem to have been imported because the same domain appears partially translated in the statistics for that series09:58
loolhttp://launchpadlibrarian.net/92966336/autotools-dev_20110511.1_20120210.1.diff.gz says "A required database is unavailable. See http://identi.ca/launchpadstatus for maintenance and outage notifications."10:01
looland no messages from launchpadstatus in a month10:01
wgrantlool: 1000-1005 UTC is an outage window10:02
odonylool: it's back10:02
wgrantIt's back now10:02
wgrantWas down for 86 seconds.10:02
loolshould the link be changed though?  or should a bot be setup to announce it on launchpadstatus?10:02
odonyjtv: I guess I should first wait a few hours, our templates list is complete in the series but only the first few ones have a non-zero count of translations - I imagine this means the import is still in progress10:04
odonyjtv: https://translations.launchpad.net/openobject-addons/6.1/+templates10:04
jtvodony: sorry for the delay; also in a phone call10:04
odonyjtv: np, take your time :)10:05
jtvodony: the existing translations don't necessarily prove that imports happened.  By default, it shares translations from other series for the same project/template/language.10:06
jtvodony: the imports normally shouldn't take very long.  Scheduling is round-robin, so you'd see one of your files being imported, then a few minutes of imports for other projects, then one of yours again.10:06
odonyjtv: ok... didn't know translations were shared between series10:07
jtvodony: I don't think that happened when you started using Launchpad Translations.  :)10:07
jtvBut now, if a string is in 2 series (same template), translate one and it'll be instantly translated in the other series as well.10:08
odonyjtv: sounds good, and actually explains an issue we had where our trunk translations started to bleed onto our previous 6.0 stable series.. causing bugs in the process ;-)  (because we use special PO comments for internal purposes, and their format had changed)10:09
odonyjtv: that's actually weird.... I mean the msgid would be the same in the 2 series, but the comments were not... so I assume it should be using the one from the right series when exporting the actual PO, shouldn't it?10:10
odonyjtv: s/the one/the ones/  (meaning the comments)10:10
jtvodony: off the phone.  :)10:18
odonyjtv: :)10:19
jtvodony: we never really anticipated the comments being so significant, really; I think the comment will be whatever was imported most recently.10:19
odonyjtv: ok, that would indeed have been our trunk comments... I understand better. Anyway we worked around it and it was really no big deal10:22
odonyjtv: so, assuming the translation count basically comes from other series, we still have hundreds of PO sitting in the import queue and waiting to be manually reviewed... what can we do about them? ignore them because they're in fact identical to the translations that are shared?10:22
odonyjtv: e.g. https://translations.launchpad.net/openerp-web/6.1/+imports?field.filter_status=NEEDS_REVIEW&field.filter_extension=all10:22
=== debfx_ is now known as debfx
* jtv has a look10:22
jtvI'll just go through a bunch of checkboxes now, things that _might_ be blocking automatic approval.  May take a while.10:24
jtvThe paths look OK; there's a template in the same directory.10:24
odonyjtv: thanks... the openerp-web project has a different layout from what I mentioned with a leading /addons dir, but the problem looks similar in our main openobject-addons project  https://translations.launchpad.net/openobject-addons/6.1/+imports?field.filter_status=NEEDS_REVIEW&field.filter_extension=all10:24
jtvThere are also no weird elements in the path that might confuse things.10:25
odonyjtv: normally the naming of the po files is also standard10:25
jtvYes, the names look fine.10:25
jtv(I'll just stick with the openerp-web one for now; it's easy to spread oneself too thin with so complex a piece of software.)10:25
odonyjtv: sure10:26
jtvNow let me see if there's really just one template in that directory.  Maybe there's too and the queue gardener can't choose.10:26
jtvNope; no competing templates.10:28
jtvThere's one matching template, and it's active.10:28
jtvodony: sorry, X crash.  The disadvantage of alpha-testing operating systems.10:32
odonyodony: np ;-)10:32
odonyerr s/odony/jtv d'oh10:32
jtvTalking to yourself?  :)  Now, I haven't seen any reason why these uploads would not be approved.  So I'll have to dig a little deeper.  I'm going to dive into the log files.10:32
odonyjtv: thanks a lot for taking the time to look.. I'm willing to try and automate the approval of the imports using lplib if that works, but I'd love to understand the inner working of the import system better as well10:34
jtvSensible; this should be automatic.10:34
jtvNothing remarkable in the logs either.  :(10:35
jtvThat's an older log file though; I'm getting an update.10:36
odonymeanwhile the importing of our main templates is almost half done10:38
odonythis beast is huge apparently ;-)10:38
jtvodony: I suppose!  It also depends on what else is going on the queue.  You can see the global import queue at https://translations.launchpad.net/+imports10:41
jtvThere's a backlog of 502 approved entries, which need importing.  That can happen with large batches of uploads.10:42
odonyjtv: interesting :)10:43
jtvThere's a massive backlog of "needs review" entries though.10:43
jtvThe queue gardener loops over all of those, oldest to newest, so it could simply be that it's slow at the moment.10:44
odonyjtv: funny thing that the oldest ones in Needs Review seem to be one of ours10:44
jtvYes — never approved because they had unwanted country/region codes in their filenames.10:45
jtvDeleting a bunch of those might speed things up for everyone.  :)10:45
odonyjtv: yes, I should definitely be doing that10:45
odonyjtv: the CC code in the PO name isn't bad, is it? if we have local variations of some languages that's the correct name, isn't it?  e.g. es.PO for Spanish and es_CR.po for Costa Rican Spanish10:48
jtvIt's not “bad” in the sense of technically incorrect, but it is “bad” in the sense of inconvenient.  Since you _generally_ won't want such regional variations (because it fragments your translation effort, and because it overlaps with the region-less language codes) those variations are considered inactive.10:50
jtvSo translations won't be approved for them by default.10:50
odonyjtv: I see... the thing is, our community insists that these languages need specific variations, and they make merge proposals with these variations10:51
jtvYou *can* approve them manually if you're sure that's what you want, and once you've done that, a later upload with the exact same path will be approved automatically.10:51
jtvBut that does mean that you need to approve them.10:51
jtvCustom language codes _may_ help you get around this.10:51
jtvIt's a bit embarrassing because I wrote them myself; I don't remember whether they do.10:52
odonyjtv: :D10:52
jtvIt may be possible to create a custom language to map, say, es_CR to Costa-Rican Spanish (which, yes, is just a duplicate of the normal mapping) and the queue gardener may then understand that you do want that language.10:52
jtvAlthough generally what we've seen is that even the Spanish translators manage to keep their language unified.10:53
odonyjtv: good to know, might try that, but indeed we should try to avoid it10:53
odonyjtv: Actually we have a special way to handle translations:   when a user decides to use the Costa Rican translations for instance, we will still load all missing ones from the es.po, which is a kind of "translation inheritance"10:54
odonyjtv: I don't suppose there is any such notion in Launchpad10:54
jtvNot dynamically; not in the same way we share translations between series.10:54
jtvWe do, however, have the “Using <other language> as a guide” option in the UI.10:54
jtvSo if you translate to es_CR, you can pick Spanish there and you'll get the Spanish translations as automatic suggestions.10:55
jtvIn most cases I suspect the translator can just click on the right one.10:55
odonyjtv: indeed, but as it doesn't actually share them, translators would still need to do them one by one10:55
jtvWhat we've found sometimes with large communities is that you get people treating these more subtle distinctions between languages as a license to re-word everything.10:56
odonyjtv: given that we have 14k+ terms to translate, they usually prefer to duplicate the es.po files in a merge proposal, and then work from there10:56
odonylicense to re-word everything indeed... that might be the case for us too... though I think there are cases where they do really need to change a few words..10:57
jtvI suppose it makes sense; theoretically you could also leave most strings untranslated and have the user's system fall back to the "mother language" at runtime, but then we don't have any way of tracking which ones have been reviewed.10:57
odonyspecific legal and accounting terms for example....10:57
jtvYes, you guys are just about the only project I've seen that really needs that, and handles it well.10:57
odonyjtv: yes that's what we do too, but then the statistics and reviews are all wrong on LP ;)10:57
jtvYour situation is a bit unusual in that it's relatively rare for open-source projects to interact quite so much with real-world things that depend on countries.10:58
jtvLaws and taxes, for instance.10:59
odonyjtv: true... we're certainly quite specific in that fashion10:59
jtvFor other projects, I would say those differences are basically cosmetic (with the exceptions of pt_BR/pt and the two main versions of written Chinese).11:00
odonyjtv: I would imagine so, indeed11:00
jtvYou've got a bunch of localization projects that really are for countries.  Which is good and proper, but sometimes a bit confusing because so many other people register their own projects just to translate somebody else's project to a new language!11:01
odonybut for us, even Belgium French has a few noticeable differences from France French in accounting terminology, making some features unsuited for the other country without the proper translation care11:01
odonyyes, it can be quite confusing11:01
jtvYes, I've seen the uploads (and spent many hours approving them :)11:02
jtvDon't worry about it.  We want your project to run smoothly, although we're limited in what we can do in terms of engineering because it's such an isolated use-case.  I'd definitely give the custom language codes a try.11:02
odonydo you know if launchpadlib would let me manage the translation imports programmatically?11:03
odonyI've seen something about import queue items in the API ref, but not sure I can alter anything from there11:03
jtvI believe the Ubuntu folks have been doing something like that.  Let me have a look at the code.11:03
odonyjtv: thanks!11:03
jtvodony: ah, I'm being silly.  The UI has an ajax-y little pop-up status selector on the import queue entries.11:05
jtvYou get those too, right?11:05
jtvThose use the very same API, from your account.  So yes, you can do that.  :)11:05
odonyjtv: yes I see them for our own import items11:06
odonyjtv: so it means that's automatically exposed via launchpadlib? great!11:07
jtvYes.  But you still shouldn't _need_ to, so it'd be nice if we could figure out why it's not happening automatically.11:07
odonyjtv: sure :-)  But I can at least clean up past years of old imports without having to ask anyone to click through thousands of Needs Review items11:08
odonyjtv: :D11:09
jtvThe code for this is massively convoluted; you can see it in http://bazaar.launchpad.net/~launchpad-pqm/launchpad/devel/files/head:/lib/lp/translations/model/translationimportqueue.py (may need a reload)11:10
odonyjtv: is there anything I can do to help find out why the gardener would not automatically process our PO files? like upload some test POs or something?11:10
jtvNo need, thanks.  It would probably introduce more unknowns, making it easy to miss the real problem.11:11
jtvAt the moment the queue gardener is taking more than an hour to run, and one run this morning failed.  Still, I'd expect some progress by now.11:11
jtv(The failure may simply have been because it got interrupted by an upgrade.)11:12
odonythanks for the link to the code!11:13
odonyjtv: looking at _attemptToApprove() it looks like the Needs Review status is not permanent but only the initial one?  or is it permanent if the "No import target selected yet." message is displayed?11:15
odonyjtv: anyway, don't let me bother you with questions about the code.. sorry ;)11:16
jtvodony: you put your finger on one of the most essential aspects of the whole thing.  Needs Review is the initial status, and it's up to the gardener to come up with something more definite later.11:24
odonyjtv: aah, so I can't really know if a given (recent) import is permanently stuck in Needs Review or simply waiting for some gardener love... can I?11:28
jtvodony: exactly!  Even if we could decide it that moment, a human action could change everything.11:29
jtvThat's why the gardener just keeps trying.11:29
aboudreaultcould you push a build before a little bit in the queue? just wondering :/11:32
aboudreaultWould have like to get the package build and published for 8HAM.... for a client.. but look like the system is busy :(11:33
odonyjtv: so cleaning up our Needs Review mess in the global queue would really help everyeone... but at the same time a single human action (or import queue patch) could automatically fix them all too... cool :)11:33
jtvodony: from a server's perspective, it's all one big mess, typical of us biological meatbags.  But yes, the code is pretty smart in some ways even if it's convoluted in others.11:34
odonyjtv: sounds familiar ;)11:35
aboudreaultdamn.. it has been push from Start in 2 hours to 3 hours. hehe11:39
jtvodony: I'll need to step out for a bit now, and unfortunately I don't have a lot more time to look into the non-approval mystery.  One thing I do note from the logs is that because of the interruption it's _possible_ (the information is a bit sketchy) that the gardener simply hasn't gotten around to your uploads yet.11:41
odonyjtv: that could make sense.. and your explanation for the forced approval of all country-specific PO files reminded me that it is usually only country-specific files that I see sitting in the queue11:43
jtvYeah, those are just a bit more difficult because of what we discussed.11:43
odonyjtv: so it could simply be that we should just wait until the normal translations are imported, and I will handle myself the country-specific ones11:44
odonyjtv: thank you very much for your help and kindness!11:44
jtvNo need to keep the one waiting for the other; they are decoupled.  I'd try the custom language codes.11:44
jtvBest of luck, I've always enjoyed watching your project in action!11:44
odonyjtv: thanks :)11:44
odonyjtv: I will be sure to try the custom codes too11:45
jtvodony: only back in for a few seconds, but: there's been progress!11:58
jtvThe gardener just completed a full run.11:58
* jtv is out again11:58
rindolfHi all.12:52
rindolfHow do I checkout lp:inkscape using http:// or https:// ?12:52
wgrantrindolf: lp: will use HTTP by default, unless you've run bzr lp-login13:08
bigjoolsrindolf: if you have no launchpad id configured, bzr branch lp:inkscape will DTRT13:08
wgrantOtherwise you can use the direct HTTP URL: http://bazaar.launchpad.net/~inkscape.dev/inkscape/trunk13:08
odonyjtv: yay, our intuition was correct, and indeed now we only have 23 Needs Review left in openerp-web series 6.1, all of them are country-specific, so I'll try custom language codes to fix it now :)13:29
jtvodony: wasn't an intuition — I was pointing out that it was possible, and I merely had no other guesses left.  :)13:30
odonyjtv: hehe13:31
=== Ursinha` is now known as Ursinha
=== bigjools is now known as bigjools-afk
=== matsubara is now known as matsubara-lunch
=== warp11 is now known as warp10
=== EyesIsServer is now known as Eyes|Infinite
elopiois there a way to receive bug mail on a different email address?16:45
mgzyes, click on the yellow warning icon next to 'Email' on your user page16:53
mgzthat will take you to /~yourname/+editemails where you can add another address and pick what subscriptions go where16:54
elopiomgz, I can add an email, but all notifications will go there, the ones from answers and code.17:00
elopiothe idea is just to filter the bug mail to a different address.17:01
mgzyeah, I don't think you can split email about bugs from email about code reviews.17:01
elopiowebm0nk3y ^^^^17:03
elopiowebm0nk3y: I would go with an email filter that forwards and deletes bug mail.17:04
webm0nk3yelopio: what I did was set my default email as the only i wanted to get bugs and then change all my subscriptions to go to a different email17:04
webm0nk3yelopio: you can't really control bug email specifically17:04
webm0nk3yHi launcpad team, the email I sent to everyone was sent when i clicked on a 'contact administrators of this list to request a change." I did not send it to the entire list.17:05
webm0nk3yczajkowski: ^^17:05
elopiowebm0nk3y: how did you do that first thing?17:07
elopio"set my default email as the only i wanted to get bugs"17:07
webm0nk3yelopio: I have 5 emails registed in launchpad17:07
webm0nk3yelopio: I change my default contact email to be the one i want bugs to go to17:07
elopiowebm0nk3y: ah, ok. But you'll also get answers notifications and other stuff.17:08
webm0nk3yelopio: yep... a sad side effect17:09
elopiowebm0nk3y: or a nice feature request :)17:10
=== bigjools-afk is now known as bigjools
=== matsubara-lunch is now known as matsubara
=== czajkowski changed the topic of #launchpad to: https://launchpad.net/ | Help contac | Launchpad is an open source project: https://dev.launchpad.net/ | This channel is logged: http://irclogs.ubuntu.com/ | User Guide: https://help.launchpad.net/ | Support: https://answers.launchpad.net/launchpad | For packaging help: join #ubuntu-packaging
=== deryck is now known as deryck[lunch]
zygaI think something is wrong with launchpad merge proposals19:18
zygaanyone interested looking at my merge request to see if I'm not missing something obvious?19:18
zygaer, false alarm, wrong project, wrong brnach19:23
=== deryck[lunch] is now known as deryck
=== matsubara is now known as matsubara-afk

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!