/srv/irclogs.ubuntu.com/2009/11/04/#launchpad.txt

Laneyhm00:01
LaneyShould I get reject emails if someone signs+uploads a package to their PPA but leaves me in Changed-By?00:02
wgrantI don't think so.00:02
wgrantUnless you have upload privileges to that PPA, I think.00:03
Laneyhttp://dpaste.com/116006/00:03
LaneyI think that's what happened here?00:03
* wgrant checks the code.00:04
wgrantHm.00:06
wgrantIt should only email changed-by or maintainer if the upload was not to a PPA.00:06
wgrantAny idea to where it was uploaded?00:06
Laneyall I have is this email00:07
LaneyYou are receiving this email because you are the uploader, maintainer or00:07
Laneysigner of the above package.00:07
lfaraone.ckear00:08
wgrantI wonder if it was in fact uploaded to the primary archive.00:08
Laneythose mails come from "Ubuntu Installer"00:09
jpdsMight of been aiming for http://tinyurl.com/yjphghl .00:09
LaneyI reckon so00:10
wgrantLaney: They should, yes. But if the uploader uploaded to ppa.launchpad.net/ubuntu, it will be from Launchpad PPA00:10
wgrantI would file a bug, since there are no Soyuz people around at the moment.00:11
wgrantGive the full email there, ideally including the headers and rationale.00:11
wgrantThere's a bug somewhere, but it's unclear exactly where without logs.00:12
blackhCan someone help? Why can I not upload binary packages to a PPA???02:10
wgrantblackh: Why would you want to, when Launchpad will build them itself?02:10
wgrantThere is a good reason to disallow it: if Launchpad builds all the binaries itself, I can be sure that the binaries are built from the sources that I see.02:11
wgrantIf you upload binaries that you build yourself, I cannot trust them.02:11
blackhwgrant: OK - I see.  But not very helpful for me.  I've already built my packages and there was some trickery due to a package with the same name in the standard builds.  I would need to go through all the same suffering over again (only on an unfamiliar environment) to get launchpad to build them.02:12
wgrantblackh: Do you not have a source package that you can easily build the binaries from?02:12
blackhI have the source packages... but if you build them "straight", builddep gets the wrong version of ghc.  I could fix it by hacking them all to refer to more specific versions... so basically I need to figure out whether I should do this, or whether I should give up and host them myself.02:15
wgrantYou should really fix the source packages, or they're not useful for anytbody else.02:15
wgrantThe point of a source package is to directly build the binaries easily.02:15
blackhOne of the packages builds ghc-6.10.4-1, and the standard packages for karmic have ghc-6.10.4-ubuntu2 (iirc)02:15
blackhThese are just grabbed from Debian.02:15
wgrant"One of the packages" being a new version of ghc?02:16
wgrantSo you need a newer version of ghc?02:16
blackhYes....  78 packages in all02:16
wgrantIf you upload the new version of ghc first and wait for it to build, all the subsequent builds will use that version of ghc.02:16
blackhAh - that could be my solution, then.02:17
wgrantBuilds are pretty slow at the moment, because most of the build machines are currently serving Ubuntu downloads because of the release of 9.10.02:18
wgrantBut they should speed up soon.02:18
blackhwgrant: Your help is very much appreciated - thanks.02:20
wgrantnp02:20
RenatoSilvawhat happens if I delete a translation branch which is target for the automatic exports?02:29
RenatoSilvaI want to delete it because I don't let the translations get into trunk automatically, I have an extra branch to analyse the work first, then commit it to the main line02:31
RenatoSilvawell, never mind. I think I don't need export branches02:32
doctormoIf there any experts here this evening, I have a question related to ssh keys for a launchpad intergration project.02:43
wgrant!ask | doctormo02:43
ubottudoctormo: Please don't ask to ask a question, simply ask the question (all on ONE line and in the channel, so that others can read and follow it easily). If anyone knows the answer they will most likely reply. :-)02:43
doctormoIs it possible to have more than one ssh key? how are they aranged? what is the difference between a key in id_rsa and id_dsa?02:43
ajmitchcertainly possible to have more than one02:44
doctormoThe reason is that if I want to automated the creation of ssh keys for launchpad use, I don't want to squash existing keys and I want it to play nice.02:45
ajmitchthe difference between them is the algorithm used to generate it02:45
doctormoajmitch: No practical reasons? no different uses for each one?02:45
wgrantIn Launchpad (as with a normal authorized_keys file), you just add new keys separated by line breaks.02:45
wgrantYou should probably use RSA keys now.02:45
ajmitchyou can read up on the differences if you want, I can't remember which one is recommended (RSA i think)02:45
wgrantDSA is losing favour.02:45
ajmitchyou can also tell your ssh client to use specific keys to connect to various hosts02:46
doctormowgrant: Right, on the persons machine can I do that in id_rsa too? just add a new line to indicate a new private key?02:46
wgrantI don't think so.02:47
ajmitchid_rsa is just the default name02:48
ajmitchyou can have them named something else02:48
ajmitchid_rsa_key_for_silly_launchpad_stuff02:48
ajmitch& then use the IdentityFile option in the ~/.ssh/config to use that for launchpad hosts02:49
doctormoajmitch: Sounds like the perfect plan to make sure there are no conflicts, offer the use the choice to use an existing key, or make a special one that won't conflict later.02:52
doctormothanks guys02:52
ajmitchI hope it works out02:53
ajmitchwhatever you're trying to do there :)02:53
RenatoSilvadoes the loggerhead support for tags include tag urls?02:58
mwhudsonRenatoSilva: no03:00
=== jon is now known as Guest73252
RenatoSilvaok, bug 47369103:09
ubottuLaunchpad bug 473691 in loggerhead "Tag urls" [Undecided,New] https://launchpad.net/bugs/47369103:09
RenatoSilvais there any work for supporting download urls in Loggerhead?03:18
RenatoSilvaThe web ui for hg has this, so you can download a .zip for the branch easily, including tags, for example http://server/project/tip/download03:19
spivNot off the top of my head, but it might not be hard to add, depending on what exactly you want.03:20
RenatoSilvadownload a tree03:20
spiv(I'm not an expert in hacking on loggerhead, though, so I might be wildly underestimating the difficulty)03:20
RenatoSilvacurrently, we need to bzr branch it03:20
mwhudsonsomeone worked on that a bit i think03:21
spivWhat do you mean by "a tree"?  The obvious meaning I can think of doesn't make sense with your "including tags" request.03:21
RenatoSilvaI think bug 246764 is what I want. Unfortunately the work is abandoned :(03:21
ubottuLaunchpad bug 246764 in loggerhead "Recreate "Download a Directory" feature" [Wishlist,Triaged] https://launchpad.net/bugs/24676403:21
RenatoSilvaspiv: forget about the tags, it's a separate bug03:22
spivOk03:22
RenatoSilvaspiv: I want something like this: http://www.sheep.art.pl/devel/mandarin/archive/tip.zip03:23
spivSo basically you want a way for loggerhead to generate a "bzr export" for you.03:23
* spiv nods03:23
spivThat would be the bug/feature mwhudson just mentioned03:23
RenatoSilvaspiv: it's not a static tip.zip, it's a tag tip (or default tag meaning the last rev), and an instruction to get the branch as zip03:24
spivYes, understood.03:24
spivUntil someone implements it natively in loggerhead, the simplest workaround I can think of would be a cronjob that runs "bzr export" and puts the zip file somewhere HTTP accessible.  Not sure how you'd then make that file easily discoverable from loggerhead, I don't know much about customising it.03:25
RenatoSilvayou mean the bug /I/ mentioned?03:25
spivOh, sorry, yes.03:25
RenatoSilvaok, I'll just subscribe and `affects me too`then03:26
lifelessspiv: it was implemented in loggerhead03:57
lifelessspiv: its disabled on lp03:57
lifelessfor reasons of fear03:58
RenatoSilvaso the bug info is outdated03:58
RenatoSilvafear of badwidth overhead?03:59
lifelessoh, the per-directory export bug? Not sure if that feature got completed; I did the work in bzrlib to permit loggerhead to do it03:59
RenatoSilvais it available in bzr? bzr export does not support specific directories right?04:02
lifelessyes it does04:02
RenatoSilvacan't find in the help, let me see04:03
RenatoSilvaok, so the sub-dir thing is what you has implemented right? So it just needs to have a link in the loggerhead ui, right04:06
RenatoSilvait would not be that hard as bzr already has the feature04:07
=== doctormo_ is now known as doctormo
=== vorian is now known as v
=== v is now known as vorian
MTecknology503 Service Unavailable05:51
MTecknologyNo server is available to handle this request.05:51
MTecknologyhurray!05:51
MTecknologyIs https://login.launchpad.net/+openid down?05:52
wgrantWFM05:52
MTecknologywgrant: musta just hated me for a couple minutes05:54
rowinggolferok, so the estimated build time for a package in my ppa is now 31 hours.09:32
rowinggolfer:(09:32
wgrantIt would be nice if one of the lpia builders could be reassigned to i386 :(09:40
noodles775losa: can we do wgrant's suggestion above - given the backlog of i386 builds?10:03
mthaddonnoodles775: we'd need to confirm with the soyuz devs and/or ubuntu osa (lamont)10:03
wgrantnoodles775: It's difficult -- it would need a change in the image :(10:09
noodles775Yeah, we need to hassle IS to get back all the normal ppa builders. bigjools is trying to do so.10:10
wgrantEven just one or two extra on i386 would make things muuuch better.10:10
fwestcan i run my own launchpad server internally?10:17
maxbfwest: Annoyingly, no, not without an awful lot of effort.10:18
fwestoh shame10:18
maxbThe Launchpad licence for the *code* is opensource. The images&icons, however, are not10:18
maxbSo basically, the first thing you would have to do is replace all of the visual branding with your own unencumbered version10:19
rowinggolferwould be an opportunity to improve the css though ;)10:20
\shmoins10:20
MethsIs launchpad a tm too?10:20
=== henninge is now known as henninge-bbl
\shguys, why is Lucid Lynx not shown on the overview page of a package in ubuntu?10:21
maxbexact link please10:21
\shmaxb, https://launchpad.net/ubuntu/+source/zend-framework (see #u-m)10:22
=== micahg1 is now known as micahg
Laney\sh: scroll down10:53
\shLaney, yeah saw it...will this be fixed somehow?10:55
wgrantBug 46401410:57
ubottuLaunchpad bug 464014 in launchpad-registry "DistributionSourcePackageView.active_series sorts versions as strings" [High,Triaged] https://launchpad.net/bugs/46401410:57
wgrant(targetted to LP 3.1.11, 2009-12-05)10:57
Laneyare the i386 virtual builders backed up?10:57
Laney(delayed I mean)10:57
wgranthttps://launchpad.net/builders10:58
wgrantThey've been stolen as release mirrors.10:58
Laneybah10:58
=== henninge-bbl is now known as henninge
=== salgado-afk is now known as salgado
siretartwgrant: just curious, will your source v3 format branch go live with tomorrow's launchpad upgrade?12:09
wgrantsiretart: No. Depending on how rapidly Debian adopts the new formats, it may be cherrypicked before 3.1.11, but it may not.12:12
siretartwgrant: the new formats are being accepted since a few days for unstable. I see a lot of package with this format being uploaded the last few days12:13
siretartand I expect more and more DDs to switch12:13
wgrantsiretart: There were only ~15 yesterday, but that number is rapidly ascending. I am watching closely, and I'm sure the distro team will poke if it becomes too critical.12:14
siretartok12:14
wgrantThe LP code is done, but there are buildd changes required which I intend to discuss tomorrow morning.12:14
siretartI was considering switching myself, but I'm not even sure how merge debian changes if I did12:15
siretartok, thanks a lot for your work on this!12:15
wgrantnp12:15
siretartwgrant: other question: how difficult would it be to setup an launchpad instance that accepts and autobuilds packages packages for debian? - in essence, a private debian PPA?12:17
siretartcompared to setting up e.g. a dak/wanna-build/buildd instance12:18
MethsI've seen no feedback what-so-ever on bug 43585712:19
ubottuLaunchpad bug 435857 in launchpad "CSS bug with Firefox on Windows XP" [Undecided,New] https://launchpad.net/bugs/43585712:19
MethsAre CSS bugs low priority or are devs unable to reproduce or want more info?12:19
wgrantsiretart: While I've tried a few times, I've never succeeded in setting up dak/wanna-build/buildd. LP took me just few hours to work out and document. So it's pretty easy.12:19
wgrantsiretart: Although using an external non-Soyuzish archive like Debian is rather hackish, it works.12:21
wgranthttp://williamgrant.id.au/f/1/2009/running-soyuz.html, if you are sufficiently brave/stupid.12:25
james_wwgrant: what will happen if we try and autosync packages in the new format?12:30
wgrantjames_w: BOOM!12:30
james_woh12:31
james_wyay12:31
wgrantjames_w: In other words, the autosyncer will crash, and you'll need to blacklist the package to get it working again.12:31
james_wthat will be fun on Monday12:31
wgrantI wonder if I can get the trivial fix to make it just reject them into the reroll.12:31
wgrantbigjools: ^^ one-liner in dak_utils.py fixes autosyncer crash. Would be nice to have.12:31
bigjoolswgrant: sure, send in an MP and I'll make sure it gets in12:34
wgrantbigjools: Will do. Not sure exactly how the reroll works.12:35
bigjoolsno different from normal really, except we don't take anything down12:35
bigjools(unless necessary)12:35
wgrantbigjools: So it's a full rollout across everything?12:37
bigjoolswgrant: AFAIK it's just to stuff that needs it12:38
wgrantbigjools: Ah.12:38
bigjoolsbut the losas can tell you more12:38
wgrantI doubt there are any tests for this (it is semicoloned Python imported from dak, used only by sync-source.py). :(12:39
bigjoolsif there are tests for it I'll be surprised12:40
wgrantAlso, tabs. Ew.12:41
siretartwgrant: looks interesting. thanks for the link!12:43
wgrantsiretart: It's much easier now than when I started, since the dev keyserver is more helpful and rocketfuel-setup does a lot more of the Soyuz configuration. But lp-buildd still needs a few manual changes.12:45
james_wwgrant: thanks12:48
siretartwgrant: ok, I guess it might indeed be worth to have a closer look12:48
wgrantIs the code in lp_archive@cocoplum:~/syncs/flush-syncs available somewhere? Would be nice to just see how it will handle rejections.12:48
bigjoolsan archive admin should be able to help you12:49
wgrantjames_w: ^^?12:50
james_wit runs ~/sync-queue/process-incoming.sh12:50
james_wand dies if that fails12:51
james_wthere's also find ~lp_archive/syncs/ -name '*.gz' -o -name '*.dsc' -o -name '*.changes' > ~lp_archive/syncs/flush-syncs-list12:51
james_wI don't think that needs adjusting for any new extensions?12:51
wgrantArgh. That'll need fixing too.12:51
wgrantIt needs *.bz2.12:51
james_wand process-incoming.sh runs process-upload.py -d ubuntu -C sync12:53
james_wstop me if you have these scripts12:53
wgrantI don't.12:53
wgrantWell, I have process-upload.py12:53
james_wcool12:53
james_wif a shell script isn't -e12:53
james_wis it's exit code always 0, or the exit code of the last thing that it runs?12:53
wgrantI don't think process-upload.py will return a failure code just because it rejects an upload.12:55
james_wthe latter12:55
james_wso yeah, all this depends on how process-upload.py handles the rejections12:55
james_wand we have possibly similar issues with backports12:58
james_wI guess we can't backport newer source formats?12:58
wgrantTechnically you could take them back to Karmic, but you'd have to convince somebody to enable the new format there. I don't think dpkg in <= Jaunty will like the new formats much.12:59
wgrantI'm not sure how backport-source.py works, as it's not in the tree, but I think I saw it in some ubuntu-archive branch somewhere.13:00
james_wubuntu-archive-tools13:01
LaneyIs it possible to have a PPA build rescored? I'd appreciate gtk2hs/i386 on ~laney/ppa being bumped up some if so... trying to fix a build failure that seems to not happen locally.13:01
james_wbut I don't know if the meat is there or on cocoplum13:01
james_wLaney: it is, those with usual buildd powers can do it for PPAs as well13:01
Laneyoh sexy13:01
wgrantjames_w: flush-backports is similar to flush-syncs?13:04
james_wwgrant: pretty much identical13:06
wgrantjames_w: OK. process-upload.py returns 0 even if an upload was rejected, so it should be fine.13:07
james_wjust uses a different directory to pull the source packages from13:07
james_wthat's fine13:07
james_wI was more worried that it would stop at the first rejection13:07
wgrantOh, no, it's not that crazy.13:07
james_wace13:07
james_wthanks for checking13:07
wgrantSo, your tools should be fine once Soyuz gets v3 support, as long as bz2 is added as an extension to match.13:08
james_wI can make the same modification to flush-backports as the archive will reject any new formats?13:08
wgrantRight.13:08
james_wyeah, I just added it to flush-syncs13:08
james_wI'll add it to flush-backports13:08
james_wthanks13:08
wgrantNow I just have to work out how the heck the buildds are going to work.13:08
=== danilo_ is now known as danilos
bigjoolsLaney: give me the build URL and I'll rescore it13:12
bigjoolsjames_w: did you request some sessions for us at UDS to talk about Build From Branch?13:12
Laneythanks bigjools, it's https://launchpad.net/~laney/+archive/ppa/+build/131901213:12
james_wbigjools: haven't yet13:12
bigjoolsLaney: done13:13
Laneythanks13:13
Laneyhopefull I won't have to hassle again ;)13:13
bigjoolsgood :)13:13
Laneystupid non reproducible problems13:13
bigjoolsjames_w: ok, or I can do it, but I don't know where to go :)13:13
james_wbigjools: nope, I'll speak to robbie13:16
bigjoolscool thanks13:16
=== abentley1 is now known as abentley
=== salgado is now known as salgado-lunch
cr3hey folks, I'm trying to propose a branch for merging against karmic-proposed and I entered "ubuntu/karmic-proposed/checkbox" in the target branch, but I get the error "invalid value"15:04
=== oubiwann_ is now known as oubiwann
=== matsubara is now known as matsubara-lunch
james_wjml: does +branch work over bzr+ssh?15:59
jmljames_w, no. there's an open bug for making it do so, though16:04
jmljames_w, simple matter of programming16:04
james_wok, thanks16:04
=== danilo_ is now known as danilos
=== welten is now known as welterde
=== salgado-lunch is now known as salgado
=== EdwinGrubbs is now known as Edwin-lunch
ScottL_the iridium ppa builder seems stuck (it has been building openclipart for over 2 days) can someone look into this? https://launchpad.net/builders/iridium16:57
ScottL_colin watson is building it but cant' look at it right now and asked me to mention it here16:58
MethsScottL_: I think the builders are currently reassigned as release mirrors17:02
=== matsubara-lunch is now known as matsubara
ScottL_Meths: but it's been building for over 2 days on the same build - it looks like an error in the build log17:05
MethsScottL_: Agreed, looks broke in the logs.17:11
MethsLooks like they're back building too.17:12
gleni'm setting up translation for a project, i see some templates in import queue (https://translations.launchpad.net/eventum/+imports), what (who) should approve these? project manager? launchpad manager?17:17
glenfrom dropdown i can only choose between "deleted" and "needs review"17:17
henninge_glen: approval of translations happens automatically if the files can be associated with a template and a language17:20
ScottL_Meths: Is there someone I should mention this to directly? to try to get it fixed?17:21
glenhenninge_: how do i associate the translation with template(pot?)+language?17:21
henninge_glen: template: same directory as the template17:22
henninge_glen: language: file name is a valid language code17:22
henninge_glen: your files look good on both counts17:22
henninge_glen: so just be patient, it may take a few hours as the approval script is often very busy17:23
=== deryck is now known as deryck[lunch]
henninge_same goes for the import script ... ;)17:23
glenah. that could explain things17:23
MethsScottL_: Sorry, don't know.  You could try sending an email to the buildd admins.17:25
ScottL_Meths: ah, I did that already :(    well, I tried, it will get fixed at some point17:29
kb9vqfAny chance more i386 PPA builders could be brought online?17:33
* kb9vqf notes the queue is at 44 HOURS!17:33
kb9vqf;)17:33
ScottL_kb9vqf: one of the builders (iridium) appears to be stuck, which is backing up the queue17:37
kb9vqfOK, just wanted to let someone know17:38
ScottL_kb9vqf: that's why I'm here too ;)17:40
kb9vqf:)17:40
kb9vqfA user wanted knetstats-kde3...hopefully he'll have it before the weekend17:41
=== flacoste is now known as flacoste_lunch
jcastrohi everyone, marjo needs the right permissions to be able to approve blueprints for the uds-l sprint17:50
jcastrocurrently the qa folks are submitting blueprints but marjo can't approve them17:51
avarHi I'm consistently getting an internal error when I submit something on this page: https://bugs.launchpad.net/ubuntu/+filebug/?no-redirect17:57
avarWe’ve recorded what happened, and we’ll fix it as soon as possible. Apologies for the inconvenience.17:58
avarTrying again in a couple of minutes might work.17:58
avar(Error ID: OOPS-1404B2436)17:58
ubottuhttps://lp-oops.canonical.com/oops.py/?oopsid=1404B243617:58
XiXaQhave I understood correctly, that Ubuntu on launchpad no longer wants usability bug reports?17:59
avarit also says I'm a member of the ubuntu beta testers team and that the edge server sucks, but the "disable redirection" button doesn't seem to work17:59
* Meths is having probs reaching bazaar. too.18:00
XiXaQfor instance. It hit me that the first time a user launches Transmission without a torrent file argument (that is, launches it from the menu), it should popup a welcome dialog explaning that Firefox already is configured to use Transmission for downloading torrents. That's not a Transmission bug, I think. It's a distro bug. and it's not a "problem" to be reported, it's just a usability issue. How am I supposed to report that now?18:01
avarXiXaQ: file something at https://bugs.launchpad.net/ubuntu/+filebug/?no-redirect ?18:01
XiXaQavar, ok, I got the impression that the point was to discourage people from filing non-crash bugs?18:02
avarXiXaQ: Dunno, just try18:04
XiXaQok, thanks.18:06
jcastrocan someone help me sort out marjo's blueprint permission thing? It's blocking the QA team from adding sessions for UDS18:08
=== bernie is now known as _bernie
jcastrojml, could you point me in the right direction perhaps?18:21
rockstarjcastro, what's up?18:33
jcastrorockstar, ~marjo-mercado needs to be able to approve/decline blueprints for the uds-l sprint18:33
jcastroI don't know if he's supposed to be in a certain group or ... ?18:33
rockstarsinzui, ^^18:34
sinzuijcastro: I suspect that marjo-mercado must be a driver for something18:35
* sinzui needs to read code to know what something is18:35
jcastrosinzui, aha! maybe "UDS Organizers"18:36
* jcastro goes off to try18:36
sinzuijcastro: I think you are right18:38
=== danilos is now known as danilo-afk
=== deryck[lunch] is now known as deryck
=== dpm is now known as dpm-afk
=== flacoste_lunch is now known as flacoste
=== sale_ is now known as sale
james_wthe Debian import seems to be quite out of date20:13
james_wis it generally unreliable?20:13
james_wit doesn't seem to be as reliable as I would like20:13
bigjoolsjames_w: can you ping a losa about it20:19
james_wmbarnett: hi, would you be able to check that the Debian import is running for us?20:21
=== salgado is now known as salgado-afk
mbarnettjames_w: sure, give me a few minutes.. have to wrap up some deploy tasks then i can take a look.. (i might have to hit you up for more info at that point as well) ..20:22
james_wI'm trying to find some indication of what the "Debian import" actually is in anticipation of that ;-)20:23
bigjoolsmbarnett, james_w: it's "gina"20:24
bigjoolsruns on iron.c.c20:24
james_waha!20:24
james_wI tried to think of a package that would have been imported in the last few days, and went for a v3.0 one as that's only been in the last week20:25
james_wthat package certainly won't be up to date20:25
james_wis it possible that gina stops as soon as it hits one?20:25
james_wok, it's not as bad as I thought20:32
james_wit looks to be up to date as of about 20 hours ago, except for new source format packages20:33
james_wbigjools: is it run from cron?20:33
bigjoolsyes, twice a day IIRC20:33
bigjoolswgrant found the problem with v3 packages, I think he has a fix ready20:34
james_wcool20:34
james_wany chance we could crank that to four times a day?20:34
bigjoolsnot sure if it blocks the whole run or just that package20:34
james_wsince Debian has 4xdinstall a day now20:34
bigjoolsoh yes in that  case we should do that20:34
james_wlet me get you the times20:35
james_whttp://lists.debian.org/debian-devel/2008/12/msg00955.html20:35
bigjoolscheers20:37
james_wbigjools: would you like a bug for this or similar?20:38
wgrantjames_w: I verified last night that gina will just skip v3 packages, and I know how to fix it.20:39
wgrantHowever I can't fix it until most of the rest of LP supports v3.20:39
james_wwgrant: thanks for looking at it20:40
bigjoolsjames_w: I just need to file an RT about it, will sort it tomorrow20:40
james_wthanks20:40
james_wmbarnett: thanks, but it seems to be running fine, so we don't need the check now.20:41
mbarnettjames_w: yay!20:41
bigjoolsgina is bug-free (according to kiko) :)20:42
=== matsubara is now known as matsubara-afk
=== micahg1 is now known as micahg
=== lionel_ is now known as lionel
ftain a ppa/+packages page, when i try to unfold a release to see the details, most of the time, it jumps to a +listing-archive-extra page with no css :(21:24
=== EdwinGrubbs2 is now known as EdwinGrubbs
=== thunderstruck is now known as gnomefreak
james_wOOPS-1404D321322:21
ubottuhttps://lp-oops.canonical.com/oops.py/?oopsid=1404D321322:21
james_wam I reading it wrong, or is that reporting lots of repeated SQL statements? ^22:24
jmljames_w, you are reading it correctly22:28
james_wany idea why that might be happening?22:29
jmljames_w, badly written code22:35
jmljames_w, it's not infinite repetition22:35
jmljames_w, if you look carefully, you'll see the '%s' -- that's probably substituted with a different value each time22:35
jmljames_w, ORMs make it really, really easy to write code like 'for x in xs: x.doExpensiveQuery()'22:36
james_wI'm calling this over the API22:36
james_wis it my code that's wrong?22:36
james_wI guess not as it wouldn't be one GET then22:37
jmljames_w, right, that's my impression22:37
=== Philip6 is now known as Philip5
james_wI'm not sure what would have changed here22:38
jmljames_w, what are you GETting?22:38
wgrantWhat's the request?22:38
jmljames_w, distro_series=https%3A%2F%2Fapi.launchpad.net%2Fbeta%2Fubuntu%2Flucid&status=Published&ws.op=getPublishedSources&ws.start=1950&ws.size=7522:38
jmlon /beta/ubuntu/+archive/primary22:39
* jml looks up the implementation for getPublishedSources22:39
james_wah, request variables, neat22:39
jmljames_w, some problems we nailed years ago :)22:40
jmljames_w, this is not a post-pint function22:47
jmlat least, not for reading.22:47
james_wheh22:47
james_wwell, it's not explicitly adding that %s22:48
mwhudson42 select person.* from person where id = %s should really not take 8 seconds22:49
james_wyeah22:49
james_wand why are they repeated through the query log as well22:49
james_w?22:49
jmljames_w, the %s is something the OOPS log does22:49
jmljames_w, I think22:49
jmlor something22:50
james_wit's almost like I'm pipelining multiple queries in to one GET22:50
jmljames_w, are you looping calls to  getPublishedSources?22:50
james_wyes22:50
james_wpartitioning on distro_series so that it doesn't timeout ironically22:51
jmlintriguing22:51
james_whttp://paste.ubuntu.com/309984/22:51
mwhudsonsounds like the implementation of getPublishedSources isn't very good22:53
wgrantIt looks fine.22:54
jmljames_w, icommon.lp_call?22:54
james_wheh22:54
mwhudsonor maybe something lazr.restful is made of crack22:55
jmljames_w, what is that?22:55
james_whttp://paste.ubuntu.com/309987/22:55
jmljames_w, :(22:57
mwhudsonoh the repeated query isn't the one from getPublishedSources23:00
mwhudsoni think it's from getFilesForSources23:01
mwhudsonnope23:01
wgrantIt's not from some permission-checking stuff?23:02
mwhudsongetChangesFilesForSources23:02
mwhudsonmaybe indirectly23:02
mwhudsonok; theory: it's because changes_file_url is a @property on SourcePackagePublishingHistory23:03
mwhudsonso when lazr.restful is serializing the spph it accesses this property, which runs that query23:04
wgrantIsn't it more likely to be on the signer property?23:04
wgrantOr is the person query not the big one?23:04
mwhudsonthat's a bit just plain odd23:05
mwhudsonthere are repeated person queries, but not that many23:05
mwhudsonand they really should be fast (1-2ms each)23:05
james_wthat sounds plausible23:05
mwhudsonheh most of them are23:06
mwhudsonbut one took 7.9 seconds23:06
mwhudsonprobably some kind of locking thing in the db23:06
wgrantAh.23:06
mwhudsonjames_w: is this reproducable?23:06
jmldo you know what ws.size=75 implies?23:07
james_wpossibly23:07
james_wjust running locally23:08
mwhudsonjml: it's the batch size i think23:08
jmlbecause there are 74 reps of that query23:08
mwhudsonjml: i bet there would be 75 if it hadn't timed out23:08
jmlmwhudson, :)23:08
james_wmakes sense23:08
mwhudsonmoral of the story?  don23:09
mwhudsondon23:09
mwhudsondon't make exported attributes expensive to compute23:09
lifelesswin 3823:10
jmlmwhudson, worth writing that one down, I reckon23:11
james_wso, bug on soyuz to make that cheaper or a method?23:11
mwhudsonjml: definitely23:11
james_wand then a workaround to avoid hitting the issue?23:11
mwhudsonjml: oh, i thought you said that in #launchpad-dev :)23:12
mwhudsonjames_w: yes a bug on soyuz23:12
jmlmwhudson, heh23:12
mwhudsonjames_w: not sure what a workaround would be, you might be able to get the client to move across the collection in smaller chunks23:13
mwhudsoni.e. it seems to be fetching 75 at a time, doing 20 at a time would be correspondingly less likely to time out23:14
mwhudsonjames_w: maybe you can say23:16
* jml is off to bed23:16
mwhudsoncollection = getPublishedSources(...)23:16
mwhudsonfor i in range(0, len(collection), 10):23:17
mwhudson  for source in collection[i:i+10]:23:17
mwhudson   ....23:17
james_wif it implements len() :-)23:17
james_wbug 47487623:17
ubottuLaunchpad bug 474876 in soyuz "getPublishedSources can timeout due to getChangesFilesForSources" [Undecided,New] https://launchpad.net/bugs/47487623:17
james_wif you want to turn it in to LP speak at all23:18
james_wyeah, no len() love23:23
mwhudsonjames_w: well just do for i in xrange(0, sys.maxint, 10) and tell when you've fallen off the end somehow i guess23:24
james_wand doesn't restfulclient request a page at a time anyway?23:25
james_wit's requesting 75, but I'm using __iter__ so I only want 123:25
mwhudsonjames_w: it looks like __iter__ requests pages as an "optimization"23:26
james_wah, but slicing will cause it to request less23:26
mwhudsonjames_w: but i don't think the slice fetching does23:26
mwhudsonwell, the 75 appears to be under the server's control actually23:27
mwhudsonjames_w: yeah, i think this will work23:27
james_wslicing sets ws.size if it thinks it won't need a full page23:28
mwhudsonyeah23:28
LaneyAlright fellas, this --- https://launchpad.net/debian/+source/gnome-do-docklets/+publishinghistory --- seems not to be correct. Can someone manually kick it, and where should I file the bug (if there is one)?23:29
Laney(it's pending, and the package is in testing)23:29
james_wLaney: not sure why that's not being shown in testing23:31
james_wother packages since then have imported23:32
james_wfrom sid at least23:32
Laneyyeah23:32
Laneyrequestsync uses this data now23:32
james_wso does the bzr importer, so I also want to see it up to date23:33
Laneylet's bug it23:35
Laneydo you know which product to file against?23:35
james_wjust go with launchpad23:37
wgrantThere's more recent stuff imported from testing as well.23:51

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!