/srv/irclogs.ubuntu.com/2008/10/16/#ubuntu-mozillateam.txt

ftatb3 unpacked is ~421M00:00
fta62M packed00:01
directhexopenoffice.org_3.0.0~rc2.orig.tar.gz 325,498.7 kB00:04
directhexopenoffice.org_3.0.0~rc2-1.diff.gz 81,851.0 kB00:04
directhex82 meg diff.00:04
asacha ;)00:04
asacthough i think the diff isnt really a diff ;)00:05
asacits more like a second overlaying upstream tarball + various patch systems patched in the orig ;)00:05
asacin short ... messy thing ;)00:06
directhexyeah, they're welcome to it00:07
directhexall i know is i'm under orders not to break the teeny tiny mono build-dep it has00:07
ftaasac, if we don't do something, we'll end up with those 62M tarballs everywhere, even for lightning00:07
asacfta: see ... it can always be worse ;)00:07
asacand people really complain that our embedded tarball layout is difficult00:08
asac;)00:08
asacfta: i have a plan ;)00:09
asacfta: most likely we will loose more than we win though ;)00:10
fta?00:10
asacfta: the idea is to put complete hg snapshot into a heavily compressed hg-mozilla-sources-all_all.deb00:11
asacfta: and put a build dependency on that and then checkout the right tag or whatever for firefox/tbird/lightning, etc. :)00:11
ftaok, something like my sdk/build-system.tar.gz00:12
asacquite a scary thought though ;)00:12
asacfta: no. something like mirror/hg.mozilla.org/mozilla-central,comm-central,etc.00:12
asac:)00:12
asacor just00:13
ftai see...00:13
asacfta: no. something like mirror/hg.mozilla.org.tar.lzma00:13
asacbut i think thats not really a good idea either :(00:13
asacmost likely we just have to accept and try to work for the future00:13
ftathe idea is similar, i unpack sdk/build-system.tar.gz at build time in prism & fennec00:14
ftawell, a full mirror is ugly00:15
asacright. but this is about a hg checkout during build time ;) ... and the size is in other spheres too ;)00:15
asacfta: you cannot do not a full mirror, because the products have individual tags etc.00:15
asacbut well00:15
asacmaybe it would be doable, but sounds hard00:16
asace.g. on every upload for product that is part of the grant-super-source.deb we would have to include exactly those snapshots that are needed by all the versions in the archive ;)00:16
asacand upload that package for each and every release00:16
asaci doubt that this is a win ;)00:16
asacanother idea would be to enable hg mirrors in launchbpad and allow builds to get files from launchpad bzr trees ;)00:17
asacbut well00:17
asacgiven that this is all a problem which has to be resolved at some point i am not confident we should do anything00:17
ftathe old cvs mozclient way was better00:20
ftamaybe i should add that back to our mozclient00:21
ftapost co filter00:21
ftaas hg is too dumb to let me do it before co00:22
asachow much "unused" garbage do you expect to be in that all-central tarball?00:23
asac*sigh* .. seems i have to wait for another import run of launchpad to grab some recent bug fixes for NM00:31
asacoh no. lp is going down for maintenance :(00:48
crimsunyeah, the timing is spectacular00:48
asacsensible-maintenance00:49
asac[reed]: can you connect to WPA-EAP with wpasupplicant manually?00:57
[reed]asac: I will try later02:14
saivannasac : What is the deadline for ubufox translations?05:15
cwilluff3.1 beta:  is it still crashy?07:33
* cwillu figures on getting a more intelligent answer here then elsewhere :p07:33
jtvasac, ping09:06
ftacwillu, it's not crashing for me09:07
ftaasac, nice boost! http://www.sofaraway.org/ubuntu/tmp/karma.png09:21
asacfta: yeah ... i did a hell of bugwork the last days ;)09:42
asacjtv: ^^09:42
jtvasac: hi, Arne tells me there's a problem with ff translations?09:43
asacjtv: yes. the template was again forgotten09:43
asacjtv: e.g. we are back to 3.0~b109:43
asacbeta09:43
asace.g. to the state that was originally released to hardy09:43
asacjtv: in hardy and only firefox-3.0 that is09:43
asacjtv: we should really look into this. appears to be a general issue with security updates somehow09:43
jtvasac: probably because we don't have a date check on XPI files.09:44
asaca date check?09:44
jtvasac: so we can't see when we're getting an outdated file.09:44
asacjtv: why would you get an outdated file?09:44
asacjtv: the one we now get exported is a year old or so ;)09:45
asacthe last uploaded was like 3 weeks ago09:45
asacjtv: for me it seems that the security uploads are somehow rejected09:45
jtvasac: when Ubuntu releases a security update, it probably also feeds the upstream translation files back into Rosetta.09:45
asacbut that cant be all09:45
asacon top rossetta appears to forget about the last used too09:46
jtvasac: last-used what?09:46
asace..g before the last security upload we clearly had 3.0.1 in the export09:46
asacbut now we have 3.0 again09:46
asacjtv: we dont upload translations from the firefox package (yet)09:46
asaconly the template09:47
asacjtv: i can probably fix taht by manually uploading the new template. but i remember that i did that a few month ago too and would love to see that this is actually investigated ;)09:48
jtvasac: going much too fast here... let's make sure I understand the problem first.09:48
asacwell investigate == someone has an idea where this might come from and we know what to do to prevent that at somet point09:48
asacjtv: yeah sorry.09:48
jtvYou're saying that an outdated template made its way into the Firefox-3 translations in Intrepid?09:48
asacjtv: give me a few minutes. i need to get coffee. then i will probably talk more comprehensible things ;)09:48
jtvCoffee!09:49
jtvThat's an idea.09:49
asacjtv: no ... and outdated template that was previously imported came back09:49
asacwe imported a new template through security ... and that triggered something that made launchpad fallback to an old template09:49
asacat least for the export en-US.xpi09:49
jtvasac: "no... and"?  Or "no... an"?09:49
asacjtv: "no ... an"09:50
* asac goes in the kitchen09:50
* jtv takes care of his own coffee09:50
jtvasac: I have a standup meeting now... will talk later, when my coffee is cold or inside me10:00
asacjtv: hehe10:00
asacjtv: yeah go for it10:00
asaci just noticed that archive is still open so i would like to do a few more uploads until this becomes a real pain10:01
asacjtv: ping me when your meeting is done10:02
jtvasac: ok10:03
asacfta: where is this stat about the total packages uploaded?10:11
asacfta: could you also provide a split graph for the karma? :-P10:29
asacor doesnt lp api offer that yet?10:29
asachttps://edge.launchpad.net/~asac/+karma10:30
=== asac_ is now known as asac
jtvasac: I've had coffee.  Should I make more?11:31
asacjtv: probably :)11:33
asacwait another sec please ;)11:33
asacjtv: ok seb is gone. lets talk ;)11:33
jtvHope seb didn't hear that.  :-)11:33
asacjtv: let me give a short description of the symptoms (i think maybe thtas not understood)11:33
jtvYes please!11:33
jtvBut slowly, and please give me time to interrupt with annoying questions.11:34
asacjtv: plain and simple: the distribution export we are getting has an old en-US.xpi11:34
asacold == even older than the one that was available in the 9th sep11:34
jtv"the" distribution export being the one for Intrepid?11:34
asace.g. on 9th sep the en-US.xpi had the version "3.0.1"11:35
jtvAnd "distribution export" being the language pack?11:35
asacjtv: sorry. this is "hardy" only.11:35
jtvOh11:35
asacjtv: yeah11:35
asaccont: the current export has the version 3.011:35
asacjtv: what happened in between: a security update which uploaded a en-US.xpi with version 3.0.311:36
asacdont know if something happened on launchpad side obviously ;)11:36
jtvAnd you really see the new strings disappearing, right?  In which case it's not just the header that's wrong.11:36
jtvWell, _something_ must have happened on the Launchpad side!  Templates don't just revert themselves.11:36
asacjtv: no. i dont know about the strings. all i see is that the exported en-US.xpi is old. I cant see more because the install.rdf generated from it doesnt allow the langpacks to be used with our firefox11:36
asacjtv: well. an upload happened from security i guess11:37
asacor maybe it didnt happen11:37
asacjtv: e.g. maybe launchpad is confused because -updates has a package version for which it never received a en-US.xpi upload?11:37
asacjtv: if you think for a moment you might remember that we had this exact issue a while back. i fixed it by manually reuploading the en-US.xpi when i was in canada11:38
jtvasac: the Translations infrastructure isn't even aware of a difference between updates and main or universe or whatever.11:38
asacjtv: yes. but something must make launchpad forget about the last used en-US.xpi11:38
asacjtv: and its only firefox11:38
asacnot xulrunner11:38
asacits really strange11:38
jtvSimply uploading an outdated en-US.xpi will do exactly this.11:38
asacjtv: yes. but we dont upload an outdated en-US.xpi11:39
jtvBut it might also be possible that the metadata (install.rdf) is simply not updated.11:39
asacjtv: maybe. howver, it doesnt explain why we go backwards by each upload. falling back to some package11:39
jtvAny chance that Soyuz decided to upload an outdated en-US.xpi?11:39
asacno. we dont build such old packages anymore11:40
jtvSo the metadata does change?11:40
asacand without a build there will be no upload11:40
jtvI mean, you get a different install.rdf than what you did previously?11:40
asacjtv: what do you mean with meta data?11:40
asacjtv: well. the en-US.xpi exported suddenly is older than what was exported before ... that means that the exported install.rdf moves backwards11:41
jtvSo we know that it's not that it's not being updated.11:41
asacwhile either _nothing_ is imported or the imported install.rdf moves forward11:41
asacjtv: well. i wouldnt say so. maybe nothing gets uploaded11:41
asacjtv: but still the install.rdf moves backwards :/11:42
asacjdstrand: are you there?11:42
jtvIf nothing gets uploaded, there's pretty much no way for Rosetta to find the old install.rdf!11:42
asacjtv: well. dont you have a history or something?11:42
asacjtv: can you look on the servers and see what en-US.xpi you have physically on the filesystem/database?11:42
jtvasac: only the raw files, in the Librarian.  But the actual database doesn't keep a history of this.11:43
asacjtv: because if you say that you dont keep the old en-US.xpi, then it probably means it must be something on the soyuz/dak side11:43
asac(which i wouldnt rule out at this point)11:43
jtvCome to think of it... no, once replaced, the old en-US.xpi just disappears from the system.  No history at all.11:44
asacjtv: can we find out with which import you got the en-US.xpi that is now exported?11:44
jtvasac: I can try...11:44
asacthat would be helpful11:44
asaci would like to identify which package upload that is11:44
jtvasac: looking... this will take a few minutes.11:44
asacand what was special about that11:44
asacwhich hopefully gives us better indication whats going on11:45
jtvasac: oh, the *package* upload... that's harder.11:45
jtvasac: doable, but some serious effort.11:45
asacjtv: dont you keep logs of what gets uploaded?11:45
asacmaybe we could get something out of that ... even if the form might be not-perfect11:45
jtvasac: not in Rosetta, though Soyuz might know.11:45
jtvasac: what happens inside Soyuz is still murky to me.11:46
asaci think nobody knows11:46
jtv:-)11:46
asacespecially for security updates its all completely misunderstood11:46
asacits not even "real" soyuz that is used for that. the things get built in hardy-security - which probably doesnt upload a thing to launchpad11:46
asacthen it gets pocket-copied to hardy-updates11:47
asacwhich probably triggers something we have to identify11:47
jtvasac: things get really difficult when it comes to architectures.  If you've got one architecture that still builds an outdated version of the package, it's possible that those happen to be the XPIs you get.11:47
asacjtv: hmm. thats a good idea, but i dont think it applies here. the only architecture that is bouncing is hppa11:47
asacand it wouldnt explain why be bumped back to the same version twice now11:48
asacand exactly in sync with our security updates11:48
asacand it doesnt explain why xulrunner doesnt have this issue11:48
asac:/11:48
jtvasac: well, if that bounce is somehow making Soyuz decide to feed Rosetta the translations for an older version...11:48
jtvasac: the ordering may be arbitrary and depend on something unexpected.11:49
jtvasac: timing, for example, or even something strange involving alphabetical ordering.11:49
asacjtv: as i said. i dont think that hppa applies here. if it really bounces, then it never succeeds and no upload happens11:50
asacjtv: and i just looked. hppa doesnt bounce :/11:50
asacit fails once and never is retried11:50
jtvso... no architecture has been held back to an older version, for example?11:51
asacjtv: i would love to put this on soyuz, but i think the fact that firefox is affected and xulrunner not, indicatess that something is broken with the state on launchpad side11:51
asacsoyuz is less likely to behave different for individual packages11:51
jtvsoyuz *is* part of launchpad.11:51
asacjtv: well. rosetta i mean ;)11:52
jtvAnyway... I see 2008-09-26 as the last update date.  What happened then?11:52
asacjtv: thats the security update11:52
jtvSo looks like that did upload a template.11:52
asacjtv: did you get multiple uploads for those days?11:52
asacor just one on 26th?11:53
jtvNo way of knowing.11:53
asachmm11:53
asacjtv: which time was that?11:53
jtv13:47:56, which I _guess_ would be UTC11:54
asacjtv: but its 26th?11:54
jtvYes11:54
asacjtv: how long would the auto approval take for the template?11:54
asaceverything happened on 25th for this upload11:54
asaceven the hppa build failure11:54
asaclet me double check11:55
jtvasac: even on a bad day, hours at most.11:55
jtvasac: after that of course, it'd have to wait for import.11:55
jtvasac: and as you know the importer has been a bit busy recently...11:55
jtvasac: let me see if I can dig up some more information from my procmail logs.11:55
asacso if the upload happened close to midnight it wouldb e possible that it showed up as impported like that?11:56
jtvasac: yeah, I guess.  If there were a lot of imports waiting at that point, or it was one of those days when we had problems with the approver...11:56
jtvLet me see if I can find that out.11:56
asacok11:56
jtvasac: I see a Hardy firefox import on the 24th, and one on the 26th.11:59
jtvasac: Oddly enough, the times don't match.11:59
asacjtv: import == upload?12:00
asacmaybe the mail gets sent when its uploaded abnd the other date is when its approved?12:00
jtvasac: could be something like that.12:00
jtvasac: could be that the update date in the database is taken from the upload time.12:01
asacjtv: ok. so there were two uploads for this security update12:01
asacor was there more mail about firefox around that date?12:01
jtvasac: in which case, and assuming the template's date is UTC but the email log is in CEST, the file would have finished importing about 18 minutes after being uploaded.12:01
jtvNot more for this template in Hardy.12:02
asachow do you know that both templates are equal (e.g. 24th + 26th)?12:02
asacis a md5sum sent?12:02
asac(in the 24th mail)12:02
jtvI have no way of knowing whether they would be identical.12:02
asacok12:03
jtvThere were also two matching xulrunner uploads, btw12:03
asaclets wait for jdstrang12:03
asacmaybe he can confirm what happened at those dates12:03
asacmostlikely 24th was when the package was built in the security staging area12:03
jtv"jdstrang, where were you on the afternoon of September 26th?"12:03
asachehe ;)12:03
jtvasac: it may also be important to know that if Soyuz uploaded the same file multiple times in rapid succession (e.g. for different architectures), those would show up as a single upload to Rosetta.12:04
asacjtv: most likely uploads happen only from i386 or something12:05
asacjtv: hmm how do you know that 24th isnt for 3.0.2?12:05
asac3.0.2 and 3.0.3 have been uploaded with just a few days in between12:05
jtvasac: I don't /think/ the uploads are only i386...  There's an open issue with string differences between archs, and so far our answer is "that's your problem."12:06
jtvI don't see any way of figuring out what versions they were.  Only template name and distro version.12:06
asacjtv: ok. so you are saying that it must be a upload coming with the old en-US.xpi?12:07
asaci will try to investigate a bit more then12:07
asacand ask pitti et al12:07
jtvasac: that, to me, is definitely the most likely explanation.  Anything else, you need to assume weird things.12:07
jtvasac: and remember, if this is an issue, we wouldn't have noticed with gettext files because those are dated.12:07
asacok. maybe the pocket copy triggers a re-upload of the en-US.xpi that was built regularly in hardy12:08
asacjtv: you should really look into install.rdf and dont allow older versions :(12:08
asacplease add that to your feature list ;)12:08
asacor at least require a manual review if the version looks lower12:09
jtvasac: question is: there's no date in install.rdf12:09
asacjtv: no. but a version12:10
asacso you can see that its aold12:10
jtvasac: so we'd have to do some pretty error-prone parsing of strings like "3.0b3"12:10
asacjtv: well. there is a rule for that ;)12:10
asacwe should implement it properly12:10
asacor copy the code from firefox ;)12:10
jtvasac: there is a formalized system for comparing version numbers?12:10
asacjtv: yes12:10
jtvasac: and not just an equality comparison?12:11
asacjtv: no ... its a strict ordered set12:11
jtvasac: the other possibility would be to look at file dates, since XPI is zip12:11
asacjtv: yeah. but thats error prone too12:11
jtvasac: strict ordered?  I don't know that term... totally ordered maybe?12:11
asacyeah12:11
asacits ordered12:11
asac;)12:11
* jtv thinks back...12:12
asacjtv: http://developer.mozilla.org/en/Toolkit_version_format12:12
jtvAny two non-equal version numbers X and Y can be ordered as either X < Y or Y < X, but not both?12:12
asacthat sounds ok ;)12:13
jtvasac: but this is specific to the package, and package version (ironic circularity there).12:13
asacjtv: what do you mean?12:14
asacstrict (or irreflexive) partial order "<" is a binary relation that is irreflexive and transitive, and therefore asymmetric.12:14
jtvasac: it says "as used in Firefox 1.5 (XULRunner 1.8) and later"12:14
asachehe12:14
asacjust what i found ;)12:15
asacjtv: yes. but that is not going to change soon12:15
jtvasac: even for plugins/extensions?12:15
asacand we dont have packages with < 1.5 <1.812:15
asacjtv: yes. plugins/extensions have to follow the versioning scheme that xulrunner dictates12:15
asacso extensions that work on > 1.5 must have that versioning12:16
jtvasac: well, I suppose we can always bail out with a warning if we see something different...12:16
jtvasac: of course all our current code assumes that the comparison is based on dates.  IIRC it's neatly isolated, but I hope the change wouldn't be too traumatic...12:17
asacjtv: what do you mean "something different"? a version that doesnt match the scheme? yes. then bail out12:18
jtvasac: right12:18
asacjtv: i think we should find the reason for the multiple uploads now12:18
asacor whats going on12:18
asacjtv: the versioning thing is just something that should ladn for the complete xpi support i guess12:18
asacuntil then its not really "supported" and for broad consumption i guess12:19
asacof course if there is no way to prevent old uploads we have to think12:19
asacand bump priority12:19
asacand until that is fixed remember to upload the template for firefox manually :/12:19
jtvasac: that's another matter, yes: it takes time to get this sort of change into the codebase.12:19
jtvasac: but if it's this useful, we can do it before export capability.12:20
jtvasac: that work is too large to land as a single branch anyway.12:20
asacjtv: yes. lets define priority after evaluating the root cause here12:21
asaci have to talk to pitti now to get his story ;)12:21
jtvasac: do let me know!12:22
asacbut whenever i talk to either you or him, there appears still be a gap nobody knows whats going on12:22
asacmaybe infinity ;)12:22
asaccelso at least doesnt know how the uploads happen12:22
jtvasac: if any mortal knows about Soyuz, it has to be Celso12:23
asacjtv: yeah. but this upload thing is something hooked in from outside or something else similar scary12:25
jtvasac: the machines have taken over already, and we never noticed12:25
asaclol12:25
fta2asac, another answer to bug 27418712:34
ubottuLaunchpad bug 274187 in ubuntu "FFe - firefox 3.1 and xulrunner 1.9.1 for intrepid/universe" [Wishlist,New] https://launchpad.net/bugs/27418712:34
asacok12:39
asaci closed the bug now12:39
asacfta2: is backports something we can live with?12:41
asaci mean in general12:41
asachmm12:42
fta2asac, i don't see the difference, if we don't have time to do it ourselves, i doubt anyone else will do it on our behalf on the long term, in backports or through regular security updates. imho, the "motu cannot maintain this package due to the way it is licensed" argument is bullshit. it's just an excuse to cover that they are not willing to work12:51
asactrue12:52
asaci think we should discuss that again for the future12:52
fta2a bof at uds, maybe12:52
asacthis train has left imo. and showing that we are not punching things through helps us in future discussions i hope12:52
asacyeah12:53
asacgood idea12:53
asacwe should think whats the exact issue to discuss there though12:53
asacwe could make it "mozilla" specific12:53
asacmost likely giving a presentation on how this all works12:53
asaci think there would be a12:54
fta2root cause is easy to pinpoint.. not enough active members in your team12:54
asacbunch of interested parties in that12:54
fta2-your+our12:54
asacthats true. and thats why bridges need to be built12:54
asacthe entry barrier is quite high12:54
asacand takes a lot of efforts12:55
asacthis together with spooky tales going around in MOTU doesnt really attract anyone :)12:55
asactales like: "mozilla software is illegal to maintain"12:55
asac14:28 < pitti> asac: you could also ask jamie and kees to look at the -security upload .changes on jackass and check whether they have translations13:29
asacjdstrand: ^^13:29
asacthanks13:29
jdstrandasac: sure13:31
jdstrandhold on13:31
asacjdstrand: we are looking for 3.0.313:32
* jdstrand nods13:32
jdstrandasac: it looks like it: http://paste.ubuntu.com/58323/13:37
asacjdstrand: ok thanks13:37
asacjdstrand: do you have a bridge interface?14:06
jdstrandasac: no14:07
asachmm14:07
asac[reed]: i would like you to test something for the EAP bug ;)14:16
nxvlasac: https://code.edge.launchpad.net/~oem-solutions-group/firefox/firefox-3.0.hardy18:30
nxvlasac: already merged and uploaded18:30
sebnernxvl: ha! good to see you around :)18:30
nxvlstill need to add the branching18:30
nxvlsebner: :D18:30
sebnernxvl: how are you? everything fine?18:31
nxvlyes18:31
nxvlwith tons of work18:31
nxvlthat's why i'm here18:31
nxvl:D18:31
sebnernxvl: what a pitty. I wouldn't want to add more work :P18:33
nxvlbut when you have fun at work, you don't feel entirely the charge18:35
nxvli will take a break now, brb18:35
sebnernxvl: kk, and when you come back I'll give you a nice work  ^^18:35
nxvl:P18:38
asacnxvl: on a first glance it looks  ok. the commit message could be improved to give more infos on "what was merged", "from where", and what adaptions were needed18:39
asacnxvl: was the merge "easy"?18:39
sebnernxvl: so your break was 3 minutes?18:42
asacnxvl: hmm i think you replayed on top of the wrong revision18:43
asacso now the maxVersion sed is still not there18:43
asacnxvl: the replay was now done on top of 3.0.1+build1+nobinonly-0ubuntu0.8.04.318:44
asacbut i think the rules developed was on top of 3.0+nobinonly-0ubuntu0.8.04.118:44
asacor something18:44
asacor maybe 3.0.1+build1+nobinonly-0ubuntu0.8.04.118:45
generalsnusI need to have some custom firefox profiles for all my users. it works to edit "/usr/lib/firefox-3.0.3/defaults/profile" for new profiles...  but what can i do to exsisting profiles? is there some way of forcing new settings on those users?21:02
[reed]asac: ok, what?21:03
[reed]asac: cause 802.1x is broken for both me and a friend of mine here on campus21:03
[reed]both running Ubuntu 8.10 beta latest on our thinkpads21:03
ftasebner, i'm trying my best to stick to DarkRoom, it's difficult :P22:38
Starkshello?23:06
[reed]fta: I like the theme23:45
[reed]reminds me of Angel, specifically Wolfram & Hart23:46
[reed]that evil law firm23:46
[reed]:p23:46
fta[reed], DarkRoom ?23:59

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!