[00:28] <smoser> nacc, ugh.
[00:28] <smoser> 11/01/2016 15:18:41 - DEBUG:Setting importer/ubuntu/devel branch to 'importer/ubuntu/breezy' (6de0c9f7d926b4c1f434bf5508eaeb675c29fea8)
[00:28] <smoser> looks like something amuck
[00:29] <smoser> http://paste.ubuntu.com/23413992/
[00:34] <nacc> smoser: um, shouldn't you have reversed the list?
[00:34] <nacc> smoser: quick debug shows zesty is the last entry
[00:35] <nacc> smoser: feel free to fix and push yourself
[00:35] <smoser> apparently yes
[00:35] <smoser> i swear i looked at that
[00:35] <nacc> smoser: need to walk the dogs :)
[00:35] <smoser> :-(
[00:35] <nacc> well, you're explicitly sorting on version by number
[00:35] <nacc> so that will come through in ascending order, aiui
[00:35] <smoser> yeah.
[00:35] <nacc> and then needs to be reversed for the names
[00:35] <nacc> i would do that in the caller, though
[00:35] <smoser> can i push that ?
[00:36] <nacc> in case the API is useful on its own later
[00:36] <nacc> you should have write access to the importer tree, yeah
[00:36] <smoser> ok.
[00:36] <nacc> smoser: yeah, you're in the ownership group
[00:42] <smoser> nacc, pushed the most simple fix for now
[00:55] <nacc> smoser: thanks!
[00:56] <smoser> your idea was not bad, but required more code change than i wanted right now
[04:20] <cpaelzer> daylight savings sucks, a.k.a. too early good morning :-)
[04:20] <Unit193> +1 to the former.
[06:44] <cpaelzer> hi, does forgetting (my bad) to include the orig tgz on a merge dput qualify to use dput --force after rebuilding with -sa (no need for an ..ubuntu2 for that right)?
[06:45] <cpaelzer> last cycle my merges were all uploaded by others, since I got permissions I only had fixes so I missed to add the orig tarball to the upload
[06:46] <cpaelzer> easy to fix, but I'd at least hear one person say "yes dput force is ok in that case"
[06:52] <RAOF> cpaelzer: dput --force is, AFAIK always fine - launchpad will just reject your upload if its not.
[06:54] <cpaelzer> RAOF: I thought that it'd be ok, but on any --force I'm shy using it the first time :-)
[06:54] <cpaelzer> RAOF: thanks
[06:54] <RAOF> Yup, better to be sure!
[06:55] <RAOF> For us, --force only disables local checks. We don't have the access DDs have to the submitting filesystem, so we can't use things like dcut (and we don't have to be as careful ☺)
[06:58] <cpaelzer> I'm good with less power to screw things up atm :-)
[07:26] <LocutusOfBorg> hi pitti can you please run xapian-core libsearch-xapian-perl testsuite against -proposed pocket?
[08:08] <sil2100> pitti: hey! I'm trying to get the new dbus package pushed through -proposed since over a week, but I see that there's still a lot of tests that are 'Test in progress' since that time and not really getting executed
[08:42] <seb128> mardy, they, that signon-ui bug you just commented on, did you see that Lan_ey already added debug logs in previous comments?
[08:44] <mardy> seb128: ouch, indeed
[08:44] <mardy> seb128: and actually the problem this guy is reporting is slightly different...
[09:19] <Laney> mardy: I'm having that bug again atm as it happens
[09:19] <Laney> I've just been minimising the window though
[09:19] <Laney> if you close it it just comes back
[09:20] <mardy> Laney: seems like I forgot some check when migrating signon-ui from webkit to oxide, I'll fix that
[09:20] <Laney> phew, thanks
[10:10] <cpaelzer> rbasak: for our discussion on passing through proposed and the binary dependency becoming uninstallable
[10:11] <cpaelzer> rbasak: is the ordering of uploads strict so that I can upload the dependent one right away?
[10:11] <cpaelzer> rbasak: or do I have to wait until it shows up in update-execuses
[10:11] <cpaelzer> I want to avoid it gets rebuild too early
[10:11] <cpaelzer> and by that misses to pick up the new abi
[10:14] <rbasak> cpaelzer: you either need to wait until the binaries are published in the proposed pocket, or the build depends needs to be versioned.
[10:14] <rbasak> We don't usually used versioned depends for this kind of thing, so I guess then ordering matters.
[10:15] <cpaelzer> rbasak: yeah it is only versioned in the sense that it depend on a virtual ABI package, but that only gets there once the former is build
[10:15] <cpaelzer> s/build/built/
[10:16] <cpaelzer> rbasak: thanks - so I'm gonna wait with the follow up dput until it shows up
[10:16] <rbasak> ack
[11:09] <doko> zul: monasca-statsd has a copyright owner not mentioned: Copyright (c) 2012, Datadog <info@datadoghq.com>
[11:09] <doko> zul: you also only packaged the python2 libs, not the python3 ones ...
[11:32] <pitti> sil2100: sprint, no IRC time -- is it queued? http://autopkgtest.ubuntu.com/running is full
[11:33] <sil2100> pitti: didn't check, but even if - is it possible those are *still* queued after 11 days of waiting?
[11:34] <pitti> sil2100: oh, no; then they were probably victim of some cleanup/bug
[11:35] <pitti> sil2100: requeueing them now, but it'll take some time to catch up with the queue
[11:36] <sil2100> Thanks! :)
[11:36] <pitti> sil2100: not the "always failed" ones as they aren't blocking/relevant
[11:36]  * pitti off again
[12:13] <GunnarHj> pitti: Hi Martin! When there are .mo files for a textdomain in both /usr/share/locale and /usr/share/locale-langpack, gettext seems to use the former. Shouldn't the one in /usr/share/locale-langpack have precedence? The reason for to my question is apt, more precisely comment #7 in bug #1637801.
[12:30] <zul> doko: thats because there isnt any python3 support for it yet
[12:38] <rbasak> cyphermox: would you mind handling bug 1629644 please? It's a (rather late) claimed regression in your SRU of 0.4.9-3ubuntu7.5.
[12:56] <rbasak> powersj: FYI, bug 1635929 is a dupe - I've marked it. Downgrading from MariaDB 10.0 to MySQL anything is broken.
[12:56] <rbasak> (not supported upstream)
[13:00] <doko> Mirv: I promoted llvm-toolchain-3.9. please do the next mesa update using this version
[13:01] <rbasak> cyphermox: also I'd appreciate some help triaging bug 1636145 please.
[13:28] <doko> jbicha: are you going to look at the pcre3/pcre2 transition then?
[13:41] <jbicha> doko: I think that's beyond my abilities as I don't think Debian or the upstreams are trying to make that transition now
[13:42] <doko> urgh
[13:42] <jbicha> and the list of affected packages is extensive
[13:42] <Mirv> doko: tjaalton will be happy to do so
[13:43] <doko> ahh, again the wrong T.
[13:58] <powersj> rbasak: thank you
[14:06] <tjaalton> doko: sure thing, once mesa 13 is ready
[14:06] <tjaalton> turns out 12 wasn't too happy with 3.9
[14:06] <tjaalton> at least some games aren't
[14:16] <cyphermox> rbasak: done, thanks.
[14:17] <mardy> Laney: hi! When you have some time, can you please try https://bileto.ubuntu.com/#/ticket/2135 and see if it fixes the issue?
[14:17]  * cyphermox goes back to the salt mines (network at Plumbers has been terrible, not sure if it will be any better today)
[14:41] <rbasak> cyphermox: thank you!
[14:43] <caribou> Is there any reason why there is no warning of the fact that "atp-get upgrade" is running when the user decides to turn off the computer (using the GUI) ?
[14:45] <rbasak> slangasek: any opinion on https://bugs.launchpad.net/ubuntu/+source/squid3/+bug/1613914/comments/4 please? Amos is upstream and active in Debian packaging of squid now too. His opinion contradicts your upload in 3.5.12-1ubuntu4 I think.
[14:48] <cpaelzer> caribou: not technically I gues seeing this http://askubuntu.com/questions/771227/how-can-i-get-a-warning-before-restart-shutdown - while clearly it needs tests/polishing it seems to be able to do what you want
[14:48] <caribou> cpaelzer: ok, I'll check this one out
[14:49] <caribou> cpaelzer: this situation hosed my wife's laptop : it would not reboot and got a kernel panic on each reobot
[14:49] <caribou> s/reobot/reboot/
[14:51] <cpaelzer> caribou: there are different suggestions on http://askubuntu.com/questions/702156/prevent-ubuntu-from-shutdown-before-background-automatic-updates-complete
[14:51] <cpaelzer> caribou: an adaption of the case I linked before for apt/update-manager and such
[14:52] <cpaelzer> caribou: I sometimes wonder if it is destiny that such things always hit family members of developers of if there are more out there
[14:55] <Laney> mardy: OK, it'll have to be tomorrow though because I'm not at that computer right now
[14:58] <caribou> cpaelzer: I got the _notorious_ cellphone picture of a kernel backtrace as a bug report :)
[14:58] <rbasak> I wonder if that's a consequence of unattended-upgrades being enabled by default.
[14:58] <caribou> rbasak: not in my case, landscape was running the upgrade
[14:58] <rbasak> Prior to that, update-manager (or whatever the GUI stuff is) fired up, and at that stage it was obvious.
[14:58] <rbasak> Ah
[14:59] <caribou> rbasak: so maybe landscape triggers a different behavior
[14:59] <caribou> (I had forced a landscape upgrade to *fix* the DirtyCOW issue)
[14:59] <rbasak> caribou: I feel there should be a bug somewhere for this. This kind of race is pretty bad for users.
[14:59] <caribou> rbasak: indeed
[15:00] <caribou> rbasak: the kernel backtrace was pointing to a missing superblock so it looked more like a dead HDD than just a failed kernel upgrade
[15:08] <doko> Laney, seb128: what's the future of ubuntu-kylin-software-center?
[15:08] <Laney> Ask the Kylin team
[15:08] <seb128> what Laney said
[15:09] <doko> hmm, who is this?
[15:15] <nacc> smoser: apport went from 13404 to 14636 KB by adding pristine-tar and upstream branches
[15:15] <nacc> rbasak: --^
[15:18] <smoser> how many tarballs is that
[15:18] <nacc> smoser: 122
[15:18] <smoser> and do you have a branch that i can try ?
[15:18] <nacc> smoser: i think i sent it to you yesterday?
[15:18] <nacc> one sec
[15:19] <rbasak> nacc: I think what I dislike about that approach is that it adds state (the pristine-tar branches themselves). If we decided we wanted to change how it's done, we'd be in a pickle because a simple update to the tool might not be enough - we'd have to modify the state too. OTOH, grabbing it from Launchpad on the fly involves no additional state.
[15:19] <nacc> smoser: https://code.launchpad.net/~nacc/usd-importer/+git/usd-importer/+ref/orig_tarball
[15:19] <nacc> rbasak: absolutely, i understand, smoser just asked for the data
[15:19] <nacc> rbasak: the biggest advantage, as i see it, is that it follows debian
[15:20] <smoser> i dont follow your comment
[15:20] <smoser> "we'd have to modify the state too".
[15:20] <nacc> rbasak: and it's really not trivial to go from a an arbitrary srcpkg and (upstream) version to a tarball
[15:20] <nacc> rbasak: doable, but not trivial :)
[15:20] <smoser> if we decided the pristine tarballs are not useful, then we can delete them from the git repositories and git gc and change tools to not use them.
[15:20] <rbasak> Debian isn't married to pristine-tar though. It's just one of the dozen ways they do it.
[15:21] <smoser> (note, i'm pretty sure we can arbitrarily *add* the pristine tarballs at any point also, and not affect any thing)
[15:21] <smoser> other than size
[15:22] <nacc> smoser: sort of -- it would need a different implemetnation to go back to the beginning of time for one branch
[15:22] <nacc> smoser: but theoretically possible, yes :)
[15:22] <Laney> doko: #ubuntukylin-devel AFAIK
[15:22] <nacc> rbasak: yeah, I understand -- again, not suggesting it to merge even
[15:22] <nacc> rbasak: just that it's there, and does seem to work
[15:24] <smoser> rbasak, can you explain further what you dont like ? we'd not be "married" to it in any way either.
[15:25] <rbasak> smoser: it feels brittle to me to rely on it in the tooling. I don't particularly object to having pristine-tar branches in the imported tree however.
[15:25] <rbasak> smoser: brittle in the sense that it is imported in a particular way (the choice of pristine-tar, the format/version pristine-tar is using, the format/version of the tarballs and compression, etc) and then tooling must stick to that. OTOH, doing it afterwards from Launchpad involves none of that, and can be changed much more easily later.
[15:26] <nacc> rbasak: i'd never rely on it; if it's there, i'd use it and probably double-check the hashes match against a known good dsc
[15:26] <nacc> rbasak: and i'd fall back to a cache
[15:26] <rbasak> I accept that in practice it is said that this hasn't yet been an issue with pristine-tar in particular. However, there's still a possibility, and there is none with a state-free system.
[15:26] <nacc> or v.v.
[15:26] <smoser> theres not any real need to double check hashes
[15:27] <smoser> launchpad wont let you upload the bad one
[15:27] <nacc> smoser: there is if you can usd-build from any directory
[15:27] <nacc> smoser: remember, pathological :)
[15:27] <smoser> i dont follow
[15:27] <smoser> there is a difference from the hash being different
[15:27] <smoser> and the tarball contents being different
[15:27] <rbasak> I guess I mainly don't understand any real world practical benefit to doing it with pristine-tar over a direct method. If there is, then that's fine, and I still have no objection to the branch being there.
[15:28] <smoser> no reliance on network is the benefit
[15:28] <nacc> smoser: the uploads will get rejected, yes
[15:28] <smoser> also i guess with prisitne tar baranch we probably get upstream/ tags also
[15:29] <nacc> smoser: so in effect it's the same; but i'd like to detect badness of that type earlier
[15:29] <smoser> which is a benefit
[15:29] <nacc> smoser: yes, we do
[15:29] <smoser> as without that, you coudlnt even create the orig tarball if you wanted.
[15:29] <smoser> well, not trivially anyway.
[15:29] <nacc> smoser: without the upstream tags?
[15:29] <smoser> where as with the tag, if you didnt' care about the tar hash matching, you can 'git archive'
[15:30] <rbasak> smoser: no reliance on the network? You need to clone the git repo. Have usd-clone grab the orig as well if you like.
[15:30] <smoser> those two events are likely hours apart
[15:30] <nacc> so there needs to be network at some point
[15:30] <nacc> certainly at clone
[15:31] <nacc> i think smoser is saying there doesn't need to be at build as well
[15:31] <nacc> i still think this is not a typical use-case :)
[15:31] <rbasak> Right, but if the orig is grabbed at clone time, then it's available.
[15:31] <nacc> *what* orig, though
[15:31] <smoser> sure... and just for fun, you'll grab all orig tarballs :)
[15:31] <nacc> we don't know what is about to be built at clone time
[15:31] <rbasak> And if he wants all available orig tarballs from pristine-tar because then it's cloned, then fair enough, but no need for our tooling to do it that way by default - it's a separate use case.
[15:31] <nacc> i did ask for a bug :)
[15:35] <nacc> rbasak: there isn't a case where an orig tarball gets *added* to a package and the upstream version is the same? if we were to do that in an ubuntu package, i think the cache doesn't work -- also how does that work in practice (what tells dpkg-buildpackage there is a second orig tarball to use)?
[15:36] <rbasak> That's a good question. If it were up to me, I wouldn't permit that. But I don't know what Debian/Launchpad do.
[15:36]  * rbasak wonders if cjwatson might know ^
[15:36] <nacc> rbasak: ack, just working on usd-build and gets all these kinds of questions :)
[15:37] <nacc> cjwatson: or, generally, if you have some advice on the 'best way' to work from an arbitrary source pacakge directory to the orig tarballs needed to build that package
[15:38] <nacc> rbasak: ah, it seems it looks for .orig-component.tar.ext
[15:39] <nacc> where component is a well defined regex
[15:39] <nacc> and is used to name the subdir
[15:40] <nacc> rbasak: but given only an unpacked source pacakge, i see no way of determing that :/
[15:40] <nacc> and i've forgotten how to type, clearly too :)
[15:42] <nacc> rbasak: let's assume it's not allowed for now
[15:42] <rbasak> OK
[15:42] <nacc> as it's giving me a headache too early in the morning :)
[15:51] <ashcell> Hello everyone and appdevs, I am currently working on the Telegram app but I am having some trouble getting an executable when building the latest (https://code.launchpad.net/~libqtelegram-team/telegram-app/telegram). It builds fine on 16.04 but on 16.10 I keep getting "../telegram-app/build_desktop/lib’: No such file or directory". Has anyone else come across anything similar on any of your apps? Any help would be appreciated.
[15:54] <smoser> nacc, http://paste.ubuntu.com/23416635/
[15:54] <smoser> that is the whole list of 'server-cares' (minus ruby, which i just removed, and 'linux', which i feel like just special casing out)
[15:57] <nacc> smoser: awesome! can you file bugs for the ones that are not DownloadErrors (and maybe one bug for the DownloadErrors)?
[16:10] <bdmurray> juliank: Could you have a look at bug 1592817?
[16:10] <juliank> aargh, not one of those
[16:11] <juliank> I assume it's one of our all time favourite string formatting bugs in apt
[16:12] <juliank> bdmurray: That should be fixed in a reasonably current apt, but that user still runs an apt from early june
[16:13] <bdmurray> juliank: could you be more specific about reasonably current?
[16:13] <nacc> smoser: thanks! i'm guessing that LP: #1638614 is me assuming i can extract authorship correctly and not handling when that fails
[16:13] <nacc> smoser: LP: #1638612 is going to need a parent overrides, i think
[16:14] <nacc> smoser: as it's published incredibly poorly :)
[16:14] <nacc> smoser: that particular publish implies an epoch change, which wasn't done
[16:14] <bdmurray> juliank: I seem some with 1.2.14 which is in xenial-proposed.
[16:14] <juliank> No, there were fixes all the time. But the one that was actually released in 16.10 should probably be fine. I'll look at the code now, but there were a lot of fixes in later 1.3 releases.
[16:14] <smoser> nacc, i'm just the messenger :)
[16:14] <juliank> bdmurray: It should not happen at all in 1.2
[16:15] <nacc> smoser: ack, mostly just notes to myself
[16:15] <juliank> Unless you set the locale with C++ functions
[16:15] <smoser> yeah
[16:15] <smoser> i filed all those failures
[16:16] <bdmurray> juliank: here's an example - https://errors.ubuntu.com/oops/752e2da8-a0f3-11e6-8735-fa163e839e11
[16:18] <juliank> bdmurray: The bug in question should be a duplicate of bug 1611010 - that fixed the problem
[16:18] <juliank> Or well, the commit fixing that bug also fixed the other one
[16:20] <bdmurray> juliank: so its fixed in yakkety, but not xenial then.
[16:21] <juliank> bdmurray: I can't see the xenial instance, but I specifically did not merge any of that stuff because it only happens if your app calls std::locale::global
[16:21] <juliank> Which we switched apt to at some point in the 1.3 series from setlocale()
[16:23] <juliank> (WRT can't see: I just filed a request for access to the error tracker, but that needs manual approval)
[16:24] <bdmurray> juliank: there you've been approved
[16:24] <juliank> Thanks
[16:24] <juliank> This is kind of weird that this happens
[16:25] <bdmurray> It also happens w/ the release upgrader - bug 1633219
[16:26] <juliank> bdmurray: Ah I might have been confused a bit when doing the later 1.2 releases, I actually cherry-picked the first "prevent C++ locale formatting" commit.
[16:26] <juliank> So, I'll take a look if I can cherry-pick that into 1.2.y for xenial
[16:26] <juliank> That said, we still need to get 1.2.15 in first :/
[16:27] <bdmurray> juliank: that'd be great.  Do you mean 1.2.14 which is in -proposed or something newer?
[16:27] <juliank> bdmurray: 1.2.14 has been superseded by 1.2.15 in the queue
[16:27] <bdmurray> Oh, I can help with that too
[16:29] <jbicha> could we get a rebuild of devscripts so that zesty is default instead of yakkety?
[16:31] <juliank> bdmurray: That would be great. Once we have 1.2.15 in (which accumulates 4 months or so of bug fixes :/) we will start seeing smaller (hopefully) monthly updates.
[16:32] <juliank> 1.2.15 was far too large, but I never managed to upload the individual bug fix releases corresponding to the 1.3 preview releases (it really should have been 4 releases or something)
[16:44] <juliank> bdmurray: I think I got all the patches in https://github.com/julian-klode/apt/compare/1.2.y...julian-klode:for-1.2/locale?expand=1 - Now I'm waiting for travis to check if it actually compiles and passes tests ...
[16:45] <juliank> If it does, I'll build a 1.2.16~rc1 source package or something and put it in the apt 1.2 PPA for testing.
[16:46] <juliank> Hmm, that requires more work: It does not find std::put_time()
[16:47] <juliank> Probably missed the include from another commit :/
[16:48] <juliank> gtg now, but will be online again in approx 30 mins
[17:18] <juliank> bdmurray: Do we still want to do some upgrade tests with apt 1.2.15 on desktop, or is one month without hiccups on (small) server OK?
[17:19] <juliank> If anyone has not upgraded xenial in a while, now (= soon) is the time to install 1.2.15 from proposed and check that it works for you too :)
[17:20] <smoser> nacc,
[17:20] <smoser> 11/02/2016 17:19:31 - DEBUG:stderr: gbp:error: Upstream tag 'upstream/0.1.0_bzr54' already exists
[17:21] <nacc> smoser: using my branch?
[17:21] <smoser> sort of.
[17:21] <smoser> some local cchanges, but i dont think related
[17:21] <juliank> Otherwise, I'll give the build another week on my server and then go to verification-done (then we basically have 5 weeks of unattended upgrades not messing things up) :)
[17:22] <nacc> smoser: it should only try to tag an upstream (import it at all) if the tag doesn't already exist)
[17:22] <nacc> smoser:         if (orig_tarball and
[17:22] <nacc>             self.get_tag_reference(upstream_tag_name) is None
[17:22] <nacc>            ):
[17:22] <nacc> smoser: ah, is it possible your upstream version doesn't comply with debian?
[17:23] <nacc> smoser: is it an ubuntu only package
[17:23] <smoser> well, this was curtin
[17:23] <smoser> basically upstream snapshots
[17:23] <smoser> no actual upstream releases
[17:24] <nacc> ah ah
[17:24] <nacc> gbp turns ~ to _
[17:24] <nacc> we don't
[17:24] <nacc> for that particular check
[17:24] <nacc> smoser: change that upstream_tag_name assignment to
[17:25] <nacc> upstream_tag_name = USDGitRepository.git_dsc_commit_tag('upstream/%s' % srcpkg.version.upstream_version)
[17:26] <nacc> or so
[17:27] <nacc> smoser: fyi, usd-clone is incompatible with xgit
[17:27] <nacc> not sure why yet
[18:03] <nacc> smoser: rbasak: http://paste.ubuntu.com/23417200/
[18:04] <nacc> smoser: i don't think it makes sense to use a cache like MP: #309876 does for the importer, if the builder has a cache
[18:05] <nacc> smoser: i'm not sure what problem the importer cache solves
[18:05] <nacc> regular users will never run the importer, ideally
[18:07] <smoser> nacc, if your argument is "regular users will never use it, so remove it". then we can just delete the whole thing ?
[18:07] <nacc> smoser: delete what whole thing?
[18:07] <smoser> usd-importer.
[18:07] <smoser> as regular users wont use it.
[18:07] <nacc> smoser: i think you're being a bit ridiclous
[18:07] <nacc> there are two use cases
[18:07] <smoser> yes.
[18:07] <nacc> one is the server team maintaining git repositories
[18:07] <nacc> that's the importer's job
[18:07] <nacc> nothign else
[18:08] <nacc> the other is building pacakges using those repositories
[18:08] <smoser> when working with the importer, having the cache of downloaded things is quite useful.
[18:08] <nacc> that is *not* the importer's job
[18:08] <smoser> and your pristine-tar branch changed the behavior from caching into the output directory to downloading into a tmpdir
[18:08] <nacc> smoser: why does your commit mention git and gitwd not existing? they are still present
[18:08] <nacc> smoser: that's not merged
[18:08] <nacc> and currently won't be
[18:08] <smoser> sure.
[18:08] <smoser> thats fine.
[18:09] <smoser> its an option, just like '--lp-user'
[18:09] <nacc> it doesn't make sense to send a MR against master
[18:09] <nacc> when it doesn't apply to master
[18:09] <smoser> which , running on infrastructure would never be needed.
[18:09] <smoser> it does still apply to  master.
[18:09] <smoser> its still quite useful
[18:09] <nacc> the commit message is wrong
[18:09] <nacc> it refers to things that aren't true in master
[18:10] <smoser> it makes my re-run using your branch take substantially less time, and saves 51G of download
[18:10] <smoser> the commit message is correct...
[18:10] <smoser> what did you think was not ?
[18:10] <nacc> previously get with the pkg/git/ and pkg/gitwd/
[18:11] <nacc> that is *not* true in master
[18:11] <smoser> sure.. previously, before this commit
[18:11] <nacc> what?
[18:11] <smoser> before the --dl-cache commit, downloads went into pkg/
[18:11] <smoser> and then there was a pkg/git and pkg/gitwd
[18:11] <smoser> that is true.
[18:11] <smoser> right?
[18:12] <smoser> and the change is to instead put them to a tempdir or to the --dl-cache dir
[18:13] <nacc> ok, my reading of your commit message is that it suggest there was a change of behavior that you're fixing
[18:13] <nacc> when in fact, you're changing behavior
[18:14] <nacc> it could be *way* clearer :)
[18:14] <nacc> I still don't think a download cache matters *except* for your tests of importing the world
[18:15] <smoser> even importing a single package
[18:15] <smoser> it does. if it fails for some reason.
[18:15] <nacc> master still uses pkg/git and pkg/gitwd, so it'ss till cached in pkg
[18:15] <smoser> firefox or linux for example, are multi-multi-gig downloads
[18:16] <nacc> i think what you're actually doing is suggesting an alternative implementation to what is done in my branch?
[18:16] <smoser> if you have access to dsc files and orig tarballs, put them in a dir and point the thing at it.
[18:16] <smoser> well, due to a change in your branch, i was forced to do *something*
[18:16] <nacc> a branch that is *NOT MASTER* :)
[18:16] <smoser> but what i was doing before was linking these files into the <pkg>/ dir so they'd get used.
[18:16] <nacc> and you are asking to merge to master
[18:16] <smoser> which was much less clean than this
[18:17] <smoser> so this solves cleanly for both cases.
[18:17] <nacc> but is wholly unnecessary in master as it is right now, afaict
[18:17] <smoser> sort of. sort of not.
[18:17] <nacc> yes, that's why i think your commit message is wrong :)
[18:17] <smoser> currently, the directory cannot exist
[18:17] <nacc> you have a good point, just put it in the commit message
[18:17] <smoser> or if it does, it must have git and gitwd/
[18:20] <nacc> smoser: do you get my point, though? you have two reasons to include this into master, one of which has nothing to do with master itself, but a hypothetical change to the code
[18:21] <nacc> what's interesting is this download cache can't be used by usd-build as currently written, because usd-build's cache is organized
[18:21] <nacc> might not be a big deal
[18:22] <nacc> and, afaict, this only really impacts the importer side, when starting from an empty repository, which will be a rarity
[18:22] <nacc> relative rarity
[18:22] <nacc> and doesn't help the actual empty repository case either, right?
[18:23] <smoser> usd-build's cache is organized ?
[18:23] <smoser> what does that mean ?
[18:24] <nacc> smoser: to make it actually usable (as i need to konw the tarballs in there are good, I also need dsc files, etc.), so we have it organized as .git/build_cache/<srcpkg>/<upstream version>/
[18:24] <nacc> so I can go find the DSC file in there and see if the hashes of the tarballs match (or if they are even present)
[18:26] <smoser> nacc, http://paste.ubuntu.com/23417260/
[18:26] <smoser> oh. i see.
[18:26] <nacc> smoser: that's way better, thank you very much
[18:26] <smoser> upstream_version does not seem terribly important there i donthink.
[18:27] <smoser> i think i convinced my self that we need to not do the tmpdir. but by default make it point to the --directory
[18:27] <nacc> smoser: then you won't be able to clean it up, right?
[18:27] <smoser> who is "you" in this scenario ?
[18:28] <smoser> oh. right. yeah. would not cleanup then.
[18:28] <nacc> smoser: the importer, without a dl-cache argument
[18:28] <smoser> which is current behavior
[18:28] <nacc> smoser: which is the default and expected use case
[18:28] <nacc> right, but i'd like to be able to clean it up, if possible
[18:28] <nacc> i think switching to directory would make it impossible?
[18:29] <smoser> tmpdir=$(mktemp -d); usd-import --dl-cache=tmpdir
[18:29] <smoser> ro
[18:29] <smoser> TMPDIR=pkg.d/dldir usd-import --directory=pkg.d pkg
[18:29] <nacc> smoser: if i don't use upstream_version there, then i have to store the .dsc file in upstream_version.dsc (or do filename munging) -- doesn't seem better
[18:31] <nacc> smoser: 'have to' becuase i need to cache the canonical sums for the tarballs somehow
[18:32] <nacc> smoser: i'm not sure i fully understand (given just master), anymore, the usecase for an importer cache. That is, right now, let's say you run the importer on a directroy and pass --no-clean. Then you run it again on the same directory later, it will just pickup where it stopped. So your case is switching directories but minimizing the files to use?
[18:32] <nacc> *to download
[18:34] <smoser> well, that is a use case.
[18:34] <smoser> but as it is right now, if you pass --no-clean
[18:34] <smoser> and you then change the importer and want to use again to do a from scratch
[18:34] <smoser> you: rm -Rf <directory>/git*
[18:34] <smoser> and it says "that dir isnt empty"
[18:35] <nacc> rm says that?
[18:35] <nacc> oh you mean if you try to reuse directory iwth the importer
[18:35] <nacc> because the files are there?
[18:35] <nacc> yes, i assume that any sane person doing from scratch imports will
[18:36] <nacc> rm -rf <directory>; mdkir <directory>
[18:36] <nacc> *mkdir
[18:36] <nacc> or will use a reasonable directory (previously imported)
[18:36] <nacc> that's why we have the sanity check
[18:36] <nacc> again, this feels like an optimization for 'from scratch' imports
[18:36] <nacc> which i know are annoying because you're doing so many
[18:36] <nacc> but not really a general use
[18:37] <nacc> i mean, obviously, *the* general use -- but not for everyone
[18:39] <nacc> rbasak: one flaw (security?) with the cached DSC model -- what if a pathological user chagnes that file. They will have write access to it. Upload will get rejected (afaict), but it will still succesfully build. I think that's why I was suggesting we always at least pull down the dsc from LP to verify the tarballs against?
[18:40] <nacc> at which point we could drop <srcpkg>/<upstream version> altogether, I think
[18:41] <nacc> smoser: and then, if we used that for the cache by default, you'd get your sharing in the importer too; you'd just have to save off the cache before deleting .git
[18:42] <smoser> nacc, i pushed up a different version.
[18:43] <smoser> which i think is generally better, and as is right now cleaner. but i thin it will still complain on --directory= re-use.
[18:43] <nacc> smoser: same MP?
[18:43] <smoser> yeah
[18:43] <nacc> hrm, says updated 1 hour ago
[18:44] <nacc> https://code.launchpad.net/~smoser/usd-importer/+git/usd-importer/+ref/download-cache ?
[18:44] <smoser> yeah
[18:44] <smoser> taht 1 hour ago is just wrong
[18:44] <smoser> its reading the commit time
[18:44] <smoser> and commit --amend doesnt update that
[18:45] <nacc> hrm, i don't see any changes from the last MP?
[18:45] <smoser> its definitely different read the commit message
[18:45] <nacc> oh i see it now, sorry
[18:46] <nacc> smoser: do you have any problem with me switching that to .git/cache or something?
[18:46] <nacc> smoser: *if* we drop git/ gitwd/
[18:46] <smoser> i dont have a problem with that no.
[18:47] <nacc> ok, i think your MP is good, I'll rebase my changes on top
[18:47] <smoser> nacc, using your branch and that change, i'm currently at
[18:47] <smoser> $ ../summarize
[18:47] <smoser> 47 total. 16 working. 31 pass. 0 fail.
[18:48] <nacc> smoser: the import-orig branch?
[18:48] <nacc> smoser: import-orig shouldn't have any functional change to the importer, really
[18:48] <smoser> well, ih ave cherry picked your one commit and then the fix for the tag thing
[18:48] <smoser> nacc, yeah, except a.) it creates new branches b.) it had a bug that we hit
[18:48] <smoser> but other than that, yeah, no changes ;)
[18:49] <nacc> smoser: i mean to the algorithm
[18:49] <nacc> so if something imported before it should import now
[18:49] <nacc> and if something didn't import before it should not import now
[18:49] <nacc> the importer algorithm doesn't use the pristine-tar branch for anything
[18:49] <smoser> outside of having bugs in your newly added logic, yes.
[18:49] <smoser> or bugs in interaction with pristine-tar
[18:49] <nacc> so this is just a sanity check run?
[18:49] <smoser> yeah.
[18:49] <nacc> ok :)
[18:50] <nacc> i need you and rbasak to continue to come to some consensus on whether it's necessary or not :)
[18:50] <smoser> oh, yeah, and the other thing... i would like to get a large set of numbers too
[18:50] <nacc> right, i only ran it on one package
[18:50] <smoser> we'll have data we can easily see how much size it adds
[18:50] <nacc> yep
[18:50] <smoser> can you write down how to remove the upstream/tarball stuff ?
[18:50] <smoser> and git-gc
[18:50] <smoser> so easy compare
[18:50] <smoser> like:
[18:50] <smoser>  git clone <original> new
[18:50] <smoser>  cd new
[18:51] <smoser>  git branch -D upstream
[18:51] <smoser>  git branch -D pristine-tarball
[18:51] <smoser>  git gc
[18:51] <smoser> i think its something like that
[18:52] <nacc> to make sure i didn't break anything, i did a master import and an branch import, so i could also check the objects
[18:52] <nacc> that *should* work
[18:53] <nacc> smoser: there is a way with to find object sizes with git-cat-file
[18:53] <nacc> smoser: not sure if that would do what you want
[18:54] <nacc> smoser: i'm going to grab lunch, i'll merge your changes and stage up the build changes after, and then look at fixing the bugs
[18:55] <smoser> so git clone <somedir>
[18:55] <smoser> cd newdir
[18:55] <smoser> git branch shows nothing
[18:55] <smoser> git branch -r shows stuff
[18:56] <smoser> but how do i tell my local repo i dont care about origin/pristine-tar
[18:56] <smoser> which is not a local branch
[18:57] <nacc> smoser: i think you need maybe --disassociate and then you can delete the branche in the new
[18:57] <nacc> smoser: rather than doing what you're doing, you could just create a new directory
[18:57] <nacc> cp git over
[18:57] <nacc> and do stuff in the new directory
[18:58] <nacc> the git repository is fully encapsulated in that dir
[18:58] <smoser> sure. which is basically what git clone does :)
[18:58] <nacc> yeah, but it uses tracking branches
[18:58] <nacc> smoser: ah you wanted to use --mirror, i think
[19:01] <slangasek> rbasak: I don't agree that we shouldn't migrate the directory; but maybe we should do that migration in postinst instead of preinst, and skip that migration if there's a non-default cache_dir setting?
[20:28] <rbasak> slangasek: thanks. I've stuck it in our backlog to look into it.
[20:29] <rbasak> nacc: wouldn't such a user just be shooting himself in the foot in that case? I think that's acceptable.
[20:44] <nacc> rbasak: yes, they would -- we do safety checks everywhere else and we rely on trusting only launchpad
[20:44] <nacc> rbasak: in that case, we're trusting a local file
[20:44] <nacc> rbasak: when we do have lp available
[20:46] <nacc> rbasak: but i understand your point, was just a thought
[20:50] <nacc> smoser: so the way i do from-scratch imports, if you need them, is '-o junk'
[20:51] <nacc> smoser: not sure why that's not trivial?
[21:19] <nacc> smoser: um, did you mean to pass workdir to func() in USDSourceInformation?
[21:19] <nacc> smoser: so ... you tested this how?
[21:42] <nacc> smoser: pushed up the usd-build changes, you'll need to rebase that MR and i'm not sure it's really necessary
[21:52] <rbasak> nacc, smoser: we could do a hangout on this tomorrow if you like?
[21:52] <nacc> rbasak: ack, would be good
[21:53] <nacc> rbasak: if you have time pull master and check out usd-build
[21:53] <nacc> or the paste i pointed to earlier
[21:54] <rbasak> OK, I'll take a look in the morning
[21:54] <nacc> rbasak: ack
[21:54] <nacc> thanks!
[21:58] <hammed> can soneone give me format to get itune card , gift and circle from maga
[21:59] <nacc> hammed: ECHAN?
 ./start 201
 # DUHul
 ./start: line 11: ./ss: cannot execute binary file: Exec format error
 cat: bios.txt: No such file or directory
 # found 0
 ----------------------------------------
[22:01] <hammed> tell me what to do to make this work
[22:01] <nacc> hammed: this is the channel for ubuntu development, I think you're in the wrong place
[22:01] <nacc> hammed: maybe you want #ubuntu, but even there seems offtopic
[22:01] <hammed> k
[22:03] <sarnold> "exec format error" sounds like a mismatched architecture; like you've got an x86 binary but are running on arm or something
[23:21] <nacc> smoser: fyi, there is an active ubuntu branch for libvirt (it's now listed in Vcs-Git, iirc) for ubuntu; i do not believe we should import it
[23:26] <nacc> smoser: pcre3's failure is different than iscsitarget's
[23:26] <nacc> 'import/8.30..-2'
[23:29] <nacc> man git-check-ref-name: 3. They cannot have two consecutive dots ..  anywhere.
[23:33] <nacc> slangasek: is there an appropriate ML to ask for debian developer's opinion on an addition to dep14 for '..' ?
[23:34] <nacc> *developers'
[23:52] <nacc> lol, so is for real (i have been looking at a lot of changelogs today). dpkg-parsechangelog thinks May is an invalid month?
[23:52] <nacc>             if (exists $month_name{$8})
[23:52] <nacc> push @errors, sprintf(g_('uses full instead of abbreviated month name \'%s\''),