[00:21] worker/instancepoller/aggregate.go:67:22: error: reference to undefined identifier ‘ratelimit.New’ bucket := ratelimit.New(gatherTime, 1) [00:21] i have the latest github.com/juju/ratelimit [00:25] same test failure on my part again [00:26] http://paste.ubuntu.com/7117154/ [00:26] hrm [00:26] broken pipe [00:33] davecheney: godeps -u dependencies.tsv === thumper-afk is now known as thumper [00:46] wallyworld_: the reason we don't use version.readSeries is because it conflates the host with what we are going to start using tools [00:46] ok [00:46] is there no way to avoid "some-series" [00:46] sure, can use "precise" [00:46] however [00:47] in order for that method to work correctly, they need to pass in series [00:47] so it should use that when it happens [00:47] that function is unused as yet [00:47] ok [00:47] just make sure you tell them..... [00:47] ack [00:55] davecheney: ping [00:55] davecheney: I'm getting the same failure for juju-mongodb that I was getting for mongodb-server on power [00:55] it seems to think there is no journal present [00:56] is mongod changing the user from root? [00:58] davecheney: you had the local provider working, did you do anything special for mongod? [01:00] davecheney: I want to check in prior to filing a bug [01:00] o/ axw [01:00] hey thumper [01:03] thumper: all I did was the symlink [01:03] to be fair [01:03] tests don't pass on ppc64el [01:03] davecheney: I get it failing to even start [01:03] davecheney: complaining about no journal [01:04] * thumper does an update [01:04] lets see if that changes anything [01:05] nope [01:07] whaaaaaaaaaaaa ? [01:07] when you deploy the local machine [01:07] sorry, bootstrap local env [01:07] umm... not long ago [01:07] worker/instancepoller/aggregate.go:67:22: error: reference to undefined identifier ‘ratelimit.New’ bucket := ratelimit.New(gatherTime, 1) [01:07] I grabbed my branch [01:07] ^ any idea how to fix this one [01:07] rebuilt [01:07] then I can try to have a look [01:08] run godeps? [01:08] ubuntu@winton-02:~/src/launchpad.net/juju-core$ go get -u -v github.com/juju/ratelimit [01:08] github.com/juju/ratelimit (download) [01:08] github.com/juju/ratelimit [01:08] what ? [01:08] \ [01:08] head isn't buildable / [01:08] where is the source for godeps ? [01:08] launchpad.net/godeps [01:08] sorry [01:08] dumb question [01:09] ubuntu@winton-02:~/src/launchpad.net/juju-core$ godeps -u github.com/juju/ratelimit [01:09] godeps: cannot parse "github.com/juju/ratelimit": open github.com/juju/ratelimit: no such file or directory [01:09] oh for fuxcks sake [01:10] why the fuck doesn't it default to something sane [01:14] ubuntu@winton-02:~/src/launchpad.net/juju-core$ pstree -p | grep -C2 mongo | |-{jujud}(31735) | `-{jujud}(31742) |-mongod(31700)-+-{mongod}(31705) | |-{mongod}(31706) | |-{mongod}(31707) | |-{mongod}(31708) [01:14] urgh [01:14] thumper: bzr up'd [01:14] and apt-get updated [01:14] still works for me [01:14] thumper: have you removed the mongodb-server package ? [01:14] davecheney: no [01:15] that'll be the problem [01:15] why? [01:15] first in the path maybe ? [01:15] nah, full path specified [01:15] yes, but /usr/bin/mongod => mongodb-server <-- borken! [01:18] thumper: hang on, let me test that scenario [01:19] davecheney: my upstart script specifies /usr/lib/juju/bin/mongod [01:19] thumper: i'm still trying to reproduce the failure [01:20] * thumper is reading mongo source files ... [01:20] that'll only make it worse [01:22] davecheney, my eyes are bleeding already [01:22] davecheney, the assert seems to be from here.. https://github.com/mongodb/mongo/blob/v2.6/src/mongo/util/logfile.cpp#L241 [01:23] thumper: i've just bootstrapped [01:23] root 32316 2.1 0.5 445460 43088 ? Ssl 01:19 0:00 /usr/bin/mongod --auth --dbpath=/home/ubuntu/.juju/local/db --sslOnNormalPorts --sslPEMKeyFile /home/ubuntu/.juju/local/server.pem --sslPEMKeyPassword xxxxxxx --bind_ip 0.0.0.0 --port 37017 --noprealloc --syslog --smallfiles [01:23] worked fine [01:23] hmm [01:23] davecheney, are you on the same emulation thingy thumper is on? [01:23] davecheney: so what is different for you and me? [01:23] this seems to be an os alignment bug [01:24] I could really use a second pair of brain cells on this [01:24] ii juju-mongodb 2.4.9-0ubuntu2 ppc64el MongoDB object/document-oriented database for Juju [01:24] ii mongodb-server 1:2.4.9-1ubuntu1 ppc64el object/document-oriented database (server package) [01:24] hazmat: davecheney is on a different machine [01:24] bodie_: sure, mine are lonley [01:24] it's in TestWriteFailure in environs/sshstorage [01:24] http://paste.ubuntu.com/7117154/ [01:25] no idea what's supposed to happen, or what's going wrong, except the broken pipe bit [01:25] davecheney: can I get you to try my branch? [01:25] replicable [01:25] it's on a remote [01:25] thumper: sure [01:25] lp:~thumper/juju-core/juju-mongodb [01:25] bodie_: you might ahve to turn up the debug on the remove sshd [01:25] bodie_: my guess is /bin/ssh is [01:25] davecheney: build it, and make sure that juju-mongodb is installed [01:25] a. crashing [01:25] b. being hung up on [01:25] bootstrap a simple local provider [01:26] davecheney: and it should start with no tweaking at all [01:26] OT: hazmat where can I get a trusty install image that is < 2.5 Gb [01:26] davecheney: in theory [01:26] could it be caused by disabling root login? [01:26] bodie_: absolutely [01:27] hm [01:27] check /var/log/secure.log [01:27] or audit.log [01:27] or wherever the AUTH syslog target points too [01:28] bodie_: the bug is that that test is discarding the output of stderr [01:28] davecheney, hmm.. i just use cloud-images most of the time.. their minimal and small.. but you mean like a boot installer.. if you need super small and have the bandwidth.. there's always net install [01:29] hazmat: i just want to download it and try it [01:29] do I really need a 2.5 Gb iso ? [01:29] hrm ? ... I'm redirecting stderr into the test output.. so you're saying it didn't go in because it was being discarded in the first place? [01:29] davecheney, http://cdimage.ubuntu.com/daily-live/current/ look like 950mb [01:29] hazmat: ta, that'll do nicely [01:29] davecheney, kvm with cloud image.. gets you down to even smaller [01:30] bodie_: by default stderr and stdout go to dev null unless otherwise requested [01:30] davecheney, 240mb http://cloud-images.ubuntu.com/trusty/current/ [01:30] hazmat: ta muchly [01:30] davecheney, bottom of that page for the raw downloads [01:30] much better solution [01:30] I called it like so: go test ./... > output.txt 2>&1 & [01:30] davecheney, also.. virtualbox images here.. http://cloud-images.ubuntu.com/vagrant/trusty/current/ [01:31] bodie_: this isn't something you've done [01:31] ok [01:31] this is a bug inside the test code [01:31] hazmat: a bounty of resources [01:31] hazmat: that error [01:31] da fuq [01:31] thumper: pingy [01:32] that isn't a journal problem [01:32] this is somethig to do with the 64mb pages option [01:32] coming [01:32] thumper: this may be the problem [01:32] Linux winton-02 3.13.0-8-generic #28-Ubuntu SMP Mon Feb 17 08:22:39 UTC 2014 ppc64le ppc64le ppc64le GNU/Linux [01:32] thumper: what you got ? [01:32] i reckon you've got a different kernel [01:32] uname -a? [01:32] thumper: yup [01:33] Linux rockne-02 3.13.0-15-generic #35-Ubuntu SMP Mon Mar 3 15:56:08 UTC 2014 ppc64le ppc64le ppc64le GNU/Linux [01:33] hmm [01:33] ok, that is another angle to try [01:39] thumper: hangouts is not loading for me :( [01:41] wallyworld_: you lot still in hangout? I can't even load https://plus.google.com/ [01:41] waigani_: yeah, we're here [01:41] wtf? [01:41] :( [01:41] talk about you :-P [01:41] waigani_: thumper is using the internet [01:41] you'll have to wait your turn [01:42] lol [01:42] lol - bastards [01:49] davecheney: can you run 'getconf PAGESIZE' [01:50] davecheney: I get 65536 [01:50] ubuntu@winton-02:~$ getconf PAGESIZE [01:50] 4096 [01:50] bingo [01:50] i get 4096 also [01:50] arse [01:50] thumper: https://docs.google.com/a/canonical.com/spreadsheet/ccc?key=0Aje1qBKEwuLVdDIxdG9NeWF2REJjemdLbllzbGotamc&usp=drive_web#gid=0 [01:50] thumper: patch getconf :-) [01:50] line 10 [01:50] wallyworld_: on rockne? [01:51] yeah [01:51] thumper: wallyworld_ the 4k/64k thing is provided by the kvm emulation [01:51] it's totally possible that different vm's get different views of the underlying hardware [01:51] but why does a log funtion vare? [01:51] care [01:52] we could just patch it to see if it works as an experiment [01:52] wallyworld_: simpler/safer just to apt-get update a new kernel image [01:53] davecheney: what does your uname -r say? [01:53] 3.13.0-8-generic [01:53] i'm a week or two behind [01:53] i wonder that thumper's is? [01:53] what [01:54] wallyworld_: check scrollback [01:54] ah. -15 [01:55] wallyworld_: i thnk that assert is checking that the log file is aligned to the os page size [01:55] probably because they use mmap a lot [01:55] ^ just a guess [01:55] but probably not totally wrong [01:55] makes sense i guess [01:55] mongo does a lot of dumb shit for performance without proof that the simple way was a problem to begin with [01:55] seems like they could do better though [01:56] s/mongo does a lot of dumb shit for performance without proof that the simple way was a problem to begin with/mongo does a lot of dumb shit [01:56] fassert( 16142, _fd >= 0 ); [01:56] what the bollocks is this ? [01:56] every assert has a unique number [01:57] but this isn't a constant ? [01:57] davecheney: it'll be a number they can grep the source for :-) [01:57] fassert(42, 'the meaning of life') [01:57] * thumper takes a stab in the dark [01:57] thumper: i hope youre joking [01:58] it's mongo, of course not [01:58] * thumper guesses not [01:58] fassert( 2 , 2 != 2 ) // totally unique, bro [01:58] chrome does not load plus.google.com anymore, yet firefox does ?!? You'd think, if anything, it would be the other way around [02:04] davecheney: can you try my branch? [02:04] I was told that there was a second VM for me, but it looks like not... [02:05] permissing denied (public key) [02:27] wallyworld_: added cloudinit test for trusty state server [02:27] thanks :-) [02:27] np [03:04] wallyworld_: bug: 2014-03-19 03:04:00 DEBUG juju.environs.simplestreams simplestreams.go:995 metadata: &{map[com.ubuntu.juju:14.04:ppc64:{ 1.17.6.1 ppc64 map[20140319:0xc21042bde0]} com.ubuntu.juju:12.04:ppc64:{ 1.17.6.1 ppc64 map[20140319:0xc21042b720]}] map[] Wed, 19 Mar 2014 03:03:55 +0000 products:1.0 com.ubuntu.juju:released:tools} [03:04] thumper: root 11980 0.7 0.4 1076640 37628 ? Ssl 03:04 0:00 /usr/lib/juju/bin/mongod --auth --dbpath=/home/ubuntu/.juju/local/db --sslOnNormalPorts --sslPEMKeyFile /home/ubuntu/.juju/local/server.pem --sslPEMKeyPassword xxxxxxx --bind_ip 0.0.0.0 --port 37017 --noprealloc --syslog --smallfiles [03:04] branch looks fine, LGTM [03:04] urgh, bugs in the server package [03:05] Removing mongodb-server (1:2.4.9-1ubuntu1) ... [03:05] arg: remove [03:05] mongodb stop/waiting [03:05] davecheney: me not understand? [03:05] the middle line [03:05] some output that shouldn't leak to the user [03:05] that's debug [03:05] * thumper goes to drink coffee [03:05] davecheney: thanks for testing [03:06] thumper: looking good [03:06] sorry your vm has brain issues [03:06] ttps://bugs.launchpad.net/ubuntu/+source/mongodb/+bug/1294455 [03:07] <_mup_> Bug #1294455: mongodb-server leaks debug information during remove [03:07] not important [03:07] so I tried upping the log level on sshd to see about that broken pipe, and it caused a bunch of other test failures for some reason. [03:08] I guess my next step is to try a 12.04 vm, and if that doesn't work, i don't know [03:08] bodie_: you said you disabled root login [03:08] that is probably the root cause [03:08] yeah, still breaks with root login enabled [03:08] ok [03:08] bodie_: are you canonical [03:08] ? [03:08] contracting w/ canonical, so, sorta [03:08] hai o/ [03:08] right, you have my sympathies [03:09] davecheney: as soon as outgoing ssh and access to port 10170 is sorted out, you can pull trunk and should be able to bootstrap ec2, hp cloud etc environments [03:09] i have no idea how you have managed to get yourself into this knot [03:09] i suspect it's a reality tv show [03:09] i recommend a 12.04 vm [03:09] that is what the landing bot users [03:09] wallyworld_: OH CRAP, i forgot about the api port [03:09] this is a nightmare [03:09] davecheney: i asked for the api port in the rt [03:09] hey man, I'm getting paid to write Go and work from home. I'LL. TAKE. IT. [03:09] wallyworld_: could I try it now [03:10] I just really want to get rolling. the testing stuff is driving me #go-nuts. [03:10] davecheney: you could, but it won't bootstrap cause it will get stuck on ssh [03:10] unless your vm is special [03:10] wallyworld_: could I bootstrap from my amd64 machine to a precise/386 image, or from an armhf machine to an amd64 precise image [03:10] that is effectively the same thing [03:10] yes [03:10] yes you could [03:10] good, i'll test that while I wait [03:10] so long as the tools are there [03:11] or, so long as they are packaged and available locally [03:11] wallyworld_: i'll choose a version that I know tools exists for [03:11] bodie_: same, https://twitter.com/davecheney/status/446075333360361472 [03:11] davecheney: if you have the tarballs, you can use the --metadata-source bootstrap are and they will be uploaded [03:11] arg [03:12] just fyi [03:12] wallyworld_: whoa there big fella, i'm not that keen [03:12] davecheney: I came to the realisation the other day that I basically never wear shoes anymore [03:12] my feet never felt so free [03:27] thumper: https://codereview.appspot.com/77340046 when you're not too busy [03:28] I'd kinda like to get it in for 1.17.x so we don't have backwards compat nightmares [03:28] * axw goes to pick up his daughter [03:31] kk [03:31] * thumper will look now [03:44] wallyworld_: I don't thnk we should/need to ask for a firewall hole for 17017 [03:44] that must be proxyable [03:44] and we should prxy it [03:44] it's http after all [03:45] hmm, yeah [03:45] so the proxy will have to allow [03:46] CONNECT machine-0:17017 HTTP/1.1 [03:46] 17070 i think you mean [03:47] i'll update the rt [03:47] yes [03:47] i don't know what i'm talking abouit [03:47] jsut kind of wildly stabbing at the keys [03:49] davecheney: so, with my branch and your VM, did the local provider start and work with no tweaks? [03:50] yes [03:50] \o/ === vladk|offline is now known as vladk [03:50] davecheney: I've made your tweak suggestion [03:50] hang on, lemmie get some proof [03:50] davecheney: I was kinda relying on us refactoring that code in the next six months due to other OS support [03:50] but was a good call [03:50] so I changed it [03:50] o/ vladk [03:51] thumper: hi [03:51] O_o! http://paste.ubuntu.com/7117795/ [03:51] thumper: http://paste.ubuntu.com/7117798/ [03:51] winning! [03:52] yeah baby, yeah! [03:52] davecheney: make sure you write that one up for the end of day email! [03:52] wallyworld_: so for power -> ec2 we are just waiting firewall poking? [03:53] thumper: believe so. of course my code will first first time, guarantee it [03:53] coolio [03:54] thumper: before we ship 1.18, i want to get my current branch in if possible, which is proper detection of supported arches on each provider, based on what images are available via simplestreams [03:54] wallyworld_: line it up [03:55] thumper: still wip [03:56] wallyworld_: root 11980 0.1 0.4 1076640 41212 ? Ssl 03:04 0:05 /usr/lib/juju/bin/mongod --auth --dbpath=/home/ubuntu/.juju/local/db --sslOnNormalPorts --sslPEMKeyFile /home/ubuntu/.juju/local/server.pem --sslPEMKeyPassword xxxxxxx --bind_ip 0.0.0.0 --port 37017 --noprealloc --syslog --smallfiles [03:56] out of the box [03:56] noice [03:57] davecheney: you mean the password being logged? [03:58] wallyworld_: eh ? [03:58] davecheney: sorry, i didn;t grok your paste [03:58] mongo obscures the passwd on the cmdline itself [03:58] i didn't do that [04:00] marcoceppi: what would it take to promulgate a trusty/mysql charm ? [04:05] thumper: does debug-log work for the local provider ? [04:06] davecheney: not until it is handled over the api [04:06] ubuntu@winton-02:~/src/launchpad.net/juju-core$ juju debug-log [04:06] Warning: Permanently added 'localhost' (ECDSA) to the list of known hosts. [04:06] Permission denied (publickey). [04:06] ERROR rc: 255 [04:06] ok [04:06] davecheney: there is an all-machines.log [04:06] yeah, i just forgot [04:06] np [04:06] ubuntu@winton-02:~/src/launchpad.net/juju-core$ tail -f ~/.ju-bash: cannot create temp file for here-document: No space left on device [04:06] ^C [04:06] uh oh [04:06] somethign has gone batshit [04:07] thumper: thanks, yeah I tested with local and canonistack - just about to test with azure [04:08] ok cock [04:08] root@winton-02:~# du -sh /var/lib/mongodb/* [04:08] 3.1G /var/lib/mongodb/journal [04:08] 64M /var/lib/mongodb/local.0 [04:08] 17M /var/lib/mongodb/local.ns [04:08] 0 /var/lib/mongodb/mongod.lock [04:08] 4.0K /var/lib/mongodb/_tmp [04:08] mongo has gone batshit [04:08] oh hang on [04:08] this is the system mongo db [04:08] not outs [04:08] ours [04:08] ok [04:08] i'll just delete that [04:08] haha [04:09] it probably is still batshit insane [04:09] lemmie raise a bug for that [04:09] * thumper tries to land that branch again [04:11] If you're happy and you know it, land your branch ♬ [04:14] root@winton-02:~# du -sh /var/lib/mongodb [04:14] 8.0K /var/lib/mongodb [04:14] great, now I can't trigger the problem [04:14] asshole [04:29] davecheney: branch landed === vladk is now known as vladk|offline [07:38] morning all [07:39] mgz, jam, relatively quick review ? https://codereview.appspot.com/77340044/ [08:05] mornin' all [08:05] dimitern: 1000 line diff is "relatively quick"? :-) [08:13] morning [08:14] relative to a 2000 line diff it is ;) [08:16] :) [08:17] rogpeppe, most of that are tests [08:18] dimitern: so we're not supposed to read tests as closely then? :-) [08:18] :D [08:18] axw: hiya [08:18] i'll remember that one [08:18] dimitern: i confess that i probably *don't* read tests as closely as production code. [08:19] rogpeppe, well then ;) give it a try ? https://codereview.appspot.com/77340044/ [08:20] dimitern: currently reviewing https://codereview.appspot.com/77500045 [08:20] rogpeppe, sure, np [08:21] fwereade, so it turned out there *will be* a sprint in Malta after all.. just not for us ;) [08:21] last week of may for the apps & client guys [08:22] I'd rather go to Malta than Las Vegas... hmm that is quite the first world problem [08:22] dimitern, ha, yeah [08:22] lol [08:22] ya'all are writing the the wrong Go application [08:23] dimitern, I will continue to quietly agitate for malta sprints [08:39] axw: do we now have a valid environment configuration in the state from the word go now? [08:39] rogpeppe: yup [08:39] axw: cool. we can probably simplify various pieces of agent logic because of that [08:40] rogpeppe: yeah, there are definitely some things I haven't gotten around to simplifying. e.g. workers waiting for valid config [08:40] axw: that's what i was thinking of === vladk|offline is now known as vladk [08:41] rogpeppe: it is still possible to get an invalid config *after* bootstrap, but that's very close to being fixed [08:41] rogpeppe: there's a small amount of work required to ensure config changes in state are transactionally validated&updated [08:42] morning all [08:42] morning vladk [08:42] axw: ah yes, because if you've got two set-environments concurrently, the combination might not be valid, i guess [08:42] vladk: hiya [08:43] rogpeppe: yup. waigani has been working on fixing it. there's a bit more to go, but it's still racy for the moment [08:57] mgz, ping [09:03] axw, fwereade, rogpeppe, jam, i'd really appreciate a review so i can land https://codereview.appspot.com/77340044/ === Ursinha is now known as Ursinha-afk [09:03] dimitern: sorry, still on that other review [09:03] dimitern, I'll take a look [09:04] about to go afk, will take a look later if it's not reviewed [09:04] fwereade, ta! === Ursinha-afk is now known as Ursinha [09:24] fwereade, jam: do you think we need to elide passwords from service-set configuration attributes in the log? [09:38] dimitern, reviewed, let me know what you think [09:39] fwereade, cheers, looking [09:41] fwereade, i'm not quite following you on that one https://codereview.appspot.com/77340044/diff/1/agent/agent.go#newcode135 [09:42] fwereade, how do you suggest to improve the doc comment? [09:42] dimitern, so, we've got a global mutex for config changes [09:42] fwereade, I agree it's not perfect, but it's a step in the right direction [09:42] fwereade, yeah [09:42] dimitern, right, yeah, as I say prgress not perfection [09:43] dimitern, just add a note to configMutex explaining the situation if there isn't already one [09:43] fwereade, that it's used to guard against modifying a created config? [09:44] dimitern, that it sort of implies a singleton config, but all we really have is an accidental-singleton config [09:45] fwereade, ok, got it [09:45] rogpeppe: can I get a follow up review on: https://codereview.appspot.com/76120044/ I simplified it [09:45] jam1: looking [09:48] jam1: what was the problem with my suggested (much simpler still) approach? [09:49]