| wallyworld | axw: running a minute late, otp with tim | 00:59 |
|---|---|---|
| axw | okey dokey | 00:59 |
| axw | babbageclunk: I think you're right, we should invest in a perf testing scaffold | 01:34 |
| axw | babbageclunk: I'm thinking we could just write something that would add a bunch of units and spread them over a few lxd containers | 01:35 |
| axw | just something that'll cause a bunch of connections and load on mongo | 01:35 |
| axw | we could do microtests, but the closer to reality the better | 01:36 |
| babbageclunk | axw: yeah, makes sense. | 01:38 |
| axw | wallyworld: BTW these might be useful: https://prometheus.io/docs/instrumenting/writing_exporters/, https://prometheus.io/docs/practices/instrumentation/, https://prometheus.io/docs/practices/naming/ | 02:04 |
| wallyworld | thanks | 02:05 |
| blahdeblah | Anyone able to explain why I can't deploy to azure? http://pastebin.ubuntu.com/24838522/ | 03:20 |
| blahdeblah | s/deploy to/create a new model on/ | 03:20 |
| blahdeblah | If I retry with just the cloud name, I get: http://pastebin.ubuntu.com/24838529/ | 03:22 |
| jam | wallyworld: are we meeting today? I know Tim is traveling | 03:22 |
| wallyworld | jam: we could, de debrief on what's the next steps on site perhaps | 03:23 |
| jam | see you in ~30 then | 03:23 |
| babbageclunk | hey jam - can I pick your brains about bug 1696509 quickly? | 03:24 |
| mup | Bug #1696509: status-history-pruner fails under load <performance> <pruning> <statuseshistory> <juju:In Progress by 2-xtian> <https://launchpad.net/bugs/1696509> | 03:24 |
| wallyworld | blahdeblah: a controller can only support one cloud | 03:25 |
| wallyworld | looks like you are trying to an an azure model to an openstack controller | 03:25 |
| blahdeblah | wallyworld: orly? | 03:25 |
| wallyworld | since forever | 03:26 |
| blahdeblah | Wow - OK; never realised that was a limitation | 03:26 |
| blahdeblah | thanks | 03:26 |
| wallyworld | jaas of course is different | 03:26 |
| blahdeblah | o.O | 03:26 |
| wallyworld | in juju 1, cloud and creds were art of environment.yaml | 03:27 |
| wallyworld | and only single model | 03:27 |
| blahdeblah | this is not juju 1 | 03:27 |
| wallyworld | xright | 03:27 |
| wallyworld | just giving you background | 03:27 |
| blahdeblah | ah, ok | 03:27 |
| wallyworld | we evolved to support multi-model, but still only on one cloud | 03:28 |
| wallyworld | and mukti-creds also | 03:28 |
| blahdeblah | I might log a bug about the error message it gives, then | 03:29 |
| blahdeblah | Because it gives the impression you can just throw creds, give it the cloud, and expect it to work | 03:29 |
| jam | babbageclunk: i'm happy to talk about it, but I haven't really started my day yet | 03:48 |
| babbageclunk | jam: oh sorry - let's do it after you've started. | 03:48 |
| babbageclunk | jam: I'm just going to try something anyway | 03:49 |
| jam | babbageclunk: my quick thought on it was to say "I need to delete everything before X, what is approximately 10,000 records should be Y, lets slowly increment up to X" | 03:49 |
| jam | instead of issuing a single db delete that will take 3hrs to complete, and gives no feedbakc in the mean time | 03:50 |
| menn0 | axw, wallyworld: you guys have 10 mins to discuss mgo session handling? | 03:50 |
| wallyworld | ok | 03:50 |
| jam | hey menn0, good to see you around | 03:50 |
| babbageclunk | jam: sure - I have something that gets ids back and issues a delete for those, but rereading you're suggesting doing it by time instead. | 03:51 |
| menn0 | jam: howdy jam | 03:51 |
| jam | babbageclunk: more that I don't think we actually want to grab 1M ids and then slowly walks through them | 03:51 |
| jam | babbageclunk: we want to be doing big batch deletes, just not everything-all-at-once | 03:51 |
| jam | babbageclunk: if what you have doesn't slow it down a lot, then I'm fine with it | 03:51 |
| menn0 | wallyworld, axw : https://hangouts.google.com/hangouts/_/canonical.com/mgo-sessions | 03:52 |
| babbageclunk | jam: ok cool - I'm just checking that now. It shouldn't be getting all of the ids at once. | 03:52 |
| jam | babbageclunk: as always, its more about "how does it handle when things are bad, vs happy case its greate" | 03:53 |
| wallyworld | jam: want to join https://hangouts.google.com/hangouts/_/canonical.com/mgo-sessions | 03:54 |
| * jam screams nooooooo! and runs away and hides | 03:55 | |
| jam | weird, 'my connection was lost', rejoining | 04:01 |
| jam | ah, 2fa kicked in | 04:01 |
| blahdeblah | Anyone able to explain why deploy via path no longer works on 2.1.3? Worked for me last time I tried this (2.1.2, IIRC). http://pastebin.ubuntu.com/24838818/ | 04:07 |
| veebers | blahdeblah: I'm pretty sure that is should just be the path to the charm, so should be: juju deploy ./ntp | 04:24 |
| blahdeblah | veebers: . is the path to the charm. If I deploy with full path, I get the same result | 04:25 |
| veebers | blahdeblah: ah, I see | 04:25 |
| veebers | blahdeblah: what's the 'ntp' part? | 04:25 |
| blahdeblah | service name | 04:26 |
| veebers | blahdeblah: ah ok, I'm totally barking up the wrong tree, looking at the error again I see "Bad Gateway" as the request error, I'm not sure about that sorry. I'm sure someone around here would have an idea though | 04:28 |
| blahdeblah | veebers: no worries - thanks for looking | 04:28 |
| axw | menn0: sorry I went to the shops, eating now... did you already talk? | 04:48 |
| menn0 | axw: still going | 04:48 |
| axw | wallyworld: it looks fine to me, can you try using "juju-introspect metrics" and grep for one? maybe the UI has cached the keys | 05:10 |
| wallyworld | ok | 05:11 |
| wallyworld | axw: just got to deal with something here so will do it soon | 05:11 |
| axw | wallyworld: and also, are you sure it's running your code? did you set the version to 2.2-rc2? if it is, it would have picked up the released binary if you didn't --build-agent | 05:11 |
| axw | wallyworld: sure | 05:11 |
| wallyworld | it's rc3 | 05:12 |
| wallyworld | and i added logging | 05:12 |
| jam | blahdeblah: IP:17070/model/6dec752c-5d00-4947-8dff-17b66ef22833/charms?revision=0&schema=local&series=xenial: Bad Gateway | 05:32 |
| wallyworld | axw: yeah, must have been browser caching, wotks from cli | 05:32 |
| jam | blahdeblah: that isn't a "cannot deploy the local directory" | 05:32 |
| jam | blahdeblah: that is "cannot talk to the controller to upload the local charm" | 05:33 |
| axw | wallyworld: cool | 05:33 |
| blahdeblah | jam: Except that I can talk to the controller just fine | 05:33 |
| blahdeblah | If I push exactly that directory to my charmstore account, it deploys OK as well. | 05:34 |
| jam | blahdeblah: I can't say for sure. I can say that we do a different operation on upload (instead of connecting and upgrading to a websocket, we just do a POST of the content) | 05:34 |
| jam | 502 Bad Gateway seems odd | 05:34 |
| jam | as it seems to indicate you have a reverse proxy inbetween you and Juju | 05:34 |
| jam | seems 502 is for when you talk to a proxy, and the proxy forwards your request but gets a bad response from the target | 05:35 |
| blahdeblah | a forward proxy is possible | 05:35 |
| blahdeblah | (i.e. my local squid) | 05:35 |
| * blahdeblah looks for errors there | 05:36 | |
| jam | both 'juju status' and 'juju deploy' will talk to 17070, but maybe the local squid tries to inspect POST in a way that it doesn't try to mess with UPGRADE to websocket | 05:36 |
| blahdeblah | seems like https_proxy is being used for one, but not the other | 05:42 |
| blahdeblah | anyhow, found the squid acl stopping it; hopefully it will work next time | 05:44 |
| blahdeblah | thanks jam | 05:44 |
| wallyworld | axw: here's that metrics PR https://github.com/juju/juju/pull/7487 | 06:16 |
| axw | wallyworld: looking | 06:16 |
| axw | wallyworld: left a few comments | 06:30 |
| wallyworld | ok, ta | 06:30 |
| wallyworld | axw: also, with agents dialing the controller, it seems to me that we don't use last successful connection - we try all the addresses concurrently, first wins. and this will have an effect of picking the least busy controller as it will be likely to respond first | 06:31 |
| wallyworld | func dialAPI(info *Info, opts0 DialOpts) (*dialResult, error) { | 06:32 |
| axw | wallyworld: yes, but I think there's a delay before we dial the [1:] addrs? | 06:32 |
| * axw checks | 06:32 | |
| axw | wallyworld: yep, see DialAddressInterval | 06:33 |
| wallyworld | axw: oh right, i just read the method doc | 06:34 |
| wallyworld | it should make that bit clear | 06:34 |
| wallyworld | axw: i wonder what happens when a counter rolls over | 06:44 |
| wallyworld | i guess it is so far off it won't happen in practice | 06:44 |
| axw | wallyworld: it's 64 bit, so not going to happen | 06:45 |
| wallyworld | well, not any time soon :-) | 06:45 |
| axw | heat death and all that... :) | 06:45 |
| wallyworld | axw: could you PTAL? | 07:00 |
| axw | looking | 07:00 |
| wallyworld | i guess i should make it a uint64 | 07:01 |
| axw | wallyworld: I meant drop connection_rate in favour of a total. no need for both is there? | 07:01 |
| wallyworld | well, i like the idea of not need to use any extra prometnius config to get the rate | 07:02 |
| wallyworld | just having the raw number served seems a good thing if you are using juju-introspect | 07:02 |
| wallyworld | you can eyeball it | 07:03 |
| axw | wallyworld: gtg get charlotte, bbs then will finish | 07:05 |
| wallyworld | ok | 07:09 |
| wallyworld | axw: and another when you are back https://github.com/juju/juju/pull/7488 | 07:26 |
| axw | wallyworld: reviewed | 07:35 |
| wallyworld | ta. i was thinking clients would benefit too, but maybe not | 07:36 |
| wallyworld | we can restrict for now | 07:36 |
| wallyworld | s/clients/CLI | 07:36 |
| axw | wallyworld: the controller *might* benefit, but the clients might also be slowed down by connecting to things that aren't known to previously be good | 07:37 |
| axw | I think it makes sense to optimise for UX for the client | 07:37 |
| axw | CLI | 07:37 |
| wallyworld | axw: maybe this needs to be config option | 07:37 |
| axw | wallyworld: what kind of config option? | 07:37 |
| wallyworld | in agent.conf or something | 07:38 |
| wallyworld | i guess only apiservers have that though | 07:38 |
| axw | wallyworld: I don't think it's necessary, it's only going to slow down connections a little bit | 07:38 |
| axw | if at all | 07:38 |
| wallyworld | ok, i'll move to workers then | 07:39 |
| wallyworld | axw: the shuffle code is now in apicaller | 08:06 |
| axw | looking | 08:06 |
| === frankban|afk is now known as frankban | ||
| wallyworld | axw: agree about rand, but was too big a change to set it all up in the manifolds | 08:16 |
| wallyworld | i think it will be ok for now | 08:16 |
| axw | wallyworld: yeah, no big deal if it's not particularly random anyway | 08:16 |
| wallyworld | yep | 08:16 |
| wallyworld | axw: going afk for a bit for dinner. if your findings today are worth sharing, can you email tim, me, john etc? even just to add some extra context to what tim might see on site tomorrow | 08:17 |
| axw | wallyworld: I don't have anything much to share today | 08:18 |
| wallyworld | ok, np | 08:18 |
| axw | hard slog through unpicking watcher code atm | 08:18 |
| wallyworld | bbiab | 08:18 |
| axw | later | 08:18 |
| thumper | o/ | 14:21 |
| === frankban is now known as frankban|afk | ||
| pogi | is there any juju hello world for local provider | 16:22 |
| wpk | charm? | 16:23 |
| wpk | I'd go with mediawiki-single | 16:23 |
| rick_h | pogi: just juju deploy ubuntu | 16:24 |
| pogi | Can I use Ansible base with local provider any example | 16:27 |
| pogi | ansible hook | 16:27 |
| babbageclunk | menn0: ping? | 21:58 |
| * babbageclunk goes to the doctor | 22:20 | |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!