[00:42] <thumper> marcoceppi: still around?
[00:43] <thumper> jose: ping
[00:43] <jose> thumper: pong
[00:43] <thumper> jose: hey, you were having problems with the local provider?
[00:43] <jose> thumper: yep, that was me
[00:43] <thumper> jose: I have good news and bad news
[00:43] <jose> what is it?
[00:44] <thumper> well, when lxc is installed it sets up a bridge by default
[00:44] <thumper> normally this is lxcbr0
[00:44] <thumper> but you can change it
[00:44] <thumper> now you can configure the bridge for the local provider to use
[00:44] <thumper> jose: can you pastebin an ifconfig?
[00:44] <jose> sure thing, just give me a minute
[00:44] <thumper> jose: the bad news, I have found this morning that the local provider is broken in 1.16 (and trunk)
[00:45] <thumper> and just submitted fixes a few hours ago
[00:45] <jose> yay!
[00:45] <jose> but when will the next release be done?
[00:45] <thumper> well, I'm pushing for a 1.16.1 ASAP
[00:45] <thumper> so, maybe tomorrow even
[00:46] <thumper> we have hoops to jump through
[00:46] <jose> http://paste.ubuntu.com/6248564/
[00:46] <thumper> I may push for  a 1.17 into the juju ppa
[00:46] <thumper> jose: hmm... no bridge there
[00:46] <jose> yeah, I was about to say that
[00:47] <thumper> jose: here's mine http://paste.ubuntu.com/6248565/
[00:47] <thumper> jose: apt-cache policy lxc ?
[00:48] <thumper> jose: also, what's in /etc/lxc/default.conf ?
[00:48] <jose> http://paste.ubuntu.com/6248566/
[00:50] <thumper> jose: I take it you are on raring
[00:50] <jose> yep
[00:50] <thumper> I wonder why it didn't create the bridge for you...
[00:51] <jose> bug!
[00:51] <thumper> hallyn: any idea why lxc wouldn't create the lxcbr0 bridge when installed?
[00:52] <thumper> I may be being hopeful that hallyn is online
[00:52] <thumper> jose: however there is another bit of bad news...
[00:52] <jose> thumper: which is...
[00:52] <thumper> jose: I found out today that lxc isn't working in precise just now
[00:52] <thumper> due to another bug
[00:52] <hallyn> thumper: jose: does your kernel have bridges built-in?  what does 'brctl show' say?
[00:52] <thumper> this is either in progress or in a review queue
[00:53] <jose> wasn't that on quantal? :P
[00:53] <jose> hallyn: no bridges
[00:53] <hallyn> jose: your kernel doesnt' support them?
[00:54] <jose> http://paste.ubuntu.com/6248592/ is what I get
[00:54] <thumper> jose: when juju starts the precise ubuntu-cloud image in lxc, there is a package configuration problem that causes most charms to fail install hooks
[00:54] <hallyn> jose: does 'brctl addbr br0' work?
[00:55] <jose> hallyn: operation not permitted
[00:55] <hallyn> sudo !!?
[00:55] <jose> ah, right!
[00:55] <hallyn> uh, !! in the history sense, not in the i'm shouting sense :)
[00:55] <jose> done
[00:55] <thumper> :)
[00:56] <jose> thumper: it explains why it failed when I demoed it at a conference months ago :P
[00:56] <thumper> a month ago it worked
[00:56] <thumper> although that is sub optimal
[00:56] <jose> then, that wasn't it
[00:56] <jose> hallyn: done, btw
[00:57] <hallyn> jose: and that worked?
[00:57] <jose> http://paste.ubuntu.com/6248605/
[00:57] <hallyn> is anything in /var/log/upstart/lxc-net.log ?
[00:58] <thumper> ah... I wondered where to look for logs
[00:59] <jose> http://paste.ubuntu.com/6248609/
[00:59] <jose> hmm, /me checks the dhcp server, maybe?
[01:00] <thumper> jose: you use 10.0.3.0/24?
[01:00] <jose> no, not at all
[01:00] <hallyn> hm
[01:00] <thumper> that's very weird then
[01:01] <hallyn> so you have dnsmasq itself installed...  but lxc should have made it - oh, di dyou *just* install lxc?
[01:01] <jose> even my dhcp for the occasional ad-hoc network I enable is 10.42.0.0/24
[01:01] <hallyn> maybe /etc/init.d/dnsmasq stop; /etc/init.d/dnsmasq start would fix it
[01:01] <jose> hallyn: I think yes
[01:01] <hallyn> jose: is there a /etc/dnsmasq.d/lxc file?  there should be...
[01:02] <hallyn> my guess is dnsmasq hasn't been restarted to read that
[01:02] <jose> there is
[01:02] <jose> yeah, let me restart it
[01:02] <hallyn> "have you tried turning it off and on again" would have solved this then :)
[01:03] <thumper> haha
[01:03] <hallyn> (then to 'stop lxc; start lxc' to have it try to restart lxc-net)
[01:03] <jose> oh wait dnsmasq was not isntalled
[01:03] <hallyn> well then what's pinning 10.0.3.x?
[01:04] <jose> should I install dnsmasq?
[01:04] <hallyn> nope
[01:04] <jose> I have bind9 installed, though
[01:04] <hallyn> can you do 'netstat -na' and look for 10.0.3' ?
[01:05] <jose> found, using port 53
[01:06] <hallyn> bind9?
[01:06] <jose> state is blank, though]
[01:06] <jose> bind9 is a dns server
[01:06] <hallyn> no, i mean that's the one holding it
[01:06] <hallyn> ?  just to make sure all is making sense :)
[01:07] <jose> then, any ideas?
[01:07] <hallyn> what do you mean by state is blank?
[01:08] <hallyn> i guess a 'listen-on' statement in bind9 config.
[01:09] <jose> on the table, it says proto udp, recv-q 0, send-q 0, local address 10.0.3.1:53, foreign address 0.0.0.0:*, state [here, this is completely blank'
[01:09] <hallyn> waiting for packages to install so i can test (and see the stock config)
[01:10] <jose> sure
[01:10] <hallyn> jose: a stock bind9 install followed by stock lxc install doesn't prevent lxcbr0 from being created in saucy (for me)
[01:10] <hallyn> how custom is your config?
[01:10] <jose> erm, just enabled a couple domains
[01:11] <jose> let me check, though
[01:11] <hallyn> jose: can you try adding 'listen-on { your ip addr }' in /etc/bind/named.conf.options ?
[01:11] <jose> hallyn: wait, there is no problem if I turn it off as I'm not using it right now
[01:12] <jose> and won't for the rest of this session
[01:12] <hallyn> oh, you can do listen-on { ! 10.0.3.1 };
[01:12] <hallyn> jose: ok, in the meantime can you open a bug against lxc?  we should do this automatically probably
[01:12] <jose> sure thing
[01:12] <hallyn> (though bind9 configs tend to be custom so automating it may be scary)
[01:13] <hallyn> thx - /me heads afk
[01:13] <jose> thanks to you!
[01:13] <jose> hallyn: wait, turning bind9 off will solve the prob?
[01:14] <jose> looks like it did
[01:17] <hallyn> yeah, long as htat doesn't mean you can't resolve anything locally :)
[01:18] <jose> it's all going good :)
[01:18] <jose> thumper: then, problem solved until the fix is pushed to repos, thanks! :)
[01:18] <thumper> :)
[01:18] <thumper> if you are a fanatic and want to run from trunk...
[01:18] <thumper> you might get it working
[01:41] <marcoceppi> thumper: I am now
[01:41] <thumper> marcoceppi: hey, it was just about the local provider and jose's problem
[01:41] <thumper> marcoceppi: but we got it mostly sorted
[01:41] <marcoceppi> thumper: ah, cool
[01:41] <thumper> marcoceppi: however we have a few problems
[01:41] <thumper> marcoceppi: the local provider is broken in 1.16
[01:42] <thumper> marcoceppi: we need to get 1.16.1 out to fix that, sinzui is in the loop
[01:42] <marcoceppi> thumper: that's what I've heard, any idea if you guys will be fixing and addressing that in 1.16.1 ?
[01:42] <marcoceppi> thumper: awesome
[01:42] <thumper> marcoceppi: the juju issue is fixed, but there is another lxc/precise issue
[01:42] <thumper> which means that while juju might "work", you can't deploy anything
[01:42] <marcoceppi> awesome
[01:42] <thumper> as the install hooks fail
[01:43] <thumper> there is another group looking at that
[01:43] <thumper> marcoceppi: you are there next week?
[01:43] <marcoceppi> thumper: I will be, should be touching down Saturday evening local time
[01:43]  * thumper nods
[01:43] <thumper> I arrive Sunday just after lunch I think
[01:44] <thumper> 11:15am landing actually
[01:44] <thumper> so after noon at the hotel certainly
[01:46] <marcoceppi> thumper: cool
[02:39] <jose> hey guys, any idea why while trying to deploy rais it tells me ERROR no settings found for "rack"?
[02:42] <marcoceppi> jose: how are you deploying it?
[02:43] <jose> marcoceppi: juju deploy rails --config rails.yaml
[02:43] <marcoceppi> jose: what does rails.yaml look like?
[02:43]  * jose pastebins
[02:44] <jose> http://paste.ubuntu.com/6248944/
[02:44] <marcoceppi> jose: that's not a properly formatted --config yaml file for what you're doing
[02:45] <jose> how should it be, then?
[02:45] <marcoceppi> jose: https://juju.ubuntu.com/docs/charms-config.html see "Configuring a service at deployment"
[02:46] <jose> ah, got it, thanks
[02:47] <jose> marcoceppi: if I don't specify a value it'll use default, correct?
[02:47] <marcoceppi> jose: Correct
[02:47] <jose> thanks! :)
[02:47] <marcoceppi> using --config is completely optional to begin with
[02:47] <jose> just to confirm, are we having a charm school this week?
[02:54] <marcoceppi> jose: no
[02:54] <jose> then the cal was right :)
[02:54] <marcoceppi> We'll have a new schedule figured out after the sprint
[02:54] <jose> ok!
[13:55] <jcastro> marcoceppi, hey
[13:55] <jcastro> cache-relation fails with wordpress/memcached
[13:55] <marcoceppi> jcastro: this has been a known issue for months
[13:55] <jcastro> oh
[13:55] <jcastro> is there a bug?
[13:55] <jcastro> why yuo no fix memcached?
[13:56] <marcoceppi> because plugin author + time
[13:56] <jcastro> oh this is the plugin one!
[13:56] <jcastro> I remember now
[13:56] <marcoceppi> https://bugs.launchpad.net/charms/+source/wordpress/+bug/1170034
[13:56] <_mup_> Bug #1170034: integration with memcached broke <wordpress (Juju Charms Collection):Confirmed> <https://launchpad.net/bugs/1170034>
[13:56] <jcastro> ok well wordpress keeps running
[13:56] <jcastro> so I think I'll use it as an example
[13:57] <jcastro> http://ec2-54-221-127-143.compute-1.amazonaws.com:7777/
[13:57] <jcastro> this charm is in the incoming queue
[13:57] <jcastro> it's a nodejs pastebin, it runs hastebin.com
[13:58] <marcoceppi> jcastro: link?
[13:58] <marcoceppi> jcastro: I'll try to fix WP charm on the plane to san fran
[13:58] <marcoceppi> no promises
[13:58] <jcastro> nah
[13:58] <jcastro> I am doing the demo today
[13:58] <jcastro> https://jujucharms.com/~davidolf/precise/haste-server-0/
[13:58] <marcoceppi> jcastro: k
[13:59] <jcastro> marcoceppi, free time is for the discourses
[13:59] <marcoceppi> oic ;)
[13:59] <marcoceppi> jcastro: I don't see haste in http://manage.jujucharms.com/tools/review-queue
[14:00] <jcastro> huh, the guy mailed me and asked me what to do
[14:00] <jcastro> I'll follow up
[14:00] <jcastro> but that was like 2 days ago, I would have assumed he would have submitted it
[14:00] <jcastro> unless it's for the contest maybe and he's waiting?
[14:00]  * marcoceppi checks bug list
[14:00] <jcastro> marcoceppi, it's pretty slick
[14:00] <jcastro> the software itself I mean
[14:01] <marcoceppi> jcastro: cool
[14:01] <marcoceppi> jcastro: time to replace paste.ubuntu.com ;)
[14:01] <marcoceppi> jcastro: charmers was not subscribed https://bugs.launchpad.net/charms/+bug/920797
[14:01] <jcastro> yeah
[14:01] <_mup_> Bug #920797: Charm needed: Haste server <Juju Charms Collection:Fix Committed by davidolf> <https://launchpad.net/bugs/920797>
[14:01] <jcastro> I'll mail him
[14:01] <jcastro> or I can just fix it
[14:02] <marcoceppi> jcastro: already did it
[14:02] <jcastro> this is the one jcsakket was mailing us about
[14:02] <jcastro> ones like this I mean
[14:02] <marcoceppi> cool
[14:02] <jcastro> I'm going to have it if it's a bug in charms and there's a branch attached with no resolution, add it to the queue anyway
[14:03] <jcastro> that way when people don't follow step 23434 of our amazing launchpad submission process we still catch them
[14:03] <marcoceppi> jcastro: yeah, branch attached, fix committed, bug on charms? show in the queue
[14:03] <jcastro> yup
[14:04] <jcastro> ok I've got wp, mediawiki, discourse, and their db's, haste
[14:04] <jcastro> anything else I can demo for the ubuntu on air today?
[14:05] <marcoceppi> jcastro: oh, for the demo - not sure
[14:05] <marcoceppi> rails?
[14:05] <jcastro> is there a way for a charm to tell the gui "don't show green, I am still doing stuff"
[14:05] <jcastro> like the discourse charm shows up green right away
[14:05] <jcastro> but needs like another 5 minutes to finish stuff up
[14:05] <marcoceppi> jcastro: no, because there's no way to provide feedback
[14:05] <jcastro> but if you look at the gui it looks ready to go
[14:06]  * marcoceppi really wants to be able to have juju describe it's state
[14:06] <jcastro> hazmat, is that something we can talk about in SFO?
[14:06] <marcoceppi> pending, installing, configuring, starting, started, relating
[14:06] <marcoceppi> for when those events are firing
[14:08]  * marcoceppi dreams on
[14:08] <jcastro> mysql has passed 10k downloads!
[14:09] <ehw> marcoceppi: I have a jujucharms.com question: why does 'openstack' never show up in the "providers" list?
[14:10] <ehw> could be that I'm misunderstanding what the providers list does
[14:10] <marcoceppi> ehw: Possibly, could you link to a page where you're seeing "providers"?
[14:10] <ehw> https://jujucharms.com/precise/mysql-27/#bws-code
[14:11] <ehw> marcoceppi: ^^ but really any charm that I look at usually doesn't say 'openstack'
[14:11] <marcoceppi> ehw: Ah, that might be a bug. Those are showing the results of our testing environment
[14:11] <ehw> another example, https://jujucharms.com/precise/ceph-16/
[14:12] <marcoceppi> ehw: right, we test "openstack" against HP Cloud, so it might show as that. We're still working out the kinks for testing stuff, just because it doesn't  say it explictitly doesn't mean it's not supported
[14:13] <ehw> marcoceppi: ok, was curious about that
[14:13] <ehw> marcoceppi: thanks
[14:14] <marcoceppi> ehw: we'll be working over the next several weeks to make those results (both testing and supported providers) better
[16:01] <jose> hallyn: ran apport, it collected info from bind9, but doesn't seem to appear on launchpad
[16:01] <jose> oh, there we go
[16:05] <jose> no, not in there yet
[16:14] <hazmat> jcastro, it sounds good to bring up, the notion of steady state is effectively a poll/time period with no active
[16:16] <jamespage> marcoceppi, I got asked that at the ceph day last week as the ceph charm does not advertize as tested on MAAS
[16:17] <marcoceppi> jamespage: none do at the moment, since we don't have testing yet for MAAS, I think we should just hide those results for now, they're really misleading
[16:18] <jamespage> marcoceppi, yeah - agreed
[16:18] <jamespage> the assumption was that it was not tested on MAAS so did not support it
[16:20] <marcoceppi> I think that's part of charmworld, sinzui are you guys working on these pages? https://jujucharms.com/precise/ceph/
[16:21] <sinzui> marcoceppi, juju-gui is the pages, the data is from manage.jujucharms.com (charmworld)
[16:21] <marcoceppi> sinzui: thanks! gary_poster thoughts on above ^ ?
[16:21] <sinzui> jcsackett, are we deploying charmworld?
[16:22] <jcsackett> sinzui: not at the moment, but we can. that's via RT, yes?
[16:23] <sinzui> jcsackett, I was just inquiring as it would be factor if a jujucharm.com page had an issue
[16:24] <rick_h_> marcoceppi: ? I'm confused. We don't run tests on maas so we can't say the charm is tested on maas. What's the goal?
[16:24] <jcsackett> sinzui: ah, yeah, to my knowledge there's nothing going on with production right now.
[16:24] <rick_h_> marcoceppi: the goal is that we've had charms that we KNOW fail on ec2 before and wanted to provide info to the user
[16:24] <marcoceppi> rick_h_: it's misleading, since testing isn't strong, to say that "Providers" and not list providers because there are no tests
[16:24] <sinzui> jcsackett, if we release today, charmers get askubuntu and github integration
[16:25] <marcoceppi> rick_h_: had two reports today of this causing end user confusion
[16:25] <marcoceppi> just passing along the info
[16:25] <rick_h_> marcoceppi: yea, it's been around 100 times. at one point I got only failures to show, but then others wanted all listed.
[16:25] <rick_h_> marcoceppi: yea, understand. It's been a long running point of fun discussion
[16:26] <marcoceppi> rick_h_: cool, here's more data for your pocket then :)
[16:26] <jcsackett> sinzui: yes, as long as we're releasing to revno 421 on charmworld and use charmworld-79 tag for the charm.
[16:27] <marcoceppi> rick_h_: maybe even just saying "Tested Providers" with a caveat to mention that you can attempt to deploy charms on any provider we only have definitive results for XYZ
[16:27] <jcsackett> wait, we don't need all the way through 421.
[16:27] <jcsackett> many things have landed. :-P
[16:27] <jcsackett> sinzui: through revno 415 for github. it looks like there have several bundle related landings as well--i don't know the QA status of all of thsoe.
[16:28] <rick_h_> marcoceppi: yea, you can toss feedback out to Juju-gui-peeps if you want. I'm not sure where to take it at this point.
[16:29] <marcoceppi> rick_h_: cool, I'll take this discussion to their court
[16:29] <rick_h_> jcsackett: yea, we've got proof api stuff and things in progress that are not complete for release.
[16:29] <sinzui> jcsackett, can you do a quick review of staging. The app.log will show any misadventures with new proof. We can look at some charms to verify we see icons warning.
[16:30] <jcsackett> sinzui: popping into staging now.
[16:35] <jcsackett> sinzui: app.log shows a few tracebacks for bad YAML as IngestErrors, and some no branch, but that's all logging normal for charms with errors, iirc.
[16:36] <jcsackett> sinzui: i'm not sure i follwed the second part; what charms and what about icons warning?
[16:36] <sinzui> jcsackett, tabs about smoke
[16:36] <sinzui> ?
[16:36] <jcsackett> sinzui: yup.
[16:36] <sinzui> I wrote the branch owner. He replied that he will fix them when he has time
[16:37] <rick_h_> jcsackett: sinzui so in checking no reason to not go to 421 if you want.
[16:37] <sinzui> jcsackett, We want to confirm that charmworld is showing the proof that we include.
[16:40] <sinzui> jcsackett, i looked at a few charms and I see sensible proof warning
[16:40]  * sinzui thinks the underling of them is ugly and a bug
[16:41] <jcsackett> sinzui: ok. my lunch finished cooking a moment ago. right after food, i'll start the release process.
[16:42] <sinzui> fab
[16:42] <sinzui> thank you rick_h_
[17:27] <gary_poster> for those following along, marcoceppi caught up with me in #juju-gui .  His point made sense to me, and he filed https://bugs.launchpad.net/juju-gui/+bug/1241075 , with my thanks.
[17:27] <_mup_> Bug #1241075: Wording of "Providers" confusing on charm information page <juju-gui:Triaged by lucapaulina> <https://launchpad.net/bugs/1241075>
[18:14] <rick_h_> marcoceppi: ping
[18:14] <marcoceppi> rick_h_: pong
[18:14] <rick_h_> marcoceppi: got http://paste.mitechie.com/show/1048/ as the new setup for you. You can just use the root error messages. They're prefixed by the bundle name.
[18:15] <rick_h_> marcoceppi: the details are nested and they're lists now so that you can support multiple errors per service (e.g. multiple config issues)
[18:15] <marcoceppi> rick_h_: it doesn't indicate severity - or are these all always error?
[18:15] <rick_h_> marcoceppi: what I'd suggest for a first cut is that, if there are errors in here, that you provide a link at the least to the api call for a "for full details go to:" until some sort of verbosity can come up
[18:15] <rick_h_> marcoceppi: right now, all the things in that blueprint we're checking are errors
[18:16] <rick_h_> we can expand, but currently it's all we have use cases for
[18:16] <marcoceppi> rick_h_: cool, I'm fine with that just need to know how to prefix these messages
[18:16] <marcoceppi> thanks! This looks good
[18:16] <rick_h_> https://blueprints.launchpad.net/charm-tools/+spec/charm-bundle-support says they're all critical
[18:16] <rick_h_> so error == critical and if we get to a warnings then we'll add "warning_messages", "warnings"
[18:17] <rick_h_> (note that's a typo, it should be error_messages (with an s)
[18:17] <marcoceppi> rick_h_: right, missed "error" in the error_messages key
[18:17] <rick_h_> marcoceppi: cool, I've got some tests to write around this new stuff for the config checking and will get it pushed up. I'll let you know when it's on staging and you can poke at it with fury
[18:17] <marcoceppi> thanks for working on this, looks good!
[18:17] <rick_h_> marcoceppi: probably sometime tomorrow
[19:01] <CaptainTacoSauce> hi guys, still trying to understand some basics, with juju-local, I should be able to run precise charms on a saucy "host" right?
[19:01] <CaptainTacoSauce> assuming lxc
[19:07] <marcoceppi> CaptainTacoSauce: yes, despite your host being saucy, all LXC containers launched will be precise (unless you specify otherwise)
[19:07] <marcoceppi> CaptainTacoSauce: however, I think there's a bug in 1.16.0 that breaks the local provider, so if you're experiencing an issue, it might be related to that
[19:07] <CaptainTacoSauce> marcoceppi: ah, indeed I am, but I've been playing with it for all of 5 minutes now, thanks
[19:08] <marcoceppi> CaptainTacoSauce: let me find the bug for you
[19:08] <marcoceppi> CaptainTacoSauce: https://bugs.launchpad.net/juju-core/+bug/1240709
[19:08] <_mup_> Bug #1240709: local provider fails to start <local-provider> <juju-core:Fix Committed by thumper> <juju-core 1.16:Fix Committed by thumper> <https://launchpad.net/bugs/1240709>
[19:12] <paulczar> ^ I was seeing that bug when I installed on my laptop yesterday
[19:54] <paulczar> how does the juju-gui charm get the admin-secret from enviroments.yaml  ?    I would like to be able to use the same for my own apps
[19:59] <marcoceppi> paulczar: you have to manually enter it last I tried
[20:00] <paulczar> when I do juju deploy juju-gui it somehow gets the admin-secret out of my juju environment
[20:00] <paulczar> but I'm not seeing how in the charm hooks
[20:00] <marcoceppi> paulczar: hum, I'll ping gary_poster but also poke at the charm if he doesn't answer
[20:01] <paulczar> thx
[20:03] <gary_poster> paul czar, it does not--it just remembers in browser for a single url in a single browser session.  However, https://launchpad.net/juju-quickstart gets out the admin secret with Python (and eventually we have talked about doing what you describe)
[20:04] <gary_poster> (that is, starting you logged in to the GUI)
[20:04] <gary_poster> paulczar, sorry ^^^
[20:32] <jcsackett> sinzui: release has finished, heartbeat is coming up good.
[20:33] <sinzui> I just checked the review queue
[20:33] <jcsackett> sinzui: be a bit before askubuntu items show up in it.
[20:34] <sinzui> jcsackett, I expect new things to show by tomorrow
[20:34] <jcsackett> sinzui: that would be accurate.
[20:34] <jcsackett> i have a card for the release in assessment, but have moved releasable cards to done.
[20:34] <jcsackett> s/releasable/released/
[20:42] <jcastro> jcsackett, about how long until questions show up?
[20:42] <jcastro> we talking hours or ... ?
[20:42] <jcastro> jcsackett, thanks for working on this btw, it will be awesome!
[21:23] <thedac> Just upgraded from 1.14.x to 1.16.0 and now getting "ERROR cannot start bootstrap instance: index file has no data for cloud" What needs changing?
[21:45] <jcsackett> jcastro: the job runs daily, so should be up by tomorrow morning.