| lazyPower | thumper: what is the namenode charm? | 03:26 |
|---|---|---|
| lazyPower | thumper: you're using big data terminology here... | 03:26 |
| thumper | lazyPower: oh hai | 03:26 |
| thumper | I was watching a deployment and noticed that it failed to install every time | 03:26 |
| lazyPower | thumper: the kubernetes-master charm? | 03:27 |
| thumper | i think it was a custom bundle | 03:27 |
| thumper | used to scale testing | 03:27 |
| thumper | on aws | 03:27 |
| lazyPower | hmm, ok | 03:27 |
| lazyPower | i'm not sure what this namenode charm would be. it might be something kwmonroe has cooking up | 03:27 |
| thumper | that's fine | 03:31 |
| thumper | I have enough issues to chase just now :) | 03:32 |
| Zico | Mattyw_, GM, thank you for your earlier reply. It works, I just added the layer.yaml containing (includes layer:metrics) and metrics.yaml containing (metrics: juju-units:) and upgraded the charms as "juju upgrade-charm <charm_id> --path <local/path/to/charm>" and after 5 minutes, juju metrics --all, Gives the number of units for all the charms like a CHARM :) | 07:22 |
| === frankban|afk is now known as frankban | ||
| mattyw | Zico, glad it worked out, if you think there's improvements to be made with the docs I'd love to hear them. | 07:31 |
| mattyw | Zico, any any more questions feel free to ask - I'm here all the time, if I can't answer a question I'll be able to point you to someone who can | 07:32 |
| Zico | Mattyw, Great, thank you my friend, much appreciated :) | 07:32 |
| Zico | Mattyw, Concerning the docs improvement, yes, I think there is room for improvement, for example, compiling the steps that I mentioned to form a "HELLO_WORLD" Metric, I mean the unit count by enumerating the process as 1 , 2, 3, & 4 where 1. Layer.yaml, 2. metrics.yaml, 3. upgrade-charm, 4. After 5 minutes (Default), invoking the juju metrics command. | 07:35 |
| Zico | The Call for Upgrade-charm wasn't obvious unless you informed me to :) | 07:35 |
| mattyw | Zico, which pages did you read from the docs, was it just https://jujucharms.com/docs/stable/developer-metrics ? | 08:07 |
| Zico | Mattyw, yes, it was https://jujucharms.com/docs/stable/developer-metrics the starting page. But as you notice, there is no mention in it for " juju-units: " and no mention to trigger the "juju upgrade-charm" | 08:19 |
| Zico | Mattyw, Also, in the layer.yaml section, the word " includes " is not mentioned... | 08:20 |
| Zico | Personally, I added in the layer.yaml " includes: ['layer:metrics'] " as copied from a manually created TEST charm | 08:21 |
| mattyw | Zico, yeah, that page kind of assumes you know lots of stuff already, we probably need a better getting started page, how did you find out about charm metrics (just trying to understand where would be best for us to make a change in the docs) | 08:21 |
| Zico | Mattyw, Yes, Correct, in fact, I got frustrated at first :) because, I screened all the pages, and couldn't grasp a whole procedure. Starting point was: https://jujucharms.com/docs/stable/developer-metrics | 08:23 |
| Zico | then went to https://jujucharms.com/docs/2.1/charms-metrics | 08:24 |
| mattyw | Zico, we have https://jujucharms.com/docs/stable/developer-getting-started. I guess that wasn't helpful? | 08:25 |
| Zico | Yes, Helpful of course, but doesn't read anything about the metrics. it would be nice to add a section to it to link to metrics | 08:27 |
| mattyw | Zico, understood, thanks very much for your feedback | 08:28 |
| mattyw | Zico, hopefully we'll make it easier for the next person :) | 08:28 |
| Zico | Mattyw, you are welcome, my friend, I hope so :) I am doing some research on Orchestration through JUJU and I need to get feedbacks (Metrics) to trigger optimization | 08:29 |
| Zico | BTW, I have a problem that is: My Laptop is able to spin multiple machine and provision multiple services, however, when I run a large bundle , it arrives to a time that It dies (Sluggish responding), although free -h and top and iotop are reading low load! Any hint? | 08:31 |
| mattyw | Zico, sounds interesting, any questions or suggestions we're here to help/ listen | 08:32 |
| mattyw | Zic, you're running lxd I guess? | 08:32 |
| mattyw | Zico, ^^ | 08:33 |
| Zico | yes | 08:33 |
| Zico | Mattyw, 7 applications running on 4 machines (4 applications on 1 machine and remaining is 1 app per machine). | 08:33 |
| Zico | Mattyw, the 4 apps on 1 machines as 4 LXD | 08:34 |
| kjackal | Good morning Juju world! | 08:50 |
| mattyw | kjackal, morning | 08:51 |
| mattyw | Zico, that means you'll probably have 5 lxd machines total including the controller | 08:51 |
| mattyw | Zico, doesn't suprise me that it might be a bit slow on your laptop | 08:52 |
| Zico | Mattyw, Correct. | 08:53 |
| Zico | I have a new question please: | 08:53 |
| Zico | I am struggling to make the PROXY SQUID_DEB_PROXY HIT but all is miss :( | 08:54 |
| Zico | I am following | 08:54 |
| Zico | https://askubuntu.com/questions/3503/best-way-to-cache-apt-downloads-on-a-lan | 08:54 |
| Zico | written by Jorje Castro | 08:54 |
| Zico | All I get is TCP_MISS not TCP_HIT :( | 08:56 |
| Zico | Although, I remove the machine and recreate, so it's supposed to be cached | 08:56 |
| Zic | lazyPower: thanks for your reply (I just backlogged) | 09:37 |
| Zic | (hi Juju world) | 09:37 |
| wpk | /wind 11 | 10:57 |
| Zico | Hi, how to purge (flush) historical logs, I mean JUJU debug-log --replay keeps tracks of several days back which are useless. Is it safe if I ssh the controller and empty the logsink.log by (ssh -m controller 0 and echo "" > /var/log/juju/logsink.log)? | 11:22 |
| rick_h | Zico: since the logs are stored in the db that won't really work out. | 11:25 |
| rick_h | Zico: there's tools in debug-log to help limit the time responded | 11:25 |
| rick_h | Zico: check out https://jujucharms.com/docs/stable/troubleshooting-logs#the-debug-log-command | 11:26 |
| Zico | Rick_h, Yes, Right, thank you, I checked this, Much Helpful :) | 11:27 |
| === salmankhan1 is now known as salmankhan | ||
| Zico | Hi, is there a way to forcibly remove a unit or an application without removing the underlying machine? (The "--force" is only application to remove-machine). This is the case when I get stuck with an app/unit with status ERROR and MESSAGE: *hook failed: "install"* | 12:13 |
| Zico | application* shall read applicable :) | 12:14 |
| Zico | BTW, removing it from the GUI (Destroy) says, this application is marked for destroy on next deploy. What's the catch? | 12:15 |
| rick_h | Zico: no, there's not. If you force then there's no way for Juju to know what to remove as it doesn't track the files/installs/etc the charm does | 12:16 |
| rick_h | Zico: is that you have to go down to the bottom-right and hit commit | 12:16 |
| rick_h | Zico: where it'll try the same thing the cli does to remove an application, trigger the hooks, etc | 12:16 |
| Zico | Rick_h, yup, I commited of course :) and as result of commit, it says marked for destroy on next deploy | 12:17 |
| rick_h | Zico: hmm, sounds like the GUI got confused? | 12:17 |
| Zico | Yup The exact wording is: (This application has been marked to be destroyed on next deployment.) | 12:18 |
| Zico | and the status is (Status: error - hook failed: "install" Agent Status: executing Workload Status: error) | 12:19 |
| Zico | So, basically, I am stuck in infinite loop, neither the gui, nor the cli are able to remove the app/unit which is having status error (hook failed: install). The only way I could resort is by forcibly removing the underlying machine. My question is : Is there any other way to remove the app/unit without losing the machine? | 12:22 |
| anrah | Zico: I think I have sometimes managed to resolve that by making dummy configuration change through cli and then say resolve to failed unit and after that remove-application | 12:26 |
| Zico | Anrah, Good idea :), this is what I am thinking of. so, I go to $juju debug-hooks <app_name> and then what? | 12:28 |
| anrah | I just said juju config <app> <config-value>=foobar | 12:39 |
| anrah | then juju resolve <unit> | 12:39 |
| anrah | juju remove-application application | 12:39 |
| anrah | but hmm, you have only one app per machine? | 12:40 |
| Zico | Anrah, Yes Only one app, per machine currently. | 12:42 |
| Zico | Anrah, I have done the trick (Y) , changed the config of passwd and then *resolved*, but again, hook failed: install and stuck at same position again and cannot remove the app. | 12:44 |
| === rvba` is now known as rvba | ||
| Zic | lazyPower: can I deploy a specific bundle version through Juju GUI? because as I use manual-provisionning, I will need to redispatch charm to the "good" machine, and it's esasier with drag'n'drop if I need to demonstrate it to coworkers :) | 13:11 |
| lazyPower | Zic: yep just download teh bundle to your machine and drag/drop onto the gui | 13:12 |
| Zic | https://localhost:8080/gui/u/admin/default/canonical-kubernetes/bundle/38 <= hmm, I thought to just edit that silly '38' | 13:12 |
| Zic | will it work? | 13:12 |
| Zic | drag'n'dropping from local is also good to know :) | 13:13 |
| lazyPower | Zic: you can view the specific revisin and choose deploy as well, sure | 13:15 |
| lazyPower | *revision | 13:15 |
| Zic | thanks, I'm impatient to upgrade this cluster in 1.7.2 to have the snap architecture | 13:16 |
| Zic | (the other one is already at latest revision) | 13:16 |
| Zic | my next move will be to test if Juju and our Puppet orchestrator has some conflict on some files | 13:16 |
| Zic | with snap, normally, all will be OK | 13:16 |
| Zic | lazyPower: before juju upgrade-charm, do you recommend upgrading the Juju client? we're not using the juju snap on the production cluster for now, I'm planning to switch to the snap version before/after the upgrade | 13:27 |
| Zic | don't know if I choose before or after :> | 13:27 |
| lazyPower | Zic: as far as i know the snap package has very little to do with what you wind up with in your controller, as thats all packaged and maintained on the controller itself | 13:27 |
| lazyPower | it'll only change how you receive your client package and client updates | 13:27 |
| lazyPower | Zic: but i would recommend the least-change method. introduce as few changes as possible, and slowly, so you can validate they haven't caused you any heartburn | 13:28 |
| Zic | yup | 13:28 |
| Zic | lazyPower: the kubernetes-master is stuck at "installing charm software" with no output at juju debug-log or in /var/log/juju of the kubernetes-master, where can I look to have more info? :( | 13:36 |
| lazyPower | Zic: thats the pre-dependency bootstrapping hook for reactive. the only thing i can think of would be to juju debug-hooks that unit, and kill the process executing the existing upgrade-charm hook | 13:37 |
| lazyPower | that way you can intercept it and run it manually | 13:37 |
| Zic | oh, did not know debug-hooks | 13:38 |
| Zic | python3 /var/lib/juju/agents/unit-kubernetes-master-0/charm/hooks/install /var/lib/juju/agents/unit-kubernetes-master-0/charm/hooks/install | 13:38 |
| Zic | killing this one inside debug-hook ? | 13:38 |
| Zic | and relaunch it manually ? | 13:38 |
| lazyPower | Zic: yep, if you kill it, just wait a few seconds | 13:39 |
| lazyPower | juju will auto-retry the hook and trap it in that tmux session you have open | 13:39 |
| Zic | ok | 13:39 |
| Zic | killed it 1min ago, it does not seem to respawn :( | 13:41 |
| lazyPower | Zic: juju resolved kubernetes-master/0 | 13:41 |
| lazyPower | its likely on the backoff timer | 13:41 |
| lazyPower | so resolving it will cause it to go ahead and retry | 13:41 |
| Zic | ERROR unit "kubernetes-master/0" is not in an error state | 13:41 |
| Zic | it stuck at maintenance/executing in fact | 13:42 |
| lazyPower | Zic: systemctl restart jujud-unit-kubernetes-master-0 | 13:42 |
| Zic | on the juju controller machine right? | 13:42 |
| lazyPower | cycle the agent, that should kick it in the head | 13:42 |
| lazyPower | no | 13:42 |
| lazyPower | on the unit you're attached to for debug-hooks | 13:42 |
| Zic | ah, on the kubernetes-master | 13:42 |
| lazyPower | yep | 13:42 |
| Zic | oki | 13:42 |
| lazyPower | just to make things easier, if i dont explicity identify another unit, i'm referring to the unit you're attached to via debug-hooks. | 13:43 |
| Zic | it switched to error then back to maintenance/executing | 13:43 |
| Zic | ok :) | 13:43 |
| lazyPower | ok, in your tmux session | 13:43 |
| lazyPower | there should be a new buffer open with the context listed | 13:43 |
| lazyPower | "upgrade-charm" for example | 13:43 |
| Zic | yep, I got the "This is a Juju debug-hooks tmux session." | 13:43 |
| lazyPower | do you see the hook listed in the tmux buffers? | 13:43 |
| lazyPower | i forget if that message prints for every buffer or not | 13:44 |
| lazyPower | i tend to just ignore that spam now :) | 13:44 |
| lazyPower | ok yeah, you're in the right context. i just trapped a hook to verify | 13:44 |
| lazyPower | Zic: from here, you can execute the hook manually, and attempt to gather more information. This buffer is loaded with all the juju env bits we set to make the agent operate | 13:45 |
| Zic | ok, so I'm trying to launch the python3 script that I killed before, right? | 13:45 |
| lazyPower | Zic: so hooks/upgrade-charm if you're in the upgrade charm context. it may not give you an indicator as to whats actually happening, we scrape stdout from here to pipe to the logs. | 13:45 |
| lazyPower | so if its just blank and hangs, time to start poking about to see if its network connectivity, or a locked apt daemon, or something similar | 13:46 |
| Zic | root@mth-k8stestmaster-01:/var/lib/juju/agents/unit-kubernetes-master-0/charm# hooks/upgrade-charm <= I think I'm in the right context :) | 13:46 |
| Zic | http://paste.ubuntu.com/24633743/ | 13:47 |
| Zic | it does not output after that | 13:47 |
| Zic | (but does not return prompt either) | 13:48 |
| lazyPower | Zic: so it appears that its held up attempting to install the wheelhouse | 13:50 |
| lazyPower | :S i'm not sure what to recommend here, i haven't encountered reactive failing to bootstrap before | 13:51 |
| lazyPower | and our resident reactive expert is out for Pycon | 13:51 |
| Zic | same here :D it's the first time I encounter this issue | 13:51 |
| lazyPower | Zic: not an ideal solution, but can you bug this with the steps to reproduce and i can pass this along to cory when he's back from pycon? | 13:52 |
| Zic | if you weren't here, I would reboot the master with anger and expect it recaps the installation :D | 13:52 |
| lazyPower | well | 13:52 |
| lazyPower | thats an option | 13:52 |
| Zic | huh :) | 13:52 |
| Zic | trying it \o/ | 13:52 |
| lazyPower | but if its halting here, i dont necessarily think rebooting will help | 13:52 |
| lazyPower | but its worht a shot | 13:52 |
| lazyPower | give it a go | 13:52 |
| Zic | in earlier time at my first try with Juju, I sometime rebooted the bad unit *and* the juju controller | 13:53 |
| Zic | sometime it recaps well | 13:53 |
| Zic | was long time ago before joining here o/ | 13:53 |
| Zic | oh, the upgrade-charm just gives me a traceback | 13:53 |
| Zic | maybe because it receives the ACPI signal to reboot | 13:54 |
| Zic | http://paste.ubuntu.com/24633780/ | 13:54 |
| Zic | don't know if it helps | 13:54 |
| Zic | unit-kubernetes-master-0: 13:56:02 INFO unit.kubernetes-master/0.juju-log Invoking reactive handler: reactive/kubernetes_master.py:88:install <= saw that at juju debug-log after reboot, so it restarted correctly but... no signs of life after that entry | 13:57 |
| lazyPower | aha | 13:57 |
| lazyPower | i have a couse of action for you now | 13:57 |
| lazyPower | File "/usr/local/lib/python3.5/dist-packages/charmhelpers/core/hookenv.py", line 956, in resource_get <-- | 13:57 |
| lazyPower | it was locked up waiting on juju to resource_get a resource | 13:58 |
| Zic | network issue? :o | 13:58 |
| lazyPower | so, lets start with least invasive action | 13:58 |
| lazyPower | can you re-attach to that unit and enter the debug-hook context again? | 13:58 |
| Zic | yup | 13:58 |
| lazyPower | same process, attach to unit, if its locked up, restart the agent daemon | 13:58 |
| Zic | hmm | 14:00 |
| Zic | the debug-hooks does not let me in the right context this time | 14:00 |
| Zic | root@mth-k8stestmaster-01:~# pwd | 14:00 |
| Zic | /home/ubuntu | 14:00 |
| Zic | the tmux buffer is just "bash" instead of "install" like earlier | 14:01 |
| lazyPower | right, when you first attach you only get a bash shell | 14:01 |
| lazyPower | so, recycle the agent now | 14:01 |
| lazyPower | systemctl restart jujud-unit-kubernetes-master-0 | 14:01 |
| Zic | ah yup | 14:01 |
| Zic | forgot this step sorry | 14:01 |
| Zic | ok, it's the right context now | 14:01 |
| lazyPower | now, lets try this manually and see if we get any further detail | 14:01 |
| lazyPower | resource-get kubernetes | 14:02 |
| lazyPower | i suspect its going to just be hanging like it was when invoked with python, but you never know | 14:02 |
| Zic | for now it's stucking yeah :) | 14:02 |
| lazyPower | ok, in another termina, lets attach to the controller and tail the controller logs | 14:02 |
| lazyPower | if there's an issue we should see some serious spam in there while this resource-get is constantly polling attempting to grab the resource | 14:03 |
| Zic | 2017-05-23 14:01:28 ERROR juju.rpc server.go:510 error writing response: write tcp 10.52.128.99:17070->10.52.128.24:59540: write: broken pipe | 14:04 |
| Zic | like this? | 14:04 |
| Zic | (I have it repeatedly) | 14:05 |
| lazyPower | that may be it | 14:07 |
| lazyPower | i would have expected something more descriptive | 14:07 |
| lazyPower | Zic: what version of the controller is this? | 14:07 |
| Zic | 2.1.2 | 14:08 |
| lazyPower | Zic: looks like you're getting bit by this https://bugs.launchpad.net/juju/+bug/1627127 | 14:09 |
| mup | Bug #1627127: resource-get gets hung on charm store <cdo-qa> <cdo-qa-blocker> <juju:Incomplete> <https://launchpad.net/bugs/1627127> | 14:09 |
| Zic | I feared that, as this test cluster is fully AWS (the production one is hybrid), I recreate the AWS SecurityGroup from scratch and mistaken somewhere, but normally it's openbar on private network | 14:10 |
| lazyPower | Zic: well there's also a defect in resource-get hanging like this | 14:10 |
| lazyPower | it should have returned null or error by now | 14:10 |
| lazyPower | instead of hanging indef. | 14:10 |
| Zic | always stuck with not returning the prompt :( | 14:10 |
| lazyPower | click the link at the top that this bug effects me, and add detail that you're able to reproduce deploying the bundle revision -23 (? i think?) | 14:11 |
| lazyPower | that'll help anastasiamac reproduce when it comes time to verify this bug again, as right now its incomplete and there's a good amount of back and forth about how to trigger this | 14:11 |
| Zic | need to recover my Launchpad infos, wait :) | 14:12 |
| lazyPower | Zic: and you'll get an update when its fixed too :) becase ya know, you interacted with the bug <3 | 14:12 |
| anastasiamac | lazyPower: repro would be awesome \o/ midnight here now so m clocking off but will read backscroll :D | 14:12 |
| lazyPower | anastasiamac: awe i didnt mean to ping you to bring you in here, my bad | 14:13 |
| lazyPower | cheers and will catch up with you tomorrow | 14:13 |
| anastasiamac | lazyPower: u did not ping ;) but i heard it all the way from there :D | 14:13 |
| Zic | lazyPower: added | 14:23 |
| lazyPower | Zic: fantastic, thanks for that. Now we're in a situation where we have to wait :S | 14:24 |
| lazyPower | Zic: correct me if i'm wrong, but this was just on the initial install of that older bundle rev yeah? | 14:24 |
| Zic | yup | 14:24 |
| lazyPower | ok | 14:24 |
| lazyPower | i know how you can work around this | 14:24 |
| lazyPower | so we dont have to wait but it wont be as clean as drag and drop | 14:25 |
| Zic | the only special case is that I'm using manual provisionning | 14:25 |
| lazyPower | in that bundle, it specifies individiual releases of charms... eg: kubernetes-master-12 | 14:25 |
| Zic | (even if it's fully on AWS, because our Internal system manage AWS instance on its own...) | 14:25 |
| lazyPower | if you go to http://jujucharms.com/u/containers/$charm (including revno) | 14:25 |
| lazyPower | you can grab the resources for that charm on the right hand sidebar of that page | 14:25 |
| lazyPower | then once you juju deploy that bundle, you can juju attach $charm kubernetes=kubernetes.tar.gz as an example | 14:26 |
| lazyPower | so you'll need to manually attach the resources, but it will get you unblocked | 14:26 |
| lazyPower | :( sorry that this isn't as smooth as it could be | 14:26 |
| Zic | https://jujucharms.com/u/containers/kubernetes-master-12/ is 404 :) | 14:27 |
| lazyPower | gah | 14:29 |
| lazyPower | s/-12/\/12/ | 14:29 |
| lazyPower | also i dont know that thats the release you need | 14:30 |
| lazyPower | i was using 12 as an example | 14:30 |
| lazyPower | i think you're on rev 21 of master in that bundle... | 14:30 |
| Zic | lazyPower: just get the 12 from my juju status | 14:34 |
| Zic | it's the charm revision of kubernetes-master, right ? | 14:35 |
| Zic | or the revision of the charm-bundle? | 14:35 |
| lazyPower | Zic: the charm revision | 14:55 |
| Zic | lazyPower: do I need to restart the deploying of canonical-kubernetes from scratch ? | 14:57 |
| lazyPower | Zic: you should be able to attach those resources and recycle the agent and it should unstick the deployment | 14:57 |
| Zic | cool | 14:57 |
| Zic | for attaching from CLI, what do I need? I think I'm mistaken "add-relation" and "attach" in my minds | 14:58 |
| lazyPower | Zic: juju attach --help (on your workstation) | 15:00 |
| lazyPower | Zic: and https://jujucharms.com/docs/2.0/developer-resources#adding-resources for reference | 15:01 |
| Zic | lazyPower: oh, it's what I thought, I'm mistaken attach vs. relation | 15:10 |
| Zic | thought it was relation to do manually :) | 15:10 |
| Zic | I'm OK with attach so :D | 15:10 |
| Zic | lazyPower | you can grab the resources for that charm on the right hand sidebar of that page | 15:26 |
| Zic | kubernetes.gz is not clickable :D | 15:26 |
| lazyPower | Zic: from the revision specified in the bundle | 15:27 |
| lazyPower | yeah | 15:27 |
| lazyPower | make sure thats 1:1, i wouldn't recommend trying to use a different revision of the resource than what is published for the charm you're deploying | 15:27 |
| lazyPower | eg if you have kubernetes-master-12, then grab the resources off the right sidebar from https://jujucharms.com/u/containers/kubernetes-master/12/ | 15:27 |
| Zic | yup but how can I *grab* it? you mean download locally right? | 15:28 |
| Zic | lazyPower: in https://jujucharms.com/u/containers/kubernetes-master/ (19th revision, the latest), ressources are clickable and downloadable, but for my revision 12th, ressources are not clickable either downloadable | 15:36 |
| lazyPower | :/ i'm not sure why that would be the case, resources are supposed to persist for the lifetime of the charm | 15:36 |
| Zic | lazyPower: https://jujucharms.com/u/containers/kubernetes-master/12/ can you get the kubernetes.gz ressource on this page? | 15:38 |
| Zic | (I'm using Firefox) | 15:38 |
| lazyPower | rick_h: is there an API hack i can use to view this charm resource and determine why there's no downloadable resource? | 15:39 |
| lazyPower | Zic: the only thing i can figure is somehow the charm got disassociated with a resource at this revision, and thats not going to be fun | 15:39 |
| Zic | :'( | 15:39 |
| lazyPower | as i have no clue what resource would go with that revision, its quite old | 15:39 |
| rick_h | lazyPower: looking at what we're up to | 15:40 |
| rick_h | lazyPower: https://api.jujucharms.com/charmstore/v5/~containers/kubernetes-master/meta/resources ? | 15:41 |
| rick_h | lazyPower: e.g. https://api.jujucharms.com/charmstore/v5/~containers/kubernetes-master-12/meta/resources | 15:41 |
| lazyPower | rick_h: https://api.jujucharms.com/charmstore/v5/~containers/kubernetes-master/12/meta/resources doesn't seem tow ork with a revision in the url | 15:41 |
| lazyPower | oh | 15:41 |
| lazyPower | ofcourse :) the format changes | 15:41 |
| rick_h | lazyPower: yea, our bad for old vs new url format mixups | 15:41 |
| Zic | lazyPower: lurking a bit and found that https://api.jujucharms.com/charmstore/v5/~containers/kubernetes-master-12/resource/kubernetes/1 | 15:41 |
| Zic | is this good? | 15:42 |
| lazyPower | yeah there's nothing there... | 15:42 |
| lazyPower | its got no fingerprint on the listing | 15:42 |
| lazyPower | whoa | 15:42 |
| lazyPower | what kind of wizardry is this | 15:42 |
| Zic | :> | 15:42 |
| lazyPower | rick_h: your api skills surpass mine in every way, i have no clue how you found that | 15:42 |
| lazyPower | oh snap and zic found it to boot | 15:43 |
| lazyPower | i need new glasses | 15:43 |
| rick_h | lazyPower: https://api.jujucharms.com/charmstore/v5/~containers/kubernetes-master/meta goes to list all the bits available | 15:43 |
| lazyPower | i think thats a sign i need to take my lunch before i head into a sig meeting | 15:43 |
| rick_h | lazyPower: so that lead to /meta/resources (and then the revision trick) | 15:43 |
| rick_h | lazyPower: :) | 15:43 |
| Zic | lazyPower: is this "1" file which seems to be a tar.gz archive containing kube-* binary is the kubernetes.gz you expect? | 15:45 |
| Zic | if yes, mv 1 kubernetes.tar.gz and I will continue your steps :) | 15:46 |
| Zic | hmm, tried a ./kubectl --version of the binary inside | 15:46 |
| Zic | it's 1.4.0-beta.10 | 15:47 |
| Zic | not my version :( | 15:47 |
| lazyPower | Zic: time to walk through the revisions until you find the resource required. i hvae no clue whats going on in those older charm revs :| we were kind of a guinepig with resources | 15:48 |
| lazyPower | Zic: you need 1.5.1 right? | 15:49 |
| Zic | 1.5.3 | 15:50 |
| Zic | http://paste.ubuntu.com/24634572/ | 15:51 |
| lazyPower | Zic: try master rev 19 | 15:51 |
| lazyPower | that should have 1.5.3 | 15:51 |
| lazyPower | might be 18... but right around that range. | 15:51 |
| Zic | what I did not understand is why I have Rev 12 in the production cluster with kubernetes-master 1.5.3 | 15:52 |
| Zic | is the revision number is incorrect in this juju status? | 15:52 |
| lazyPower | Zic: did you attach a resource package post deployment? | 15:52 |
| Zic | nop :x | 15:53 |
| lazyPower | i have no idea how this happened | 15:53 |
| lazyPower | i'm just as baffled as you are :S | 15:53 |
| Zic | this cluster in 1.5.3 is "one version" before 1.7.1 | 15:53 |
| lazyPower | to my knowledge nobody on the k8s team has gone back and refreshed resource revisions attached to a charm rev | 15:53 |
| Zic | we waited so long to upgrade it because 1.7.1 needs an outage maintenance (+ some test on our side) | 15:53 |
| lazyPower | so what we published with is what should be attached to the charms | 15:54 |
| lazyPower | waiiit | 15:54 |
| lazyPower | Zic: | 15:54 |
| lazyPower | i know why we're seeing the version mismatch now | 15:54 |
| lazyPower | promulgated version vs namespace version. the promulgated charm is just a pointer to a charm rev in the namespace | 15:54 |
| cmars | tvansteenburgh, hi, i'm trying to get that zetcd snap to work in a charm, https://github.com/cmars/charm-zetcd | 15:55 |
| lazyPower | let me see if thats the case | 15:55 |
| cmars | tvansteenburgh, but, i can't seem to connect to zetcd with zkctl | 15:55 |
| lazyPower | cmars: he's afk for a bit headed to pickup his fam | 15:55 |
| cmars | lazyPower, ack, thanks | 15:56 |
| tvansteenburgh | just got back :) | 15:56 |
| lazyPower | Zic: thats not it - https://jujucharms.com/kubernetes-master/ is not a promulgated charm. so we only point at the namespace | 15:56 |
| tvansteenburgh | cmars: does this help https://github.com/tvansteenburgh/zetcd-snaps | 15:56 |
| lazyPower | Zic: yeah i have no idea why thats the case :( i'm sorry i dont have better details. | 15:56 |
| tvansteenburgh | cmars: i only tested with the example from the upstream zetcd readme | 15:56 |
| cmars | tvansteenburgh, ok. might be that i'm trying to connect it to cs:~containers/etcd | 15:57 |
| Zic | Client Version: version.Info{Major:"1", Minor:"4+", GitVersion:"v1.4.0-beta.11", GitCommit:"4b28af1232cc52da453eb4ebe3dc001314a1f99b", GitTreeState:"clean", BuildDate:"2016-09-23T22:53:01Z", GoVersion:"go1.6.3", Compiler:"gc", Platform:"linux/amd64"} | 15:58 |
| Zic | oops | 15:58 |
| Zic | bad pasting, let my try again... | 15:58 |
| Zic | lazyPower: Client Version: version.Info{Major:"1", Minor:"4+", GitVersion:"v1.4.0-beta.11", GitCommit:"4b28af1232cc52da453eb4ebe3dc001314a1f99b", GitTreeState:"clean", BuildDate:"2016-09-23T22:53:01Z", GoVersion:"go1.6.3", Compiler:"gc", Platform:"linux/amd64"} | 15:58 |
| Zic | RAH | 15:58 |
| Zic | :'( | 15:58 |
| * Zic needs coffee | 15:59 | |
| Zic | third try, I can do it | 15:59 |
| Zic | lazyPower: https://api.jujucharms.com/charmstore/v5/~containers/kubernetes-master-19/resource/kubernetes/9 | 15:59 |
| Zic | lazyPower: found the 1.5.3 here | 15:59 |
| Zic | don't ask me "why 9" | 15:59 |
| Zic | but the /9 contains the 1.5.3 binary | 15:59 |
| lazyPower | our api confuses me. | 15:59 |
| lazyPower | i feel you | 16:00 |
| Zic | :} | 16:00 |
| Zic | lazyPower: does this mismatch displayed version can have significant problem when I will upgrade to the latest charms? | 16:00 |
| Zic | or it's just a displaying bug? | 16:01 |
| lazyPower | Zic: you'll be moving to snap packging | 16:01 |
| lazyPower | we can make more garantees there | 16:01 |
| lazyPower | Zic: you'll be in a track and always at tip of that track. | 16:01 |
| Zic | ok | 16:02 |
| Zic | I think I will giving up the goal of building a "clone cluster" in 1.5.3 tho :( | 16:02 |
| Zic | will directly test the upgrade in prod and *feared* :| | 16:03 |
| lazyPower | Zic: whats your scheduled time to do this upgrade? | 16:09 |
| lazyPower | Zic: i can spend some time either this evening or tomorrow morning running down the resources/revisions you have deployed and get something setup so we can test thsi without running a science experiment in prod | 16:09 |
| lazyPower | Zic: but i'm neck deep in trying to vet some code for a release today and i'm close to finishing. so i need the remainder of the day to finish this work up. | 16:10 |
| Zic | lazyPower: we can schedule that together, I don't want to impose you a date as it's for my work and you are just here as community help (my company decline the Canonical offers, sadly :/) | 16:11 |
| lazyPower | Zic: you're a valuable contributing member, you file bugs. i'm willing to help | 16:11 |
| lazyPower | but i appreciate you being respectful of my time as well | 16:11 |
| lazyPower | so let me rund own the resources you need, and we'll go from there. | 16:12 |
| lazyPower | Zic: ill work off of http://paste.ubuntu.com/24634572/ and we can unwind from there | 16:12 |
| Zic | ask me all you need, we are on different timezone (UTC+2 for info) and I'm on office from 10->19h, but I can lurk on IRC from home if needed | 16:14 |
| Zic | lazyPower: for http://paste.ubuntu.com/24634572/ for example, as displayed charm rev is maybe false, if I have a way of manually retrieving the good rev, tell me :) | 16:20 |
| lazyPower | Zic: /var/lib/juju/agents/unit-kubernetes-master/charm/revision | 16:23 |
| lazyPower | i suspect it says "12" though | 16:23 |
| Zic | it said... "0" | 16:24 |
| Zic | xD | 16:24 |
| Zic | # cat /var/lib/juju/agents/unit-kubernetes-master-0/charm/revision | 16:24 |
| Zic | 0 | 16:24 |
| vlad_ | Hey guys anyone here to field a quick question? | 16:25 |
| Zic | can I throw something violently on the wall? :) | 16:25 |
| vlad_ | If you answer my question then yes for sure | 16:25 |
| Zic | vlad_: huhu, sorry, was not for you :) | 16:25 |
| vlad_ | Zic: ahh ok no worries | 16:25 |
| vlad_ | So I'm deploying a PoC juju/openstack cloud an want to deploy my juju controller to a specific node... is there a way to do this? (I looked but couldn't find anything obvious) | 16:26 |
| vlad_ | Also I should clarify that I'm using maas as my machine provider | 16:27 |
| lazyPower | vlad_: you can specify a machine tag and tag that machine in maas | 16:28 |
| Zic | vlad_: I'm on manual provisionning so it's maybe incompatible with your case, but for me, it's like that: juju bootstrap manual/host.name.of.the.machine.which.host.the.controller cdk | 16:28 |
| lazyPower | vlad_: juju bootstrap --help there's anotion of bootstrap constraints. and in that constraint list, you can specify the maas tag. | 16:28 |
| vlad_ | lazyPower: thanks that's awesome didn't realize how deep constraints went. | 16:29 |
| vlad_ | Zic: Thank you as well! | 16:29 |
| Budgie^Smore | o/ Juju world | 16:34 |
| hatch | o/ Budgie^Smore | 16:35 |
| lazyPower | \o Budgie^Smore | 16:44 |
| rick_h | Budgie^Smore: are we chatting today? | 17:02 |
| Budgie^Smore | yeah, was just pulling your number up... thought you were calling me for a min ;-) | 17:03 |
| rick_h | Budgie^Smore: hangout! link in the calendar invite | 17:03 |
| rick_h | Budgie^Smore: let me know if that doesn't work out | 17:03 |
| === frankban is now known as frankban|afk | ||
| jackjohnsmith | ^_^ | 18:23 |
| jackjohnsmith | remove it | 18:23 |
| jackjohnsmith | remember felisha? | 18:23 |
| jackjohnsmith | sure canadian gov isnt looking for a smell is it? | 18:24 |
| === jackjohnsmith is now known as H0LYR3V3NG3 | ||
| H0LYR3V3NG3 | rdy for a file top prevent visual | 18:28 |
| H0LYR3V3NG3 | prison? | 18:28 |
| H0LYR3V3NG3 | i know ur in csis body thats why im here | 18:28 |
| === H0LYR3V3NG3 is now known as jesse9 | ||
| jesse9 | get it | 18:31 |
| xModeMunx | Hi all. I'm new to juju, and just starting up a new cluster to test. This is an openstack "enterprise" local configuration. | 19:05 |
| xModeMunx | Am I able to provision the infrastructure via the online tool? Or am I not doing it right? | 19:05 |
| xModeMunx | I can't quite tell if this can be used as a "private" tool. I can register juju-cli as a cloud for my local maas configuration. So what are my limitations? :-/ | 19:06 |
| rick_h | xModeMunx: so you can use the Juju CLI to bootstrap to a "private" openstack, or a local maas | 19:07 |
| rick_h | xModeMunx: from there you get a juju gui embedded into that Juju controller that you bootstrap so you get a bit of the online experience but self contained | 19:08 |
| xModeMunx | rick_h: I have got to that stage so far. So, i've bootstrapped and via the cli I can poll some basic things to test. So, onward to "configuring" my openstack deployment, how can I go about this? | 19:08 |
| rick_h | xModeMunx: oic, so you've used Juju to deploy openstack on top of MAAS? | 19:08 |
| rick_h | xModeMunx: to configure the openstack you can use Juju to provide some application level configuring for each OpenStack service or go to OpenStack (horizin dashboard for instance) to manage the OpenStack from there. | 19:09 |
| xModeMunx | rick_h: I haven't /yet/ deployed anything via juju. I have literally installed maas, added 2x "to-be" compute nodes, and 1x "to-be" controller node. | 19:09 |
| rick_h | beisner: and others from the team that managed the openstack work would be able to help drop hints as to how to configure different bits you're interested in. | 19:09 |
| rick_h | xModeMunx: oic, so it might be useful to try the conjure-up to help do a sample/test install. It kind of guides/walks through the process a bit more than a manual deploy | 19:10 |
| xModeMunx | I have previously built OS from scratch, but having seen this tool, it seems I can alleviate mych of the efforts. | 19:10 |
| xModeMunx | rick_h: ah, awesome, i'll give that a go now :-) | 19:10 |
| rick_h | https://www.ubuntu.com/download/cloud/conjure-up check out https://docs.ubuntu.com/conjure-up/en/#getting-started | 19:11 |
| stokachu | and im here as well to help answer questions | 19:11 |
| stokachu | xModeMunx: ^ | 19:11 |
| xModeMunx | stokachu: Waw, you guys are probably the friendliest irc people ever :-D | 19:12 |
| rick_h | xModeMunx: cool, yea hit up stokachu and others if you hit anything | 19:12 |
| xModeMunx | Much appreciated guys. Let me go have a read, and see where it leads. Is this considered production ready btw? Cos it it proves useful, it may make its way into my next "real" work lab deployment. | 19:13 |
| rick_h | xModeMunx: yes, this is the same stack of tools we use to support our paying OpenStack customers. | 19:17 |
| xModeMunx | Thanks Rick. Are you part of the canonical support guys? | 19:17 |
| rick_h | Just they get a nice phone number to call and some PDF files to go with it :) | 19:17 |
| rick_h | xModeMunx: no, we're more the dev engineer side. | 19:18 |
| * rick_h has to run biab | 19:18 | |
| xModeMunx | ah, I see. The "real" men ;-) | 19:18 |
| jesse9 | anywho i hacked all of you | 19:23 |
| jesse9 | goodluck logging into anything | 19:23 |
| xModeMunx | ```Set automatic aliases for snap "conjure-up" (cannot enable alias "juju" for "conjure-up", it conflicts with the command namespace of installed snap "juju")``` | 19:23 |
| xModeMunx | Seems the first hurdle has presented itself. | 19:23 |
| stokachu | xModeMunx: sudo snap remove juju | 19:23 |
| stokachu | xModeMunx: conjure-up provides its own | 19:24 |
| xModeMunx | stokachu: Ahh. Even this snap stuff is new to me. I must be getting old :-( | 19:24 |
| stokachu | xModeMunx: im right there with you | 19:24 |
| bdx | Sandbox2016! | 19:58 |
| bdx | well | 19:59 |
| xModeMunx | Am I correct to view conjure as a terminal-based alternative to the online juju architect design tool? | 20:10 |
| stokachu | xModeMunx: to some extent, we go further and provide you with helpful guidance to configure your deployment | 20:11 |
| stokachu | we can also make adjustments for deploying openstack and kubernetes on a single local machine | 20:11 |
| xModeMunx | stokachu: I see. Thanks for the clarity. | 20:11 |
| stokachu | bdx: are you handing out passwords again? | 20:12 |
| bdx | the problem with being overzealous to login to your pc before the screen turns on and you realize it wasn't sleeping and your irc window had the context | 20:14 |
| * bdx weeping | 20:14 | |
| stokachu | lol | 20:16 |
| stokachu | ive done that before too | 20:16 |
| * lazyPower starts poke-checking known accounts for bdx | 20:17 | |
| * bdx wipes all reminisce of known string | 20:17 | |
| lazyPower | good plan :) I tease anyway ;) | 20:18 |
| bdx | lazyPower: its cool ... keep it up ... as long as you enlighten me to what this "CAAS" thing is while you are at it :) | 20:23 |
| bdx | crickets | 20:26 |
| bdx | :) | 20:26 |
| rick_h | bdx: you causing trouble :P | 20:29 |
| lazyPower | bdx: its a WIP, thats what it is :) | 20:35 |
| lazyPower | or an experiment? i forget which | 20:35 |
| lazyPower | maybe both | 20:35 |
| xModeMunx | if/when this conjure install finishes, and it works. I will consider it quite magical. | 20:41 |
| xModeMunx | I think it stalled. I crtl+c'd. Maybe I shouldn't have :-| | 21:09 |
| stokachu | depending on your hardware it could take up to an hour | 21:17 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!