hpidcockthumper: looking00:09
thumperhpidcock: ta01:32
kelvinliujust pushed and released the new mariadb and mediawiki testing charms for CI,  got this tiny PR to upgrade those charms for test, anyone got 1min to take a look plz? thank you https://github.com/juju/juju/pull/1173802:42
kelvinliuand https://github.com/juju/juju/pull/11739 ports the change to develop02:42
* thumper looks at kelvinliu's branch03:45
thumperkelvinliu: good to go03:45
hpidcocklooking thumper03:50
Chipacathumper: đź‘‹05:06
thumperah poo05:25
thumpersorry Chipaca05:25
thumperChipaca: got busy watching some testing05:25
thumperand for whatever reason, didn't actualy create a calendar item05:26
thumperChipaca: I could chat now for a bit if you are still around05:27
thumperthis was on me sorry, I should have made the calendar entry, then I would have remembered05:27
jamthumper, I think he went back to sleep, but we'll plan for it next week05:30
thumperjam: ok, sorry05:30
Chipacathumper: you are forgiven :-) i got a nice early run out of it (the "go back to bed" plan didn't pan out)08:26
Chipacathe sleep-deprived me of 10 years ago scoffs at current-day me08:26
=== Guest84896 is now known as psydroid
=== narindergupta is now known as narinderguptamac
Eryn_1983_FLhi guys14:24
Eryn_1983_FLso i am trying to figure out what logs i need to pull for ssl cert issues on openstack/juju14:24
Eryn_1983_FLbarbican/1*                  waiting   idle   0/lxd/7     9311/tcp,9312/tcp  'shared-db' incomplete14:24
Eryn_1983_FL  barbican-vault/11*         blocked   idle                          'secrets-storage' missing14:24
Eryn_1983_FLi think something is wrong with the vault14:24
hmlEryn_1983_FL: try “juju debug-log —include unit-barbican-1 —include unit-barbican-vault-1 —replay”   these are the logs for those 2 units14:26
Eryn_1983_FLjuju debug-log —include unit-barbican-1  â€”include unit-barbican-vault-1 —replay14:27
Eryn_1983_FLERROR unrecognized args: ["—include" "unit-barbican-1" "—include" "unit-barbican-vault-1" "—replay"]14:27
hmlEryn_1983_FL: sorry… things got auto corrected on me.  the include and replay args use 2 dashes.14:29
hmlEryn_1983_FL:  hrm.. just those 53 lines?   what are your logging levels set to?  â€śjuju model-config logging-config”14:34
hmlwas there anything for barbican-vault?14:34
Eryn_1983_FLthats all that came out14:34
Eryn_1983_FL juju model-config logging-config14:34
Eryn_1983_FLi dont see it14:35
hmlEryn_1983_FL: can we change it to “juju model-config logging-config=`<root>=WARNING;<unit>=DEBUG`” ?14:36
Eryn_1983_FLi can try..14:36
Eryn_1983_FLback ticks?14:36
hmlEryn_1983_FL:  yes, or quotes work too14:37
Eryn_1983_FLgot it14:37
Eryn_1983_FLmaybe its been too long and the errors were last week when we done it14:38
hmlEryn_1983_FL: unfortunately that will only change for logs moving forward… has the charm with the relation for “shared-db” deployed?14:39
hmlwhat’s the db’s status?14:39
Eryn_1983_FLbarbican/1*                  waiting   idle   0/lxd/7     9311/tcp,9312/tcp  'shared-db' incomplete14:39
Eryn_1983_FLi dont think so14:39
Eryn_1983_FLcan we rip out and start over?14:41
hmlEryn_1983_FL:  looks like the db is in an error state.14:41
Eryn_1983_FLthe vault and barbican14:41
hmlEryn_1983_FL: i’d get the db happy - then see what happens with barbican14:42
rick_hpetevg:  did you bootstrap to the cluster? I'm failing to bootstrap at "Contacting controller to verify accessibility" and wonder what I've missed14:50
jamespageEryn_1983_FL: is barbican directly related to mysql-innodb-cluster? it really should be related via a mysql-router subordinate14:57
jamespagethat might be the cause of the shared-db-relation-departed errors14:58
Eryn_1983_FLnot sure15:01
Eryn_1983_FLhe just restarted15:01
Eryn_1983_FLill see what happens after the reinstalls15:05
Eryn_1983_FLok guys how do i fix the certs15:40
Eryn_1983_FLvault is initalized and i got the keys15:40
rick_hpetevg:  what's your az --version output looking like?15:56
petevgrick_h: 2.5.1 *15:57
petevgFull paste:15:57
rick_hpetevg:  ok, far ahead of me even on the edge snap then. Let me try all this with your version. You confirmed you got it from the deb link in your email?15:58
rick_hgeeze, nothing like pipe to bash...16:00
petevgrick_h: I don't think that I got it w/ the deb link. I'm actually not sure what I did to install :-/16:01
rick_hpetevg:  ok, well getting 2.7 from the deb link now so will try that16:02
Eryn_1983_FLare there juju ovn docs i can use that are for this kind of deployment?16:02
hmljamespage: ^^16:07
Eryn_1983_FLanyideas what i should do rick_h ?16:13
rick_hEryn_1983_FL:  what to do about using vault? I'm not familiar with driving that tbh.16:16
Eryn_1983_FLallright who do i gotta murder to get this working right,16:17
rick_hEryn_1983_FL:  configuring, managing, etc. Looking at the traceback to see what the ask is. You mention having keys?16:17
Eryn_1983_FLvault is open we got keys16:17
Eryn_1983_FLhow do i resolve the certificate missing error16:17
rick_hEryn_1983_FL:  this is maintained by the openstack team. They've written the charms and know how to hold them right to dance for you.16:17
Eryn_1983_FLnetwork wont build yet16:17
rick_hEryn_1983_FL:  that looks like a missing relation16:17
rick_hEryn_1983_FL:  juju status --relations16:18
rick_hEryn_1983_FL:  do you see a relation on barbican-vault and vault?16:18
Eryn_1983_FLRelation provider                      Requirer                                         Interface                       Type         Message16:18
Eryn_1983_FLbarbican-mysql-router:shared-db        barbican:shared-db                               mysql-shared                    subordinate16:18
Eryn_1983_FLbarbican-vault:secrets                 barbican:secrets                                 barbican-secrets                subordinate16:18
rick_hEryn_1983_FL:  oh, but your vault is in an error state "hook failed: update-status"16:18
rick_hEryn_1983_FL:  so you have to mark it resolved and get it to kick again16:18
rick_hEryn_1983_FL:  juju resolve vault/016:19
rick_hEryn_1983_FL:  might have to look at the log file on vault to see why update-status is erroring16:19
Eryn_1983_FL juju resolve vault/016:19
Eryn_1983_FLERROR unit "vault/0" is not in an error state16:19
rick_hEryn_1983_FL:  ok, looking at your paste, is it ready now then?16:19
Eryn_1983_FLhere let me make anew one16:20
Eryn_1983_FLvault says read and active.16:21
rick_hEryn_1983_FL:  ok, good there. I do see this though16:21
rick_h  barbican-mysql-router/0*       error     idle                          hook failed: "install"16:21
rick_hEryn_1983_FL:  so have to check out why that's unhappy16:21
Eryn_1983_FLpulling logs16:22
Eryn_1983_FLwould that prevent the ovn  certs from being there16:23
rick_hEryn_1983_FL:  no idea on that one. That's the question for the openstack folks. They have a community setup for the charms that would be good to check with. Let me get the link16:23
Eryn_1983_FL juju debug-log --include barbican-mysql-router-0  --replay  is this suppose to take forever?16:24
Eryn_1983_FLthank rick we been at this for months16:24
rick_hEryn_1983_FL:  hmm, I'd suggest just juju ssh barbican-mysql-router/016:24
rick_hEryn_1983_FL:  and from there less /var/log/juju/unit<tab>16:24
rick_hand it'll complete the unit name and get you into the unit log16:24
* rick_h is old school and wants to see the log file for himself I guess16:24
Eryn_1983_FLrick_h is teaching me the ways of the kungu fu of juju16:26
rick_hEryn_1983_FL:  lol you're getting the same thing I am on a k8s install right now16:26
rick_hmystery error16:27
rick_hEryn_1983_FL:  what version of Juju?16:27
* rick_h hopes you saying 2.8.016:27
rick_hpetevg:  ^ same error, on a MAAS, 2.8.016:27
Eryn_1983_FLjuju version16:27
rick_hmanadart_:  achilleasa anyone around? this is kinda :(16:27
rick_hEryn_1983_FL:  I've been working to pull notes together to file one today.16:27
Eryn_1983_FLwell im going to go fight with openstack peeps,16:28
rick_hEryn_1983_FL:  ok, well good news you're not alone and I don't think this is you. Bad news is I don't know why we're getting this error and have to chase down smarter folks that work on Juju to HALP!16:28
Eryn_1983_FLsee who wins16:28
rick_hEryn_1983_FL:  lol well you can check on the certs working order, but they're not going to be able to help much with this issue16:29
Eryn_1983_FLovn vs openvswitch?16:29
Eryn_1983_FLboss is wanting to put in openvswitch instead16:29
rick_hEryn_1983_FL:  yea, they can help more with that. fnordahl is a bit of an expert there and might be able to help but we'll see16:31
pmatulisEryn_1983_FL, you just need to pass a CA cert to vault16:42
petevgrick_h: catching up on the backscroll (I'm technically at lunch right now): I don't see the Juju bug? I do know that vault can be tetchy about certificates, and the OpenStack folks can help out w/ that.16:42
petevgSpeaking of the OpenStack folks, I see that pmatulis has jumped in. Thx!16:43
pmatulisEryn_1983_FL, juju run-action --wait vault/leader generate-root-ca16:43
pmatulisEryn_1983_FL, please tell me what documentation you were following so i can improve16:44
rick_hpetevg:  it's the exit 1 error on install that got hit on there as well.16:44
manadart_rick_h: I have failures connecting to both achive.ubuntu.com and the charm store. Failed charm deployment earlier, now I can't bootstrap.16:46
petevgrick_h: right. Which I think has to do w/ certs not being generated. Things fail in really bad ways if your vault isn't set up properly. (Security software is always a headache.) I'll keep an eye on the convo -- if there is a bug in Juju, I'd definitely like to get it filed and fixed.16:46
Eryn_1983_FLim not sure what he followed16:47
pmatulisEryn_1983_FL, i see, you are helping someone else? (too much backscroll, sorry)16:47
Eryn_1983_FLits cool16:48
Eryn_1983_FLno worries16:48
Eryn_1983_FLhe install openvswitch now16:48
Eryn_1983_FLnow i we got sqllite errors on octavia16:52
Eryn_1983_FLhow do i get missing relations i need neutron-plugin and messaging16:54
rick_hmanadart_:  yea, I'm seeing the archive one now I think16:57
rick_hmanadart_:  the issue seems to be that things hang/don't get marked as an error so there's no retry/etc path really16:57
Eryn_1983_FLanybody know where octavia stores it sqlite db17:07
jamespageEryn_1983_FL: https://docs.openstack.org/project-deploy-guide/charm-deployment-guide/latest/app-ovn.html is the general deployment guide for the charms (that section covers ovn)17:23
jamespageoctavia - https://docs.openstack.org/project-deploy-guide/charm-deployment-guide/latest/app-octavia.html17:24
jamespageapologies - you caught me at me end of day17:24
jamespageI see pmatulis is helping as well17:24
Eryn_1983_FLi think we are going to try this doc17:28
Eryn_1983_FLand see if that helps us solve some issues,17:28
Eryn_1983_FLsigh i swear every time we try to install something it breaks something else17:35
Eryn_1983_FLnow the networks are down on two machines17:36
rick_hkwmonroe:  ping, when you get a few can I bug you please for k8s info for the demo prep?17:48
kwmonroeping away rick_h17:49
rick_hkwmonroe:  https://meet.google.com/zhg-vdsi-rgi?authuser=1 I'll bring a list :)17:50
Eryn_1983_FLi got a wacked error19:25
Eryn_1983_FL    raise SourceConfigError(19:25
Eryn_1983_FLcharmhelpers.fetch.SourceConfigError: Invalid Cloud Archive release specified: bionic-train on this Ubuntuversion (focal)19:25
Eryn_1983_FLfor ovn19:25
josephillipssomeone know what is the cicle of the charms i mean what is the charm i cna download normaly from juju19:26
josephillipsin github from stable?19:26
josephillipsstable/year.month right?19:26
Eryn_1983_FLhi guys we are trying to do https://docs.openstack.org/project-deploy-guide/charm-deployment-guide/rocky/app-certificate-management.html19:36
petevgjosephillips: I'm not sure what you're asking?19:43
petevgYou can visit the charmstore at https://jaas.ai/store19:43
petevgIf you want to deploy a charm on a machine from a specific ubuntu release, you can do that by adding the --series flag to the juju deploy command.19:44
petevgIf you want to deploy a specific charm revision, you do so by specifying it like so:  juju deploy cs:<charm>-<revision>19:45
tvansteenburghhello juju friends19:47
tvansteenburghi've got a bundle where i deploy some stuff "to: [lxd:0, lxd:1]" etc...19:48
tvansteenburghwhen the dust settles i've got one lxd with both and ipv4 and ipv6 address, and the rest have ipv6 addresses but no ipv419:49
tvansteenburghis there a way to tell juju, "hey, give all my lxds an ipv4 address"19:49
rick_htvansteenburgh:  :/ since Juju normally hates that ipv6 on lxd that's surprising. Is the host machine setup with some custom lxd config?20:07
tvansteenburghrick_h: no, nothing custom. it's a machine newly provisioned by maas20:07
tvansteenburghrick_h: the machines *are* getting both ip4 and 6 addresses20:08
tvansteenburghwhich is fine, i'm just not sure what's happening with lxd20:08
rick_hkwmonroe:  do we have any default alerts/dashboards for graylog that are interesting?20:29
Eryn_1983_FL hey guys how do i get the ca private key from openstack20:42
kwmonroerick_h: unfortunately we don't have any default dashboards for graylog.  we leave it completely up to the user as to what log they choose to care about.  that said, graylog's UI is pretty good for drilling down.  the System->Inputs->Show Recvd Msgs gives you a host of fields that you can drill on.  It's not a dashboard, but it's still pretty powerful ootb.21:00
rick_hkwmonroe:  yea, all good just checking21:02
rick_hpetevg:  lol well found the memory limits on kvm pods on guimaas21:06
rick_h21 deployed machines and it's cranky now21:06
hmlrick_h: that’s it?  :-D21:11
rick_hhml:  well a few are hardware, but 15 vms nuc4 cried uncle and said no more21:12
rick_hbut my juju status is now scrolling off the terminal so I just got it going well enough lol21:13
kwmonroerick_h: tvansteenburgh, can you come back to me in https://meet.google.com/zhg-vdsi-rgi?authuser=1 re: dashboards21:23
rick_hkwmonroe:  yea omw21:31
tlmvery tiny PR if anyone has two seconds https://github.com/juju/juju/pull/1174222:09
kwmonroerick_h: remove-unit --force doesn't mess around.22:39
rick_hkwmonroe:  yea, it's pretty brutal23:50

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!