/srv/irclogs.ubuntu.com/2017/07/06/#juju.txt

=== tris- is now known as tris
=== stokachu_ is now known as stokachu
=== cargonza_ is now known as cargonza
=== frankban|afk is now known as frankban
cnfmorning08:54
cnfso anyone around that can help me figure out why juju isn't putting ip's in my containers even though i have the correct constraint on the services?08:57
wpkWhat's the setup?08:58
cnfi used to do it fine, it stopped doing it when i upgraded to the latest version09:00
cnfwpk: running on MaaS09:00
wgrantcnf: It's not adding the extra interfaces to the containers?09:01
cnfwgrant: right09:01
wgrantcnf: Juju 2.2.0? That's fixed in 2.2.1.09:02
cnfwgrant: it _is_ getting ip's from maas...09:02
cnfoh09:02
cnfso i need to upgrade again09:02
cnfcan you link the bug?09:02
wgrantcnf: https://bugs.launchpad.net/juju/+bug/169844309:02
mupBug #1698443: Juju-2.2 does not create interfaces in an LXD for all spaces <4010> <canonical-bootstack> <containers> <cpe> <cpe-sa> <eda> <maas-provider> <network> <juju:Fix Committed by wpk> <juju 2.2:Fix Released by wpk> <https://launchpad.net/bugs/1698443>09:02
cnfthanks09:02
cnfhmz11:25
cnfright, so juju messed up my networking, again11:28
cnf>,<11:28
cnfso when MaaS configures the machine, it works11:40
cnfjuju takes over, and i can't even make arp work anymore on that vlan11:40
cnfdamn machine stops replying to arp requests o,O11:51
wpkcnf: do you have console access to that machine? e/n/i would be useful11:55
wpkor could you set log level to debug, try to add the machine then and look what's in the log11:57
cnfi do12:01
wpkcnf: Could you post /etc/network/interfaces and /etc/network/interfaces.(backup...) somewhere?12:04
cnfwpk: https://bpaste.net/show/59224fa597dc12:10
cnfi have 2 backups12:11
cnfand a .new12:11
wpkcnf: paste everything if you can12:17
cnfwpk: https://bpaste.net/show/4873574782b012:18
wpkand the .new?12:19
wpkalso, what's happening when you try to do ifup -a ?12:21
cnfhttps://bpaste.net/show/a13728fa885b12:29
cnfsorry if i'm a bit slow, helping a coworker install a VM12:29
cnfifup -a just gives a new prompt12:29
cnfno messages12:29
cnfexit code 012:30
wpkyet the machine has no network connectivity?12:30
wpkI can't see anything wrong with those files, the bridges seem to be configured correctly12:31
cnfwpk: only the vlan 401312:37
cnfthe rest works fine12:37
cnfi can see arp requests coming in12:37
cnfbut no replies going back out12:37
wpkcnf: could you remove post-up/pre-down lines from bond0.4013 definition (leave them for br-bond0.4013) and then do ifdown -a; ifup -a ?12:44
cnfok, i'm back :P12:53
cnfand if i do a ifdown -a, won't i lose connectivity? PP12:54
cnfwpk: ^^12:54
cnfi just rebooted13:00
wpkI thought you were using a console of some sort, you probably would :)13:02
cnfno, juju ssh13:03
cnfit's running on MaaS13:04
cnfok, no difference13:06
cnfalso, all interfaces have MTU 9100 or 900013:08
cnfexcept br-bond0.401313:08
cnfwait, i just noticed the routes in /e/n/i are wrong13:13
cnfand also not what is actually set on the system13:13
cnfwt...13:14
wpkthat is a wtf13:14
wpkwhere is it getting them from then?13:14
cnfi have no idea13:15
cnfit should not even be touching that  subnet13:15
cnfapart form that, i can't even ping the gateway on the 4013 vlan13:16
cnfit works when maas brings it up13:16
cnfjuju takes over, and it stops working13:17
cnfhmm, and it's not outputting icmp packets, either, on that vlan o,O13:18
cnfnot even when i ping -I13:21
cnfi'm flabbergasted o,O13:23
wpkThe fact that e/n/i is inconsistent with what's really there is weird for me13:27
cnfyes13:30
* cnf sighs13:30
cnfi'm getting a serious juju burnout...13:30
wpkhm, one more idea - could you disable jujud on this machine 'permanently', reboot it and see if e/n/i is consistent with configured networking?13:37
wpksystemctl disable jujud-machine-013:38
wpkcnf: juju might be messing with it, but we have to rule out that something is broken in Ubuntu itself14:07
=== salmankhan1 is now known as salmankhan
julenHi there! does someone happen to know the right API endpoint address for MaaS?14:30
julenin the docu it says that http://$ip:5240/MAAS14:30
julenbut my MaaS controller is not listening on port 5240 for IPv414:31
julenI also tried http://$ip/MAAS/api/2.0/  but it's also not working14:31
joedborghey everyone14:36
joedborgis there a "set_staus()" eqv for old bash charms?14:37
admcleodjoedborg: i think its just status-set ?14:40
admcleodjoedborg: https://github.com/juju-solutions/charms.reactive/blob/7322a9bc13ffde1960bcfcb9166e3c09341d27bb/docs/index.rst14:40
joedborgcheers @admcleod that looks promising14:53
admcleodjoedborg: !14:56
cnfwpk: rebooting14:59
cnfwpk: still the same15:04
joedborgadmcleod works perfectly!  thank you sir15:06
admcleodjoedborg: !15:06
admcleodjoedborg: Success rate is 100 percent (2/2), round-trip min/avg/max = 4/6/8 ms15:10
wpkcnf: and jujud is not running?15:14
cnfuhm, a lot of jujud things are running15:14
cnfhttps://bpaste.net/show/7f8d48b3375715:15
cnfis that normal?15:15
wpkcnf: have you disabled jujud-machine-0 before rebooting?15:16
cnfi did  sudo systemctl disable jujud-machine-015:16
cnfhmm15:21
cnfwpk: was that not enough?15:25
wpkcnf: hm, it should be...15:30
wpkcnf: systemctl list-unit-files \*juju\*15:30
cnfjuju-clean-shutdown.service          enabled15:30
cnfjujud-unit-neutron-gateway-0.service enabled15:30
cnfjujud-unit-ntp-3.service             enabled15:30
wpkdisable all of those, reboot and see15:31
wpkhmm15:31
wpkbut before that15:31
wpkset logging to DEBUG, reboot, and copy logs somewhere (or mail them to me)15:31
cnfin syslog?15:32
wpkin /var/log/juju/15:32
cnfhow do i set logging to debug in juju?15:32
cnfespecially as i just disabled all things juju?15:32
wpkreenable jujud-machine-015:33
wpksomething really bad is happening there, I'd guess that multiple units in LXCs are trying to start up container networking all at once15:34
cnfok, how do i systemd jujud-machine-0 ?15:34
wpksystemctl start jujud-machine-015:35
cnfFailed to start jujud-machine-0.service: Unit jujud-machine-0.service not found.15:35
wpkjuju model-config logging-config="<root>=DEBUG"  should work15:38
cnfok15:39
cnfbut now juju is still disabled, right?15:39
wpkBut the units should receive this logging15:40
cnfbut if juju isn't running, how can it log things?15:41
wpkjujud-unit-* are running and will be logging15:42
cnf$ systemctl list-unit-files \*juju\*15:43
cnfUNIT FILE                   STATE15:43
cnfjuju-clean-shutdown.service disabled15:43
cnf1 unit files listed.15:43
cnfnothing is running?15:43
wpkwhat about the jujud-unit-ntp3.service and jujud-unit-neutron-gateway-0?15:44
cnfno, i stopped them all15:44
wpkAh, ok. Reboot is a way to go then probably15:46
wpkI have a suspiction of what might be happening, but having a debug log from the units would be really helpful15:47
wpkto see -why- it's happening15:47
cnfi'm rebooting15:48
cnfok wpk, what log do you want?15:51
cnfmachine-0 ?15:51
cnfwpk: https://bpaste.net/show/c60636a3617415:52
cnfanything in there?15:58
cnfk, wpk it's time to go home here, can I poke you tomorrow?16:00
cnfI have meetings till 13:00 CET16:00
wpkcnf: Please do.16:11
wpkcnf: The only unusual thing in the logs is "2017-07-06 13:27:25 INFO juju.api.common network.go:118 no addresses observed on interface "bond0.4013""16:12
=== dames is now known as thedac
cnfhmm16:52
=== frankban is now known as frankban|afk
=== scuttle|afk is now known as scuttlemonkey
=== scuttlemonkey is now known as scuttle|afk

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!