=== tris- is now known as tris === stokachu_ is now known as stokachu === cargonza_ is now known as cargonza === frankban|afk is now known as frankban [08:54] morning [08:57] so anyone around that can help me figure out why juju isn't putting ip's in my containers even though i have the correct constraint on the services? [08:58] What's the setup? [09:00] i used to do it fine, it stopped doing it when i upgraded to the latest version [09:00] wpk: running on MaaS [09:01] cnf: It's not adding the extra interfaces to the containers? [09:01] wgrant: right [09:02] cnf: Juju 2.2.0? That's fixed in 2.2.1. [09:02] wgrant: it _is_ getting ip's from maas... [09:02] oh [09:02] so i need to upgrade again [09:02] can you link the bug? [09:02] cnf: https://bugs.launchpad.net/juju/+bug/1698443 [09:02] Bug #1698443: Juju-2.2 does not create interfaces in an LXD for all spaces <4010>

[09:02] thanks [11:25] hmz [11:28] right, so juju messed up my networking, again [11:28] >,< [11:40] so when MaaS configures the machine, it works [11:40] juju takes over, and i can't even make arp work anymore on that vlan [11:51] damn machine stops replying to arp requests o,O [11:55] cnf: do you have console access to that machine? e/n/i would be useful [11:57] or could you set log level to debug, try to add the machine then and look what's in the log [12:01] i do [12:04] cnf: Could you post /etc/network/interfaces and /etc/network/interfaces.(backup...) somewhere? [12:10] wpk: https://bpaste.net/show/59224fa597dc [12:11] i have 2 backups [12:11] and a .new [12:17] cnf: paste everything if you can [12:18] wpk: https://bpaste.net/show/4873574782b0 [12:19] and the .new? [12:21] also, what's happening when you try to do ifup -a ? [12:29] https://bpaste.net/show/a13728fa885b [12:29] sorry if i'm a bit slow, helping a coworker install a VM [12:29] ifup -a just gives a new prompt [12:29] no messages [12:30] exit code 0 [12:30] yet the machine has no network connectivity? [12:31] I can't see anything wrong with those files, the bridges seem to be configured correctly [12:37] wpk: only the vlan 4013 [12:37] the rest works fine [12:37] i can see arp requests coming in [12:37] but no replies going back out [12:44] cnf: could you remove post-up/pre-down lines from bond0.4013 definition (leave them for br-bond0.4013) and then do ifdown -a; ifup -a ? [12:53] ok, i'm back :P [12:54] and if i do a ifdown -a, won't i lose connectivity? PP [12:54] wpk: ^^ [13:00] i just rebooted [13:02] I thought you were using a console of some sort, you probably would :) [13:03] no, juju ssh [13:04] it's running on MaaS [13:06] ok, no difference [13:08] also, all interfaces have MTU 9100 or 9000 [13:08] except br-bond0.4013 [13:13] wait, i just noticed the routes in /e/n/i are wrong [13:13] and also not what is actually set on the system [13:14] wt... [13:14] that is a wtf [13:14] where is it getting them from then? [13:15] i have no idea [13:15] it should not even be touching that subnet [13:16] apart form that, i can't even ping the gateway on the 4013 vlan [13:16] it works when maas brings it up [13:17] juju takes over, and it stops working [13:18] hmm, and it's not outputting icmp packets, either, on that vlan o,O [13:21] not even when i ping -I [13:23] i'm flabbergasted o,O [13:27] The fact that e/n/i is inconsistent with what's really there is weird for me [13:30] yes [13:30] * cnf sighs [13:30] i'm getting a serious juju burnout... [13:37] hm, one more idea - could you disable jujud on this machine 'permanently', reboot it and see if e/n/i is consistent with configured networking? [13:38] systemctl disable jujud-machine-0 [14:07] cnf: juju might be messing with it, but we have to rule out that something is broken in Ubuntu itself === salmankhan1 is now known as salmankhan [14:30] Hi there! does someone happen to know the right API endpoint address for MaaS? [14:30] in the docu it says that http://$ip:5240/MAAS [14:31] but my MaaS controller is not listening on port 5240 for IPv4 [14:31] I also tried http://$ip/MAAS/api/2.0/ but it's also not working [14:36] hey everyone [14:37] is there a "set_staus()" eqv for old bash charms? [14:40] joedborg: i think its just status-set ? [14:40] joedborg: https://github.com/juju-solutions/charms.reactive/blob/7322a9bc13ffde1960bcfcb9166e3c09341d27bb/docs/index.rst [14:53] cheers @admcleod that looks promising [14:56] joedborg: ! [14:59] wpk: rebooting [15:04] wpk: still the same [15:06] admcleod works perfectly! thank you sir [15:06] joedborg: ! [15:10] joedborg: Success rate is 100 percent (2/2), round-trip min/avg/max = 4/6/8 ms [15:14] cnf: and jujud is not running? [15:14] uhm, a lot of jujud things are running [15:15] https://bpaste.net/show/7f8d48b33757 [15:15] is that normal? [15:16] cnf: have you disabled jujud-machine-0 before rebooting? [15:16] i did sudo systemctl disable jujud-machine-0 [15:21] hmm [15:25] wpk: was that not enough? [15:30] cnf: hm, it should be... [15:30] cnf: systemctl list-unit-files \*juju\* [15:30] juju-clean-shutdown.service enabled [15:30] jujud-unit-neutron-gateway-0.service enabled [15:30] jujud-unit-ntp-3.service enabled [15:31] disable all of those, reboot and see [15:31] hmm [15:31] but before that [15:31] set logging to DEBUG, reboot, and copy logs somewhere (or mail them to me) [15:32] in syslog? [15:32] in /var/log/juju/ [15:32] how do i set logging to debug in juju? [15:32] especially as i just disabled all things juju? [15:33] reenable jujud-machine-0 [15:34] something really bad is happening there, I'd guess that multiple units in LXCs are trying to start up container networking all at once [15:34] ok, how do i systemd jujud-machine-0 ? [15:35] systemctl start jujud-machine-0 [15:35] Failed to start jujud-machine-0.service: Unit jujud-machine-0.service not found. [15:38] juju model-config logging-config="=DEBUG" should work [15:39] ok [15:39] but now juju is still disabled, right? [15:40] But the units should receive this logging [15:41] but if juju isn't running, how can it log things? [15:42] jujud-unit-* are running and will be logging [15:43] $ systemctl list-unit-files \*juju\* [15:43] UNIT FILE STATE [15:43] juju-clean-shutdown.service disabled [15:43] 1 unit files listed. [15:43] nothing is running? [15:44] what about the jujud-unit-ntp3.service and jujud-unit-neutron-gateway-0? [15:44] no, i stopped them all [15:46] Ah, ok. Reboot is a way to go then probably [15:47] I have a suspiction of what might be happening, but having a debug log from the units would be really helpful [15:47] to see -why- it's happening [15:48] i'm rebooting [15:51] ok wpk, what log do you want? [15:51] machine-0 ? [15:52] wpk: https://bpaste.net/show/c60636a36174 [15:58] anything in there? [16:00] k, wpk it's time to go home here, can I poke you tomorrow? [16:00] I have meetings till 13:00 CET [16:11] cnf: Please do. [16:12] cnf: The only unusual thing in the logs is "2017-07-06 13:27:25 INFO juju.api.common network.go:118 no addresses observed on interface "bond0.4013"" === dames is now known as thedac [16:52] hmm === frankban is now known as frankban|afk === scuttle|afk is now known as scuttlemonkey === scuttlemonkey is now known as scuttle|afk