[06:53] Morning o/ [06:58] davidcalle, yo yo yo [06:59] I didn't play around with staging too much yet [06:59] and haven't figured out the hero tour [06:59] I'm still going through the examples and making sure that stuff works or almost works with the new snapd/series 16 [07:02] Yep, btw, youtube-dl works for me [07:03] built from the newest trunk with the newest snapd and snapcraft? [07:03] A fresh build worked yesterday morning, but let me update and try again [07:03] *evening [07:04] thanks [07:05] oh, and install squid-deb-proxy{,-client} before :) [07:06] Oh no wait, I haven't tried a fresh build actually, I just took dpm's word [07:07] big mistake :-P [07:07] dholbach: how do you start webdm? I used to do it with snappy service webdm start [07:07] I have no idea [07:30] dholbach: do you still have ubuntu-core-config installed? [07:30] I managed to fix a number of issues in lp:snappy-playpen, unfortunately this didn't give us more working snaps [07:30] davidcalle, yes... should I delete it? :) [07:30] No, just checking if I should :) [07:31] You should not need to [07:31] install this package manually. [07:31] Not sure what that's supposed to mean... :) [07:33] :) [08:04] dholbach: youtube-dl works perfectly for me :) [08:05] ok... maybe you can follow up on the bug report then? [08:12] ok [09:25] davidcalle, the caching on staging (or whatever it is) is driving me nuts [09:27] dholbach, I feel your pain! [09:29] dholbach, will you mind if I wipe the staging db later today? (around 15) [09:30] no, not at all [09:30] I should be done with my tests before [09:30] ok [09:30] during the import: [09:30] 502 Bad Gateway [09:30] The server returned an invalid or incomplete response. [09:30] do we have a way to access logs? [09:30] or do we need to ask IS/webops? [09:30] it's a bit hard to debug without logs [09:31] we have, I'll send them to you in 2 min [09:32] <3 [09:39] dholbach: any specific log file? [09:39] import_md.log is empty [09:39] sure, that's probably only used for the management command [09:39] is there a log of the main thread? [09:43] https://pastebin.canonical.com/154786/ [09:44] gracias [09:44] did you find the log? [09:44] https://pastebin.canonical.com/154788/ [09:45] dholbach: lol -> https://pastebin.canonical.com/154789/ [09:46] dholbach: I need to run, I'll add the dep as soon as I'm back. python-yaml? python3-yaml? [09:47] (not doing it now as it needs a redeploy) [09:47] I don't even know where that's coming from [09:47] dholbach: the generate command [09:47] ah ok [09:48] python3 [09:48] ok [09:48] * davidcalle runs, bbiab [09:48] sorry about that [09:48] thanks davidcalle [09:49] I guess it's this: [09:49] 2016-04-20 09:31:16 [17467] [CRITICAL] WORKER TIMEOUT (pid:17479) [09:49] 2016-04-20 09:31:16 [17467] [CRITICAL] WORKER TIMEOUT (pid:17479) [09:49] 2016-04-20 09:31:16 [30091] [INFO] Booting worker with pid: 30091 [09:49] can we define what a suitable worker timeout is? [09:50] ok... maybe the issue here is that I'm using the admin interface [09:50] and that it's going to work if we wait for the cronjob [09:50] in that case we should increase the frequency [09:50] and maybe go for hourly? [09:50] or something [09:50] let's discuss later on [09:51] I'm going to meet somebody for lunch later on, so will take a longer break, but will let you know once I'm back [12:43] dholbach: back o/ [12:45] dholbach: about to redeploy for the new dep... any objection? [12:46] * davidcalle presses button [13:44] davidcalle, no, please go ahead [13:49] :) [13:50] davidcalle, what do you think about what I said earlier? [13:52] dholbach: how would that solve the timeout issue, more trials per day => more chances for it to pass? [13:52] no [13:52] it's a different process [13:53] I believe that "[CRITICAL] WORKER TIMEOUT" is a wsgi or whatever else requirement [13:53] if a slightly related, but also unrelated cronjob times out that's something separate [13:53] or maybe I'm wrong, I don't know [13:54] mhall119's api importer takes MUCH longer to complete [13:54] and it's also a cronjob [13:54] not sure if I explained myself well [13:54] dholbach: I see your point about workers, but not whywe should change the cronjob (I'm not against it, though) [13:55] davidcalle, using the worker through the admin interface makes no sense right no [13:55] it times out and gets killed [13:55] yep [13:55] this provides no easy way to test [13:55] and having to wait 1 day to see results is not really practical [13:55] Oh right, for testing pruposes, gotcha [13:55] purposes* [13:55] and to make sure that stuff works [13:56] in normal conditions when everything works, daily is good enough for me :) [13:57] dholbach: if you make a branch running it every 30min, I can plug that in :) (currently fighting with the db dump :/, asking IS for help) [13:57] shit :-/ [13:57] I can't believe there's no easy way to do this [13:57] how are the other teams dealing with staging/prod data? [13:59] dholbach: maybe you would know? What I'm doing is dropping the db, creating it, and "psql devportal-app < dbfile", it loads fine until http://paste.ubuntu.com/15948848/ [13:59] maybe we can ask the U1 guys? [13:59] they must have experience with this [14:00] dholbach: lol, deployment done, it worked [14:01] dholbach: somehow, after 45min of fighting, the new db is in [14:01] wow [14:01] * davidcalle stops touching with postgre [14:01] https://code.launchpad.net/~dholbach/developer-ubuntu-com/hourly-md-imports/+merge/292384 [14:01] touch postgre* [14:02] there must be a way to exclude certain tables from a pg dump [14:03] I remember I wrote a very hacky script to exclude certain bits from a pg dump ages ago, but I could imagine that somebody did a clean job of this somewhere [14:03] dholbach: yeah, there must be one :) Sooo... Testing a few things related to the db and pushing your branch [14:04] (pushing on staging) [14:16] thanks! [14:48] dholbach: mhall119 db corruption fixed on staging \o/ [14:48] dpm: ^ [14:49] YES!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! [14:49] __ _______ ____ _ [14:49] \ \ / / ____/ ___|| | [14:49] \ V /| _| \___ \| | [14:49] | | | |___ ___) |_| [14:49] |_| |_____|____/(_) [14:49] [14:51] oh wow, NICE WORK davidcalle and dholbach! [14:51] ship it [14:53] dholbach: branch pushing in progress [14:54] * dholbach hugs davidcalle [15:17] dholbach: pushed. You need to re-add import directives, though. [15:19] awesome [15:40] davidcalle, I added snappy and snapcraft docs to staging [15:41] davidcalle, was python3-yaml added? [16:01] dholbach: yep [16:01] davidcalle, ok... I'll take a look at it tomorrow [16:02] let's see if the main imports work later on [16:02] I need to run after this call [16:27] dpm: I need further confirmation from daniel, but it looks like the importer is working [16:28] nice! [16:28] Have a nice eod dpm o/ [16:28] you too! === dpm is now known as dpm-mostly-afk