[00:01] czajkowski: something is causing harvest to do very bad things, and it's killing every other site on the box [00:01] it's also making my inbox explode [00:02] 200+ messages :( [00:15] its bad [00:16] i made a rule [00:16] :-( [00:32] it's bringing the box to it's knees [00:32] I've seen load > 12 [01:12] I'm going to have unhappy words with dholbach tomorrow [01:13] yuck :\ [01:15] I wonder if "correct horse staple battery" is the 2nd most popular password in use right now [01:16] * mhall119 hates his college password policy [01:44] looks like I may be taking French this semester [02:43] mhall119: Don't worry, I'll catch dholbach first :D [02:57] nigelb: kick him for me [03:08] mhall119: Yeah, I will. With any luck, his inbox will be far worse. [06:53] good morning all [07:06] good morning [07:20] morning dholbach [07:22] hey dpm [07:23] hey, how were the holidays? :) [07:24] great :) [07:24] the first week in the North of Norway was pretty relaxed, but the second week a bit more heavy with travelling and meeting loads of people, but still fun :) [07:32] cool :) [08:04] dholbach: heya! [08:04] morning dpm [08:05] dholbach: Harvest crons are eating out the machine it's hosted. We had to kill the cron becase it wwas hitting summit and LD. When you get some time, could you talk to IS and sort it out? :) [08:06] morning nigelb :) [08:07] nigelb, do you have any specifics? [08:08] dholbach: from the errors that we got in summit, I think its not releasing postgres connections. elmo will know better though [08:08] s/summit/summit and LD/g [08:08] hum, the harvest crons jobs are django management commands just like the ones in the LD/summit [08:09] maybe they're running too long and opening up too many simultaneous connections? [08:10] I doubt the latter [08:10] running too long I can test [08:15] Morning all [08:15] dholbach: dpm welcome back folks .. did you enjoy yout time off [08:15] hey kim0 [08:15] yeah, I did :) [08:15] dpm, how was your time off? [08:15] morning kim0 - I definitely did :) [08:16] Great :) [08:17] dholbach, it was awesome, we went to Tuscany for the week, hired a car and made short trips to visit the surroundings. The area is beautiful! We nearly met with Paolo in Siena, but it didn't work out in the end [08:18] nice, that's awesome [08:26] nigelb, the update cronjob takes 4m [08:26] but I found something else, let me dig out the link [08:27] in a very old commit, that up until recently was no problem [08:28] it might be a red herring, but it's all I have: http://bazaar.launchpad.net/~harvest-dev/harvest/trunk/revision/120 [08:28] in updatelists.py [08:32] * nigelb looks [08:32] sorry, was away for lunch [08:33] dholbach: cranberry was running out of memory and postgres connections for about 2 weeks ;) [08:33] nigelb, the code has been in there for ~2 years :) [08:34] dholbach: yeah, I know, which is strange :) [08:34] but maybe that bit is not the problem at all, I don't know [08:37] dholbach: do you want to grab elmo sometime this week? He'll have mo details. [08:37] Btw, mhall119 and cjohnston are looking forward to kicking you :P [08:38] (just a heads up) [08:38] ... [08:38] we had about 200 emails over night since friday [08:38] mhall had twice as many [08:38] (summit *and* LD) [08:47] I got the LD mails as well [08:47] and I agree that we should fix whatever needs fixing [08:48] I'll try to get elmo [08:48] So we can know what exactly is broken [08:48] let's talk in #canonical-sysadmin [08:48] I know you're probbaly busy catching up [08:48] I just think it's weird that it started acting up in the last 2 weeks [08:48] and Harvest hasn't changed much in the last time [08:48] Yeah, when it acted up, everything acted up. [08:48] Like, summit, LD, sponsoring reports, etc [08:49] because of either OOM or postgres [11:12] https://www.youtube.com/watch?v=5smhy9OB-CM [11:13] bwahahah [11:14] im glad he wasnt injured [11:15] AlanBell: where is the one of you drunk? :P [11:15] I am glad the ironing boad wasn't permanently damaged! [11:15] haha [11:17] this one is me https://plus.google.com/109175303602657131317/posts/SjwA3kCHD1S [11:18] and aquarius [11:48] AlanBell: I didn't know you could breathe fire ;) [11:53] AlanBell: hahah "I'mnot doing that ***** thing" [12:01] hello nigelb AlanBell [12:14] morning dholbach , nigelb [12:15] hey duanedesign [12:15] Morning mhall119. IS is sprinting, so hard to grab hold of them. [12:15] :? [12:16] so what's the status this morning, harvest's crons shut off? [12:16] dholbach: has harvest's data been updating at all? [12:17] mhall119: harvest crons temporarily shut off. [12:19] dholbach: i saw a lot of idle postgres transactions for harvest, could it be something not closing off a transaction or something? [12:19] or something blocking on network IO it can't reach, but not timing out? [12:20] mhall119, yep it has been updating [12:21] I noticed a 2 year old commit (http://bazaar.launchpad.net/~harvest-dev/harvest/trunk/revision/120) I'm unsure about, but it hasn't been a problem until 2 weeks ago [12:21] but I have no idea if it actually is causing the problems we're seeing [12:21] so you haven't been pushing new code out in 2 years? [12:22] we have, but the lines in updatelists that were added weren't changed since then [12:22] as I said - I don't know if it's red herring or not [12:25] does updatelists call into the other code at all? [12:25] or is it standalone? [12:25] a standalone cronjob [12:25] ok [12:27] how often does updatelists run? [12:27] I don't know exactly, I assume every 30m? [12:29] and does it just make calls to the launchpad api? [12:30] I just saw that updateopportunities makes use of those transaction bits too [12:30] both get stuff from LP and other places (urllib) [12:30] wow, google is buying motorola [12:31] I basically just had a look at where harvest differs from LD and the transaction bits looked "non-standard" to me [12:31] do you think that could be the problem? [12:31] could be, like I said I saw a lot of idle transaction processes consuming ram [12:31] ok [12:32] I'll propose a merge, but talk to elmo first to find out what he noticed [12:33] thanks for having a look at it [12:35] np [12:39] hello hello mr nigelb [13:26] akgraner, hey! [13:27] ara, hey! [13:27] akgraner, are you coming to the UF meeting today? [13:27] I can...I was just working on an email to you all... [13:27] :-) [13:28] I haven't commented much as I I felt the process is awesome, but I was also awesomely confused. I think I've gotten that worked out as I re-read all the mailing list info and wiki pages this weekend.. [13:29] akgraner, cool, because there is a topic on the ubuntu release parties and it would be great if you could be there :) [13:29] ara, roger that I'll be there.. in -quality right? I need to add that to my auto-join script... [13:31] akgraner, yes, I took that channel because it is not as crowed as -meeting and it has a meeting bot [13:32] great - just making sure I had the right place..thanks! [14:16] dholbach: ping [14:17] hey I totally missed the calendar email [14:17] you wanted to talk nowish? [14:33] jcastro, we were meant to look at "UGJ hitlist" today [14:33] we were? [14:33] what is it? [14:33] sorry I am just back from a sprint and discombobulated [14:34] jcastro, at the sprint we said "let's talk about the hitlist 2 weeks before UGJ" [14:34] oh ok [14:34] which hitlist? [14:34] this is my first day after the holidays too :) [14:35] I just had it in my calendar [14:35] I assume a "things to do" list for UGJ [14:36] OH OH. [14:36] so it's not like a list of bugs or something I had to prepare [14:36] good. :) [14:38] jcastro, we should talk to bug/distro/etc people about it [14:38] ok [14:39] hey how do you feel about having a quick call tommorrow [14:39] I need like some time to catch up with other crap [14:41] sure [14:46] <3 you [14:47] awwwwww, ♥ [14:47] * nigelb hugs everyone [14:50] :-) [14:50] * dholbach hugs you all [15:02] dholbach / mhall119: Its dying again :( [15:03] (it = guanabana) [15:04] cool name! what's that :) [15:04] kim0: server hosting a lot of community websites :) [15:04] kim0: IS likes fruits. Earlier server was cranberry [15:04] nigelb: hehe cool :) [15:04] kim0, about set? [15:05] yeah [15:06] hey jono [15:06] nigelb, dying with harvest disabled? [15:06] hey dholbach [15:06] dholbach: harvest is still up, so i don't know about disabled. [15:07] yah, I'll be sprinting at UDS [15:07] dholbach: only harvest's cron job is disabled [15:08] so maybe it's not updatelists causing the problems at all [15:08] but rather something in the site code itself [15:08] kim0, invite sent [15:09] mhall119, feel free to disable it for a while and see if that fixes things [15:09] dholbach: it's been disabled since this morning, and nigelb says the problems are still happening [15:10] I'm talking to IS, so feel free to jump in, I'll report back on what's happening. [15:10] jono: https://plus.google.com/109175303602657131317/posts/SjwA3kCHD1S [15:10] mhall119, the site or the cronjobs? [15:11] dholbach: cronjob [15:11] AlanBell: who's the brave lady? ;) [15:11] she is Carolyn [15:12] AlanBell: and what were you spitting out? beer? [15:12] mhall119, feel free to disable the site for a while and see if that's the issue [15:24] AlanBell, nice! [15:25] nigelb: parafin [15:25] grabbing breakfast, brb [15:25] AlanBell: woah, isn't that sort of dangerous? [15:25] nigelb: oh, actually I did rinse my mouth out with beer, yes [15:26] nigelb: how do you think it works! [15:26] heh [15:26] you take a mouthfull of parafin and kind of spit and spray it out over a flame [15:27] and I ended up dribbling most of it down my shirt so I was a little bit worried about bursting into flames [15:29] not worried enough to actually stop playing with fire though [15:29] heh [16:08] anyone here using Thunderbird on Oneirc? [16:08] Oneirc [16:08] Oneiric [16:08] ugh [16:13] I've got it [16:13] I don't use it much [16:13] I've got it - but I only use it for my work account...like jcastro I don't use it much... [16:14] kim0: want to double up on the reports tomorrow? [16:15] jcastro: Yeah was just gonna say that :) [16:18] jono: I was using it until I gave up on Oneiric. No problems there [16:19] hggdh, cool [16:19] I am trying to see if anyone else is getting https://bugs.launchpad.net/ubuntu/+source/compiz/+bug/822929 [16:19] jono: I am .. what's up [16:19] Ubuntu bug 822929 in compiz "Significant screen tearing when using Thunderbird" [Undecided,New] [16:20] ah I'm not using compiz .. gave up on that :) unity-2d ftw [16:21] and I *cannot* use unity 3d on Intel, compiz dies on startup [16:21] (on a netbook) [16:24] interesting [16:24] mine is totally boned [16:25] I had to use 2d all last week [16:25] along with almost everyone at the sprint [16:25] <--- lunch [17:14] pleia2: AlanBell can ye please link to your applications in the agenda https://wiki.ubuntu.com/LoCoCouncil/Agenda [17:16] doh, AlanBell editing [17:16] badly [17:17] ok, all yours pleia2 [17:17] ty [17:17] frack, email's blowing up [17:17] thanks guise [18:00] jono: I'm all set [18:00] jcastro, sure, one sec [18:00] \m/ >_< \m/ [18:06] "A great collective gasp issued from tuned-in Firefox fans when Mozilla announced that it was switching to a Chrome-like release schedule for its browser. Now Mozilla wants to take things one step further and remove Firefox version numbers entirely — from the user-facing parts of the browser, anyway." [18:06] Oh jeez, what morons :) [18:06] when's ubuntu switching to chrome as the default browser, again? [18:07] makes sense to me [18:07] I have no clue what version of chrome I am on [18:07] so why even show it [18:07] I'd like that. I'm tired of users asking for firefox $versionnumber [18:07] yeah [18:08] it won't help that [18:08] since we'd be out of date it'd whine and try to klobber dpkg [18:08] there'd just be firefox $latest, and firefox $notupdated [18:08] When they in-fact don't even know what changed between releases, they just want the bigger number. [18:08] depends how it's delivered [18:08] firefox'd check it's own servers for uptodateness [18:08] not the apt repo [18:08] that.. depends how its delivered [18:09] I think that chrom(e|ium)'s channels are a rather sane way of delivering different levels of stability to the end-user/tester/developer [18:09] we used to disable that in firefox [18:09] popey: they won't implement it for every package management system, I'm sure of it [18:09] they might not, we might [18:09] big ugly patches :( [18:10] we're not out of date [18:10] the PPAs and updates are all ready to go [18:13] jono: you have to restart the hangout I think [18:20] i am sure you have seen this, but just in case :) we are hoping for a good turnout since it is the first one and will probably decide if their are more, http://voices.canonical.com/ubuntuone/?p=1053 [18:26] jono: just as an FYI, I'm not sure if your survery is take-able by anyone who uses a screen reader [18:27] (I can't check it while I take it and survey monkey radio buttons have been things where I know accessibility audits in the past done by 3rd parties have fallen down) [18:29] what survey? [18:33] AlanBell: check your email [18:33] jono sent it to all ubuntu members [18:33] oh, email, I remember that [18:34] he did [18:34] I've no email :/ [18:36] maybe we're too old [18:37] (I didn't receive one either) [18:37] hmm [18:37] pleia2: maybe we're not special :( [18:37] I haven't gotten that many emails today anyway, weird. [18:38] Pendulum, yeah, unfortunately we don't have a decent alternative [18:38] Pendulum, I would be more than happy to manually add data from those who email it to me though [18:38] jono: I did set up a limesurvey instance last time this happened [18:38] czajkowski, pleia2 it is sent to all applicants from the last two years [18:39] AlanBell, gotcha [18:39] ah, sweet. that's why I did not get it either :) [18:39] :-) [18:39] I got one, and finished too. [18:39] awww [18:39] cute :) [18:39] But I think I might not be your ideal survey material ;) [18:40] I mean, I was on a team with paultag. That pretty much skews normal sample :P [18:40] nigelb: always, my man. What was it about? How often you get yelled at? [18:40] paultag: lol, other way around. [18:41] How was your membership process, how smooth it was, etc. [18:41] oh jeez [18:41] sure [18:41] Well, I had *lots* of help with the wiki page and I talked to a lot of people. [18:41] Which meant lots of testimonials, so the membership process was smooth. [18:41] jono: have you blogged about the survey at all? just not sure how to let anyone who might qualify to know about it (because I know there are screen reader users out there who I certainly don't know about and some of them very well may be members who applied within the last 2 years, but there's nothing in that e-mail saying 'contact jono for alternate format' [18:41] Coding DOjos in ireland need Ubuntu USB live sticks :D http://codrcamp.com/2011/08/dublin-coderdojo-coming-soon/ [18:42] Pendulum, I haven't blogged it [18:42] jono: ahh ok, I'm 2 years and 3 months [18:42] czajkowski, :-) [18:42] Ah, that would do it. [18:42] tbh, I'm still too drugged to be able to remember where it is that survey monkey does and doesn't falldown with screen readers, but I don't know any screen reader users who bother to even click survey monkey links due to the access issues [18:42] Pendulum, I will blog it and offer for people to send me data if they can't use the surveymonkey interface [18:43] jono: awesome, thanks [18:43] * AlanBell will do the survey eyes free [18:43] Pendulum, http://help.surveymonkey.com/app/answers/detail/a_id/2/~/our-surveys-are-508-compliant-and-accessible-by-users-with-disabilities. [18:43] AlanBell: probably easier to try it on w3m? [18:43] what is w3m? [18:44] !info w3m [18:44] AlanBell: terminal browser [18:44] hrm. [18:44] firefox + orca + monitor off button [18:44] that's pro. [18:44] :) [18:45] usefuly realistic imho [18:45] it sounds like SM actually meets a11y needs [18:46] "Surveys are available to anyone using screen reader software, limited to keyboards to enter responses, and anyone with vision impairments that require high-contrast themes." [18:47] jono: that's new within the last year [18:47] Pendulum: It says they were ...certified us as Section 508 compliant on June 5, 2008. [18:48] Pendulum, it was confirmed in 2008 [18:48] Pici: we tested and researched a year ago and found current things at the time saying it wasn't accessible [18:48] Pendulum, I assume you didn't see the notice about this [18:48] Pendulum: /me shrugs [18:48] as such, I am not going to blog it - it seems the survey should be accessible as is [18:48] my survey meets the guidelines [18:48] okay [18:48] brb, grabbing some lunch [18:49] * Pendulum shrugs [18:49] I'm positive that wasn't on the website a year ago so dunno what's changed [18:50] but if it works, great. [18:51] :-) [19:01] paultag: I'm sure you've already seen this, but if not, http://www.islinuxaboutchoice.com/ [19:02] You'll love it [19:02] meh [19:02] ouch [19:03] GNU/Linux is about choice, that's some RMS bullshit :) [19:03] nigelb: I giggled, but I'm so sick of that argument these days :) [19:04] paultag: lol, yeah. [19:04] Pendulum: we used a wordpress based survey tool because we knew it was simple HTML and presented alternate ways to provide the information, I don't recall considering surveymonkey for long at that time [19:04] paultag: similar thing on firefox channel today - "How do I get it to work on GNU/Linux?" "Knock off the GNU/" [19:04] the other case was more recently in loco-contacts where the objection to survey monkey was around it not being free software [19:04] nigelb: yeah :) [19:05] which is why I put up a limesurvey instance which has yet to be used [19:05] AlanBell: translation too. [19:05] that site seems to have two very different points [19:05] that too [19:06] I am finding the radio buttons in surveymonkey very confusing with orca, I will try a limesurvey with radio buttons, it could just be me failing to use orca correctly [19:33] limesurvey totally flunked the security team's tests. [19:33] jcastro: ping [19:33] pong [19:34] jcastro: got time for a few mins of PM? :) [19:34] yeah [19:34] jcastro: hope they filed bugs [19:34] but yeah, not massively surprised at a PHP app with security problems [19:41] jono: ping [19:41] hey m4n1sh [19:41] the survey has Asia and Oceania as separate and EMEA is missing [19:41] jono: I applied via EMEA, but it is not in the list [19:42] m4n1sh: what's on the list? [19:42] (I momentarily forget) [19:42] Americas, Asia and Oceania [19:42] m4n1sh, oops [19:42] and an Another textbox [19:42] let me see if I can add it [19:43] help: the loco director ate 6 global jam events, including Vancouver's. thoughts? [19:43] *directory [19:43] nigelb: hey. long time :) [19:43] m4n1sh, added [19:43] great [19:43] m4n1sh: hello [19:44] nigelb: anything special these days? [19:44] doing something kickass? Apart from summit? [19:45] m4n1sh: doing a bit of stuff on mozilla webdev [19:45] you keep dabbling around with various things [19:45] nigelb: so mostly web work? [19:45] yeah, web. django. [19:46] ah cool [19:46] I'm just doing a *lot* of webdev lately - summit, launchpad, mozilla webdev projects [19:46] django is the only python web framework I know [19:46] I love launchpad [19:46] esp I know the API pretty well [19:46] I mean the raw REST API [19:48] well, once you start writing Zope code, you may not love launchpad any more ;) [20:02] * popey wonders what the content of the survey in question is [20:06] jono: what's in the survey? [20:06] http://www.surveymonkey.com/s.aspx?sm=EgGTTDiE0HLhOMm2cpp1dw_3d_3d [20:07] thanks [20:23] * AlanBell completes the process, but not with orca. I couldn't figure out what radio button values I was on, and change them - even with the screen on it didn't make much more sense