/srv/irclogs.ubuntu.com/2011/07/28/#ubuntu-kernel.txt

quentusrexAlright, I have been following this guide for kernel building and installation: http://blog.avirtualhome.com/2010/11/06/how-to-compile-a-ubuntu-10-10-maverick-kernel/03:42
quentusrexIs there any way to build the package(or even just build the replacement kernel) faster than rebuilding everything from scratch?03:43
quentusrexI'm trying to test patches to fix a problem with Seagate Barracuda 7200.12  SATA drivers, but it takes 30+ minutes between attempts currently.03:43
apwquentusrex, you can patch the source, remove debian/stamps/*build* and then fakeroot binary-<flavour> will not rebuild everything07:10
quentusrexthanks apw, but just to confirm that will rebuild the parts of the kernel that have changed?07:15
=== smb` is now known as smb
apwquentusrex, it should yes, the packaging still occurs so its still not zippy but doesn't build every c file07:19
* smb waves to apw07:19
* apw waves to smb07:20
quentusrexthanks apw. I'll give that a try. 07:20
quentusrexI'm trying to track down a problem with the Seagate Barracuda 7200.12 and the ATI chipset. 07:20
apwsound fun07:24
ohsixquentusrex: what problem? the link keeps going down?07:29
quentusrexohsix, basically there is a load of ~3 on idle and trying to write anything above 20MB will cause the server to become io-bound and unresponsive.07:45
ohsixhave you looked at dmesg?07:46
ohsixthere's a pretty general problem with seagate drives and the link going down07:46
quentusrexif I unplug the Seagate hard drive and plug in a Western Digital then everything works fine, and everything works fine if I plug in a 7200.9 Seagate drive.07:46
quentusrexohsix, I haven't see anything about the link going down in dmesg07:46
ohsixpost the output to a pastebin, it doesn't say "link down" there are ata errors about resets07:47
quentusrexhttps://bugs.launchpad.net/ubuntu/+source/linux/+bug/81554007:48
ubot2Ubuntu bug 815540 in linux "Server becomes unresponsive after spawning 16 ksoftirqd processes" [Undecided,Confirmed]07:48
quentusrexthere is a dmesg file uploaded there. 07:48
quentusrex'reset' isn't in the log.07:48
ohsixsec, there was a change not too long ago that made the resets transparent too07:49
ohsixi'll have to think a bit about what i did back when i had the problem drives; they've since been replaced with other seagates that don't do it07:51
quentusrexohsix, I would appreciate it.07:52
ohsixquentusrex: have you tried to track down a firmware update for the drive yet?07:56
quentusrexohsix, I started with the drives on CC4607:56
quentusrexthen updated to the latest which is CC4907:56
quentusrexno difference.07:56
ohsixok07:56
ohsixhm, you know it's been quite a long time; i remember having to disable ncq for some reason, and i'm pretty sure the link resets were it, but i can't remember if just setting the queue depth less than 31 also helped07:57
apwohsix, now that seems familiar, some drive causing reserts if you used all of the queue entries or something07:58
ohsixyou could try disabling ahci too; it does the same thing basically08:00
ohsixthen you're back to 'ole classic chipset restrictions08:01
ohsixthere's also something to show those resets again but i'll have to look a bit08:01
quentusrexyeah, I see a check around them all for verbose. I'm back tracking it to find the config. If you find it first, let me know.08:02
ohsixok i found my emails from 2008, i'll look through them :]08:03
quentusrexWhat feels crazy is that these are brand new drive models from Seagate. I would think they wouldn't make the same mistake again only 3 years later.08:04
apwquentusrex, and i bet you are being sensible and spreading your maker to avoid systemic failure too08:05
quentusrexspreading my maker?08:05
ohsixthey don't actually do the firmware on some of their models, it's actually pretty hard to figure out if you want to avoid stuff08:06
apwbuying differnet makers kit so that if say like the old death-stars they have a manufacturing fault you don't loose everything08:06
quentusrexapw, aah. Yes, and I stress test every new server before it touches production.08:07
quentusrexand by stress test I mean memtester for a week straight, then at least a week running boinc for rosetta@home.08:07
quentusrexrosetta does well at finding incompatible or flaky drives, at least it is good at finding them for me.08:07
apwso i guess +1 for it catching this bad drive, -1 for seagate for their drive08:07
quentusrexapw, it's the entire model. I have 3 of the same drives from different batches. all with the exact same problem.08:08
ohsixok this is back when i had spindles lock on a bunch of seagate drives, one locked; got rma, the rma had the link down problem08:09
apwquentusrex, yep, awsome08:09
ohsixthe ncq thing worked around it, and they had to contact an engineer to actually make a new firmware image to update the drive i had to fix it08:09
apwohsix, now that sucks, "i want the old one, oh no i don't"08:09
ohsixapw: they were the enterprise series drive too08:09
ohsixi had accounted for all types of failure besides then turning into a block of aluminum08:10
apwprobabally why you got anything other than ignored when you said it was broke08:10
ohsixthey use fluid dynamic bearings; they spin weld themselves :D08:10
ohsixthe other drive i had in the set did it within a few power on hours of the first too08:11
ohsixthis is what i said at the time to support: 3.AAK, nforce5 mcp55, the sata link keeps going up and down and the drive keeps resetting with controller errors, and its worse with NCQ enabled [06:01:40 PM]08:12
apwohsix, i had all of my personal data on a pair of travel-stars, they both died in the same way within a day of each other08:12
ohsixthey sent me 3.AAM, and they had a hard time doing it too :] but that fixed it08:12
apwthose were the days mind when the manufacturer could claim "oh we don't rate those drives for continuious spin"08:13
ohsixbut according to that message and my confusion, the problem wasn't entirely resolved with disabling ncq08:13
ohsixquentusrex: i'll keep looking for a way to reenable those messages, and the patch that disabled them (cuz i explicitly remember seeing it on patchwork); i'd start the process to getting even newer firmware, since it takes a while08:14
apwohsix, the odd thing is i do recall a reduction in outstanding queue count helping for something like this08:14
ohsixya i couldn't figure out why the controller kept resetting, there was no rhyme or reason08:14
apwquentusrex, cirtanly worth reducing the queue depth on the drive to see if it helps08:14
ohsixit really liked to break when i was reading enough off the drive constantly, but barely enough to keep the head moving (like playing mp3s or a movie from it)08:15
ohsixi tried using short and stout cables and stuff to see if that mattered, it didn't08:16
ohsixit was just some firmware badness08:16
ohsixoh, you can also try forcing the link speed to sata1.508:17
quentusrexI've got to crash soon. It's 1:20am here.08:18
ohsixok, you can set the link mode, and ncq at boot with libata.force=1.5Gbps,noncq08:20
ohsixnohrst, nosrst, and norst controls the hiding of the different reset messages, hard, soft, and both respectively08:21
ohsixso quick confirmation wrt what i think it is, is libata.force=norst, then get it to do it and check dmesg08:21
quentusrexohsix, so how do I enable them?08:21
quentusrexok08:22
ohsixedit the commandline in grub before you boot, or add them to /etc/default/grub (GRUB_CMDLINE_LINUX_DEFAULT) run grub-update and reboot08:22
quentusrexI'll know shortly ohsix 08:24
quentusrexohsix, do you know why it was decided to hide the ata reset messages?08:25
ohsixi don't remember, that's why i'm looking for the patch again08:25
ohsixthey're mostly useless messages, except in this particular situation heh08:25
ohsixlinks go down occasionally anyways, and it doesn't really hurt; but if the host is doing something that crashes the drive firmware you want to know :]08:26
ohsixaha, forgot about git-blame, i can see who added the documentation08:33
ohsixhttp://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=commit;h=05944bdf6fadb5394710269df6770dde447b23ca08:34
ohsixer, heh; going by the commit message that doesn't do what i thought it does08:34
ohsixthat actually disables resets alltogether08:35
quentusrexohsix, yeah, that actually made it worse. Took much longer to boot with that option.08:36
ohsixright08:36
ohsixi don't see anything that actually hides the messages, looks like stuff just changed08:46
=== Quintasan_ is now known as Quintasan
amitkapw: you guys sprinting before Plumbers?10:13
* ppisati -> out11:52
davmor2ogasawara: Morning both test kernels seem to have wifi beaming out quite happily, not seen any issues, on either box hibernate, suspend etc have all brought the wifi back up and connected successfully etc12:54
ogasawaradavmor2: cool, so for the broadcom one, I'll put together a few more kernels so we can narrow down the regression13:08
davmor2ogasawara: no probs13:08
ogasawaradavmor2: for the ralink, I'll apply the commit and it should hit Alpha313:08
davmor2ogasawara: nice,  I'll keep an eye on the ralink one for you over the weekend makes sure nothing drops out etc but so far seems nicely stable13:09
* smb wonders whether reviewing cves is not a waste of time...13:19
tgardnersmb, how so?13:20
smbtgardner, They seem to get applied quicker than I can look at them.. :-P13:20
tgardnersmb, it seems straightforward to me if they are cherry-picks, and have already been applied to other master branches.13:21
tgardnerI did look at the backports pretty carefully13:21
smbYeah, did the same. And yes, more or less those are not very critical in the sense of having much change compared to other branches...13:23
smbJust for those the question is whether I look at them or just wait whether they get applied the next hour... ;)13:24
tgardnerwell, I'm just compulsive about clearing out my inbox first thing. you'll just have to start earlier.13:25
smbtgardner, Good point. Unfortunately Andy sent them out between the end of my lunch break and your start of the day. I just need to avoid that kind of work in your mornings :)13:27
apwhttp://www.debian.org/releases/lenny/example-preseed.txt13:49
ogasawaraskaet: at the rally we had a gcc discussion for the P release.  I recall you had taken notes, did they get transcribed anywhere by chance?13:57
ogasawaradavmor2: when you have a chance, new test kernel at http://people.canonical.com/~ogasawara/lp814882/13:59
ogasawaradavmor2: same info posted to the bug as well13:59
davmor2ogasawara: righto I'll give it a go in a bit just doing some testing at the minute so might be an hour or so14:00
ogasawaradavmor2: cool, thanks14:00
skaetogasawara: have the notes, and happy to put them somewhere public - ideas/preferences?  mail/spec/wiki?14:01
ogasawaraskaet: wiki or spec would be good, I just wanted to have some reference I could share with some Intel folks14:02
skaetogasawara, is there a SPEC you want me to add them to?  happy to do that.14:02
* skaet figures there might be a few feathers ruffled if I start off a Oneiric/ToolchainPlans page.14:03
ogasawaraskaet: we can probably add it to https://launchpad.net/ubuntu/+spec/other-kernel-o-gcc-build-dependency as that's where the action was listed for us to get together at the rally14:04
ogasawaraskaet: just throw it on the whiteboard as notes from that meeting14:04
skaetogasawara, makes sense.   adding.14:04
ogasawaraskaet: thanks14:05
apwtgardner, well if i had to guess i'd say it'd be worth adding this to the boot command line via F6: cdrom-detect/eject=false14:26
tgardnerapw, ack14:26
skaetogasawara, raw notes added to the spec.14:27
ogasawaraskaet: thanks again14:29
* ogasawara back in 2014:29
sforsheemjg59, cking: either of you have a minute for an AML question?14:46
apwogasawara, ok i've pushed a bunch of cleanups to patches to the tip of oneiric, all from the delta-review.  i've reverted and reapplied patches where they were updated so you can see them, feel free to collapse and move them as appropriate on your next rebase14:49
ogasawaraapw: ack thanks14:51
apwogasawara, that represents the bulk of what i am doing for that work item so i have closed it out and made a new one for the remainder14:52
ogasawaraapw: cool14:52
apwnone of the remainder is release critical, so once i have the patches in progress i'll close that too14:52
ogasawaraworks for me14:53
apwogasawara, i did revert some include additions which may pop an FTBS, i don't think so as none of my test builds needed them, but just in case so you know they are there ... all my reasons are on the wiki14:53
bdmurrayafaict bug 817213 seems fixed in oneiric14:58
ubot2Launchpad bug 817213 in linux "Spaces instead of mainboard vendor name in dmesg DMI: line" [Undecided,New] https://launchpad.net/bugs/81721314:58
tgardnerapw, 'cdrom-detect/eject=false' seems to have worked15:17
apwtgardner, awsome15:18
apwsomething going our way15:19
apwsomething going our way15:21
apw(but apparently not mine)15:21
bdmurrayhey there so I was looking at https://wiki.ubuntu.com/DebuggingKernelSuspendHibernateResume#Battery_drained_whilst_suspended_stock_reply and wanted to stop those from being reported16:41
bdmurrayWhat is the tell for your your battery drained?16:41
=== _LibertyZero is now known as LibertyZero
davmor2ogasawara: sorry for the delay, the latest kernel you added has working wifi17:30
ogasawaradavmor2: thanks, was hopping you'd say that.  I'll kick off the next build...17:30
=== cking is now known as cking-afk
* cking-afk --> EOD17:46
=== tgardner is now known as tgardner-afk
* tgardner-afk is out early today17:47
ogasawaradavmor2: k, next test kernel at the same location - http://people.canonical.com/~ogasawara/lp814882/17:55
ogasawaradavmor2: comment also posted to the bug so that I keep track where we are17:56
apw(but apparently not mine)18:02
quentusrexapw, ohsix just to let you know the Seagate issue appears fixed in the 2.6.38-11.47 kernel18:02
apwquentusrex, and its broken in which version ?18:03
quentusrexI will try to figure out which patch resovled the issue18:03
quentusrexbroken as late as 2.6.38-10.4618:03
apwquentusrex, what host controller do you have18:08
hertondoes someone have any idea why we don't have linux-image-2.6.38-11-powerpc64-smp_2.6.38-11.47_ppc64.deb on repositories?18:14
hertonmaint-getabis is complaining:18:15
hertonII: linux-image-2.6.38-11-powerpc64-smp_2.6.38-11.47_ppc64.deb18:15
hertonII: Downloading to kernel.ubuntu.com ... FAILED!18:15
hertonit's the only one missing18:15
davmor2ogasawara: I have wifi again with that installed18:15
quentusrexapw, SATA controller: ATI Technologies Inc SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode]18:16
ogasawaradavmor2: k, kicking off the next test build...18:16
apwherton, it is in the launchpad librarian, so it did exist 18:18
davmor2ogasawara: I'm off soon so I'll take this one from lp when I get back home from shopping and stuff possibly around 22:00bst currently 19:19 for a reference18:19
ogasawaradavmor2: cool, thanks18:19
hertonapw: hmm, maint-getabis looks at that 4 urls, none has it. strange thing as also none of them have any deb with arch=ppc6418:21
apwherton, it is in universe18:21
apwwhich i believe it should not be18:22
apwchange http://ports.ubuntu.com/pool/universe/l/linux/linux-image-2.6.38-11-powerpc64-smp_2.6.38-11.47_powerpc.deb18:22
apwherton, you can grab it from there for your purposes i suspect18:23
apwbut ... i'd ask why its there, we've had a lot of stable kernels drop in the wrong hole recently18:24
apwand its meant to be scripted to avoid that18:24
hertonapw: but this url also doesn't have the ppc64 deb (note that file it looks ends with "ppc64.deb")18:25
bjfherton, jjohansen, apw, ogasawara, bug 74709218:29
ubot2Launchpad bug 747092 in linux "[FUJITSU FMVNP2PL] edge scrolling does not work" [Undecided,Confirmed] https://launchpad.net/bugs/74709218:29
quentusrexapw, It seems to be much better now, but not fixed.18:45
quentusrexit is possible that restarting the machine after returning the command queue to 20 might have had an effect.18:46
quentusrexapw, any idea why dmesg never gets written to after boot? even when there is a printk that should be printing to it.18:49
apw_should work in my experience 18:50
quentusrexapw, so the issue is down from 10-15 times the overhead down to about 5-10 times the overhead.18:52
apw_herton: the ppc binaries should be sorted shortly18:52
hertonapw_: cool. I noted that previous natty releases didn't include ppc64 abi (there is no debian.master/abi/2.6.38-*/ppc64 on them)18:54
apw_ignore ppc64 it is not enabled18:55
apw_powerpc64 is a powerpc not ppc64 kernel18:55
bjfogasawara, sforshee, jjohansen, herton, whoever is looking at that bug, take a look at 74de8a14d8afe3d8dd009e223eea742a753314f4 in the oneiric repo18:57
bjfogasawara, sforshee, jjohansen, herton if we do the same thing but match on FMVNP2PL would that get us what we want?18:58
hertonbjf: it's possible, if the "Magic Sequence" is the same on Fujitsu19:02
ogasawarabjf: posted an additional comment to the bug19:02
bjfogasawara, i responded to your comment19:05
bjfogasawara, i'm getting "port 22: Connection refused" for tangerine19:06
ogasawarabjf: hrm, lemme try.  I've been using tyler lately19:06
ogasawarabjf: I keep getting a "Permission denied, please try again." when I enter my password19:09
bjfogasawara, try "the standard password"19:09
ogasawarabjf: ah, that works19:09
bjfogasawara, working for me now19:12
* herton -> eod (soccer)20:36
=== Quintasan_ is now known as Quintasan
=== yofel_ is now known as yofel
kamalrtg: at your convenience... htop for tangerine?21:05
kamaltgardner-afk: at your convenience... htop for tangerine?21:06
apwkamal, done21:21
kamalapw: ty21:21
keeswith pitti on vacation, who is doing kernel publications?21:51
quentusrexAnyone know how to enable ahci debug in the kernel?21:54
FanfareHi @ All! I get a kernel freeze when ever i disconnect  from LAN. How to debug? 21:58
bjfkees, that's always a good question22:01
bjfkees, the answer is supposed to be SpamapS, skaet, or jdstrand are all supposedly capable 22:03
keesjdstrand: I think you're EOD, but I'd rather do publications before friday. any chance you can look at the pending ones?22:03
skaetbjf,  I lack the right permissions on cocoplum it appears.  22:04
jdstrandkees: what is needed?22:04
skaetkees,  I can move to -proposed, but not -updates.22:04
keesbjf: do you have it handy? I know there is at least one I saw go into "needs copy" mode a few days ago.22:04
bjfkees, i'll look but i'm on rotation this cycle22:05
keesbjf: I can look too, no worries22:06
keesjdstrand: let me find them22:06
bjfkees, it's just that i've not been tracking them22:06
keesbjf: yeah. I have searches for "what needs me attention" but I don't have a "what's pending?" search handy... building22:07
bjfkees, i don't see anything right now that needs copying22:07
keesbjf: https://bugs.launchpad.net/kernel-sru-workflow/+bug/811215 lucid linux-lts-backport-maverick does, IIUC22:08
ubot2Ubuntu bug 811215 in kernel-sru-workflow "linux-lts-backport-maverick: 2.6.35-30.56~lucid1 -proposed tracker" [Undecided,In progress]22:08
jdstrandhttp://people.canonical.com/~ubuntu-archive/pending-sru.html shows that as having *many* bugs that haven't been confirmed22:08
jdstrandand one that needs to be backed out22:08
keeshttps://bugs.launchpad.net/kernel-sru-workflow/+bug/808934 maverick linux does too22:08
ubot2Ubuntu bug 808934 in kernel-sru-workflow "linux: 2.6.35-30.56 -proposed tracker" [Undecided,In progress]22:08
skaetjdstrand while you're at it, ;)  could you take a look at moving the .71 lucid kernel from -proposed to -updates https://bugs.launchpad.net/ubuntu/+source/linux/+bug/81350722:09
ubot2Ubuntu bug 813507 in linux "linux: 2.6.32-33.71 -proposed tracker" [High,In progress]22:09
keeshttps://bugs.launchpad.net/kernel-sru-workflow/+bug/813507 lucid linux too22:09
skaetheh22:09
bjfjdstrand, i believe most of those *many* are CVE's22:10
keesso, that's 3 that are many days old22:10
bjfjdstrand, oops, looking at the wrong one22:10
bjfkees, that is a lts-backport22:10
keesbjf: so?22:10
bjfkees, nothing just making sure we are looking at the same thing22:11
keeslucid linux is 6 days old (!)22:11
jdstrandI'm happy to process the kernels, though I would like to verify it is ready so need to review22:11
keeslucid linux-lts-backport-maverick is 2 days old22:11
jdstrandI'm currently looking at http://people.canonical.com/~kernel/reports/sru-report.html22:11
keesjdstrand: bugs 808934 813507 811215 all show full sign-off22:12
ubot2Launchpad bug 808934 in kernel-sru-workflow "linux: 2.6.35-30.56 -proposed tracker" [Undecided,In progress] https://launchpad.net/bugs/80893422:12
jdstrandI don't really understand that page22:12
keesjdstrand: as in, they're at the "promote" part of the workflow, iiuc22:12
bjfkees, jdstrand i'm not sure the backport should go to updates before the regular maverick kernel does22:12
keesjdstrand: basically https://wiki.ubuntu.com/Kernel/kernel-sru-workflow steps 16 and 1722:13
jdstrandoh my gosh, there is a lot in there22:13
keesbjf: sure, but they're both ready, afaict22:13
jdstrandbeen a while since I looked22:14
bjfkees, look at http://people.canonical.com/~kernel/reports/sru-report.html22:14
bjfkees, looks like 805209 needs verification on maverick22:14
jdstrandkees: so bug 808934 goes to security and updates?22:15
ubot2Launchpad bug 808934 in kernel-sru-workflow "linux: 2.6.35-30.56 -proposed tracker" [Undecided,In progress] https://launchpad.net/bugs/80893422:15
keesbjf: "Verification-testing" is Fix Released22:15
jdstrandbug 813507 to updates22:15
ubot2Launchpad bug 813507 in linux "linux: 2.6.32-33.71 -proposed tracker" [High,In progress] https://launchpad.net/bugs/81350722:15
bjfkees, i'm also unsure about 790754 w.r.t validation22:15
bjfkees, meant validation22:15
jdstrandand bug 811215 to security and updates?22:15
ubot2Launchpad bug 811215 in kernel-sru-workflow "linux-lts-backport-maverick: 2.6.35-30.56~lucid1 -proposed tracker" [Undecided,In progress] https://launchpad.net/bugs/81121522:15
keesbjf: oh22:15
keesjdstrand: in theory, yes, but hold on a sec. I want to understand what bjf is pointing out. :)22:15
* jdstrand holds for one sec22:16
keesbjf: where are those bugs verified in the workflow process?22:16
bjfkees, i'm confused, the "Verification-testing" should be set to "Fix Released" when the bugs have all been verified22:17
keesbjf: "will be reverted" was 20 days ago22:17
keesbjf: yeah, I would agree.22:18
keesbjf: herton set it to fix-released on the 13th, 5 days after 790754 was marked incomplete22:19
keesjdstrand: lucid linux to -updates appears good to go, though22:19
bjfkees, yes, and without talking to either him or sconklin, i'm not sure what to tell you22:19
keesbjf: yeah, I will hold off. I just saw it sitting for a long time and then realized pitti was on vacation. :)22:20
bjfkees, i'll send email to find out what's up22:20
keesjdstrand: please ignore the maverick backport and the lucid linux for now. we'll get this sorted tomorrow when sconklin and/or herton are here22:20
keesbjf: cool, thanks22:20
keesjdstrand: sorry _maverick_ linux. lucid linux to -updates is fine22:21
jdstrandkees: what do you need me to do now?22:21
jdstrand(bug number)22:21
keesjdstrand: 813507 appears ready for copying to -updates (and not -security)22:21
jdstrandkees: 'appears ready for copying' doesn't instill as much confidence as I would hope :P22:22
keesjdstrand: hah. well, the workflow process shows it ready, and sru-report seems to agree.22:22
jdstrandkees: are you talking about http://people.canonical.com/~kernel/reports/sru-report.html? I don't know how to read that report22:23
jdstrandwell, it has enough so I can figure it out22:24
jdstrand1 bug, 588861, and jamespage confirmed it as fixed22:25
* jdstrand goes to copy22:25
keesjdstrand: right, was just waiting for LP to cough that up.22:25
jdstrandthough I'm not sure why 588861 doesn't have verification tags...22:25
* bjf -> errand22:30
=== bjf is now known as bjf[afk]
jdstrandok, copied22:31
keesjdstrand: thanks!22:31
jdstrandtha is a lot of steps :)22:32
jdstrand(kernel-sru-workflow)22:32
jdstrandI am not suggesting anything different; just suprised :)22:32
keesjdstrand: it's actually pretty great; the transitions are well-defined and a bot keeps us all honest22:35
jdstrandseems like it22:36
skaetre jdstrand, 813507 is ready,  I've just been blocked on it going out since last Friday by not having the right permissions or getting someone not traveling who does.   Should have been pinging you yesterday.... (thanks kees - ;) )22:44
jdstrandskaet: ack and done22:45
skaetjdstrand: THANK YOU!  22:45
jdstrandhehe22:45
jdstrandsure :)22:46

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!