=== mgalvin [n=mgalvin@ubuntu/member/mgalvin] has joined #ubuntu-server | ||
=== MrRio [n=rio@pdpc/supporter/sustaining/MrRio] has left #ubuntu-server ["Leaving"] | ||
=== elias__ [n=Mussi@201.22.150.44.adsl.gvt.net.br] has joined #ubuntu-server | ||
=== nictuku [n=yves@ubuntu/member/nictuku] has joined #ubuntu-server | ||
=== nandemonai [n=nandemon@ppp217-74.lns1.adl2.internode.on.net] has joined #ubuntu-server | ||
xerophyte | anybody useing postfix and saslauthd | 07:04 |
---|---|---|
xerophyte | i am getting some auth fail werror with ubuntu but fedora core just work fine .. and i tested with testsaslauthd it worked fine | 07:05 |
=== Vaske_Car [n=opera@d38-208-116.home1.cgocable.net] has joined #ubuntu-server | ||
Vaske_Car | anybody have a minute to explane me something? | 07:43 |
Vaske_Car | actually I need tutorial to install required aplication to host forum | 07:44 |
=== Vaske_Car [n=opera@d38-208-116.home1.cgocable.net] has left #ubuntu-server [] | ||
=== soumyadip [n=soumyadi@59.93.198.181] has joined #ubuntu-server | ||
=== soumyadip [n=soumyadi@59.93.198.181] has joined #ubuntu-server | ||
=== nandemonai [n=nandemon@ppp217-74.lns1.adl2.internode.on.net] has joined #ubuntu-server | ||
=== ToadZzZztool [n=jcorbier@maisel-gw.enst-bretagne.fr] has joined #ubuntu-server | ||
=== truz24 [n=truz24@12.203.70.118] has joined #ubuntu-server | ||
=== spike [n=spike@unaffiliated/spike] has joined #ubuntu-server | ||
=== lionelp [n=lionel@ip-128.net-82-216-65.rev.numericable.fr] has joined #ubuntu-server | ||
=== nnonix [n=brad@xeon.bkjohnson.com] has joined #ubuntu-server | ||
=== fabbione [i=fabbione@gordian.fabbione.net] has joined #ubuntu-server | ||
=== Drac[Server] [n=Draccy@c-24-60-219-129.hsd1.ma.comcast.net] has joined #ubuntu-server | ||
=== asw [n=asw@karuna.med.harvard.edu] has joined #ubuntu-server | ||
=== Nite_Hawk [n=nh@wildfire.msi.umn.edu] has joined #ubuntu-server | ||
=== tepsipakki [n=tjaalton@replicant.hut.fi] has joined #ubuntu-server | ||
=== neuralis [n=krstic@solarsail.hcs.harvard.edu] has joined #ubuntu-server | ||
=== infinity [n=adconrad@loki.0c3.net] has joined #ubuntu-server | ||
=== nandemonai [n=nandemon@ppp217-74.lns1.adl2.internode.on.net] has joined #ubuntu-server | ||
=== ubuntulog [i=ubuntulo@trider-g7.fabbione.net] has joined #ubuntu-server | ||
=== Topic for #ubuntu-server: ubuntu-server development discussions | for general support see #ubuntu | U. S. (stable) at http://tinyurl.com/b3jek | U. S. (Devel) at http://tinyurl.com/cllfu | U. S. dapper specs: http://tinyurl.com/aen9b | U. S. forums at http://tinyurl.com/b77qg | ubuntu-server@lists.u.c is up and running | searchable packages list: http://packages.ubuntu.com | ||
=== Topic (#ubuntu-server): set by fabbione at Thu Apr 27 14:52:47 2006 | ||
=== #ubuntu-server [freenode-info] why register and identify? your IRC nick is how people know you. http://freenode.net/faq.shtml#nicksetup | ||
=== Cturtle [n=Cturtle@a213-84-50-38.adsl.xs4all.nl] has joined #ubuntu-server | ||
=== ivoks [n=ivoks@ubuntu/member/ivoks] has joined #ubuntu-server | ||
=== nawty [n=neogenix@globlet.eefy.net] has joined #ubuntu-server | ||
nawty | guys, gots a question, anyone around? | 01:03 |
nawty | HostRAID, is that controller supported in the -server kernel ? | 01:03 |
nawty | Intel/Adaptec afaik, SATA. | 01:04 |
nawty | Standard in some of our Intel Boxen. | 01:04 |
soumyadip | I suppose so | 01:12 |
soumyadip | it is there in the stock kernel | 01:12 |
nawty | soumyadip: it detects the two sata disks seperately, and not as the raid, where as the vanilla kernel on the gentoo install works perfectly, as does freeBSD | 01:13 |
nawty | on FreeBSD it becomes ar0 | 01:15 |
soumyadip | http://www.ubuntuforums.org/showthread.php?t=34519 <- maybe this would help | 01:16 |
nawty | checking quick, :) | 01:16 |
=== Cturtle [n=Cturtle@a213-84-50-38.adsl.xs4all.nl] has joined #ubuntu-server | ||
=== thefish [n=thefish@unaffiliated/thefish] has joined #ubuntu-server | ||
=== truz24 [n=truz24@12.203.70.118] has joined #ubuntu-server | ||
=== mgalvin [n=mgalvin@ubuntu/member/mgalvin] has joined #ubuntu-server | ||
nawty | it's the SATA Hostraid, not the SCSI one. | 04:13 |
=== CarlFK [n=carl@c-67-163-39-124.hsd1.il.comcast.net] has joined #ubuntu-server | ||
=== allee [n=ach@217.19.180.111] has joined #ubuntu-server | ||
=== allee [n=ach@217.19.180.111] has joined #ubuntu-server | ||
=== zenrox [n=zenrox@71.115.198.118] has joined #ubuntu-server | ||
=== lbm [n=lbm@0x555298ca.adsl.cybercity.dk] has joined #ubuntu-server | ||
=== CarlFK [n=carl@c-67-163-39-124.hsd1.il.comcast.net] has joined #ubuntu-server | ||
=== nandemonai [n=nandemon@ppp217-74.lns1.adl2.internode.on.net] has joined #ubuntu-server | ||
=== ivoks [n=ivoks@ubuntu/member/ivoks] has joined #ubuntu-server | ||
=== soumyadip [n=soumyadi@59.93.247.183] has joined #ubuntu-server | ||
=== nandemonai [n=nandemon@ppp217-74.lns1.adl2.internode.on.net] has joined #ubuntu-server | ||
=== soumyadip_ [n=soumyadi@59.93.245.201] has joined #ubuntu-server | ||
=== fabbione [i=fabbione@gordian.fabbione.net] has joined #ubuntu-server | ||
=== highvoltage [n=Jono@ubuntu/member/highvoltage] has joined #ubuntu-server | ||
highvoltage | hi there. | 09:00 |
highvoltage | i need some help for someone in #edubuntu | 09:00 |
highvoltage | this person has 8GB RAM on an LTSP server | 09:00 |
=== Petaris [n=Petaris@216.56.37.162] has joined #ubuntu-server | ||
highvoltage | so I suggested they install the server kernel. | 09:00 |
highvoltage | the problem is, it brings the server to a crawl. | 09:00 |
highvoltage | hi Petaris, i'm just about half way explaining your problem :) | 09:01 |
Petaris | highvoltage: I didn't even know about this channel | 09:01 |
Petaris | hehe | 09:01 |
highvoltage | and with a 686 kernel, you'd only be able to use 4GB of the ram on that server. | 09:01 |
highvoltage | so what would be the ideal Ubuntu kernel for a big LTSP server? | 09:01 |
Petaris | my system is a dual opteron with 8 GB of RAM (4 per cpu) and hardware raid 1 using an LSI MegaRAID SATA PCI-X adapter | 09:04 |
=== Cturtle [n=Cturtle@a213-84-50-38.adsl.xs4all.nl] has joined #ubuntu-server | ||
=== ivoks [n=ivoks@lns02-1277.dsl.iskon.hr] has joined #ubuntu-server | ||
ivoks | highvoltage: what's the problem? | 09:14 |
highvoltage | ivoks: Petaris is building a big ltsp server, with 8GB RAM | 09:14 |
ivoks | ok | 09:14 |
highvoltage | the 686 kernel can only see up to 4GB RAM, so he's using the ubuntu server kernel | 09:14 |
ivoks | ok | 09:15 |
highvoltage | but it brings the machine to a crawl very quickly | 09:15 |
highvoltage | so which kernel should he use? | 09:15 |
Petaris | my system is a dual opteron with 8 GB of RAM (4 per cpu) and hardware raid 1 using an LSI MegaRAID SATA PCI-X adapter | 09:15 |
highvoltage | it's a dual-opteron server, btw. | 09:15 |
ivoks | crawl as slow or it dies? | 09:16 |
Petaris | slow | 09:16 |
Petaris | very slow | 09:16 |
ivoks | did you try to figure out why it's so slow? | 09:16 |
Petaris | I looked a bit, but didn't find any real obvious reasons | 09:17 |
highvoltage | ivoks: well, it's only slow with the server kernel, with the 386 kernel, it was apparently much faster | 09:17 |
highvoltage | right Petaris? | 09:17 |
Petaris | highvoltage: yes | 09:17 |
ivoks | hm... | 09:18 |
ivoks | run it with -server kernel | 09:19 |
ivoks | and i'll be here next few hours | 09:19 |
ivoks | so i can help you debug the problem | 09:19 |
ivoks | what version is that? | 09:20 |
=== mdz [n=mdz@studiocity-motorola-bsr1-70-36-194-85.vnnyca.adelphia.net] has joined #ubuntu-server | ||
mdz | highvoltage: what's up? | 09:20 |
Petaris | 2.6.15-21 | 09:20 |
highvoltage | mdz: thanks for coming :) | 09:20 |
ivoks | ok, not the latest, but... | 09:21 |
highvoltage | Petaris is building a big ltsp server, with 8GB RAM | 09:21 |
ivoks | Petaris: install -22 for start | 09:21 |
highvoltage | the 686 kernel can only see up to 4GB RAM, so he's using the ubuntu server kernel | 09:21 |
highvoltage | but it brings the machine to a crawl very quickly | 09:21 |
highvoltage | so which kernel should he use? | 09:21 |
mdz | he should use the server kernel | 09:21 |
ivoks | to take the most of the ram - server | 09:21 |
mdz | if he's having a problem with that kernel, he should report a bug and work with BenC to get it resolved | 09:21 |
mdz | otherwise it's just going to bite someone else | 09:22 |
highvoltage | he reports that the system runs very, very slow with the server kernel though, and that's with just one thin client connected. | 09:22 |
highvoltage | mdz: ok, thanks for that feedback | 09:22 |
mdz | highvoltage: that's not a feature | 09:22 |
Petaris | ivoks: that is the version that kernel-image-server installed | 09:22 |
ivoks | Petaris: i know, but new version is out | 09:22 |
highvoltage | Petaris: i think our best bet is to track down BenC, and find out what information he needs to fix it | 09:23 |
Petaris | ivoks: ok | 09:23 |
ivoks | Petaris: metapackage still doesn't install it, but it will soon | 09:23 |
Petaris | highvoltage: right | 09:23 |
highvoltage | Petaris: i see he's on #ubuntu-kernel, let's go bug him there :) | 09:24 |
ivoks | file a bug | 09:24 |
ivoks | but we can work on a problem | 09:24 |
Petaris | highvoltage: ok | 09:24 |
highvoltage | ivoks, mdz: thanks again for pointing us in the right direction | 09:24 |
ivoks | highvoltage, Petaris rarely there is a chance to work on a broken system in real time, so it would be nice if you could give some more informations here on IRC | 09:26 |
ivoks | and paste everything to the launchpad bug | 09:27 |
Petaris | ivoks: What info would you like? | 09:27 |
ivoks | do you run it now? | 09:27 |
mdz | highvoltage: np | 09:27 |
Petaris | ivoks: any chance this could just be my system? | 09:27 |
ivoks | Petaris: all options are open, but we have to start with "it's kernel problem" :) | 09:28 |
Petaris | ivoks: yep, its running now | 09:28 |
Petaris | just grabbing the -22 kernel | 09:28 |
ivoks | keep an eye on load and tail syslog in other window | 09:28 |
ivoks | and kernlog in other | 09:29 |
highvoltage | Petaris: syslog might be handy, the output of dmesg too (perhaps there's some error somewhere) | 09:29 |
highvoltage | Petaris: perhaps also the contents of /proc/cpuinfo. i suppose more informaiton is better than less. | 09:29 |
Petaris | right | 09:30 |
ivoks | but don't paste it here :) | 09:30 |
Petaris | let me install this new kernel first | 09:30 |
ivoks | ok | 09:30 |
Petaris | maybe this will fix it | 09:30 |
Petaris | you never know | 09:30 |
ivoks | it has quite large changelog | 09:31 |
ivoks | not sure how much of it is related to your problem | 09:31 |
highvoltage | the k7 kernels has nothing to do with the opterons, right? | 09:35 |
ivoks | no | 09:36 |
Petaris | ok its in, rebooting | 09:38 |
ivoks | ok | 09:39 |
Petaris | server booted, booting client | 09:40 |
ivoks | ah.. does server without clients works ok? | 09:41 |
Petaris | don't know | 09:41 |
ivoks | ok | 09:41 |
Petaris | clients up | 09:42 |
ivoks | now tail syslog and kernlog | 09:42 |
ivoks | and open top to watch over load and apps that grab too much proc | 09:42 |
Petaris | its slow again | 09:43 |
ivoks | ok, can you work on it at all? | 09:43 |
ivoks | just run 'uptime' to see load | 09:44 |
Petaris | root@Ayumi:~# min, 1 user, load average: 0.40, 0.87, 0.44 | 09:44 |
ivoks | so, it's not load | 09:45 |
Petaris | nope | 09:45 |
Petaris | and top isn't showing much either | 09:45 |
ivoks | oh... hm... | 09:45 |
ivoks | dmesg | 09:45 |
ivoks | and try to catch any error | 09:45 |
ivoks | you can paste it to a file and upload it somewhere | 09:47 |
Petaris | :) | 09:47 |
ivoks | ok, sec... | 09:47 |
ivoks | this looks ok | 09:48 |
Petaris | what next then | 09:49 |
ivoks | netstat -a | grep -v unix | 09:49 |
ivoks | hm... | 09:51 |
ivoks | didn't you say you booted clients? | 09:51 |
Petaris | just one | 09:51 |
ivoks | none is connected | 09:51 |
Petaris | I'm not logged into it | 09:51 |
Petaris | could that be why? | 09:51 |
ivoks | ok, never mind... | 09:52 |
ivoks | and memory is mostly free? | 09:52 |
ivoks | free -m | 09:52 |
Petaris | root@Ayumi:/var/log# free -m | 09:52 |
Petaris | total used free shared buffers cached | 09:52 |
Petaris | Mem: 8011 244 7767 0 10 141 | 09:52 |
Petaris | -/+ buffers/cache: 92 7919 | 09:52 |
Petaris | Swap: 6204 0 6204 | 09:52 |
Petaris | easier to read: http://phpfi.com/115939 | 09:54 |
ivoks | hm... | 09:55 |
ivoks | just a sec... | 09:55 |
Petaris | ok | 09:55 |
ivoks | install and run saidar package | 09:56 |
ivoks | and take a look at disk activity | 09:57 |
Petaris | ok, sec | 09:57 |
ivoks | anything abnormal? | 10:05 |
Petaris | other then I'm still waiting for it to finish installing? | 10:09 |
ivoks | :) | 10:09 |
Petaris | :/ | 10:09 |
ivoks | ok... | 10:09 |
ivoks | in grub | 10:10 |
ivoks | add this argument to kernel: | 10:10 |
ivoks | elevator=cfq | 10:10 |
Petaris | add it at the end of that line? | 10:14 |
ivoks | yes... kernel .... elevator=cfq | 10:15 |
Petaris | added | 10:15 |
ivoks | now boot that kernel | 10:15 |
Petaris | ok | 10:15 |
Petaris | what will that do | 10:17 |
ivoks | change default io scheduler | 10:18 |
ivoks | from deadline to cfq | 10:18 |
ivoks | in -686 and -386 default if anticipatory | 10:19 |
ivoks | and in -server deadline | 10:19 |
ivoks | this is kernel tuning | 10:19 |
Petaris | ok its back up | 10:21 |
ivoks | it's not cpu, it's not memory, nor network | 10:21 |
ivoks | so, it has to be disk :) | 10:21 |
Petaris | and I was able to install saidar | 10:21 |
ivoks | is it slow again? | 10:22 |
Petaris | yeah, but not quite as slow | 10:22 |
Petaris | http://phpfi.com/115945 | 10:23 |
ivoks | faster than before? | 10:23 |
ivoks | but still slow | 10:23 |
Petaris | yes, but not by much | 10:23 |
ivoks | this comp is totally idle | 10:23 |
Petaris | yeah | 10:24 |
Petaris | not even a client booted yet | 10:24 |
Petaris | sda is getting a writes every few secounds | 10:24 |
ivoks | i guess these are nfs exports? | 10:25 |
ivoks | on sda | 10:25 |
Petaris | not sure | 10:25 |
ivoks | i'm missing something :) | 10:26 |
Petaris | me too | 10:26 |
ivoks | ok, try booting with elevator=anticipatory | 10:27 |
ivoks | (this is a long shot) | 10:27 |
Petaris | ok, rebooting | 10:28 |
Petaris | ok its up | 10:30 |
ivoks | and? | 10:31 |
Petaris | wth? | 10:31 |
Petaris | I can't ssh to it | 10:31 |
Petaris | ahh, there it goes | 10:31 |
ivoks | ? | 10:31 |
Petaris | still very slow | 10:32 |
ivoks | ok | 10:33 |
ivoks | then it's memory | 10:33 |
Petaris | espeacially with X stuff | 10:33 |
ivoks | X stuff? | 10:33 |
ivoks | on clients? | 10:33 |
Petaris | on the server | 10:33 |
Petaris | I haven't booted the client yet | 10:33 |
ivoks | hm... | 10:33 |
Petaris | maybe it is an xorg issue | 10:34 |
Petaris | naw | 10:34 |
Petaris | that would show in memmory probably | 10:34 |
ivoks | well, -server doesn't have preempt | 10:34 |
Petaris | hrm | 10:35 |
Petaris | is there anyway to add it? | 10:35 |
Petaris | like as a kernel option? | 10:35 |
ivoks | nope | 10:35 |
Petaris | bugger | 10:35 |
ivoks | pardon | 10:35 |
ivoks | it has preempt | 10:35 |
Petaris | oh | 10:36 |
Petaris | then thats not it | 10:36 |
ivoks | CONFIG_PREEMPT_NONE=y | 10:36 |
Petaris | hrm | 10:36 |
ivoks | # CONFIG_PREEMPT is not set | 10:37 |
Petaris | should it be? | 10:37 |
Petaris | *for an ltsp server | 10:37 |
ivoks | well, i'm not sure it's preempt problem | 10:38 |
ivoks | BenC will know that better | 10:38 |
ivoks | i'm really not sure | 10:38 |
ivoks | anyway, report a bug | 10:39 |
Petaris | hrm | 10:39 |
Petaris | This is not good | 10:39 |
Petaris | maybe I should just build my own kernel | 10:40 |
Petaris | off of the i386 one that worked | 10:40 |
ivoks | you can try with .config of -server | 10:40 |
ivoks | but change preempt | 10:40 |
Petaris | and add the smp and support for greater than 4 GB of RAM | 10:41 |
ivoks | and then you'll know if it is preempt | 10:41 |
Petaris | hrm | 10:41 |
ivoks | all kernels are i386 | 10:41 |
ivoks | but one is -686 | 10:41 |
Petaris | the i386 kernel (not server) worked quite well for me | 10:41 |
Petaris | but with only one cpu and 4 GB of ram | 10:42 |
ivoks | -386 kernel is generic | 10:42 |
ivoks | use -686 | 10:42 |
Petaris | hrm | 10:42 |
ivoks | did you file a bug about this? | 10:43 |
Petaris | no | 10:43 |
Petaris | not sure what to put in it | 10:43 |
Petaris | My system is slow? lol | 10:43 |
ivoks | poor performance with -server kernel on ltsp server | 10:43 |
ivoks | and mention that X apps are slow | 10:44 |
ivoks | or all apps are slow? | 10:45 |
Petaris | cli apps are slow as well, but not nearly as slow as X apps are | 10:45 |
ivoks | i doubt that's preempt | 10:45 |
ivoks | well... build your own kernel | 10:46 |
ivoks | and you'll see how it goes, but file that bug | 10:46 |
Petaris | is there anything speacial I have to do when building it? | 10:46 |
ivoks | get source | 10:47 |
ivoks | and copy /boot/config*-686 in .config | 10:47 |
ivoks | change max ram supported and that's it | 10:47 |
Petaris | I don't have a 686 config | 10:47 |
ivoks | wait... | 10:48 |
ivoks | is that 32bit or 64bit? :) | 10:48 |
ivoks | processor | 10:48 |
Petaris | opterons are 64 bit with 32 bit compatability | 10:49 |
Petaris | I run 32 bit on them | 10:49 |
ivoks | that's why -386 works | 10:49 |
ivoks | -686 wouldn't work either | 10:49 |
ivoks | get amd64 release | 10:50 |
ivoks | not i386 | 10:50 |
Petaris | won't that break my ltsp clients? | 10:50 |
Petaris | well worth a try | 10:50 |
ivoks | break? why? | 10:50 |
Petaris | 64 bit server enviornment with 32 bit clients? | 10:51 |
Petaris | hrm | 10:52 |
Petaris | where is the amd64 linux-image? | 10:52 |
Petaris | I can only find the k7 | 10:52 |
ivoks | on amd64 cd | 10:52 |
Petaris | hrm | 10:52 |
ivoks | together with amd64 libc :) | 10:52 |
Petaris | right | 10:52 |
Petaris | I was recommended not to run that for ltsp server | 10:53 |
ivoks | why? | 10:53 |
Petaris | issues with clients and some of the other software | 10:53 |
Petaris | ogra in #edubuntu was the one who advised that | 10:54 |
ivoks | thath could be, i don't know | 10:54 |
ivoks | then you have to use -386 kernel | 10:54 |
Petaris | right | 10:55 |
ivoks | not -686 | 10:55 |
Petaris | is there a specific source package I should use? | 10:56 |
Petaris | and is there anything speacial I have to do when building it? | 10:56 |
ivoks | apt-get install linux-source | 10:56 |
Petaris | ok | 10:56 |
Petaris | brb | 10:57 |
Petaris | back | 10:59 |
Petaris | ok, its installed | 11:02 |
ivoks | you'll find the source in /usr/src | 11:02 |
Petaris | ok | 11:03 |
ivoks | you know how to compile a kernel? | 11:03 |
Petaris | yeah | 11:03 |
ivoks | great | 11:03 |
Petaris | but is there anything speacial I need to know? | 11:03 |
ivoks | nope... | 11:04 |
ivoks | go in /usr/src/linux-... | 11:04 |
ivoks | copy /boot/config*-386 in .confg | 11:04 |
ivoks | .config | 11:04 |
ivoks | starta make menuconfig | 11:04 |
ivoks | add support for 16GB RAM | 11:04 |
ivoks | and build it with make | 11:04 |
Petaris | how do you create that initrd.img file in /boot | 11:05 |
nawty | Hey folks, anyone round here had any experience with the Adaptec/Intel/IBM SATA HostRAid ? | 11:06 |
ivoks | mkinitramfs -o /boot/my_new_initrd | 11:06 |
Petaris | ivoks: don't I have to do a make old-config or something? | 11:08 |
ivoks | no | 11:09 |
ivoks | just run make | 11:09 |
Petaris | oh | 11:09 |
Petaris | I seem to remember having to do that before | 11:09 |
ivoks | you runed make menuconfig | 11:10 |
ivoks | and changed a configuration | 11:10 |
ivoks | so oldconfig is newconfig now :) | 11:11 |
Petaris | ahh | 11:11 |
Petaris | ok | 11:11 |
Petaris | hrm | 11:16 |
Petaris | root@Ayumi:/usr/src/linux# make menuconfig | 11:16 |
Petaris | -bash: make: command not found | 11:16 |
Petaris | that can't be good | 11:16 |
ivoks | apt-get install build-essential | 11:16 |
Petaris | ok | 11:16 |
ivoks | i have to go now... | 11:16 |
Petaris | alright | 11:17 |
Petaris | thanks for all the help | 11:17 |
ivoks | i hope it will work | 11:17 |
Petaris | me too | 11:17 |
ivoks | read some docs about initrd | 11:17 |
ivoks | i'm not sure if it will work as i said | 11:17 |
Petaris | ok | 11:17 |
ivoks | bye | 11:17 |
Petaris | bye | 11:17 |
Petaris | hrm | 11:23 |
nawty | anyone? | 11:35 |
Petaris | nawty: LSI MegaRAID SATA | 11:35 |
Petaris | but none of the ones you listed | 11:35 |
nawty | :( | 11:36 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!