/srv/irclogs.ubuntu.com/2012/08/24/#maas.txt

=== lifeless_ is now known as lifeless
jtvbigjools: fwiw I see the app server reporting upload_leases requests on the API — so at least the initial loop of the beat jobs is closed!12:06
jtvHmm… looks like the request is being redirected though.12:07
jtvFor authentication.12:07
bigjoolsoops12:08
jtvIt's getting reported as success, but that may just be because the client is successfully told to bugger off — and I guess it just gives up.12:08
jtvIt follows the redirect, gets the login page, and…  done.12:09
jtvHmm.  Let me check the database.12:12
jtvNope.  Definitely not coming through.12:19
rbasakallenap: I just rebased my armhf patch series to today's trunk and have a conflict due to https://code.launchpad.net/~allenap/maas/new-tftp-layout/+merge/12018212:30
roaksoaxbigjools: group write means changing the permissions for path's where other package has been installed12:30
roaksoaxbigjools: meaning we would be messing with the permissions of other applications12:30
rbasakallenap: not sure what the implications are for me right now. It feels like this hinders my progress since there's no replacement right now. Any ideas?12:31
bigjoolsrbasak: ok12:31
bigjoolsoops12:31
bigjoolsroaksoax: ok12:31
allenaprbasak: There are a few more branches on the way. See https://code.launchpad.net/maas/+activereviews for the ones I need to land.12:32
roaksoaxbigjools: which I don't think/know is the right thing to do12:32
roaksoaxbigjools: for that matter, sudoers might be a better approach12:32
bigjoolsroaksoax: ok, we need to make a code change for that12:33
roaksoaxbigjools: but AFAIK sudoers only takes care of binaries, not files12:33
bigjoolsunless we can make celeryd run as root?12:33
bigjoolstoo dangerous?12:33
roaksoaxbigjools: I don't think the security team would want that12:33
bigjoolsok12:33
roaksoaxbigjools: another option could be to add the maas user to the daemon group12:33
roaksoaxbigjools: i.e. add maas user to the bind group12:34
roaksoaxthat should cover it right?12:34
bigjoolsroaksoax: I don;t know how that affects things, can you explain?12:35
roaksoaxbigjools: so if the maas user is in bind group, it would supposedly be able to access files that are for the bind group, right?12:36
bigjoolsoh what about dhcpd.conf?12:37
roaksoaxbigjools: we should be able to do the same12:37
roaksoaxbigjools: ig what I'm saying is right, then it should work12:37
roaksoaxwe'll have to test it out12:37
bigjoolsroaksoax: will it allow maas to restart the daemons?12:38
bigjoolswell we don't need to restart DNS other than at installation time12:38
bigjoolssince it uses an included config + rndc12:38
roaksoaxbigjools: that it wont do. That would supposedly allow us to write in /etc/bind and /etc/dhcp/12:39
roaksoaxbigjools: for the daemons, we would need sudoers12:39
bigjoolsok12:39
bigjoolswell it would still make my life easier to do the daemon group thing, it means a lot less code needs to change :)12:40
roaksoaxindeed12:40
roaksoaxso let me package tthis stuff first and then we can play with the group adding thing and sudoers12:40
bigjools    check_call(['sudo', 'service', 'isc-dhcp-server', 'restart'])12:40
bigjoolsis what it does to restart12:40
bigjoolsawesome12:41
roaksoaxbigjools: yeah, so we won't need to change anything12:41
bigjoolsok, I need to go to bed RSN12:41
bigjoolsroaksoax: you rock :)12:41
rbasakallenap: there seem to be merge conflict markers in the diff in https://code.launchpad.net/~allenap/maas/pxe-intel-arch-config/+merge/121039. Is this intentional?12:48
allenaprbasak: Oh, I'll check that out. Thanks.12:49
allenaprbasak: They're real; I need to merge trunk.12:50
rbasakOh, so this is how merge requests are supposed to work? I've not seen it before.12:51
roaksoaxallenap: can you please check that http://paste.ubuntu.com/1164368/ has all your patches to python-tx-tftp12:51
rbasakAh. "493 lines (+68/-315) 4 files modified (has conflicts)"12:51
rbasakI get it now :)12:51
roaksoaxallenap: there might be one missin12:51
allenapjtv: Any chance of a +1 for https://code.launchpad.net/~allenap/maas/pxe-intel-arch-config/+merge/12103912:54
allenapPlease :)12:54
jtvcoming12:54
allenaproaksoax: I'll take a look.12:54
* allenap can't remember how to use git12:55
jtvallenap: conflict.  (12:58
jtvConflicts, even.  :(12:59
allenapjtv: It's fixed and pushed, but Launchpad is being slow to catch up.13:00
jtvYes, it's slow at the moment.13:00
bigjoolsallenap: bzr-git? :)13:00
allenapbigjools: I did try that, and I just didn't get on with it.13:01
jtvallenap: done13:01
bigjoolsyeah I think it's incomplete13:01
allenapjtv: Ta!13:01
jtvNot seeing why the API is redirecting the worker to the login page.  If only piston didn't confuse Forbidden with Unauthorized...13:02
bigjoolsauthenticated url type?13:03
jtvlawnmower fiscal epidermis?13:04
jtvbigjools: no idea what your question meant, sorry.13:08
bigjoolsis it unauth or auth api13:08
jtvAuthenticated.13:08
* jtv goes to kitchen to make some hot toddy13:08
bigjoolsis the auth header getting added?13:09
allenaproaksoax: Full diff, I think: http://paste.ubuntu.com/1164399/13:13
roaksoaxallenap: ah, so there was things missing then13:13
allenapI have to go out for a bit, back in ~1h.13:13
jtvbigjools: it should be, since the request goes through the maas client… any tips on how to verify?13:18
bigjoolsmy brain shut down an hour ago13:19
jtvEww toddy is vile without the honey13:19
jtvOh seriously?  My logs dir is empty?13:20
roaksoaxbigjools: have you gusy hit an issue on PXE booting that causes an error with "Unable to locate configuration file"13:21
roaksoaxbigjools: or is this due to the missing patch to python-tx-tftp13:21
bigjoolsroaksoax: could be to do with allenap's latest changes?13:21
bigjoolsotherwise did you run maas-import-pxe-files?13:21
roaksoaxbigjools: i see this error since yesterday, so I'll wait for his changes to hit trunk13:22
roaksoaxbigjools: yes I did run it13:22
bigjoolsok I've not done a full boot for a few days13:22
* bigjools eod13:28
bigjoolsnn13:28
jtvallenap: have you seen this?  https://bugs.launchpad.net/maas/+bug/104115813:29
ubot5Ubuntu bug 1041158 in MAAS "Worker not authenticating to API in upload_leases" [Critical,Triaged]13:29
roaksoax-D  debian/maas-dhcp.config13:44
roaksoax-D  debian/maas-dhcp.lintian-overrides13:44
roaksoax-D  debian/maas-dhcp.postinst13:44
roaksoax-D  debian/maas-dhcp.postrm13:44
allenapjtv: I saw that someone (you?) marked it critical, that's it. What's up?14:29
jtvallenap: it means that the worker can't send its leases back to the server.14:32
allenapjtv: Gah. I hope that's a simple fix :) I guess you're EOD nowish, and I'm away until Thursday after today. I'll try and look at it later this afternoon.14:34
jtvallenap: what's really fun is that as far as I can make out, the request isn't touching any code in piston's authentication.py.14:34
jtvThanks.  Technically I'm about EOD and a half.14:35
allenapjtv: It's POSTing to /nodegroups/master/ - no /api/... in front.14:36
allenapjtv: Indeed, you should be tucked up in bed with some cocoa.14:37
jtvWell I didn't have honey for the toddy, so I found some chocolate that's supposed to have honey in it.  Is that good?14:37
jtv(It was needed.  The concoction was horrible.)14:37
allenapjtv: Chocolate is almost always good for the mental state.14:38
jtvMental yes.  Physical…  Haven't been out at all today, so the sitting flesh isn't really supporting me any more.14:39
jtvAnyway, let me see about that URL14:39
jtvYup, that's it!  Missing prefix.14:39
jtvJust got a notice that the worker hadn't had a refresh from the server yet, so it wasn't sending DHCP.14:42
jtvMaybe that's something to do with the restart logic.14:43
jtvallenap: yay!  Just a POST now.  Not a lot of detail in the logs, but...14:47
jtvallenap: do you know off the top of your head how the API test can get at the netloc it's running its API at?15:02
jtvAt least, I _think_ it runs real http on a real port…  I hope it does.15:02
allenapjtv: settings.DEFAULT_MAAS_URL... and get_maas_facing_server_host() returns the hostname part of that.15:07
allenapOf course, that doesn't work outside of Django.15:08
jtvYeah but does that apply to tests?15:08
jtvThat's why I'm doing this in the API test, not in the worker test.15:08
allenapjtv: self.client.get(reverse(...), ...) or absolute_reverse().15:09
jtvHmm… it uses http://localhost/15:09
jtvWonder why it 404s when I feed that to the worker15:10
allenapjtv: I think self.client cheats.15:10
jtvYes, I would expect it to.15:11
allenapYay Django.15:11
jtvBut I also thought there was a real service waiting for real http requests during the tests.15:11
jtvallenap: if you have time… https://code.launchpad.net/~jtv/maas/bug-1041158/+merge/12120715:47
ubot5Ubuntu bug 121207 in gcc-3.4 (Ubuntu) "[Feisty] Dangling symlink in amd64 libg2c0-dev package" [Undecided,Won't fix]15:47
allenapjtv: Sure :)15:49
jtvThanks15:49
jtvubot5 has quite an imagination.15:49
ubot5jtv: I am only a bot, please don't think I'm intelligent :)15:49
jtvShut up.15:50
jtvallenap: oh dear... lots and lots of really strange-looking failures on a fresh branch.15:54
allenapGah.15:55
jtvMostly DNS stuff I think.15:55
allenapjtv: +1 for that mp.15:58
jtvThanks.15:58
jtvAnd it looks like either start_up is now being called 3× where previously it was called once, or tests have been converted from FakeMethod to Mock and become accidentally stricter in the process.15:59
allenapjtv: Got time for a short review? https://code.launchpad.net/~allenap/maas/patch-mock-thing/+merge/12121016:00
jtvYes16:00
allenapThanks.16:00
allenapWeird.16:01
jtvDone.16:01
allenapThanks.16:04
jtvWell, trunk looks thoroughly  broken & I don't see a clear single reason16:05
jtvOr does it?  Maybe it's just my fresh branch that's broken.16:06
jtvYup.  It's my branch.  Maybe I shouldn't have named it all-you-zombies.16:07
allenapHeh16:07
allenapjtv: Do you ever use `lsof +D` btw? It is remarkably useful for finding still running stuff that's causing weird failures.16:08
allenapWell, `lsof +D $directory`.16:08
jtvOh, no, I don't use the whole program much actually.16:08
jtvAnd usually I just grep my way around the output of such tools.16:09
allenapjtv: I guess I'm interested to know how other people do this stuff. lsof is the best thing I've found for this, but fuser can do similar things.16:10
jtvThere's so much of this out there that I prefer to remember just a few simple things.16:11
rbasaklsof has always confused me. I use it as a last resort, usually combined with grep16:19
jtvTools like “cut” can also help query and manipulate structured output uniformly.16:20
allenaproaksoax: I've just landed the last of my branches for this week. Any chance of a new package?16:38
* allenap has to go now, have a good weekend everyone.16:40
jtvnn allenap!16:42
roaksoaxallenap: there's a newer precise version16:42
roaksoaxjtv: you know anything about the tftp server?17:00
jtvroaksoax: a bit17:00
roaksoaxjtv: when trying to PXE boot, what happens if no PXE IP/MAC is found17:01
jtvThat's not really a question of the tftp server — by convention, the pxe client loads a config named “default” in that situation.17:02
roaksoaxjtv: wheres is that default ? where is it being handled?17:02
roaksoaxjtv: i keep getting an "unable to locate configuration file"17:03
jtvIt's dynamically generated by the tftp server.17:03
jtvBut that's probably not the issue here.17:03
jtvThe problem would seem to be in matching the path.17:03
roaksoaxjtv: right, (i get this on pserv.log: 2012-08-24 13:03:32-0400 [TFTP (UDP)] Datagram received from ('192.168.123.101', 49162): <RRQDatagram(filename=pxelinux.cfg/default, mode=octet, options={'tsize': '0', 'blksize': '1408'})>17:04
roaksoax)17:04
jtvThat means your DHCP server isn't configured right.17:04
roaksoaxjtv: my DHCP is right17:05
roaksoaxjtv: i have been working with it17:05
roaksoaxjtv: pre cobblerless MAAS17:05
jtvBut everything was very different back then.17:05
roaksoaxjtv: right, but DHCP only needs to tell where the bootp is for it to PXE boot17:05
roaksoaxjtv: it is an external DHCP17:06
roaksoaxjtv: this is on a virtual environment though17:06
jtvIs this i386?17:06
roaksoaxjtv: its a VM17:07
jtvAn i386 VM?17:07
roaksoaxcan't recall TBH17:07
roaksoaxit is my local dev environemtn17:08
jtvSo either i386 or amd64 then?17:08
roaksoaxthat's been working since orchestra17:08
roaksoaxyep17:08
jtvOK17:08
jtvDo you see any sign in the TFTP logs of pxelinux.0 being requested?17:08
roaksoaxjtv: where is that particular log stored? the only that has anything releated is pserv.log17:09
jtvBecause from what I heard, there's a weirdness where that file's directory effectively becomes the root for the session.17:09
jtvThat should be the one, yes17:09
roaksoaxjtv: http://paste.ubuntu.com/1164794/17:09
jtvThat's taking a while to load.17:10
jtvMay be beacuse I'm doing a big fsck.17:10
jtvWas there no mention of pxelinux.0 in that log?  It's possible because plain files are served in a different way from config files.17:11
roaksoaxjtv: the only mention is: [TFTP (UDP)] Datagram received from ('192.168.123.101', 1024): <RRQDatagram(filename=pxelinux.0, mode=octet, options={'blksize': '1432', 'tsize': '0'})>17:13
jtvThat makes it harder to find the information we need.17:13
jtvIs there any helpful logging on the client side?17:13
jtvOh wait,I see now17:13
jtvSorry; it's late here and I'm not well.17:14
jtvHaving a bit of trouble reading from the screen.17:14
jtvWell this tells us that the DHCP setup is definitely not right.17:14
roaksoaxjtv: hehe no worries17:14
roaksoaxjtv: the DHCP server is libvirt17:14
jtvAnd it's not set up to point clients to the right TFTP path.17:15
jtvThe right server, yes.17:15
roaksoaxjtv: "<bootp file='pxelinux.0' server='192.168.123.2' />"17:15
jtvBut not the right path.17:15
jtvYes.17:15
jtvThat's wrong.17:15
roaksoaxjtv: what's the right path?17:15
jtvWe use maas/<arch>/generic/pxelinux.017:15
roaksoaxjtv: right, but in a DHCP you can't tell what patch to use based on the arch right?17:16
jtvYou can, but it's tricky.17:16
roaksoaxjtv: ah, so why are we doing that then17:16
jtvIt's what we do in a MAAS-generated config.17:16
roaksoaxjtv: right, but when we are not using MAAS DHCP17:16
roaksoaxjtv: then that should not happen17:16
jtvBut as long as you've got a single-architecture setup, you can just use the path I gave you — with either i386 or amd6417:17
jtv(The paths are changing, but I don't think they've changed yet)17:17
roaksoaxjtv: right, but that defeats the purpose of PXE booting doesn it?17:17
jtvNot really.  The purpose of PXE booting is to give us control of a machine across power cycles.17:17
roaksoaxjtv: right, so in a mixed network, with external DHCP., we are in trouble17:18
jtvNow,17:18
roaksoaxjtv: on the case of an upgrade, we are screwed17:18
jtvthe i386 image will work just fine for amd64 machines.17:18
jtvAn upgrade?17:18
roaksoaxjtv: so, we have a maas server, we upgrade precise version to latests, we don't modify external DHCP17:19
roaksoaxthen we have a broken maas infrastrcuture17:19
jtvYes, so it seems.17:19
roaksoaxthat makes administrator manually modify their DHCP servers17:19
jtvYes, it's a manual step if MAAS doesn't manage DHCP.17:19
roaksoaxjtv: rigt, which defeats the purpose of everything17:20
roaksoaxjtv: i think there should be some defaults to continue to use the older path17:20
roaksoaxand default to i38617:20
roaksoaxfor these cases at least17:20
jtvI suspect you could work around that by installing pxelinux on the server.17:20
roaksoaxright, but we won't have the systems available would we?17:21
jtvHmm that fixes the pxelinux.0 problem, but not the config one.17:21
roaksoaxexactly17:21
jtvYou already have pxelinux-common installed, I suspect.17:21
roaksoaxyep17:21
roaksoaxIMHO, this is a regressio17:21
jtvGavin was working on this, but he has eow'ed.17:21
roaksoaxyeah, oh well17:22
jtvAnd for me it's technically saturday now, so I won't be around for long enough to fix this tonight.17:22
roaksoaxno worries17:22
roaksoaxi'll try to look into it if I find the time after i finish the stuff i need to get done17:22
jtvWould a workaround help?17:22
jtvTemporary one?17:22
rbasakAre you guys talking about a regression for precise->precise-updates, or precise->quantal?17:22
roaksoaxjtv: heh, now I get a permission denied to obtain the file :)17:23
jtvWhat did you change?17:23
roaksoaxjtv: i changed the pxelinux path17:24
jtvrbasak: I think we missed the 12.04.1 window, so I think the most urgent issue would be the latter.  But I'm not too sure.17:24
jtvroaksoax: what did you change it to?17:24
rbasakHmm, ok17:24
roaksoaxjtv: <bootp file='maas/i386/generic/pxelinux.0' server='192.168.123.2' />17:25
jtvThen what's biting you now, I think, is the problem that our patch for the tftp server is not in the package.17:25
roaksoaxjtv: probably. I have to review that by EOD too17:25
roaksoaxjtv: alright then. Thanks for the help :)17:26
jtvWaitwaitwait17:26
jtvI don't think you answered my question: would a workaround help?  Temporary one?17:26
jtvOr would it be a waste of time?17:26
roaksoaxjtv: to older way pxelinux.0 was located? I guess it would17:26
roaksoaxjtv: I think sabdfl  wanted to test over the weekend, but we can point out to the change in the DHCP server17:27
jtvWell he said he was quite keen to, so hell yeah he wants to test over the weekend!17:27
jtvI just wonder if this is what Gavin was doing.  Let me look.17:28
roaksoaxjtv: ok :) btw.. if you can point me out to the branch where the permission thing was fixed for python-tx-tftp would be great too17:28
jtvOuch.  I don't know that.  I only heard it talked about.17:29
jtvDon't even know if it's on launhpad or github.17:29
roaksoaxjtv: hehe no worries, I'll look it up17:32
* roaksoax off to lunch before he gets cranky17:32
jtvOK.17:32
roaksoaxjtv: thanks for the help though17:32
jtvI have something in mind for the config files, making use of something Gavin landed tonight.17:32
jtvOh dear.  Where do we match “default” config at all?17:57
jtvI remember now.  We generated it as part of the filesystem tree when installing a new image.18:00
jtvBut not now, I think...18:04
jtv roaksoax: having serious system problems now, not sure why.  But I have a branch that you might want to try.  It may solve at least part of the problem.19:05
roaksoaxjtv: got the access denied issue figured out.. python-tx-tftp was with incomplete patches apparently19:06
jtvHmm19:07
roaksoaxbut it seems that i just found another issue :)19:07
roaksoaxpermissions wrongly set for commissioning directory19:08
jtvI may drop out of the conversation at any moment.19:08
jtvCommissioning directory?19:08
jtvYou mean in /var/lib/tftpboot/...?19:08
roaksoaxjtv: /var/lib/tftpboot/maas/.../commissioning19:08
roaksoaxjtv: yeah19:08
jtvWe fixed that a few weeks back.19:09
jtvOr maybe this week?19:09
jtvNot very long ago.19:09
roaksoaxjtv: uhmmm upgrading didn't work right then19:09
roaksoaxjtv: now it doesn't enlist19:10
jtvDid you get past the problem of not finding the default pxe config somehow?19:11
roaksoaxjtv: yeah19:11
roaksoaxjust edited the path to maas/pxelinux.019:11
roaksoaxjtv: and now : NameError: name 'preseed_data' is not defined at line 14 column 3 in file /usr/share/maas/preseeds/generic at line 87 column 3 in file /usr/share/maas/preseeds/preseed_master19:11
jtvroaksoax: back after some system trouble… how did you get around the pxe-config problem?19:23
roaksoaxjtv: <bootp file='maas/pxelinux.0' server='192.168.123.2' />19:24
jtvAnd then the machines booted into enlistment?19:24
roaksoaxjtv: they boot into the commissioning environment that does the enlistment19:24
roaksoaxjtv: but there's an error on the preseed19:25
roaksoaxNameError: name 'preseed_data' is not defined at line 14 column 3 in file /usr/share/maas/preseeds/generic at line 87 column 3 in file /usr/share/maas/preseeds/preseed_master19:25
jtvScott may know.19:26
roaksoaxsmoser: ^^19:26
jtvroaksoax: I'm crashing.  I've got a review up for a compatibility change that would solve your previous problem, but I'm not in a state where I can judge whether it's a good idea.  I'll have to call it a night!19:29
smoseroh fool.19:29
smoserfoo19:29
smosernot fool19:29
jtvfood?19:29
smoserwhere is this?19:29
smosertrunk ?19:30
roaksoaxjtv: thanks a lot! it used to be under maas/<arch>/etc/etc/pxelinux.0 now it is under maas/pxelinux.0 so should be easier19:30
roaksoaxsmoser: trunk19:30
roaksoaxsmoser: packaging up the latest trunk19:30
jtvroaksoax: the branch I have up here also supports the classic pxelinux.cfg/*: https://code.launchpad.net/~jtv/maas/bug-1041318/+merge/12126619:31
ubot5Ubuntu bug 121266 in openoffice.org (Ubuntu) "OpenOffice does not start: abnormal early exit ..." [Undecided,Invalid]19:31
jtvShut up, bot.19:31
roaksoaxjtv: cool I'll take a look19:32
smoseri dont know from the to po fmy hhead.19:33
roaksoaxsmoser: ok ;)19:36
allenaproaksoax: Do you have some background on bug 1041327?21:44
ubot5Launchpad bug 1041327 in MAAS "Where's the “default” PXE config?" [Critical,Triaged] https://launchpad.net/bugs/104132721:44
roaksoaxallenap im guessing is the fact that in order to use the tftp we have to tell the external dhcp server that pxelinux.0 is in maas/pxelinux.021:54
allenaproaksoax: jtv mentioned that you were having problems with that, in a merge proposal. Is that because the boot filename cannot be set on your DHCP server?21:55
roaksoaxallenap so on upgrades for those who have external dhcp maas is "broken"21:55
roaksoaxbecauae if you upgrade maas magically tftp fails21:56
allenaproaksoax: Ah, is this only pertinent to upgrades?21:56
roaksoaxyrs21:56
allenapRighty ho. In https://code.launchpad.net/~jtv/maas/bug-1041318/+merge/121266 I ponder if we shouldn't just get rid of the maas/ prefix completely.21:56
ubot5Ubuntu bug 121266 in openoffice.org (Ubuntu) "OpenOffice does not start: abnormal early exit ..." [Undecided,Invalid]21:56
allenapubot5: Your regex is wrong.21:57
roaksoaxallenap leaving it there might be benefitial if we have Nother infrastructure in pla e21:58
roaksoaxthe only problem i see is that since pxelinux.0 that maas is using chanves administrators will see this as broken21:59
roaksoaxbecauze they would need yo update the dhcp server to tsll the new location21:59
roaksoaxhowever this could so be a regression21:59
roaksoaxbecause an upgrade and path location haz changed21:59
roaksoaxso if old pxelinux.0 is left Nd dchp server not chsnged then cinfig file iz not found22:00
roaksoaxon new jnsls we have to tell the admin tha oxelinux.9 for maas has changrd location but in uogrades we cant just simply change and expect admins will figure out wjat was wrong22:01
roaksoaxso it should be backwards comoatible22:01
roaksoaxallrnap unless we tell tctp that root is /var/lib/tftpboot/maas22:03
roaksoaxdahhh that shiuld cover it22:03
roaksoaxso no need for code chsnges rught?22:03
roaksoaxonly config22:03
allenaproaksoax: I'm way too tired to understand all that right now! I think it may be best if you email the list, as I'm away until Thursday next week too.22:08
allenaproaksoax: Have a good weekend, thanks for putting up with us upstreamers :)22:08
roaksoaxallenap will do have a good week22:08
roaksoaxhehe no worries22:08
roaksoaxglad to had the chance to work with u guys22:09

Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!