| maozhou | When I run "cronscripts/process-job-source.py IInitializeDistroSeriesJobSource", it output deug message "Running <InitializeDistroSeriesJob for distribution: kylin, distroseries: ginkgo, parent[overlay?/pockets/components]: utopic[False/Release/main], architectures: (u'amd64', u'arm64', u'armhf', u'hppa', u'i386'), archindep_archtag: None, packagesets: None, rebuild: True> (ID 2044) in status Waiting". How to debug it ? | 07:57 |
|---|---|---|
| wgrant | maozhou: Debug what? | 08:00 |
| maozhou | wgrant: How to make it initialize the series ? | 08:02 |
| wgrant | maozhou: You've said that it said it initialised the series, but nothing further. | 08:02 |
| wgrant | There's no problem. | 08:02 |
| maozhou | wgrant: But , it's this status for hours | 08:05 |
| wgrant | Ah, that is an important piece of information. | 08:05 |
| wgrant | Is it doing anything? | 08:05 |
| wgrant | if your machine is slow that may not be unreasonable. | 08:05 |
| maozhou | No, my machine is not slow.And there is no building job now. | 08:07 |
| maozhou | The build queue is empty | 08:08 |
| wgrant | Series initialisation does not create builds. | 08:08 |
| wgrant | Is the script still running? | 08:08 |
| maozhou | The script maintain this status | 08:09 |
| wgrant | I don't understand what you mean. | 08:10 |
| maozhou | http://i1.tietuku.com/74d40e72869ead18.png | 08:15 |
| wgrant | So it is still running, and has been running for several hours? | 08:15 |
| wgrant | Is it issuing database queries? | 08:15 |
| maozhou | Yes, it's has ben running for several hours. | 08:16 |
| maozhou | I search the ID which belong to the package ,the package has been builded successful. | 08:18 |
| wgrant | The package? | 08:19 |
| wgrant | IDS does not touch builds. | 08:19 |
| maozhou | The ID of 2044 , is it the package ID ? | 08:20 |
| wgrant | No, that's a job ID. | 08:21 |
| wgrant | IDS doesn't touch a single package. | 08:21 |
| wgrant | It touches an entire series. | 08:21 |
| wgrant | You should find out from postgres whether it is still actively issuing queries. | 08:22 |
| maozhou | which is postgres? | 08:23 |
| wgrant | PostgreSQL, the database that Launchpad uses. | 08:23 |
| maozhou | Which table can I find the job ID 2044? | 08:25 |
| wgrant | Either Job or DistributionJob, I forget. | 08:26 |
| maozhou | Need I modify the database manual ? | 08:28 |
| wgrant | No | 08:28 |
| wgrant | You need to work out whether the job is actually hung. | 08:28 |
| wgrant | strace it, look in pg_stat_activity to see if it's running DB queries, etc. | 08:28 |
| maozhou | ok, thank you | 08:30 |
| maozhou | wgrant: In table pg_stat_activity , I find the job is actually hung. How to deal with it? | 09:08 |
| maozhou | http://i1.tietuku.com/7bcb98edbf3a5831.png | 09:08 |
| wgrant | The transaction start time isn't very interesting, but the query start time is. | 09:08 |
| maozhou | I don't understand. | 09:12 |
| wgrant | maozhou: IDS can use long transactions, that's fine. | 09:14 |
| wgrant | The question is whether a single query has hung, and if so what that is. | 09:14 |
| wgrant | Those are other columns in pg_stat_activity that you haven't disclosed. | 09:14 |
| maozhou | I only select "datid,datname,pid,usename,Xact_start" from the table "pg_stat_activity" | 09:20 |
| wgrant | There should also be the query start time and query text. | 09:20 |
| wgrant | Those are interesting. | 09:20 |
| cjwatson | just select *, it's not that wide | 09:21 |
| cjwatson | better than messing about | 09:21 |
| cjwatson | and use a text pastebin rather than pointlessly turning text into an image :-) | 09:22 |
| maozhou | http://i3.tietuku.com/e31c6b656b8c47ce.png | 09:24 |
| maozhou | The output message is like this. | 09:25 |
| maozhou | the query is "idle in transaction | SELECT BinaryPackageBuild.arch_indep, BinaryPackageBuild.archive, BinaryPackageBuild.build_farm_job, BinaryPackageBuild.builder, BinaryPackageBuild.date_created, BinaryPackageBuild.date_finished, BinaryPackageBuild.date_first_dispatched, BinaryPackageBuild.date_started, BinaryPackageBuild.dependencies, BinaryPackageBuild.distribution, BinaryPackageBuild.distro_arch_series, BinaryPackageBuild.distro_series, Binar | 09:28 |
| maozhou | yPackageBuild.failure_count, BinaryPackageBuild.id, BinaryPackageBuild.is_distro_archive, BinaryPackageBuild.log, BinaryPackageBuild.pocket, BinaryPackageBuild.processor, BinaryPackageBuild.source_package_name, BinaryPackageBuild.source_package_release, BinaryPackageBuild.status, BinaryPackageBuild.upload_log, BinaryPackageBuild.virtualized FROM BinaryPackageBuild WHERE BinaryPackageBuild.archive = 18 AND BinaryPackageBuild.source_package_release | 09:28 |
| maozhou | = 6079 AND BinaryPackageBuild.distro_arch_series = 71 ORDER BY BinaryPackageBuild.id" | 09:28 |
| cjwatson | That would appear to be making progress. | 09:28 |
| maozhou | The query start time is "2015-08-20 15:39:18.258064+08" | 09:29 |
| cjwatson | query_start two minutes before you gave the paste URL here, if I have your timezone correct | 09:29 |
| cjwatson | No, it's not | 09:29 |
| cjwatson | That's the xact_start | 09:29 |
| cjwatson | query_start is 2015-08-20 17:22:12.816189+08 (which if you'd used a text pastebin I would have been able to copy and paste rather than having to retype it) | 09:30 |
| maozhou | Oh, yes , query start time is "2015-08-20 17:22:12.816189+08" | 09:33 |
| maozhou | Why It's idle in transaction? | 09:44 |
| wgrant | Because it is thinking, most likely. | 09:45 |
| wgrant | How big is the series you're copying from? | 09:45 |
| cjwatson | Or waiting for a lock | 09:46 |
| wgrant | No, idle means no query is in progress. | 09:46 |
| wgrant | (and waiting is false) | 09:46 |
| cjwatson | oh, true | 09:47 |
| cjwatson | (I blame openssh having eaten my brain) | 09:47 |
| wgrant | Heh | 09:47 |
| wgrant | What are you doing to it? | 09:47 |
| wgrant | Or is it conch? | 09:47 |
| maozhou | This series is derived from Utopic | 09:52 |
| wgrant | Your utopic. | 09:53 |
| wgrant | How big is your utopic? | 09:53 |
| maozhou | Will it spend long time for that? | 09:53 |
| maozhou | 114G | 09:54 |
| cjwatson | wgrant: 6.9p1 packaging, followed by fixing conch, followed by 7.0p1 packaging | 09:55 |
| wgrant | Aha | 09:55 |
| cjwatson | or hopefully fixing conch, anyway | 09:55 |
| cjwatson | which will then require upgrading twisted, hence my arguing with pip recently | 09:55 |
| cjwatson | btw, do you already have a yak-shaving machine factory or do I need to build one? | 09:56 |
| wgrant | All the yak-shaving machine capacity for the next year is alread spoken for, I'm afraid. | 09:56 |
| cjwatson | damn. | 09:57 |
| maozhou | Oh, it's finished ,thank you. | 09:59 |
| cjwatson | wgrant: tempted to make an LP-specific fork with https://github.com/msabramo/setuptools-git/pull/10 | 15:02 |
| cjwatson | (OK, won't help once we move to git, but would already have saved me the time I spent writing it) | 15:02 |
| cjwatson | A pip install of LP's dependencies is down to 36 seconds with that plus a wheel cache, which is still a lot slower than buildout's ~5 seconds but maybe now not prohibitively so | 15:04 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!
