| cjwatson | guruprasad: have you tried resetting the relevant builders? that shouldn't need an SRE | 10:33 |
|---|---|---|
| guruprasad | cjwatson, I reset the builders and that didn't do anything at all - nothing in the buildd logs. That is why I asked for IS help. | 14:12 |
| guruprasad | *buildd-manager logs. I had asked them to delete the stuck VMs and restart buildd manager. | 14:13 |
| guruprasad | They did the former and instead of the latter, restarted the ppa-reset service. Which did not help. | 14:16 |
| guruprasad | This meant that the affected builders are now unstuck and handling other builds. But the builds themselves are still stuck. Based on what we have done in the recent past for similar issues, a buildd manager restart is needed to sort this out. | 14:21 |
| guruprasad | I have asked again for help. | 14:24 |
| guruprasad | I was wrong about the builders getting unstuck too! :( | 14:26 |
| guruprasad | ricotz, the builds have been cancelled now and you should be able to retry. | 14:45 |
| RikMills | guruprasad: this finished building over hrs ago, but has still not been published to the release pocket https://launchpad.net/ubuntu/+source/haruna/0.12.3-1ubuntu1 | 14:47 |
| RikMills | *over 4 hrs | 14:47 |
| RikMills | is there something amiss with the publisher? | 14:47 |
| guruprasad | RikMills, that is what I was alerted about and we are looking at right now. | 14:48 |
| guruprasad | There is something stuck holding the lock and blocking all the subsequent runs for the past 6 hours. | 14:48 |
| RikMills | guruprasad: great :) thanks | 14:49 |
| RikMills | great someone is trying to sort I mean | 14:57 |
| guruprasad | RikMills, it looks like we fixed the issue and there is a new run progressing along nicely. | 15:11 |
| RikMills | guruprasad: appreciated. especially on a Sunday! | 15:12 |
| guruprasad | happy to help :) | 15:13 |
| ricotz | guruprasad, thank you, builds were already running :) | 15:32 |
Generated by irclog2html.py 2.7 by Marius Gedminas - find it at mg.pov.lt!