Opened 5 years ago

Last modified 5 years ago

#3018 new defect

Slaves appear to be building when doing nothing

Reported by: Ben Owned by:
Priority: major Milestone: 0.8.x
Version: 0.8.9 Keywords:
Cc:

Description

From: http://markmail.org/thread/zknduuglpmpi46pk

I have run into the following problem recently:

from the buildslaves view I see that some slaves are being used, thus marked as yellow:

Running 1 build(s)

When I open any of those slaves' dedicated page they are doing nothing. They successfully finished the previous build but dont seem to be able to get an other job, as I guess the master is still seeing them as busy.

It only seems to be happening on linux slaves.

014-11-10 16:25:01+0100 [-] Unhandled Error
Traceback (most recent call last):
  File
"/usr/local/lib/python2.7/dist-packages/buildbot/process/buildstep.py",
line 663, in finished
    self._finishFinished(results)
  File
"/usr/local/lib/python2.7/dist-packages/buildbot/process/buildstep.py",
line 676, in _finishFinished
    self.deferred.callback(results)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line
362, in callback
    self._startRunCallbacks(result)
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line
458, in _startRunCallbacks
    self._runCallbacks()
--- <exception caught here> ---
  File "/usr/lib/python2.7/dist-packages/twisted/internet/defer.py", line
545, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File "/usr/local/lib/python2.7/dist-packages/buildbot/process/build.py",
line 416, in _stepDone
    return self.startNextStep()
  File "/usr/local/lib/python2.7/dist-packages/buildbot/process/build.py",
line 403, in startNextStep
    return self.allStepsDone()
  File "/usr/local/lib/python2.7/dist-packages/buildbot/process/build.py",
line 506, in allStepsDone
    return self.buildFinished(text, self.result)
  File "/usr/local/lib/python2.7/dist-packages/buildbot/process/build.py",
line 537, in buildFinished
    self.builder.setExpectations(self.progress)
  File
"/usr/local/lib/python2.7/dist-packages/buildbot/process/builder.py", line
450, in setExpectations
    self.expectations.update(progress)
  File
"/usr/local/lib/python2.7/dist-packages/buildbot/status/progress.py", line
295, in update
    old = self.times[name]
exceptions.KeyError: 'shell_20'

Change History (2)

comment:1 Changed 5 years ago by Ben

More information:

The issue seems to have gone by restating the service on the master.

All I did was:

  • add a new step to the factory
  • reconfig the master

Again, this introduced the issue. Restarting the service fixed it. So yep that step 20 already existed, only thing it used to be the 19th.

comment:2 Changed 5 years ago by dustin

  • Milestone changed from undecided to 0.8.x
  • Type changed from undecided to defect

Progress is removed (and will likely be rewritten) in nine, so I'm marking this for 0.8.x.

Note: See TracTickets for help on using tickets.