Ticket #564 (closed defect: worksforme)

Opened 4 years ago

Last modified 4 years ago

Exceptions after graceful shutdown

Reported by: catlee Owned by: warner
Priority: minor Milestone: undecided
Version: 0.7.10 Keywords:
Cc:

Description

When trying to do a graceful shutdown of a few slaves last night, we ran into the exception below.

The slaves in question had been idle for quite a long time, one for over 2 hours, and the other for several days, so my guess right now is that the connection has timed out somehow. The slaves have keepalive=None set.

I haven't been able to reproduce this. If my guess is right, then pinging the slave may make this problem go away.

2009-05-12 16:47:58-0700 [Broker,233,10.2.71.196] Unhandled Error

Traceback (most recent call last):

File "/tools/buildbot/lib/python2.5/site-packages/buildbot/process/base.py", line 580, in allStepsDone

return self.buildFinished(text, self.result)

File "/tools/buildbot/lib/python2.5/site-packages/buildbot/process/base.py", line 613, in buildFinished

self.deferred.callback(self)

File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/internet/defer.py", line 242, in callback

self._startRunCallbacks(result)

File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/internet/defer.py", line 307, in _startRunCallbacks

self._runCallbacks()

--- <exception caught here> ---

File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/internet/defer.py", line 323, in _runCallbacks

self.result = callback(self.result, *args, kw)

File "/tools/buildbot/lib/python2.5/site-packages/buildbot/process/base.py", line 345, in _release_slave

self.slavebuilder.buildFinished()

File "/tools/buildbot/lib/python2.5/site-packages/buildbot/process/builder.py", line 245, in buildFinished

d = self.slave.buildFinished(self)

File "/tools/buildbot/lib/python2.5/site-packages/buildbot/buildslave.py", line 449, in buildFinished

return self.shutdown()

File "/tools/buildbot/lib/python2.5/site-packages/buildbot/buildslave.py", line 393, in shutdown

d = b.remote.callRemote("shutdown")

File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/spread/pb.py", line 340, in callRemote

_name, args, kw)

File "/tools/twisted-8.0.1/lib/python2.5/site-packages/twisted/spread/pb.py", line 815, in _sendMessage

raise DeadReferenceError?("Calling Stale Broker")

twisted.spread.pb.DeadReferenceError?: Calling Stale Broker

Change History

comment:1 Changed 4 years ago by dustin

  • Status changed from new to closed
  • Resolution set to worksforme

That sounds like a good guess. You should set the keepalive to something..

Note: See TracTickets for help on using tickets.