Ticket #548 (closed defect: fixed)

Opened 4 years ago

Last modified 4 years ago

slave somehow gets into a state where it cannot process any new commands

Reported by: exarkun Owned by:
Priority: major Milestone: undecided
Version: 0.7.10 Keywords:
Cc:

Description

One day one of my slaves started to fail every build sent its way. In its logs, I found this near the time of each failed build:

2009-04-14 08:51:05-0400 [Broker,client] leftover command, dropping it
2009-04-14 08:51:05-0400 [Broker,client] stopCommand: halting current command <buildbot.slave.commands.SlaveShellCommand instance at 0x3830dd0>
2009-04-14 08:51:05-0400 [Broker,client] <bound method SlaveBuilder.remote_startCommand of <SlaveBuilder 'ubuntu64-pypy' at 38737392>> didn't accept (<twisted.spread.pb.RemoteReferen
ce instance at 0x24edcf8>, '1303', 'svn', {'workdir': 'build/Twisted-src', 'patch': None, 'retry': None, 'mode': 'copy', 'timeout': 1200, 'svnurl': 'svn://svn.twistedmatrix.com/svn/T
wisted/trunk', 'revision': 26700}) and {}
2009-04-14 08:51:05-0400 [Broker,client] Peer will receive following PB traceback:
2009-04-14 08:51:05-0400 [Broker,client] Unhandled Error
        Traceback (most recent call last):
          File "/usr/lib/python2.5/site-packages/twisted/spread/banana.py", line 146, in gotItem
            self.callExpressionReceived(item)
          File "/usr/lib/python2.5/site-packages/twisted/spread/banana.py", line 111, in callExpressionReceived
            self.expressionReceived(obj)
          File "/usr/lib/python2.5/site-packages/twisted/spread/pb.py", line 526, in expressionReceived
            method(*sexp[1:])
          File "/usr/lib/python2.5/site-packages/twisted/spread/pb.py", line 837, in proto_message
            self._recvMessage(self.localObjectForID, requestID, objectID, message, answerRequired, netArgs, netKw)
        --- <exception caught here> ---
          File "/usr/lib/python2.5/site-packages/twisted/spread/pb.py", line 851, in _recvMessage
            netResult = object.remoteMessageReceived(self, message, netArgs, netKw)
          File "/usr/lib/python2.5/site-packages/twisted/spread/flavors.py", line 117, in remoteMessageReceived
            state = method(*args, **kw)
          File "/home/exarkun/.local/lib/python2.5/site-packages/buildbot/slave/bot.py", line 160, in remote_startCommand
            self.stopCommand()
          File "/home/exarkun/.local/lib/python2.5/site-packages/buildbot/slave/bot.py", line 196, in stopCommand
            self.command.doInterrupt() # shut up! and die!
          File "/home/exarkun/.local/lib/python2.5/site-packages/buildbot/slave/commands.py", line 687, in doInterrupt
            self.interrupt()
          File "/home/exarkun/.local/lib/python2.5/site-packages/buildbot/slave/commands.py", line 1048, in interrupt
            self.command.kill("command interrupted")
          File "/home/exarkun/.local/lib/python2.5/site-packages/buildbot/slave/commands.py", line 510, in kill
            msg += ", killing pid %d" % self.process.pid
        exceptions.TypeError: int argument required
$ buildbot --version
Buildbot version: 0.7.9
Twisted version: 8.1.0

Change History

comment:1 Changed 4 years ago by dustin

  • Status changed from new to closed
  • Resolution set to fixed

Let's see if this fixes it: [0d445057e07937e1aa8f8a0719d11f622b333e77]

Note: See TracTickets for help on using tickets.