builder: release-comm-esr38-linux64_repack_3 slave: bld-linux64-spot-419 starttime: 1447404843.68 results: exception (4) ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.676895) ========= master: http://buildbot-master91.bb.releng.usw2.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.677345) ========= ========= Started set props: basedir (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.677641) ========= bash -c pwd in dir /builds/slave/tb-rel-c-esr38-l64_rpk_3-00000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber COMM_REV=THUNDERBIRD_38_4_0_RELEASE DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-419.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LD_LIBRARY_PATH=/tools/gcc-4.3.3/installed/lib64 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZILLA_REV=THUNDERBIRD_38_4_0_RELEASE MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=objdir-tb MOZ_SYMBOLS_EXTRA_BUILDID=linux64 MOZ_UPDATE_CHANNEL=release PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin POST_SYMBOL_UPLOAD_CMD=/usr/local/bin/post-symbol-upload.py PWD=/builds/slave/tb-rel-c-esr38-l64_rpk_3-00000 SHELL=/bin/bash SHLVL=1 SYMBOL_SERVER_HOST=symbolpush.mozilla.org SYMBOL_SERVER_PATH=/mnt/netapp/breakpad/symbols_tbrd/ SYMBOL_SERVER_SSH_KEY=/home/mock_mozilla/.ssh/tbirdbld_dsa SYMBOL_SERVER_USER=tbirdbld TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False /builds/slave/tb-rel-c-esr38-l64_rpk_3-00000 program finished with exit code 0 elapsedTime=0.003672 basedir: '/builds/slave/tb-rel-c-esr38-l64_rpk_3-00000' ========= master_lag: 0.05 ========= ========= Finished set props: basedir (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.731516) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.731800) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.743321) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.743604) ========= rm -rf properties in dir /builds/slave/tb-rel-c-esr38-l64_rpk_3-00000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'properties'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber COMM_REV=THUNDERBIRD_38_4_0_RELEASE DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-419.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LD_LIBRARY_PATH=/tools/gcc-4.3.3/installed/lib64 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZILLA_REV=THUNDERBIRD_38_4_0_RELEASE MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=objdir-tb MOZ_SYMBOLS_EXTRA_BUILDID=linux64 MOZ_UPDATE_CHANNEL=release PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin POST_SYMBOL_UPLOAD_CMD=/usr/local/bin/post-symbol-upload.py PWD=/builds/slave/tb-rel-c-esr38-l64_rpk_3-00000 SHELL=/bin/bash SHLVL=1 SYMBOL_SERVER_HOST=symbolpush.mozilla.org SYMBOL_SERVER_PATH=/mnt/netapp/breakpad/symbols_tbrd/ SYMBOL_SERVER_SSH_KEY=/home/mock_mozilla/.ssh/tbirdbld_dsa SYMBOL_SERVER_USER=tbirdbld TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002733 ========= master_lag: 0.04 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.790664) ========= ========= Started set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.790944) ========= script_repo_url: https://hg.mozilla.org/build/tools ========= Finished set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.791277) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.791578) ========= rm -rf scripts in dir /builds/slave/tb-rel-c-esr38-l64_rpk_3-00000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber COMM_REV=THUNDERBIRD_38_4_0_RELEASE DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-419.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LD_LIBRARY_PATH=/tools/gcc-4.3.3/installed/lib64 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZILLA_REV=THUNDERBIRD_38_4_0_RELEASE MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=objdir-tb MOZ_SYMBOLS_EXTRA_BUILDID=linux64 MOZ_UPDATE_CHANNEL=release PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin POST_SYMBOL_UPLOAD_CMD=/usr/local/bin/post-symbol-upload.py PWD=/builds/slave/tb-rel-c-esr38-l64_rpk_3-00000 SHELL=/bin/bash SHLVL=1 SYMBOL_SERVER_HOST=symbolpush.mozilla.org SYMBOL_SERVER_PATH=/mnt/netapp/breakpad/symbols_tbrd/ SYMBOL_SERVER_SSH_KEY=/home/mock_mozilla/.ssh/tbirdbld_dsa SYMBOL_SERVER_USER=tbirdbld TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002771 ========= master_lag: 0.04 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2015-11-13 00:54:03.838727) ========= ========= Started 'hg clone ...' (results: 0, elapsed: 2 secs) (at 2015-11-13 00:54:03.839034) ========= hg clone https://hg.mozilla.org/build/tools scripts in dir /builds/slave/tb-rel-c-esr38-l64_rpk_3-00000/. (timeout 1320 secs) watching logfiles {} argv: ['hg', 'clone', 'https://hg.mozilla.org/build/tools', 'scripts'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber COMM_REV=THUNDERBIRD_38_4_0_RELEASE DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-419.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LD_LIBRARY_PATH=/tools/gcc-4.3.3/installed/lib64 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZILLA_REV=THUNDERBIRD_38_4_0_RELEASE MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=objdir-tb MOZ_SYMBOLS_EXTRA_BUILDID=linux64 MOZ_UPDATE_CHANNEL=release PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin POST_SYMBOL_UPLOAD_CMD=/usr/local/bin/post-symbol-upload.py PWD=/builds/slave/tb-rel-c-esr38-l64_rpk_3-00000 SHELL=/bin/bash SHLVL=1 SYMBOL_SERVER_HOST=symbolpush.mozilla.org SYMBOL_SERVER_PATH=/mnt/netapp/breakpad/symbols_tbrd/ SYMBOL_SERVER_SSH_KEY=/home/mock_mozilla/.ssh/tbirdbld_dsa SYMBOL_SERVER_USER=tbirdbld TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False (ignoring URL on server that requires SNI) (your Python is older than 2.7.9 and does not support modern and secure SSL/TLS; please consider upgrading your Python to a secure version) downloading bundle https://s3-us-west-2.amazonaws.com/moz-hg-bundles-us-west-2/build/tools/5b4d30a49fe750ef399e068574d434e93510c1b9.stream-legacy.hg warning: s3-us-west-2.amazonaws.com certificate with fingerprint 57:f7:b6:16:39:b4:c8:bf:ac:9e:73:2e:68:f8:20:ae:c2:02:60:cb not verified (check hostfingerprints or web.cacerts config setting) streaming all changes 1920 files to transfer, 25.8 MB of data transferred 25.8 MB in 0.6 seconds (46.3 MB/sec) finishing applying bundle; pulling searching for changes adding changesets adding manifests adding file changes added 1 changesets with 1 changes to 1 files updating to branch default 1125 files updated, 0 files merged, 0 files removed, 0 files unresolved program finished with exit code 0 elapsedTime=2.160865 ========= master_lag: 0.01 ========= ========= Finished 'hg clone ...' (results: 0, elapsed: 2 secs) (at 2015-11-13 00:54:06.012980) ========= ========= Started 'hg update ...' (results: 0, elapsed: 1 secs) (at 2015-11-13 00:54:06.013331) ========= hg update -C -r THUNDERBIRD_38_4_0_RELEASE in dir /builds/slave/tb-rel-c-esr38-l64_rpk_3-00000/scripts (timeout 1200 secs) watching logfiles {} argv: ['hg', 'update', '-C', '-r', 'THUNDERBIRD_38_4_0_RELEASE'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber COMM_REV=THUNDERBIRD_38_4_0_RELEASE DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-419.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LD_LIBRARY_PATH=/tools/gcc-4.3.3/installed/lib64 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZILLA_REV=THUNDERBIRD_38_4_0_RELEASE MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=objdir-tb MOZ_SYMBOLS_EXTRA_BUILDID=linux64 MOZ_UPDATE_CHANNEL=release PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin POST_SYMBOL_UPLOAD_CMD=/usr/local/bin/post-symbol-upload.py PWD=/builds/slave/tb-rel-c-esr38-l64_rpk_3-00000/scripts SHELL=/bin/bash SHLVL=1 SYMBOL_SERVER_HOST=symbolpush.mozilla.org SYMBOL_SERVER_PATH=/mnt/netapp/breakpad/symbols_tbrd/ SYMBOL_SERVER_SSH_KEY=/home/mock_mozilla/.ssh/tbirdbld_dsa SYMBOL_SERVER_USER=tbirdbld TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 1 files updated, 0 files merged, 0 files removed, 0 files unresolved program finished with exit code 0 elapsedTime=1.254442 ========= master_lag: 0.01 ========= ========= Finished 'hg update ...' (results: 0, elapsed: 1 secs) (at 2015-11-13 00:54:07.282274) ========= ========= Started get_script_repo_revision exception (results: 4, elapsed: 15 mins, 28 secs) (at 2015-11-13 00:54:07.282626) ========= remoteFailed: [Failure instance: Traceback (failure with no frames): : [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] ]

<class 'twisted.spread.pb.PBConnectionLost'>: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion. ]

<class 'twisted.spread.pb.PBConnectionLost'>: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion. ]

Traceback (most recent call last): Failure: twisted.spread.pb.PBConnectionLost: [Failure instance: Traceback (failure with no frames): : Connection to the other side was lost in a non-clean fashion. ] ========= Finished get_script_repo_revision exception (results: 4, elapsed: 15 mins, 28 secs) (at 2015-11-13 01:09:36.024730) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Started set_script_properties exception (results: 4, elapsed: 0 secs) (at 2015-11-13 01:09:36.025176) ========= remoteFailed: [Failure instance: Traceback: : Calling Stale Broker /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py:225:start /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1071:startCommand /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1002:runCommand /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:77:run --- --- /builds/buildbot/build1/lib/python2.7/site-packages/twisted/internet/defer.py:125:maybeDeferred /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:529:start /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:311:start /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:112:start /builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py:328:callRemote /builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py:807:_sendMessage ]

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

/builds/buildbot/build1/lib/python2.7/site-packages/twisted/internet/defer.py, line 125 in maybeDeferred
123  """
124  try:
125    result = f(*args, **kw)
126  except:
Locals
args'()'
kw'{}'
f"<bound method RemoteShellCommand.start of <RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>>"
/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 529 in start
527                       self.args['workdir'])
528    log.msg(what)
529    return LoggedRemoteCommand.start(self)
530
Locals
what'"command \'[\'bash\', \'-c\', \'for file in `ls -1`; do cat $file; done\']\' in dir \'properties\'"'
self"<RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>"
Globals
LoggedRemoteCommand'<class buildbot.process.buildstep.LoggedRemoteCommand at 0x2dd50b8>'
log"<module 'twisted.python.log' from '/builds/buildbot/build1/lib/python2.7/site-packages/twisted/python/log.pyc'>"
/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 311 in start
309          % self)
310    self.updates = {}
311    return RemoteCommand.start(self)
312
Locals
self"<RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>"
Globals
RemoteCommand'<class buildbot.process.buildstep.RemoteCommand at 0x2dc2ae0>'
/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 112 in start
110    # We should fire self.deferred when the command is done.
111    d = self.remote.callRemote("startCommand", self, self.commandID,
112                  self.remote_command, cmd_args)
113    return d
Locals
self"<RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>"
cmd_args"{'workdir': 'properties', 'command': ['bash', '-c', 'for file in `ls -1`; do cat $file; done'], 'timeout': 1200, 'env': {'MOZ_AUTOMATION': '1', 'MOZ_OBJDIR': 'objdir-tb', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'tbirdbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'LD_LIBRARY_PATH': '/tools/gcc-4.3.3/installed/lib64', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_tbrd/', 'MOZILLA_REV': 'THUNDERBIRD_38_4_0_RELEASE', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'BUILDBOTCUSTOM': 'https://hg.mozilla.org/build/buildbotcustom', 'TINDERBOX_OUTPUT': '1', 'COMM_REV': 'THUNDERBIRD_38_4_0_RELEASE', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'LC_ALL': 'C', 'BUILDBOT_CONFIGS': 'https://hg.mozilla.org/build/buildbot-configs', 'MOZ_UPDATE_CHANNEL': 'release', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/tbirdbld_dsa', 'CLOBBERER_URL': 'https://api.pub.build.mozilla.org/clobberer/forceclobber', 'CCACHE_DIR': '/builds/ccache', 'CCACHE_COMPRESS': '1'}, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}}"
/builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py, line 328 in callRemote
326
327    return self.broker._sendMessage('',self.perspective, self.luid,
328                    _name, args, kw)
329
Locals
self'<twisted.spread.pb.RemoteReference instance at 0x219ceef0>'
args"(<RemoteShellCommand '['bash', '-c', 'for file in `ls -1`; do cat $file; done']'>, '145209', 'shell', {'workdir': 'properties', 'command': ['bash', '-c', 'for file in `ls -1`; do cat $file; done'], 'timeout': 1200, 'env': {'MOZ_AUTOMATION': '1', 'MOZ_OBJDIR': 'objdir-tb', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'tbirdbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'LD_LIBRARY_PATH': '/tools/gcc-4.3.3/installed/lib64', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_tbrd/', 'MOZILLA_REV': 'THUNDERBIRD_38_4_0_RELEASE', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'BUILDBOTCUSTOM': 'https://hg.mozilla.org/build/buildbotcustom', 'TINDERBOX_OUTPUT': '1', 'COMM_REV': 'THUNDERBIRD_38_4_0_RELEASE', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'LC_ALL': 'C', 'BUILDBOT_CONFIGS': 'https://hg.mozilla.org/build/buildbot-configs', 'MOZ_UPDATE_CHANNEL': 'release', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/tbirdbld_dsa', 'CLOBBERER_URL': 'https://api.pub.build.mozilla.org/clobberer/forceclobber', 'CCACHE_DIR': '/builds/ccache', 'CCACHE_COMPRESS': '1'}, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}})"
kw'{}'
_name"'startCommand'"
/builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py, line 807 in _sendMessage
805      del kw['pbanswer']
806    if self.disconnected:
807      raise DeadReferenceError("Calling Stale Broker")
808    try:
Locals
self'<twisted.spread.pb.Broker instance at 0x24b56248>'
kw'{}'
Globals
Broker'<class twisted.spread.pb.Broker at 0x30cb598>'
DeadReferenceError"<class 'twisted.spread.pb.DeadReferenceError'>"

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

Traceback (most recent call last): File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py", line 225, in start self.startCommand(cmd, warnings) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1071, in startCommand d = self.runCommand(cmd) # might raise ConnectionLost File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1002, in runCommand d = c.run(self, self.remote) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 77, in run d = defer.maybeDeferred(self.start) --- --- File "/builds/buildbot/build1/lib/python2.7/site-packages/twisted/internet/defer.py", line 125, in maybeDeferred result = f(*args, **kw) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 529, in start return LoggedRemoteCommand.start(self) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 311, in start return RemoteCommand.start(self) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 112, in start self.remote_command, cmd_args) File "/builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py", line 328, in callRemote _name, args, kw) File "/builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py", line 807, in _sendMessage raise DeadReferenceError("Calling Stale Broker") twisted.spread.pb.DeadReferenceError: Calling Stale Broker ========= Finished set_script_properties exception (results: 4, elapsed: 0 secs) (at 2015-11-13 01:09:36.141951) ========= ========= Started rm_oauth_txt exception (results: 4, elapsed: 0 secs) (at 2015-11-13 01:09:36.142815) ========= remoteFailed: [Failure instance: Traceback: : Calling Stale Broker /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py:225:start /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1071:startCommand /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:1002:runCommand /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:77:run --- --- /builds/buildbot/build1/lib/python2.7/site-packages/twisted/internet/defer.py:125:maybeDeferred /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:529:start /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:311:start /builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py:112:start /builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py:328:callRemote /builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py:807:_sendMessage ]

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

/builds/buildbot/build1/lib/python2.7/site-packages/twisted/internet/defer.py, line 125 in maybeDeferred
123  """
124  try:
125    result = f(*args, **kw)
126  except:
Locals
args'()'
kw'{}'
f"<bound method RemoteShellCommand.start of <RemoteShellCommand '['rm', '-f', 'oauth.txt']'>>"
/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 529 in start
527                       self.args['workdir'])
528    log.msg(what)
529    return LoggedRemoteCommand.start(self)
530
Locals
what'"command \'[\'rm\', \'-f\', \'oauth.txt\']\' in dir \'.\'"'
self"<RemoteShellCommand '['rm', '-f', 'oauth.txt']'>"
Globals
LoggedRemoteCommand'<class buildbot.process.buildstep.LoggedRemoteCommand at 0x2dd50b8>'
log"<module 'twisted.python.log' from '/builds/buildbot/build1/lib/python2.7/site-packages/twisted/python/log.pyc'>"
/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 311 in start
309          % self)
310    self.updates = {}
311    return RemoteCommand.start(self)
312
Locals
self"<RemoteShellCommand '['rm', '-f', 'oauth.txt']'>"
Globals
RemoteCommand'<class buildbot.process.buildstep.RemoteCommand at 0x2dc2ae0>'
/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py, line 112 in start
110    # We should fire self.deferred when the command is done.
111    d = self.remote.callRemote("startCommand", self, self.commandID,
112                  self.remote_command, cmd_args)
113    return d
Locals
self"<RemoteShellCommand '['rm', '-f', 'oauth.txt']'>"
cmd_args"{'workdir': '.', 'command': ['rm', '-f', 'oauth.txt'], 'timeout': 1200, 'env': {'MOZ_AUTOMATION': '1', 'MOZ_OBJDIR': 'objdir-tb', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'tbirdbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'LD_LIBRARY_PATH': '/tools/gcc-4.3.3/installed/lib64', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_tbrd/', 'MOZILLA_REV': 'THUNDERBIRD_38_4_0_RELEASE', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'BUILDBOTCUSTOM': 'https://hg.mozilla.org/build/buildbotcustom', 'TINDERBOX_OUTPUT': '1', 'COMM_REV': 'THUNDERBIRD_38_4_0_RELEASE', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'LC_ALL': 'C', 'BUILDBOT_CONFIGS': 'https://hg.mozilla.org/build/buildbot-configs', 'MOZ_UPDATE_CHANNEL': 'release', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/tbirdbld_dsa', 'CLOBBERER_URL': 'https://api.pub.build.mozilla.org/clobberer/forceclobber', 'CCACHE_DIR': '/builds/ccache', 'CCACHE_COMPRESS': '1'}, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}}"
/builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py, line 328 in callRemote
326
327    return self.broker._sendMessage('',self.perspective, self.luid,
328                    _name, args, kw)
329
Locals
self'<twisted.spread.pb.RemoteReference instance at 0x219ceef0>'
args"(<RemoteShellCommand '['rm', '-f', 'oauth.txt']'>, '145210', 'shell', {'workdir': '.', 'command': ['rm', '-f', 'oauth.txt'], 'timeout': 1200, 'env': {'MOZ_AUTOMATION': '1', 'MOZ_OBJDIR': 'objdir-tb', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'tbirdbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'LD_LIBRARY_PATH': '/tools/gcc-4.3.3/installed/lib64', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_tbrd/', 'MOZILLA_REV': 'THUNDERBIRD_38_4_0_RELEASE', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'BUILDBOTCUSTOM': 'https://hg.mozilla.org/build/buildbotcustom', 'TINDERBOX_OUTPUT': '1', 'COMM_REV': 'THUNDERBIRD_38_4_0_RELEASE', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'LC_ALL': 'C', 'BUILDBOT_CONFIGS': 'https://hg.mozilla.org/build/buildbot-configs', 'MOZ_UPDATE_CHANNEL': 'release', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/tbirdbld_dsa', 'CLOBBERER_URL': 'https://api.pub.build.mozilla.org/clobberer/forceclobber', 'CCACHE_DIR': '/builds/ccache', 'CCACHE_COMPRESS': '1'}, 'want_stdout': 1, 'usePTY': 'slave-config', 'maxTime': None, 'logEnviron': True, 'want_stderr': 1, 'logfiles': {}})"
kw'{}'
_name"'startCommand'"
/builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py, line 807 in _sendMessage
805      del kw['pbanswer']
806    if self.disconnected:
807      raise DeadReferenceError("Calling Stale Broker")
808    try:
Locals
self'<twisted.spread.pb.Broker instance at 0x24b56248>'
kw'{}'
Globals
Broker'<class twisted.spread.pb.Broker at 0x30cb598>'
DeadReferenceError"<class 'twisted.spread.pb.DeadReferenceError'>"

<class 'twisted.spread.pb.DeadReferenceError'>: Calling Stale Broker

Traceback (most recent call last): File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/steps/shell.py", line 225, in start self.startCommand(cmd, warnings) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1071, in startCommand d = self.runCommand(cmd) # might raise ConnectionLost File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 1002, in runCommand d = c.run(self, self.remote) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 77, in run d = defer.maybeDeferred(self.start) --- --- File "/builds/buildbot/build1/lib/python2.7/site-packages/twisted/internet/defer.py", line 125, in maybeDeferred result = f(*args, **kw) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 529, in start return LoggedRemoteCommand.start(self) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 311, in start return RemoteCommand.start(self) File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_41f0fbee10f4_production_0.8-py2.7.egg/buildbot/process/buildstep.py", line 112, in start self.remote_command, cmd_args) File "/builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py", line 328, in callRemote _name, args, kw) File "/builds/buildbot/build1/lib/python2.7/site-packages/twisted/spread/pb.py", line 807, in _sendMessage raise DeadReferenceError("Calling Stale Broker") twisted.spread.pb.DeadReferenceError: Calling Stale Broker ========= Finished rm_oauth_txt exception (results: 4, elapsed: 0 secs) (at 2015-11-13 01:09:36.235432) ========= ========= Total master_lag: 0.17 =========