Project

General

Profile

Bug #8123

Unhandled exception in the frontend causes it to completely shut down

Added by Krista Larson almost 5 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Parag Mhashilkar
Category:
-
Target version:
Start date:
03/19/2015
Due date:
% Done:

0%

Estimated time:
First Occurred:
Occurs In:
Stakeholders:
Duration:

Description

The CERN frontend had an unhandled exception yesterday that caused it to completely shut down. There were no issues restarting it.

Condor version: 8.2.7-1.1 (OSG)
GWMS version: 3.2.8-1

frontend.err.log:
[2015-03-18 15:42:19,792] WARNING: Group voms_es terminated with exit code 2 (4 recent failure)
[2015-03-18 15:42:25,529] WARNING: Group main terminated with exit code 2 (4 recent failure)
[2015-03-18 15:43:16,108] ERROR: Exception occurred trying to spawn:
Traceback (most recent call last):
File "/usr/sbin/glideinFrontend", line 365, in main
restart_interval, restart_attempts)
File "/usr/sbin/glideinFrontend", line 254, in spawn
failure_dict, restart_attempts, "run")
File "/usr/sbin/glideinFrontend", line 192, in spawn_iteration
raise RuntimeError, "Too many group failures, aborting"
RuntimeError: Too many group failures, aborting

main.err.log:
[2015-03-18 15:42:23,445] ERROR: Unhandled exception, dying:
Traceback (most recent call last):
File "/usr/sbin/glideinFrontendElement.py", line 197, in main
rc = self.iterate()
File "/usr/sbin/glideinFrontendElement.py", line 226, in iterate
done_something = self.iterate_one()
File "/usr/sbin/glideinFrontendElement.py", line 438, in iterate_one
self.do_match()
File "/usr/sbin/glideinFrontendElement.py", line 1309, in do_match
pipe_out=forkm_obj.bounded_fork_and_collect(self.max_matchmakers)
File "/usr/lib/python2.6/site-packages/glideinwms/lib/fork.py", line 231, in bounded_fork_and_collect
post_work_info_subset = fetch_ready_fork_result_list(pipe_ids)
File "/usr/lib/python2.6/site-packages/glideinwms/lib/fork.py", line 145, in fetch_ready_fork_result_list
logSupport.log.warning("Failed to extract info from child '%s'" % key)
TypeError: not all arguments converted during string formatting

History

#1 Updated by Parag Mhashilkar almost 5 years ago

  • Assignee set to Parag Mhashilkar
  • Target version set to v3_2_9

#2 Updated by Parag Mhashilkar almost 5 years ago

  • Status changed from New to Feedback
  • Assignee changed from Parag Mhashilkar to Marco Mambelli

Changes in v3/8123

#3 Updated by Marco Mambelli almost 5 years ago

  • Assignee changed from Marco Mambelli to Parag Mhashilkar

#4 Updated by Parag Mhashilkar almost 5 years ago

  • Status changed from Feedback to Resolved

#5 Updated by Parag Mhashilkar over 4 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF