Project

General

Profile

Bug #7320

the jobsub server error log is unusable

Added by Joe Boyd almost 5 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
-
Target version:
Start date:
11/13/2014
Due date:
% Done:

0%

Estimated time:
First Occurred:
Occurs In:
Stakeholders:
Duration:

Description

It has *HUGE** lines in it. You can vi it and you can't grep it without getting huge amounts of output. It makes it impossible to find issues. What is this for instance?

[09/Nov/2014:13:49:49] [format.py:_format_response] application/json {'out': ['ID\t \t \t \tOWNER\tSUBMITTED\tRUN_TIME\tST\tPRI\tSIZE\tCMD', '995
\tashley90\t11/08\t00:30\t0+08:50:49\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '99579.48@fi
febatch2.fnal.gov\tashley90\t11/08\t00:30\t0+08:49:52\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '99579.49@fifebatch2
.fnal.gov\tashley90\t11/08\t00:30\t0+08:52:15\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '
v\tashley90\t11/08\t00:30\t0+08:52:32\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashle
y90\t11/08\t00:30\t0+08:54:38\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11
/08\t00:30\t0+08:55:15\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00
:30\t0+08:54:26\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+
08:55:04\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:53:5
1\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:54:53\tR\t0
\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:55:09\tR\t0\t732.4
\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:55:26\tR\t0\t732.4\tsubmi
tLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:55:02\tR\t0\t732.4\tsubmitLargeF
eldman.sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:55:24\tR\t0\t732.4\tsubmitLargeFeldman.
sh_20141108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:55:05\tR\t0\t732.4\tsubmitLargeFeldman.sh_2014
1108_003037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:55:12\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_00
3037_28508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:55:07\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28
508_0_1_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:55:02\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1
_wrap.sh', '\tashley90\t11/08\t00:30\t0+08:55:09\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.s
h', '\tashley90\t11/08\t00:30\t0+08:55:08\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '99
\tashley90\t11/08\t00:30\t0+08:52:05\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '99579.301
@fifebatch2.fnal.gov\tashley90\t11/08\t00:30\t0+08:50:10\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '99579.302@fifeba
tch2.fnal.gov\tashley90\t11/08\t00:30\t0+08:50:51\tR\t0\t732.4\tsubmitLargeFeldman.sh_20141108_003037_28508_0_1_wrap.sh', '
<snip>

It's a listing of all the jobs in the queue???

History

#1 Updated by Parag Mhashilkar over 4 years ago

  • Status changed from New to Assigned
  • Assignee set to Dennis Box
  • Target version set to v1.1

Yea, it doesnt make sense to log output of jobsub_q/jobsub_status or any other condor logs that dont make sense. We do need to log the status of the condor query, when the process started and when it ended, so we can diagnose if there periodic issues.

Dennis, please go through the api and make the required changes

#2 Updated by Dennis Box over 4 years ago

  • Status changed from Assigned to Feedback
  • Assignee changed from Dennis Box to Parag Mhashilkar

reduced verbosity of log messages. Also checked files with pylint but restrained my changes to tab/space and some >80 char lines:w:

#3 Updated by Parag Mhashilkar over 4 years ago

  • Assignee changed from Parag Mhashilkar to Dennis Box

Looks ok to merge

#4 Updated by Dennis Box over 4 years ago

  • Status changed from Feedback to Resolved

#5 Updated by Parag Mhashilkar over 4 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF