Project

General

Profile

Scripts

bin

nova

monitoring
  • checkClusterIdStatus.sh
    This script checks the status of the jobs in a given cluster ID
  • monitorProductionJobs.sh
    This script monitor the status of jobs registered in the OPOS Production DB

scripts

fts
  • locateFileInFts.sh
    This script print the current location of the a file in FTS,receiving in input his name
jobsub
  • submitJobSubClientCalib.sh
    This script submits a test job that run a calibration job on a FermiGrid worker node
  • submitJobSubClientRaw2Root.sh
    This script submits a test job that run a raw2root job n a FermiGrid worker node
  • submitJobSubClientReco.sh
    This script submits a test job that run a reconstruction job on a FermiGrid worker node
  • testSubmitionScriptV1.sh
    This script submits a test job that run a raw2root job on a FermiGrid worker node

keepup

crontab
  • updateKeepupCrontab.sh
    Tis script updates the keep-up section of the crontab
statistics
  • getNovaCpuHours.sh
    This script query GRATIA database to get CPU hours and wall tile for the job in a given cluster ID. This script can run only on NOvA GPVM machines and require access to the OPOS Production DB for NOvA

common

dcache
  • dcacheGraphiteQueues.py
    ???
  • dcacheGraphiteUsers.py
    ???

fts

monitoring
  • ftsMonitor.py
    This script analize the status of an FTS project and return a report splitted for the different kind of errors ,such as failed transfer,pending files etc...

scripts

find_file_in_prod_fts

python_v2.6
  • findFileInProdFts.py
    This script search by file name across several FTS instances
python_v2.7
  • findFileInProdFts.py
    This script search by file name across several FTS instances

jobsub

scripts
  • submitJobSubClientBaseTest.sh
    This script submits a test job that run a UNIX command on the FermiGrid worker node

monitoring

  • logCleanup.sh
    This script delete all the log and garbage files into the OPOS_ReportGeneration folder.
  • quotaMonitor.sh
    This script calculate the actual quota used for the user novapro and the group nova for the /nova/data and the /nova/app folders. If the user use more than the 90% of the quota an e-mail is sent as a warning.
Calibration
  • highGainCalibrationReport.py
    This script is used to fetch and analize the logs of the high gain calibration offline keepup projects submitted to the grid beetween two and three days before the current date,All the project's metadata are collected using the SAM API,then trought the jobsub_fetchlog command all the log files of the project are downloaded and then analized,returning the report of the projects.
  • offsiteCalibrationReport.py
    This script is used to fetch and analize the logs of offsite calibration keepup projects submitted to the grid in the last day,All the project's metadata are collected using the SAM API,then trought the jobsub_fetchlog command all the log files of the project are downloaded and then analized,returning the report of the projects
db
  • production.db
    ???

ndrock

py_classes
  • analyzer.py
    This script fetch through jobSub every log of a defined cluster given in input,and calculate the error code frequency of the jobs executed on that cluster
  • monitor.sh
    ???
  • performMonitoring.py
    This script monitor the status of a samweb projects,printing the current status of every process and the number of jobs running,held,finished and in idle
  • raw2rootReport.py
    This script is used to fetch and analize the logs of novapro raw2root projects submitted to the grid one day before of the inserted day,All the project's metadata are collected using the SAM API,then trought the jobsub_fetchlog command all the log files of the project are downloaded and then analized,returning the report of the projects
  • samProjectAnalyzer.py
    This script use the SAM Api to extract useful informations from a project
inspiration
  • countRenamingFilesSam.py
    Count the number of files matching with a pattern
  • dumpMetadata.py
    This script receive in input the name of a file,search all the metadata through SAM and then print all the pairs "metadata:value"
  • locateFiles.py
    This script find the current path of all the file in SAM that match a pattern
  • moveFilesToDropbox.py
    Find the files not in dropbox and and move them to the dropbox
  • removeSamLocations.py
    Find all the files in SAM for the nova experiemnt,and remove all the path in the enstore location
  • renameFilesSam.py
    Find files in SAM with a pattern name and correct it
  • retireFilesSamReconstruction.py
    Remove files with defined metadata Stored in SAM
  • testSam.py
    Test the connection with SAM
r2r
  • r2rReport.py
    This script is used to fetch and analize the logs of the raw2root keepup projects submitted to the grid one day before of the inserted day,All the project's metadata are collected using the SAM API,then trought the jobsub_fetchlog command all the log files of the project are downloaded and then analized,returning the report of the projects
reco
  • recoReport.py
    This script is used to fetch and analize the logs of the reco keepup projects (Version 15-12-07) submitted to the grid beetween a range of days,All the project's metadata are collected using the SAM API,then trought the jobsub_fetchlog command all the log files of the project are downloaded and then analized,returning the report of the projects
osg_monitoring
  • Need to order the repository