Project

General

Profile

Wiki » History » Version 153

Margherita Vittone Wiersma, 09/18/2018 11:33 AM

1 151 Margherita Vittone Wiersma
!{width:20em}poms.jpg!
2 151 Margherita Vittone Wiersma
3 152 Margherita Vittone Wiersma
h1. %{color:blue} POMS Overview%
4 152 Margherita Vittone Wiersma
5 152 Margherita Vittone Wiersma
The *Production Operations Management System* (POMS) is a project designed to provide  a service to assist production teams and analysis groups of experiments in their MC production and DATA processing. As the quantity of data originated by the running experiments greatly increases, the ability of simplifying the steps in data processing and management has become more and more appealing to the users.
6 152 Margherita Vittone Wiersma
7 152 Margherita Vittone Wiersma
POMS provides a web service interface that enables automated jobs submission on distributed resources according to customers’ requests and subsequent monitoring and recovery of failed submissions, debugging and record keeping.
8 152 Margherita Vittone Wiersma
The ultimate goal is the most efficient utilization of all computing resources available to experiments, while providing a simple and transparent interface between users and the complexity of the grid.
9 152 Margherita Vittone Wiersma
10 152 Margherita Vittone Wiersma
POMS runs behind a web service interface that provides both interactive pages to the users, and a REST interfaces to scripts that interact with it. This means that experiments can use POMS through their web browser to configure and run their production code, or they can use the poms_client and poms_jobsub_wrapper tools to submit jobs through a command line and have POMS tracking, debugging and monitoring them.
11 152 Margherita Vittone Wiersma
12 153 Margherita Vittone Wiersma
----
13 152 Margherita Vittone Wiersma
14 115 Anna Mazzacane
h1. *What is POMS*
15 68 Anna Mazzacane
16 115 Anna Mazzacane
The Production Operations Management System (POMS) is a project to design a service which assists production teams and analysis groups of experiments in their MC production and DATA processing.
17 122 Anna Mazzacane
POMS provides a web service interface that enables automated jobs submission on distributed resources according customers’ requests and subsequent monitoring and recovery of failed submissions, debugging and record keeping.
18 126 Anna Mazzacane
19 136 Anna Mazzacane
The system is interfaced to "SAM":https://cdcvs.fnal.gov/redmine/projects/sam/wiki,  the data handling system, to keep track of files and processing, the "ECL":https://cdcvs.fnal.gov/redmine/projects/crl to keep track of the production and processing operations and "FIFEmon":https://fifemon.fnal.gov/dashboard/db/landscape?refresh=10s&orgId=1 for monitoring.
20 1 Marc Mengel
The ultimate goal is the most efficient utilization of all computing resources available to experiments, while providing a simple and transparent interface between users  and the complexity of the grid.
21 122 Anna Mazzacane
22 142 Anna Mazzacane
While POMS was initially designed  for the "OPOS":https://cdcvs.fnal.gov/redmine/projects/offline_production_operations_service?jump=search team, the capability it provides for very large scale data-intensive distributed computing motivated the POMS project to extend this service to all the Intensity Frontier experiments at Fermilab.
23 143 Anna Mazzacane
We are currently working with several  experiments  to help them efficiently manage and track their  MC production and DATA processing.
24 1 Marc Mengel
25 1 Marc Mengel
26 115 Anna Mazzacane
h1. [[User Guide for POMS]]
27 1 Marc Mengel
28 138 Anna Mazzacane
POMS run behind a web service interface that provides both interactive screens to users, and REST interfaces to scripts that interact with it.  This means that experiments can use POMS through their web browser and configure and run their production code, or they can use the *@poms_client@* and *@poms_jobsub_wrapper@* tools to submit jobs through a command line and have POMS tracking, debugging and monitoring them.
29 127 Anna Mazzacane
30 141 Anna Mazzacane
The production instance of POMS is at https://poms.fnal.gov
31 128 Anna Mazzacane
32 115 Anna Mazzacane
If new to computing at Fermilab, please read: FIFE Wiki page  "Welcome New Computing Users":https://cdcvs.fnal.gov/redmine/projects/fife/wiki/Welcome_New_Computing_Users
33 120 Anna Mazzacane
34 129 Anna Mazzacane
Users' mailing list : poms_announce@fnal.gov
35 115 Anna Mazzacane
36 115 Anna Mazzacane
h1. [[POMS Internals]]
37 115 Anna Mazzacane
38 115 Anna Mazzacane
Topics for people developing POMS.
39 134 Anna Mazzacane
40 140 Anna Mazzacane
If you wish to be part of the team and/or contribute to develop a workflow for your experiment and/or have a great professional experience with skilled computing staff, please send an email to poms_team@fnal.gov.
41 115 Anna Mazzacane
42 1 Marc Mengel
h1. [[Frequently Asked Questions]]
43 95 Anna Mazzacane
44 147 Anna Mazzacane
* How can I subscribe to a mailing list?
45 147 Anna Mazzacane
46 148 Anna Mazzacane
* Where I can find the SAM Web Client Documentation?
47 1 Marc Mengel
48 149 Anna Mazzacane
* Where I can find the quota of my experiment?
49 149 Anna Mazzacane
 
50 85 Anna Mazzacane
If you don't find your question here, please send an e-mail to poms_team@fnal.gov