Project

General

Profile

July 9th

Date:
07/09/2018

Attendees:
Anna M, Steve W, Marc M, Robert I, Vladimir P. Yuyi G, Margherita VW.

Agenda:

New Work Flow Editor and reviewing tasks for version 3.1.0

Discussion:

STEVE:
Presenting new home page; also changes in main menu in left panel. 'Tagged Campaigns' replaced simply by 'Campaigns'; same functionality.
Example clicking on Submission.

MARC:
About submissions, it shows how many are still running for that campaign, but we will change that.

ANNA:
The submission page is a little confusing.. what we see are stats.

STEVE:
Maybe than we could call it 'Submission History'.

VLADIMIR:
Suggestion to replace the repeated text for the buttons with an icon.

STEVE:
Big change is that no job tables, info comes from FIFEMON.

MARC:
All job stats will got to Kibana pages.

ANNA:
Question: where do we find now the overall view with all jobs stats?
The shifter needs to know jobs status and if the campaign failed. We don't have that from FIFEMON..

MARC:
We can ask Landscape if we can get this type of info.

STEVE:
Moving on new Work Flow Editor, Vladimir has been investigating open source products and found one very promising.

VLADIMIR:
Showing basic functionality of VISJS. (no connections yet to database, just hardcoded info).

ANNA:
With this type of workflow we should also add Data Handling between stages, like what is the output from one to be used as input for next stage.

MARC:
This is already available using file patterns to generate output types.
All files by default go to next stage

ANNA:
Are we also changing the 'jobtype' naming ? It's not too popular among users..

STEVE:
Probably not.

BRIAN:
Question, is it possible from Work Flow Editor to dump the information in a file?

STEVE:
Yes, and the user can save the file, change it and then uploaded again. The file is used to interface to project.py.

MARC:
About project.py.At some level, it is just a job launcher; at another level, we convert the config file to a file that can be used by POMS,
this is what Yuyi has been working on.

ANNA:
Thought we wanted to get rid of it..

STEVE:
The long term is to support also analysis, so we want to make it work with POMS.

YUYI:
Users are using command line to start jobs, the idea of converting is that they would be able to use POMS.

STEVE:
about jobs: we don;t have job tables anymore; info comes from FIFEMON.

MARC:
We also want FIFEMON take care of file scraping, there is a prototype for it but don't know when they will be done.

ANNA:
Wondering when new workflow could be available..
Icarus want to have MV production for August 1st. So they need to know if to setup the campaign they would
use the work flow or the normal way.
Also, ProtoDUNE/DUNE will work on MCC11 mid July.

STEVE:
Not sure yet when new work flow will be available.
As far the poms db, the VMs for database hosting is available so at some point db will move from current host.