Project

General

Profile

TeamMeeting2015-04-29 » History » Version 3

Michael Gheith, 04/29/2015 02:42 PM

1 1 Marc Mengel
h1. TeamMeeting2015-04-29
2 1 Marc Mengel
3 2 Marc Mengel
Paola is documentifying the Requirements wiki, with Katherine Lato.
4 2 Marc Mengel
5 1 Marc Mengel
Discussed initial  release plans: version 1 will be targeted at just the OPOS group;
6 1 Marc Mengel
no experimenter interface screens yet, etc.  Focus on:
7 1 Marc Mengel
* tracking jobs
8 1 Marc Mengel
* triage jobs
9 1 Marc Mengel
10 1 Marc Mengel
Divying up design work for v1
11 1 Marc Mengel
12 1 Marc Mengel
Database: Steve White
13 1 Marc Mengel
GUI: Michael Gheith , Paoula
14 1 Marc Mengel
Job Info: Diesburg
15 1 Marc Mengel
Monitoring Info: Mengel
16 1 Marc Mengel
17 1 Marc Mengel
Another discussino of job log retention -- plan is for v1 to 
18 1 Marc Mengel
rely on jobsub_client's 2 week retention; longer term we may want to
19 1 Marc Mengel
standardize archiving logs for experiments in their DCache area.
20 3 Michael Gheith
21 3 Michael Gheith
22 3 Michael Gheith
23 3 Michael Gheith
h2. Other Notes
24 3 Michael Gheith
25 3 Michael Gheith
Discussed what will be in the releases.  Plan is to start with a smaller scope, that will grow out later.
26 3 Michael Gheith
-First release will contain basics for OPOS group.
27 3 Michael Gheith
-Second release will contain more complex features.
28 3 Michael Gheith
29 3 Michael Gheith
How do we get information for the triage screens?  Logs go in the fifemon logs directory.
30 3 Michael Gheith
31 3 Michael Gheith
Need a longer holding time for log storage from jobsub people.  Currently it is just two weeks.
32 3 Michael Gheith
33 3 Michael Gheith
Briefly touched base on technology stack:
34 3 Michael Gheith
-Apache Server
35 3 Michael Gheith
-CherryPy
36 3 Michael Gheith
-SQLAlchemy
37 3 Michael Gheith
-Template Engine (mako, jinja, ...)
38 3 Michael Gheith
39 3 Michael Gheith
Users aren't supposed to use condor directly.  Only jobsub should talk to condor.
40 3 Michael Gheith
We may need to hammer out how to get job information from the jobsub people.  Maybe via a web API?
41 3 Michael Gheith
42 3 Michael Gheith
Talked about logs.  We shouldn't have our own document DB, as we would be duplicating efforts with the jobsub people.
43 3 Michael Gheith
Probably dump it on tape, and use SAM for long term log storage?
44 3 Michael Gheith
Mu2e is already managing all their logs.
45 3 Michael Gheith
The OPOS group would only need to go 3 weeks back in regards to logs.
46 3 Michael Gheith
47 3 Michael Gheith
Want to keep all the log files for a campaign until all the tasks are finished.  People will not look at it until the last task in the campaign is finished.