Project

General

Profile

POMS release notes draft » History » Version 3

Andres Alba hernandez, 01/09/2017 02:57 PM

1 1 Andres Alba hernandez
h1. POMS release notes draft
2 1 Andres Alba hernandez
3 1 Andres Alba hernandez
h1. Release Notes
4 1 Andres Alba hernandez
5 1 Andres Alba hernandez
h2. %{color:red}v1_1_0%
6 1 Andres Alba hernandez
7 1 Andres Alba hernandez
8 1 Andres Alba hernandez
*%{color:green}New Features%*
9 1 Andres Alba hernandez
10 1 Andres Alba hernandez
> Ability to get reports about how effective/efficient are the campaigns and assure POMS is alive  #13699 
11 1 Andres Alba hernandez
12 1 Andres Alba hernandez
>Split "Located" state into "Successful"/"Failed" We should have the potential for Submissions/Jobs to be Failed vs Succeded.Feature #14751: (is that not in place?) 
13 1 Andres Alba hernandez
14 1 Andres Alba hernandez
> Feature #14752: Add job log parser to get final job info
15 1 Andres Alba hernandez
16 1 Andres Alba hernandez
17 1 Andres Alba hernandez
18 1 Andres Alba hernandez
19 1 Andres Alba hernandez
--------
20 1 Andres Alba hernandez
Working
21 1 Andres Alba hernandez
> Allow specification of completion requirements in order to launch dependant task #12751
22 1 Andres Alba hernandez
> The runtime,memory, and disk were included in the Campaign Def/Campaign info #12966 
23 1 Andres Alba hernandez
> The job efficiency per campaign page is also included into landscape. #14377
24 1 Andres Alba hernandez
> Monitor internal components #14473
25 1 Andres Alba hernandez
> Poms should keep a list of job launches requested while job launches are "held" #14659
26 1 Andres Alba hernandez
> POMS hold job launches when services are "red" on dashboard.
27 1 Andres Alba hernandez
> Add a script to extract VO Role=Production user info.  #14747
28 1 Andres Alba hernandez
29 1 Andres Alba hernandez
30 1 Andres Alba hernandez
31 1 Andres Alba hernandez
32 1 Andres Alba hernandez
33 1 Andres Alba hernandez
> *Currently POMS use project descriptions Feature 14504*, Integrate with SAM feature #14503 --
34 1 Andres Alba hernandez
> "why is my job not running?" *screen for a campaign. lets you do the jobsub_q --better-analyze for jobs, and look at their Condor joblog, last-matched stuff, etc.* #12965
35 1 Andres Alba hernandez
36 1 Andres Alba hernandez
*%{color:green}Improvements%*
37 1 Andres Alba hernandez
38 1 Andres Alba hernandez
> The HTML templates were renamed to line up with the URL's, so they are easier to find. #12933
39 1 Andres Alba hernandez
40 1 Andres Alba hernandez
41 1 Andres Alba hernandez
--------
42 1 Andres Alba hernandez
Working
43 1 Andres Alba hernandez
> Improve in the labeling of the job status, now the table describe the complete jobs with the total number, number of jobs located and number of jobs non-located.. #14477
44 1 Andres Alba hernandez
> A complete refurbish of the POMS code in order to split in modules by functionality, having independent test units. #12934
45 1 Andres Alba hernandez
> The  Campaign Info page was updated for new fields added to Campaign(Layers), LaunchTemplates, etc. #14531
46 1 Andres Alba hernandez
47 1 Andres Alba hernandez
48 1 Andres Alba hernandez
> *A  better split types was added allowing the user to ...*  #13707
49 1 Andres Alba hernandez
 
50 1 Andres Alba hernandez
 
51 1 Andres Alba hernandez
52 1 Andres Alba hernandez
53 1 Andres Alba hernandez
*%{color:green}Bugs Fixed%*
54 1 Andres Alba hernandez
55 1 Andres Alba hernandez
56 1 Andres Alba hernandez
--------
57 1 Andres Alba hernandez
Working
58 1 Andres Alba hernandez
59 1 Andres Alba hernandez
> The code for pending campaigns made a query that didn't work if you did the whole campaign.  Furthermore, the generation of these dimension strings was factored out to common routines #13889
60 1 Andres Alba hernandez
> POMS use elasticsearch condor events for obtain complete information about the jobs and prevent incomplete data as happens with jobsub_fetchlog #14248
61 1 Andres Alba hernandez
> When the jobs dropped out of the queue condor_q no longer suffices. Now it is stored into the elasticsearch logs.  #14376 *Get all poms data accessible for landspace*
62 1 Andres Alba hernandez
63 1 Andres Alba hernandez
64 1 Andres Alba hernandez
65 1 Andres Alba hernandez
66 1 Andres Alba hernandez
67 1 Andres Alba hernandez
############
68 1 Andres Alba hernandez
69 1 Andres Alba hernandez
70 1 Andres Alba hernandez
71 1 Andres Alba hernandez
h2. v2_0_0
72 1 Andres Alba hernandez
73 1 Andres Alba hernandez
74 1 Andres Alba hernandez
*%{color:green}New Features%*
75 1 Andres Alba hernandez
76 1 Andres Alba hernandez
*%{color:green}Improvements%*
77 1 Andres Alba hernandez
78 1 Andres Alba hernandez
*%{color:green}Bugs Fixed%*
79 1 Andres Alba hernandez
80 1 Andres Alba hernandez
Feature #14270: Allow users to run arbitrary executables/scripts and workloads through the system via arbitrary launch scripts/executables
81 1 Andres Alba hernandez
Feature #14271: Support the model of sending data to jobs
82 1 Andres Alba hernandez
Feature #14272: Supports data externally pre-staged manually at sites (i.e. different site local caches)
83 1 Andres Alba hernandez
Feature #14273: Provide a "campaign-layer" status view with the following types of information: * overall percentage done (of the campaign) * resubmission/failure rates * efficiency
84 1 Andres Alba hernandez
Feature #14274: Have appropriate permissions and privileges implemented to authorize each operation
85 1 Andres Alba hernandez
86 2 Andres Alba hernandez
> The job efficiency per campaign page is also included into landscape. #14377
87 2 Andres Alba hernandez
> Monitor internal components  and assure POMS is alive  #14473
88 2 Andres Alba hernandez
89 1 Andres Alba hernandez
90 1 Andres Alba hernandez
h2. v3_0_0
91 1 Andres Alba hernandez
92 1 Andres Alba hernandez
*%{color:green}New Features%*
93 1 Andres Alba hernandez
94 1 Andres Alba hernandez
*%{color:green}Improvements%*
95 1 Andres Alba hernandez
96 1 Andres Alba hernandez
*%{color:green}Bugs Fixed%*
97 1 Andres Alba hernandez
98 1 Andres Alba hernandez
Feature #14287: More detailed overall campaign-at-a-glance status page (campaign workflow summary,overall percentage done, resubmission / total failure rates, efficiency
99 1 Andres Alba hernandez
Feature #14288: Support sending jobs to known data caches (i.e. steering to sites).
100 1 Andres Alba hernandez
Feature #14289: Support automatic pre-staging of data to sites.
101 1 Andres Alba hernandez
Feature #14290: Have appropriate permissions and privileges implemented to authorize each operation *and* assign priority.
102 1 Andres Alba hernandez
Feature #14291: Be able to interface with multiple Data Management Systems via modular API's.
103 3 Andres Alba hernandez
> POMS use elasticsearch condor events for obtain complete information about the jobs and prevent incomplete data as happens with jobsub_fetchlog #14248