R009 » History » Version 4
Kenichi Nakano, 11/19/2018 06:46 PM
1 | 1 | Kenichi Nakano | h1. R009 |
---|---|---|---|
2 | 1 | Kenichi Nakano | |
3 | 1 | Kenichi Nakano | Last update on 2018-11-19 by Kenichi. |
4 | 1 | Kenichi Nakano | |
5 | 1 | Kenichi Nakano | This production will include the FY2017 dataset and be processed with our local computers. |
6 | 1 | Kenichi Nakano | |
7 | 1 | Kenichi Nakano | Some info in this page is +not correct+ for now. Being written... |
8 | 1 | Kenichi Nakano | |
9 | 1 | Kenichi Nakano | h2. Information on R009 Production |
10 | 1 | Kenichi Nakano | |
11 | 1 | Kenichi Nakano | * The good runs are listed in "/data2/production/list/R009/R009_fy2017.list". |
12 | 1 | Kenichi Nakano | ** The reasons for good/bad schemas are described in "00readme.txt". |
13 | 1 | Kenichi Nakano | ** The format (columns) of this list file is a bit different from R008 etc. |
14 | 1 | Kenichi Nakano | * Decoder |
15 | 1 | Kenichi Nakano | ** git hash |
16 | 1 | Kenichi Nakano | * Data quality check ... "Spill.dataQuality" field |
17 | 1 | Kenichi Nakano | ** +Not done yet+. |
18 | 1 | Kenichi Nakano | ** The criteria is identical to R007. Details can be found in the Git repository ("spillDQRunSchema.py, 606a858a451be9a585ec86ce0434221a812ef7d9":https://cdcvs.fnal.gov/redmine/projects/seaquest-decoding/repository/revisions/606a858a451be9a585ec86ce0434221a812ef7d9/entry/SpillDQ/spillDQRunSchema.py). |
19 | 1 | Kenichi Nakano | ** The set of "good" spills is different from R007 because of a requirement of "N of tracks/spill > 0. |
20 | 1 | Kenichi Nakano | ** The "Spill.dataQuality" field was set accordingly on May 17. |
21 | 1 | Kenichi Nakano | ** Analyzer can use the lists of good spills in "/data2/production/list/R008/good_spill_*.list" instead. |
22 | 1 | Kenichi Nakano | * Chamber intensity ... "QIE.Intensity(_p)" field |
23 | 1 | Kenichi Nakano | ** +Not done yet+. |
24 | 1 | Kenichi Nakano | ** Identical to R007. Details can be found in the Git repository ("AddIntensityFieldRunSchema.py, b47c94ad1f20ff8ba8f8c8d5cf4a74be5dbe1188":https://cdcvs.fnal.gov/redmine/projects/seaquest-production/repository/revisions/b47c94ad1f20ff8ba8f8c8d5cf4a74be5dbe1188/entry/IntensityCorrection/AddIntensityFieldRunSchema.py). |
25 | 1 | Kenichi Nakano | ** The run schemas included in not R007 but R008 were updated on May 17. |
26 | 1 | Kenichi Nakano | * kTracker |
27 | 3 | Kenichi Nakano | ** +Not done yet+. |
28 | 1 | Kenichi Nakano | ** The version used is stored in the "kInfo" table. |
29 | 1 | Kenichi Nakano | |
30 | 1 | Kenichi Nakano | h2. Details about use of our local computers |
31 | 1 | Kenichi Nakano | |
32 | 3 | Kenichi Nakano | * Computers used |
33 | 3 | Kenichi Nakano | ** e906-gat2, e906-gat4, e906-gat6 (for now?) |
34 | 3 | Kenichi Nakano | * Decoder parameters |
35 | 3 | Kenichi Nakano | ** Event sampling = 1 (except FPGA2), FPGA2-event sampling = 100 |
36 | 1 | Kenichi Nakano | * Procedure |
37 | 1 | Kenichi Nakano | ** run-local-production.sh |
38 | 1 | Kenichi Nakano | ** check-schema-size.sh |
39 | 1 | Kenichi Nakano | ** summarize-local-production.cc |
40 | 3 | Kenichi Nakano | * Test #1 - 2018-11-20 |
41 | 4 | Kenichi Nakano | ** Runs used ... 299 runs in total |
42 | 4 | Kenichi Nakano | *** Runs 24172-24296 ... first 100 runs of FY2017 dataset |
43 | 4 | Kenichi Nakano | *** Runs 25781-25888 ... middle 100 runs |
44 | 4 | Kenichi Nakano | *** Runs 28612-28740 ... last 99 runs |
45 | 4 | Kenichi Nakano | *** Listed in /data2/production/list/R009/test_local/test_local_gat*.list |
46 | 1 | Kenichi Nakano | ** The decoder exit status of all the runs is OK (i.e. has reached the end of the program). |
47 | 3 | Kenichi Nakano | ** Statistics |
48 | 4 | Kenichi Nakano | *** The averaged process time = 6149 sec/run ... The process time per input Coda size (sec/MB) is shown in the attachment "h1_t2si.png". The three peaks correspond to the three run groups (or servers). |
49 | 3 | Kenichi Nakano | *** Input Coda size = 3143 MB/run on average |
50 | 3 | Kenichi Nakano | *** Output ROOT size = 637 MB/run on average |
51 | 4 | Kenichi Nakano | *** Output / input size = 0.20 on average ... The distribution is shown in the attachment "h1_so2si.png". The three peaks correspond to the three run groups. The outliers might be problematic. |