Project

General

Profile

R009 » History » Version 9

Kenichi Nakano, 01/31/2019 01:20 AM

1 1 Kenichi Nakano
h1. R009
2 1 Kenichi Nakano
3 1 Kenichi Nakano
Last update on 2018-11-19 by Kenichi.
4 1 Kenichi Nakano
5 1 Kenichi Nakano
This production will include the FY2017 dataset and be processed with our local computers.
6 1 Kenichi Nakano
7 1 Kenichi Nakano
Some info in this page is +not correct+ for now.  Being written...
8 1 Kenichi Nakano
9 1 Kenichi Nakano
h2. Information on R009 Production
10 1 Kenichi Nakano
11 1 Kenichi Nakano
* The good runs are listed in "/data2/production/list/R009/R009_fy2017.list".
12 1 Kenichi Nakano
** The reasons for good/bad schemas are described in "00readme.txt".
13 1 Kenichi Nakano
** The format (columns) of this list file is a bit different from R008 etc.
14 1 Kenichi Nakano
* Decoder
15 9 Kenichi Nakano
** "Git hash 5ec5306b3f985fc6f41582a121bc283d2f8819d6":https://cdcvs.fnal.gov/redmine/projects/seaquest-decoding/repository/revisions/5ec5306b3f985fc6f41582a121bc283d2f8819d6
16 1 Kenichi Nakano
* Data quality check ... "Spill.dataQuality" field
17 1 Kenichi Nakano
** +Not done yet+.
18 1 Kenichi Nakano
** The criteria is identical to R007.  Details can be found in the Git repository ("spillDQRunSchema.py, 606a858a451be9a585ec86ce0434221a812ef7d9":https://cdcvs.fnal.gov/redmine/projects/seaquest-decoding/repository/revisions/606a858a451be9a585ec86ce0434221a812ef7d9/entry/SpillDQ/spillDQRunSchema.py).
19 1 Kenichi Nakano
** The set of "good" spills is different from R007 because of a requirement of "N of tracks/spill > 0.
20 1 Kenichi Nakano
** The "Spill.dataQuality" field was set accordingly on May 17.
21 1 Kenichi Nakano
** Analyzer can use the lists of good spills in "/data2/production/list/R008/good_spill_*.list" instead.
22 1 Kenichi Nakano
* Chamber intensity ... "QIE.Intensity(_p)" field
23 1 Kenichi Nakano
** +Not done yet+.
24 1 Kenichi Nakano
** Identical to R007.  Details can be found in the Git repository ("AddIntensityFieldRunSchema.py, b47c94ad1f20ff8ba8f8c8d5cf4a74be5dbe1188":https://cdcvs.fnal.gov/redmine/projects/seaquest-production/repository/revisions/b47c94ad1f20ff8ba8f8c8d5cf4a74be5dbe1188/entry/IntensityCorrection/AddIntensityFieldRunSchema.py).
25 1 Kenichi Nakano
** The run schemas included in not R007 but R008 were updated on May 17.
26 1 Kenichi Nakano
* kTracker
27 3 Kenichi Nakano
** +Not done yet+.
28 1 Kenichi Nakano
** The version used is stored in the "kInfo" table.
29 1 Kenichi Nakano
30 1 Kenichi Nakano
h2. Details about use of our local computers
31 1 Kenichi Nakano
32 3 Kenichi Nakano
* Decoder parameters
33 3 Kenichi Nakano
** Event sampling = 1 (except FPGA2), FPGA2-event sampling = 100
34 1 Kenichi Nakano
* Procedure
35 1 Kenichi Nakano
** run-local-production.sh
36 1 Kenichi Nakano
** check-schema-size.sh
37 1 Kenichi Nakano
** summarize-local-production.cc
38 1 Kenichi Nakano
* Test #1 - 2018-11-20
39 7 Kenichi Nakano
** Servers used ... e906-gat2, e906-gat4, e906-gat6
40 4 Kenichi Nakano
** Runs used ... 299 runs in total
41 4 Kenichi Nakano
*** Runs 24172-24296 ... first 100 runs of FY2017 dataset
42 4 Kenichi Nakano
*** Runs 25781-25888 ... middle 100 runs
43 4 Kenichi Nakano
*** Runs 28612-28740 ... last 99 runs
44 4 Kenichi Nakano
*** Listed in /data2/production/list/R009/test_local/test_local_gat*.list
45 1 Kenichi Nakano
** The decoder exit status of all the runs is OK (i.e. has reached the end of the program).
46 3 Kenichi Nakano
** Statistics
47 4 Kenichi Nakano
*** The averaged process time = 6149 sec/run ... The process time per input Coda size (sec/MB) is shown in the attachment "h1_t2si.png".  The three peaks correspond to the three run groups (or servers).
48 3 Kenichi Nakano
*** Input Coda size = 3143 MB/run on average
49 5 Kenichi Nakano
*** Output ROOT size = 637 MB/run on average 
50 1 Kenichi Nakano
*** Output / input size = 0.20 on average ... The distribution is shown in the attachment "h1_so2si.png".  The three peaks correspond to the three run groups.  The outliers might be problematic.
51 1 Kenichi Nakano
* First pass - 2018-11-21
52 7 Kenichi Nakano
** Servers used ... e906-gat2, e906-gat4, e906-gat6 (for now??)
53 8 Kenichi Nakano
** Runs decoded ... all 3,939 runs listed in /data2/production/list/R009/test_local/v3/R009_fy2017.list.
54 1 Kenichi Nakano
** Output locations
55 1 Kenichi Nakano
*** DB schemas: seaquestdb02 & seaquestdb03 ... selected run-by-run as specified in R009_fy2017.list.
56 8 Kenichi Nakano
*** ROOT files: /data3/analysis/production/R009
57 8 Kenichi Nakano
*** ROOT files are synchronized to /pnfs/e906/production/digit/R009 by Andrew's script.
58 5 Kenichi Nakano
59 5 Kenichi Nakano
h2. Reference
60 5 Kenichi Nakano
61 5 Kenichi Nakano
* docdb 4159: Estimate of output size etc.
62 5 Kenichi Nakano
* docdb 4242: FPGA2-event sampling