Project

General

Profile

Support #24243

Minos FCRSG 2020 computing support request

Added by Arthur Kreymer about 2 months ago. Updated 19 days ago.

Status:
Work in progress
Priority:
Normal
Start date:
03/27/2020
Due date:
04/13/2020
% Done:

0%

Estimated time:
10.00 h
Duration: 18

Description

Minos has been asked to prepare input to the 2020 FCRSG process
which considers computing resources for 2020,2021, 2022.

Drafts are due April 13, with presentations May 4 and 5.


Related issues

Related to MINOS - Milestone #24326: Migrating from SL 6 to SL 7Assigned04/17/202006/01/2020

Copied from MINOS - Support #21451: Minos SCPMT FY2019 computing support requestNew11/28/201801/17/2019

History

#1 Updated by Arthur Kreymer about 2 months ago

  • Copied from Support #21451: Minos SCPMT FY2019 computing support request added

#2 Updated by Arthur Kreymer about 2 months ago

  • Status changed from New to Assigned

From: Margaret Votava <>
To: cs-liaison <>
Subject: FCRSG Templates are new ready
Date: Fri, 27 Mar 2020 21:01:12 +0000

Dear Liaisons,

We have finished the templates for your slide presentations for FCRSG 2020. The following experiments need to provide slides, although not all may necessarily present: DES, DUNE, Icarus, LSST, uboone, MINERvA, MinibooNE, MINOS, MU2e, Muon g-2, NOvA, SBND.

The template is actually using DUNE numbers as an actual use case, so DUNE does not have to fill in 2019 numbers/plots in their tables.

What we need from your experiment:

Copy the template example slides from here:
https://fermipoint.fnal.gov/project/sppm/_layouts/15/WopiFrame.aspx?sourcedoc=%7B2D44D23E-C3A8-4C96-A358-6C5DFDD559A7%7D&file=SCPMT%202020%20Slide%20Template%20Overview.pptx&action=default

Replace all the plots with the plots for your experiment. Updated plots can be found here.
https://fifemon.fnal.gov/monitor/d/r6UDhH-iz/sppm-sc-pmt-prep?orgId=1

Replace all the CY19 usage numbers with those found in the spreadsheet located here.
https://fermipoint.fnal.gov/project/sppm/_layouts/15/WopiFrame.aspx?sourcedoc=%7BB9FAF306-B57F-4BA4-8BC9-B3FD6E27B116%7D&file=History_and_Requests_2020.xlsx&action=default

These numbers were extracted from the plots in the above link.

Update all tables with your estimates for 20/21/22

Update all slides as indicated by the yellow arrows.

For slide 14, it would be nice to indicate any progress from your items listed last year.

When completed, upload your slidedeck here.
https://fermipoint.fnal.gov/project/sppm/Working%20Group%20Documents/Forms/2020pres.aspx

Please use a consistent naming convention, eg :FCRSG 2020 - <experiment>.ppt”

Please have a first draft of slides uploaded by April 13th, so we have time to digest before the May 4/5th Review.

As a reminder, the tentative review agenda can be found here.
https://indico.fnal.gov/event/23475/

Thank you all for cooperation during this unusual scheduling year.
Margaret

#3 Updated by Arthur Kreymer about 2 months ago

From: Margaret
Votava <>
To: cs-liaison <>
Subject: Re: FCRSG Templates are new ready
Date: Tue, 7 Apr 2020 16:49:03 +0000

Dear all,

Just a gentle reminder that your slide decks are due on Monday.
Stay healthy!

Margaret

#5 Updated by Arthur Kreymer about 2 months ago

I added links to previous year's presentations to our wiki,
https://cdcvs.fnal.gov/redmine/projects/admin/wiki/FCRSG20

To test the interface, I made a copy of the 2019 presentation as FCRSG 2020 - MINOS.pptx
I have not yet figured out how to move this file to the correct directory.

#6 Updated by Thomas Carroll about 2 months ago

Downloaded draft slides to start updating them. There are a few gaps in number I don't know.

I cannot upload my slides to the SharePoint site.

#7 Updated by Thomas Carroll about 2 months ago

Missing numbers and information:
  1. Tape predictions for 2020-2022 in units of PB
  2. Disk usage for App and Data for 2020-2022 in units of TB
  3. Data Lifetimes slide

#8 Updated by Arthur Kreymer about 2 months ago

Tom - I have tried to share the Sharepoint area with your account.
You should have gotten an email, and should be able to upload now.

#9 Updated by Arthur Kreymer about 2 months ago

NAS areas were shown last year as

year   app   data
2019    7     195
2020    5     100
2021    3      50

We did not actually clean up the NAS areas last year.
So I would just shift the schedule out.
The actual app quota is 8 TB, 6.5 used.
The actual data quota is 206 TB, 198 used.

I suggest
2020    8     206
2021    5     150
2022    5     100

DCACHE Other should remain at 20 TB, this is our raw data.

DCACHE Persistent  had been listed at
   2019 73
   2020 50
   2021 25
We are using 50 right now.
This is the working area we should use in place of /minos/data.
I suggest asking for a uniform 80 TB, for ongoing analysis. 
We can move some /minos/data/files to persistent, pending deletion.

Tape usage should be mainly for /minos/data/archiving.
2020   50
2021   50

#10 Updated by Thomas Carroll about 2 months ago

Arthur Kreymer wrote:

Tom - I have tried to share the Sharepoint area with your account.
You should have gotten an email, and should be able to upload now.

I neither received an email nor am I able to upload anything.

I am submitting a ticket to request access.

#11 Updated by Thomas Carroll about 2 months ago

My ticket is submitted.

Thomas,

Incident INC000001097244 has been opened for you at 2020-04-10 10:08:27 CDT. Below are the details:

Short Description: Need uploading permission to Scientific Computing Project Portfolio Sharepoint
Categorization:
Priority: 4 - Low

Summary:
Outage start date: (US/Central)
Outage/Incident details:
I need permission to upload the MINOS+ FCRSG 2020 presentation to the SharePoint located here: https://fermipoint.fnal.gov/project/sppm/Working%20Group%20Documents/Forms/AllItems.aspx?viewid=681ce790%2D08f7%2D496a%2D8ca5%2Dfe04ec197cb2

Thank you for your help.

To track or update this incident click here: INC000001097244

#13 Updated by Thomas Carroll about 1 month ago

Art - I don't follow the values you are using for dCache and tape.

-dCache
For 2020, they are asking for the request in terms of Analysis (Persistent) and Other Dedicated (Write). By my count we are currently using 55 TB (as opposed to TiB) Analysis and 42 TB Other Dedicated (see slide 9). Am I miscounting? Should I ignore the readWritePools and PublicScratchPools?

-tape
For tape, I show that we are currently using 1.1 PB (see slide 10). Am I miscounting?

#14 Updated by Arthur Kreymer about 1 month ago

I think we ignore the readWritePools and PublicScratchPools.
These are shared with everyone, without quotas.
The thing we need to retain beyond Analysis is the RawDataWrite pools, about 20 TB.

Enstore tape usage was about 450 TB the last time we got a detailed inventory
That was in July 2019.
Actual tape usage is shown at
https://www-stken.fnal.gov/enstore/tape_inventory/VOLUME_QUOTAS
There is double counting, as our LT04 tapes are being migrated to LT08 tapes.
Do not count the lines labeled 'shelf*'

#15 Updated by Arthur Kreymer about 1 month ago

The complete file listing breakdowns have had issues due to the migration.

These are usually at https://minos.fnal.gov/data/computing/dh/dcache/CFL/CFLSUM

The latest good one is last month's, https://minos.fnal.gov/data/computing/dh/dcache/CFL/cflsum.20200224
That lists a bottom line 465575 TBytes.

#16 Updated by Arthur Kreymer about 1 month ago

Tom submitted INC000001097244 and RITM0955495 to get access to the FCRSG 2020 upload area last Friday.
He uploaded draft slides.
So far, only MINOS and DES have uploaded drafts.

#17 Updated by Thomas Carroll about 1 month ago

#18 Updated by Arthur Kreymer 19 days ago

  • Status changed from Assigned to Work in progress

The preliminary FCRSG closeout report is linked from the meeting site

https://indico.fnal.gov/event/23475/



Also available in: Atom PDF