Develop a Testing framework for distributed resources and GlideinWMS
Build a testing application for distributed resources (entries) and GlideinWMS.
This application will interact with GlideinWMS components and send Glideins to explore and validate the resources.
It will further allow to customize the Glideins and replace standard components of the GlideinWMS framework with new ones than the user decides to test.
- Provide input in the design of the testing application
- Getting familiar with distributed computing and GlideinWMS
- Development and integration related to distributed computing software for Grids, Clouds and Supercomputers (this will include Python and Web development):
- Adapting components to talk the GlideinWMS protocol
- Adding a UI to drive the testing
- Testing on clusters, High-Performance Computers and clouds
- Integration and release
- No flexible way to send pilots to specific resources
- No way to substitute standard scripts
- Manual client checking which resources are available, what's the status and letting the user decide how many pilots to send and where
- The code written should be in Python 3 (specifically 3.6)
- Consider migrating some of the code in GlideinWMS (e.g. protocol sending ClassAds) using python 3.6 and htcondor python bindings
Here a project doing something similar with shell scripts:
#5 Updated by Marco Mambelli 10 months ago
Here a concrete task:
Start with manual_glidein_submit.py
Add the possibility to modify the parameters used in the submission (params dictionary) by reading them from a file in INI format. The file name will be specified in a command option, e.g. --parameters-file FILE_NAME , where FILE_NAME is the path to the INI file
Step 2 (more difficult)
Use the YAML format instead of INI and run the manual_glidein_submit with python3.
This may require some changes in the GlideinWMS code imported.
#6 Updated by Marco Mambelli 10 months ago
- % Done changed from 80 to 0
- Target version set to v3_5_x
- Assignee changed from Javier Rodriguez to Marco Mambelli
- Status changed from Assigned to New
Javier worked on a change to manual_glidein_submit.py to allow extra attr options loaded from an ini file.
The ticket is being opened for future re-assignment