Project

General

Profile

Feature #6710

Support submitting glideins to Google Compute Engine

Added by Parag Mhashilkar over 5 years ago. Updated over 3 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Parag Mhashilkar
Category:
-
Target version:
Start date:
07/30/2014
Due date:
% Done:

0%

Estimated time:
Stakeholders:

HEPCloud

Duration:

Description

HTCondor supports Google CE since 8.1.4 and this support is also available in 8.2+

Request from Gabriele ...

From: Gabriele Garzoglio 
Subject: GlideinWMS feature request: support for Google cloud
Date: July 30, 2014 10:38:00 AM CDT
To: Burt Holzman
Cc: Parag Mhashilkar, Steven Timm, Michael H Kirby, Tanya Levshina, Gerard Bernabeu Altayo

Hi Burt,
I'd like to request for glideinWMS to support running jobs on Google Cloud.

HTCondor now supports Google, as per the ticket below.

https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=3833

We would like to experiment with this early in FY15, although we have flexibility in the schedule.

For this request I'm wearing my hat as SCD / GCS stakeholder, although FIFE might be interested as well.

Please, let me know if you have feedback on this or if you want me to enter this request in some system.
Thanks
Gabriele

History

#1 Updated by Burt Holzman over 5 years ago

  • Assignee set to Anthony Tiradani

#2 Updated by Burt Holzman over 5 years ago

  • Status changed from New to Assigned

#3 Updated by Parag Mhashilkar over 3 years ago

  • Assignee changed from Anthony Tiradani to Parag Mhashilkar
  • Target version changed from v3_x to v3_3_x
  • Stakeholders updated (diff)

One the students, Flavio Giobergia, who is working with Steve Timm made progress and can manage glideins using HTCondor. This is a good time to look into Google Cloud more seriously.

#4 Updated by Parag Mhashilkar over 3 years ago

  • Target version changed from v3_3_x to v3_3

#5 Updated by Parag Mhashilkar over 3 years ago

Marco, I made the changes while I was working on other ticket. I have merged them and tagged rc2. Can you please test them for the test cases for this ticket? Once you can confirm I will announce the rc2.

Comment for wrong ticket :(

#6 Updated by Parag Mhashilkar over 3 years ago

Factory/Frontend related changes are in the branch v3/6710

#7 Updated by Parag Mhashilkar over 3 years ago

In the current format, userdata is passed to a gce instance in key=value format which is completely different than other clouds that work with a blob of string. This changes the format of userdata across the board for all cloud types. This alone is a good justification for adding this functionality as Glideinwms v3.3 and will be backwards incompatible with v1.x versions of glidein-vm* rpms

#8 Updated by Parag Mhashilkar over 3 years ago

  • Status changed from Assigned to Feedback
  • Assignee changed from Parag Mhashilkar to Marco Mambelli

I have made required changes to the factory+frontend to support GCE and GCE auth file. It is a prototype and there might be some changes expected in future. Given that these changes breaks back ward compatibility it will be merged into master and released as part of v3_3. This branch also includes changes made as part of #13484

#9 Updated by Parag Mhashilkar over 3 years ago

changes are in v3/6710

#10 Updated by Parag Mhashilkar over 3 years ago

v3/6710 is forked off branch_v3_2
master_6710 has changes w.r.t master

#11 Updated by Marco Mambelli over 3 years ago

  • Assignee changed from Marco Mambelli to Parag Mhashilkar

Feedback sent via email

#12 Updated by Parag Mhashilkar over 3 years ago

  • Status changed from Feedback to Resolved

Merged into master after working on feedback. Since these changes are disruptive to existing VMs, this will be released in v3_3

#13 Updated by Parag Mhashilkar over 3 years ago

  • Status changed from Resolved to Closed


Also available in: Atom PDF