Project

General

Profile

Investigate git clone timing

comparison table generated 6/5/2017

machine repository read-write read-only
uboonegpvm02 uboonecode 1m2.025s (80M) 6m55.439s (214M)
uboonegpvm02 uboonecode 1m11.975s (80M) 7m19.835s (214M)
uboonegpvm02 dunetpc 2m37.514s (106M) 4m13.307s (190M)
uboonegpvm02 dunetpc 0m43.447s (106M) 4m32.279s (190M)
uboonegpvm02 larreco 0m27.648s (35M) 5m13.816s (147M)
uboonegpvm02 larreco 0m29.831s (35M) 4m49.807s (147M)
development machine uboonecode 0m34.633s (80M) 0m54.053s (210M)
development machine dunetpc 0m26.825s (106M) 0m23.776s (186M)
development machine larreco 2m29.534s (35M) 0m23.208s (143M)

The numbers are real time and size of the cloned repository.

Solutions

  • run "git gc --aggressive" on redmine
  • add this block to the redmine git config for appropriate repositories
    [gc]
        auto = 1024
        autopack = 5
    

uboonegpvm02

  • source /grid/fermiapp/products/larsoft
  • setup git
  • work under /uboone/app/users/garren

read-write with Kerberos

time git clone ssh://p-uboonecode@cdcvs.fnal.gov/cvs/projects/uboonecode
Cloning into 'uboonecode'...                                                                        
remote: Counting objects: 30525, done.
remote: Compressing objects: 100% (26971/26971), done.
remote: Total 30525 (delta 21905), reused 4929 (delta 3186)
Receiving objects: 100% (30525/30525), 16.27 MiB | 1.09 MiB/s, done.
Resolving deltas: 100% (21905/21905), done.                         
Checking out files: 100% (1423/1423), done.                         

real    1m2.025s
user    0m4.334s
sys     0m1.406s

time git clone ssh://p-uboonecode@cdcvs.fnal.gov/cvs/projects/uboonecode ub2
Cloning into 'ub2'...
remote: Counting objects: 30525, done.
remote: Compressing objects: 100% (26971/26971), done.
remote: Total 30525 (delta 21903), reused 4928 (delta 3186)
Receiving objects: 100% (30525/30525), 16.27 MiB | 780.00 KiB/s, done.
Resolving deltas: 100% (21903/21903), done.
Checking out files: 100% (1423/1423), done.

real    1m11.975s
user    0m4.419s
sys     0m1.334s
time git clone ssh://p-dunetpc@cdcvs.fnal.gov/cvs/projects/dunetpc
Cloning into 'dunetpc'...
remote: Counting objects: 27672, done.
remote: Compressing objects: 100% (19092/19092), done.
remote: Total 27672 (delta 19686), reused 12002 (delta 8255)
Receiving objects: 100% (27672/27672), 16.69 MiB | 2.07 MiB/s, done.
Resolving deltas: 100% (19686/19686), done.
Checking out files: 100% (1365/1365), done.

real    2m37.514s
user    0m3.446s
sys     0m1.598s

time git clone ssh://p-dunetpc@cdcvs.fnal.gov/cvs/projects/dunetpc d2
Cloning into 'd2'...
remote: Counting objects: 27672, done.
remote: Compressing objects: 100% (19092/19092), done.
remote: Total 27672 (delta 19685), reused 12002 (delta 8255)
Receiving objects: 100% (27672/27672), 16.29 MiB | 1.67 MiB/s, done.
Resolving deltas: 100% (19685/19685), done.
Checking out files: 100% (1365/1365), done.

real    0m43.447s
user    0m3.278s
sys     0m1.292s

time git clone ssh://p-larreco@cdcvs.fnal.gov/cvs/projects/larreco
Cloning into 'larreco'...
remote: Counting objects: 38664, done.
remote: Compressing objects: 100% (25538/25538), done.
remote: Total 38664 (delta 27342), reused 19991 (delta 13040)
Receiving objects: 100% (38664/38664), 24.76 MiB | 5.37 MiB/s, done.
Resolving deltas: 100% (27342/27342), done.
Checking out files: 100% (681/681), done.

real    0m27.648s
user    0m2.878s
sys     0m1.551s

time git clone ssh://p-larreco@cdcvs.fnal.gov/cvs/projects/larreco r2
Cloning into 'r2'...
remote: Counting objects: 38664, done.
remote: Compressing objects: 100% (25538/25538), done.
remote: Total 38664 (delta 27345), reused 19990 (delta 13040)
Receiving objects: 100% (38664/38664), 24.74 MiB | 5.13 MiB/s, done.
Resolving deltas: 100% (27345/27345), done.
Checking out files: 100% (681/681), done.

real    0m29.831s
user    0m2.838s
sys     0m1.315s

read-only with Kerberos

time git clone http://cdcvs.fnal.gov/projects/uboonecode
Cloning into 'uboonecode'...
Checking connectivity: 30525, done.
Checking out files: 100% (1423/1423), done.

real    6m55.439s
user    0m23.940s
sys     0m26.645s

time git clone http://cdcvs.fnal.gov/projects/uboonecode u2
Cloning into 'u2'...
Checking connectivity: 30525, done.
Checking out files: 100% (1423/1423), done.

real    7m19.835s
user    0m24.004s
sys     0m26.849s

time git clone http://cdcvs.fnal.gov/projects/dunetpc
Cloning into 'dunetpc'...
Checking connectivity: 27672, done.
Checking out files: 100% (1365/1365), done.

real    4m13.307s
user    0m12.304s
sys     0m16.740s

time git clone http://cdcvs.fnal.gov/projects/dunetpc d2
Cloning into 'd2'...
Checking connectivity: 27672, done.
Checking out files: 100% (1365/1365), done.

real    4m32.279s
user    0m12.898s
sys     0m16.963s
time git clone http://cdcvs.fnal.gov/projects/larreco
Cloning into 'larreco'...
Checking connectivity: 38664, done.
Checking out files: 100% (681/681), done.

real    5m13.816s
user    0m13.589s
sys     0m19.034s
time git clone http://cdcvs.fnal.gov/projects/larreco r2
Cloning into 'r2'...
Checking connectivity: 38664, done.
Checking out files: 100% (681/681), done.

real    4m49.807s
user    0m12.916s
sys     0m17.814s