Project

General

Profile

Bug #7822

problem with remote install

Added by Lynn Garren about 6 years ago. Updated about 6 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
Install / build / code mgmt
Target version:
-
Start date:
02/10/2015
Due date:
% Done:

100%

Estimated time:
6.00 h
Occurs In:
Experiment:
-
Co-Assignees:
Duration:

Description

So I used pullProducts to download the binaries and executed the following order of commands:

source ./setup
setup git
setup gitflow
setup mrb
export MRB_PROJECT=larsoft
setup larsoft v03_08_00 -q e6:prof

=============================
I get these errors:
RROR: Action parsing failed on "unsetuprequired(g4surface v1_0)"
ERROR: Action parsing failed on "unsetuprequired(g4pii v1_3)"
ERROR: Action parsing failed on "unsetuprequired(g4nucleonxs v1_1)"
ERROR: Action parsing failed on "unsetuprequired(g4neutronxs v1_2)"
ERROR: Action parsing failed on "unsetuprequired(g4neutron v4_2)"
ERROR: Action parsing failed on "unsetuprequired(g4emlow v6_32)"
ERROR: Found no match for product 'g4emlow'
ERROR: Action parsing failed on "setupRequired(g4emlow v6_32)"
ERROR: Found no match for product 'g4neutron'
ERROR: Action parsing failed on "setupRequired(g4neutron v4_2)"
ERROR: Found no match for product 'g4neutronxs'
ERROR: Action parsing failed on "setupRequired(g4neutronxs v1_2)"
ERROR: Found no match for product 'g4nucleonxs'
ERROR: Action parsing failed on "setupRequired(g4nucleonxs v1_1)"
ERROR: Found no match for product 'g4pii'
ERROR: Action parsing failed on "setupRequired(g4pii v1_3)"
ERROR: Found no match for product 'g4surface'
ERROR: Action parsing failed on "setupRequired(g4surface v1_0)" =============================

I still go ahead and continue the order:

mkdir workdir
cd workdir
mrb newDev
source ./localProducts_larsoft_v03_08_00_e6_prof/setup;
cd srcs/
mrb g lbnecode

=============================
git clone: clone lbnecode at /home/elnimr/larsoft_new/workdir2/srcs

NOTICE: You do not have read-write permissions for this repository
NOTICE: Running git clone http://cdcvs.fnal.gov/projects/lbnecode
Cloning into 'lbnecode'...
fatal: unable to access '/home/garren/scratch/pe5/git/v1_8_5_6/Linux64bit+2.6-2.12/etc/gitconfig': Permission denied
ERROR: The git command failed! ==========================

Your help will be appreciated.

list (5.66 KB) list Muhammad Elnimr, 02/13/2015 08:30 PM

History

#1 Updated by Lynn Garren about 6 years ago

  • Category set to Install / build / code mgmt
  • Status changed from New to Assigned
  • Assignee set to Lynn Garren

I cannot reproduce the first part of your problem:

./pullProducts ~/p/ slf6 larsoft-v03_08_00 s6-e6 prof
source ~/p/setup
setup git
setup gitflow
setup mrb
export MRB_PROJECT=larsoft
setup larsoft v03_08_00 -q e6:prof

At this point, there are no errors.

#2 Updated by Lynn Garren about 6 years ago

  • % Done changed from 0 to 10

I can reproduce the problem with mrb g lbnecode if I do not have a proper Kerberos ticket. gitCheckout has has seen that you do not have permissions and is attempting a non-privileged clone.

It appears that we need to fix git.

However, you can solve your problem for now by making sure you have a Kerberos ticket (execute the kinit command) before you run mrb g.

#3 Updated by Muhammad Elnimr about 6 years ago

I have a ticket now but I am still experiencing the problem.

klist

Ticket cache: FILE:/tmp/krb5cc_5039
Default principal:

Valid starting Expires Service principal
02/12/15 17:51:56 02/13/15 19:51:53
renew until 02/19/15 17:51:53
02/12/15 17:54:41 02/13/15 19:51:53
renew until 02/19/15 17:51:53

And I still get:

git clone: clone larreco at /home/elnimr/larsoft_new/wrkdir/srcs
NOTICE: Running git clone ssh:///cvs/projects/larreco
Cloning into 'larreco'...
fatal: unable to access '/home/garren/scratch/pe5/git/v1_8_5_6/Linux64bit+2.6-2.12/etc/gitconfig': Permission denied
ERROR: The git command failed!

#4 Updated by Muhammad Elnimr about 6 years ago

Is this related but I found out that there is a directory for you Lynn here on our cluster:

[neutrino2]$ ls /home/garren/
ls: cannot open directory /home/garren/: Permission denied

#5 Updated by Erica Snider about 6 years ago

Hi Muhammad,
Lynn is away from the Lab today and won't be back until Monday, which is why there has been silence on this ticket. She sent around a message last night speculating on what might be happening. I've never seen this type of problem come up, and no one else has offered a suggestion. Really sorry the the delay. This is clearly a show-stopping problem, so we'd like to get this fixed asap.

The /home/garren/... path obviously shouldn't be happening. The thinking is that it's either in your environment somewhere or it somehow got built into the git executable you have, is the thinking.

Can you try a couple of things for me just so we can see some of the details of your environment? After setting everything up and hitting the problem, can you do the following:

ups active
which git
printenv|grep ^GIT

Thanks!
Erica

#6 Updated by Muhammad Elnimr about 6 years ago

ups active is attached.

which git
~/larsoft_new/git/v1_8_5_6/Linux64bit+2.6-2.12/bin/git

printenv|^GIT

GITFLOW_DIR=/home/elnimr/larsoft_new/gitflow/v0_4_2_pre
GIT_FQ_DIR=/home/elnimr/larsoft_new/git/v1_8_5_6/Linux64bit+2.6-2.12
GIT_TEMPLATE_DIR=/home/elnimr/larsoft_new/git/v1_8_5_6/Linux64bit+2.6-2.12/share/git-core/templates
GIT_UPS_DIR=/home/elnimr/larsoft_new/git/v1_8_5_6
GITFLOW_VERSION=v0_4_2_pre
GIT_HOME=/home/elnimr/larsoft_new/git/v1_8_5_6/Linux64bit+2.6-2.12
GITPERLLIB=/home/elnimr/larsoft_new/git/v1_8_5_6/Linux64bit+2.6-2.12/share/perl5
GIT_EXEC_PATH=/home/elnimr/larsoft_new/git/v1_8_5_6/Linux64bit+2.6-2.12/libexec/git-core

#7 Updated by Erica Snider about 6 years ago

It looks to me as though the problem is in the git distribution, which is not something I can fix directly. We'll need to wait for Lynn to look into it.

I tried using git v1_8_5_3, which is the next earlier version we have in the larsoft distribution area. That appeared to work with the current mrb g. So, a possible workaround until the later version can get fixed is to try pulling git v1_8_5_3, then setting that up explicitly before doing any mrb g operations. I suppose it's possible that the earlier one will be broken for you in the same way, but it might be worth a try if you are anxious to get something working.

Erica

#8 Updated by Muhammad Elnimr about 6 years ago

I tried:
./pullProducts ./ slf6 git-v1_8_5_3 s6-e6 prof

but I get:

looking for git 1.8.5.3 v1_8_5_3 slf6 s6-e6 prof
ERROR: pull of git-1.8.5.3-Linux64bit+2.6-2.12-s6-e6-prof_MANIFEST.txt failed
Please check the spelling and try again

#9 Updated by Lynn Garren about 6 years ago

We suspect that the problem is related to a connection between your machine and Fermilab. We would like you to do some direct tests.

First, are you able to ssh to any Fermilab machine? Which one(s)?

Second, please try git clone directly in some test directory.
setup git v1_8_5_6
which git
git clone http://cdcvs.fnal.gov/projects/larreco
git clone ssh://p-larreco@cdcvs.fnal.gov/cvs/projects/larreco
setup git v1_8_5_3
which git
git clone http://cdcvs.fnal.gov/projects/larreco
git clone ssh://p-larreco@cdcvs.fnal.gov/cvs/projects/larreco
unsetup git
which git

pullProducts is not designed to install individual products. To install the older git, which has known security issues and is NOT recommended for continued use:
cd <your product directory>
curl -O http://scisoft.fnal.gov/scisoft/packages/git/v1_8_5_3/git-1.8.5.3-slf6-x86_64.tar.bz2
tar xf git-1.8.5.3-slf6-x86_64.tar.bz2

#10 Updated by Lynn Garren about 6 years ago

  • Status changed from Assigned to Feedback

One more question:

What is the result of "git config -l"?

#11 Updated by Muhammad Elnimr about 6 years ago

All the git clone commands before had the same permission problems.

When I switched to the old git it definitely work except this error at the end that is probably unrelated:

git clone: clone lbnecode at /home/elnimr/larsoft_new/wrkdir/srcs
NOTICE: Running git clone ssh:///cvs/projects/lbnecode
Initialized empty Git repository in /mnt/raid3b/users/elnimr/larsoft/wrkdir/srcs/lbnecode/.git/
remote: Counting objects: 4077, done.
remote: Compressing objects: 100% (3058/3058), done.
remote: Total 4077 (delta 2491), reused 1358 (delta 729)
Receiving objects: 100% (4077/4077), 2.89 MiB | 2.03 MiB/s, done.
Resolving deltas: 100% (2491/2491), done.
ready to run git flow init for lbnecode
Branch master set up to track remote branch master from origin.
Switched to a new branch 'master'
Using default branch names.
Switched to branch 'develop'
error: unknown option `set-upstream-to=origin/develop'

also, git config -l gives me:
fatal: error processing config file(s)

#12 Updated by Muhammad Elnimr about 6 years ago

Oh and :
unsetup git
which git

gives:

/usr/bin/git

#13 Updated by Muhammad Elnimr about 6 years ago

I actually I take that back.
That old version (v1_8_5_3) doesn't work.

Only when I unsetup git. And use the default local git:

which git
/usr/bin/git

git --versino
git version 1.7.1

it does work!

#14 Updated by Lynn Garren about 6 years ago

The problem is now understood. You need to configure git. Please see this page:
http://git-scm.com/book/en/v2/Getting-Started-First-Time-Git-Setup

It is important to at least set user.name and user.email.

#15 Updated by Muhammad Elnimr about 6 years ago

I should be more clear when I have our own git setup (the one local here on the Alabama cluster):
git config -l
fatal: error processing config file(s)

but when I have the one that comes with larsoft setup:

git config -l
fatal: unable to access '/home/garren/scratch/p/git/v1_8_5_3/Linux64bit+2.6-2.12/etc/gitconfig': Permission denied

#16 Updated by Lynn Garren about 6 years ago

In both cases, git is complaining because you do not have your own git configuration. Both errors will go away when you follow the instructions on http://git-scm.com/book/en/v2/Getting-Started-First-Time-Git-Setup

#17 Updated by Muhammad Elnimr about 6 years ago

But my point is that even with the local git (/usr/bin/git) and no configuration it still works.

#18 Updated by Lynn Garren about 6 years ago

git needs a configuration file. Your system configuration is for an older release of git. If you want git 1.8.x.y to work you MUST have a git configuration in your $HOME directory. Everything else is a red herring. Once you have made your local config file, git will no longer try to find the non-existent configuration file (which never existed on ANY machine).

#19 Updated by Muhammad Elnimr about 6 years ago

I do:
git config --global user.name "Muhammad Elnimr"

and I still get the error:
fatal: unable to access '/home/garren/scratch/pe5/git/v1_8_5_6/Linux64bit+2.6-2.12/etc/gitconfig': Permission denied

#20 Updated by Lynn Garren about 6 years ago

  • Status changed from Feedback to Assigned
  • Estimated time set to 6.00 h

I finally found a machine where I can reproduce the problem.

You will not be able to git config with git v1_8_5_6. You will need to use either your system git or git v1_8_5_3.

#21 Updated by Lynn Garren about 6 years ago

  • Status changed from Assigned to Resolved
  • % Done changed from 10 to 100

Please download git v2_3_0. This works in our tests.

You will need to download and install git by hand until the new release is part of the larsoft distribution. Download the appropriate tarball from this directory:
http://scisoft.fnal.gov/scisoft/packages/git/v2_3_0/

Then cd to your product directory and "tar xf <tarball>"

#22 Updated by Lynn Garren about 6 years ago

  • Status changed from Resolved to Closed

Also available in: Atom PDF