Getting access to SweStore national storage

From SNIC Documentation
Revision as of 07:57, 25 May 2012 by Joel Hedlund (NSC) (talk | contribs) (Created page with "This list covers the required steps for storing and accessing data on SweStore national storage. It starts with the formalia of getting a storage project and a client certificate...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

This list covers the required steps for storing and accessing data on SweStore national storage. It starts with the formalia of getting a storage project and a client certificate. If you have difficulties with any of the steps, please do not hesitate to contact swestore-support@snic.vr.se.

Applying for storage and getting it

Is your research area already covered by one of the SweStore collaborators?
SweStore collaborates with ECDS, SND, Bioimage, BILS, UPPNEX,WLCG, NaturHistoriska RiksMuseet. If any of these cover your research area, first read their information about applying for SweStore storage.
Apply for storage
In the future, applications for storage will be handled by each research community, but for now an email to swestore-support@snic.vr.se will suffice. Include the following information:
  • Name for principal investigator PI
  • Purpose for storage, short description of the project and type of data.
  • Required storage capacity. Preferably as a maximum size, but if this is not currently knowable, please calculate a starting size and expansion by time period.
  • Suggested project name, used as root directory name for your storage.
Get a client certificate.
Follow the instructions here to get your client certificate. For Terena certificates, please make sure you also export the certificate for use with grid tools.
Install your Nordugrid client certificate in your web browser.
If you got a Terena certificate you already have it installed in your web browser so you can skip this step. Otherwise, first convert your Nordugrid certificate to the PKCS#12 format using openssl in a terminal, which should be available on any modern linux computer:
openssl pkcs12 -export -in ~/.globus/usercert.pem -inkey ~/.globus/userkey.pem -out DELETE_ME.p12
The procedure for installing client certificates varies depending on what web browser you use. For example in chrome Settings click "Under the hood" in the sidebar > "Manage certificates..." button > "Import..." button > browse to your DELETE_ME.p12 > "Open" button > Type in your password > Done. Now delete DELETE_ME.p12.
Request membership in the SweGrid VO.
Follow the instructions here to get added to the SweGrid virtual organisation.

Using storage

When you have installed your certificate in your browser (see above) you can go to http://webdav.swegrid.se/ to browse and download your data, and any other publicly accessible data. Your data is available at http://webdav.swegrid.se/snic/YOUR_PROJECT_NAME.

To upload data you need to use the arc client. These are the required steps:

Install the ARC client.
All SNIC systems have ARC client installed. If yours doesn't, please contact support at your centre so they can fix this error as soon as possible. To install it on your computer, please follow instructions [ARC_client_installation|here].
Use the ARC client.
Please follow instructions here. Basic commands are:
arcproxy - unlock your certificate so you can use it.
arcls - for listing files. Works similarly to ls. Example arcls http://webdav.swegrid.se/snic/YOUR_PROJECT_NAME
arccp - for copying files. Works similarly to cp. Example arccp myfile.txt http://webdav.swegrid.se/snic/YOUR_PROJECT_NAME/create_dirs_if_necessary/myfile.txt
arcrm - for deleting files. Works similarly to rm. Example arcrm http://webdav.swegrid.se/snic/YOUR_PROJECT_NAME/whoops.txt

Note that the paths on storage are the same as in the web browser. Use man and --help to get more info on each command. Examples: man arcrm or arcls --help