====== How do I get an account on NWICG? ======

===== How do I obtain a certificate? =====

NWICG provides access to resources via Globus (or Condor-G), so you don't exactly get an account on NWICG.  What you do need is a //user certificate//, and then you need to have that certificate authorized for NWICG use.

The first step is to obtain an X.509 user certificate.  Depending on where you are, this can be done in different ways:

  * If you already have a DOE, Purdue, NCSA, or other certificate, you may use that one and skip this step.
  * Purdue Calumet users can obtain certificates from Purdue.\\ [[calumet_cert|Instructions for Calumet Users]]
  * Notre Dame users can obtain certificates from the Department of Energy (DOE).\\ [[nd_cert|Instructions for Notre Dame Users]]
  * Purdue West Lafayette users can obtain certificates from Purdue.\\ [[purdue_cert|Instructions for West Lafayette Users]]
  * Off-campus OSG users must obtain a certificate from a trusted certificate authority.   If you are not affiliated with a project that already has an arrangement for user certificates, you might be able to obtain one from the OSG directly here:  http://www.opensciencegrid.org/

===== How do I get authorized for NWICG? =====

Once you have obtained a user certificate, you will need to request your certificate be authorized to send jobs to NWICG.  You may do this by emailing your certificate's DN (distinguished name) to [[support@nwicgrid.org|support@nwicgrid.org]].  **DO NOT EMAIL YOUR PRIVATE KEY!**  We need only your DN, which will look something like "/CN=My Name/OU=Purdue TeraGrid/O=Purdue University/ST=Indiana/C=US" or "/DC=org/DC=doegrids/OU=People/CN=My Name 12345".  You may extract this from your certificate using the following command:

  grid-cert-info -subject

====== How do I use NWICG resources? ======

===== Where can I submit jobs from? =====

Jobs are submitted to NWICG computational resources using Globus or Condor-G (which is a Condor interface to Globus).  Jobs may be submitted from any machine with Globus client tools.  One package which includes these is VDT, and the Open Science Grid packages a smaller subset of VDT for this purpose you may download and install.  If you would like to submit jobs from a machine which already has such tools installed and working, NWICG offers one such submit host at each site:

  * submit.calumet.nwicgrid.org\\ [[calumet_submit|Instructions for Calumet Users]]
  * submit.nd.nwicgrid.org\\ [[nd_submit|Instructions for Notre Dame Users]]
  * submit.purdue.nwicgrid.org\\ [[purdue_submit|Instructions for West Lafayette Users]]

===== Where can I submit jobs to? =====

Jobs on NWICG may be submitted to one of the NWICG Globus //gatekeepers//.  These gatekeepers accept jobs and send them into the local queuing system for the requested resource.  There are two primary gatekeepers currently on NWICG, and each is for a specific location and computational resource:

  * gatekeeper.nd.nwicgrid.org\\ 144-core 64-bit AMD Opteron Sun Fire X2100\\ (networked cluster)\\ Uses SGE queuing system
  * gatekeeper.purdue.nwicgrid.org\\ 128-processor Intel Itanium SGI Altix 4700\\ (large-memory SMP system)\\ Uses PBS queuing system

More details about these systems can be found on the [[http://www.kevin.nwicgrid.org/resources/|NWICG Computational Resources Page]].

===== How do I submit a job? =====

To submit jobs, you will need to use either Globus tools or Condor-G tools.  No matter what you use, you must first obtain your temporary proxy grid credentials.  This is done by running:

  globus-proxy-init

This proxy credential will automatically expire in a certain amount of time, usually 24 hours.  You must rerun grid-proxy-init then to obtain fresh proxy credentials.  You will be notified if your proxy expires and you try to submit another job, so don't worry about this too much.

There are several methods and tools you may use for actual job submission.  Which you choose to use may depend on your familiarity or personal preference.  There should not be much difference in capabilities.  Here are a few examples you should try to get started, and to ensure your user certificate is being accepted at each site:

  * [[example_globus-job-run|Very Simple Certificate Test Submission]]
  * [[example_globusrun|Simple Globus RSL Job]]
  * [[example_condorg|Simple Condor-G Job]]
  * [[example_globusrun_exe|Example of Sent-with-Job Executable with Globus RSL]]
  * [[example_condorg_exe|Example of Sent-with-Job Executable with Condor-G]]
  * [[example_globusrun_file|Example of Automatic File Pre-Staging with Globus RSL]]
  * [[example_condorg_file|Example of Automatic File Pre-Staging with Condor-G]]
  * [[example_globusrun_mpi|Example of Parallel (MPI) Job with Globus RSL]]
  * [[example_condorg_mpi|Example of Parallel (MPI) Job with Condor-G]]

===== How do I check status or cancel a job? =====

  * [[status_globus|Checking on or Canceling Globus Jobs]]
  * [[status_condorg|Checking on or Canceling Condor-G Jobs]]

===== How do I manage many jobs at once? =====

If you need to manage a series and/or inter-related group of jobs, you may wish to explore using DAGMan.  DAGMan is a Directed Acyclic Graph (DAG) Manager and can be used with Condor-G:

  * [[dagman_condor|DAGMan Example with Condor-G]]

===== How do I use commercial packages? =====

Some commercial software packages are available on NWICG resources and can be used there.  Here is a list of some of the most popular packages, their availability at each site, and instructions on how to access them:

  * OOPSE\\ [[software_oopse_nd|Instructions for gatekeeper.nd.nwicgrid.org]]\\ [[software_oopse_purdue|Instructions for gatekeeper.purdue.nwicgrid.org]]
  * VASP\\ [[software_vasp_nd|Instructions for gatekeeper.nd.nwicgrid.org]]\\ [[software_vasp_purdue|Instructions for gatekeeper.purdue.nwicgrid.org]]
  * WRF\\ [[software_wrf_nd|Instructions for gatekeeper.nd.nwicgrid.org]]\\ [[software_wrf_purdue|Instructions for gatekeeper.purdue.nwicgrid.org]]
  * Matlab\\ [[software_matlab_nd|Instructions for gatekeeper.nd.nwicgrid.org]]\\ [[software_matlab_purdue|Instructions for gatekeeper.purdue.nwicgrid.org]]
  * R\\ [[software_r_nd|Instructions for gatekeeper.nd.nwicgrid.org]]\\ [[software_r_purdue|Instructions for gatekeeper.purdue.nwicgrid.org]]
  * SAS\\ [[software_sas_nd|Instructions for gatekeeper.nd.nwicgrid.org]]\\ [[software_sas_purdue|Instructions for gatekeeper.purdue.nwicgrid.org]]
  * Maple\\ [[software_maple_nd|Instructions for gatekeeper.nd.nwicgrid.org]]\\ [[software_maple_purdue|Instructions for gatekeeper.purdue.nwicgrid.org]]
  * Mathematica\\ [[software_mathematica_nd|Instructions for gatekeeper.nd.nwicgrid.org]]\\ [[software_mathematica_purdue|Instructions for gatekeeper.purdue.nwicgrid.org]]
  * Gaussian\\ [[software_gaussian_nd|Instructions for gatekeeper.nd.nwicgrid.org]]\\ [[software_gaussian_purdue|Instructions for gatekeeper.purdue.nwicgrid.org]]

===== How do I compile my own code on an NWICG resource? =====

If you need to run custom code on an NWICG resource, you will need to request special permission to obtain interactive use of a compilation machine.  Once you compile your code there successfully, you can use it via the the normal routes outlined above on the primary compute resources.  Note that NWICG may elect to only approve NWICG-sponsored researchers for access to an interactive compilation machine.  These are:

  * compile.nd.nwicgrid.org\\ [[nd_compile|Instructions for Notre Dame Compilation]]
  * compile.purdue.nwicgrid.org\\ [[purdue_compile|Instructions for West Lafayette Compilation]]

===== Where can I learn more? =====

For full details on any Globus RSL attributes or possibilities, refer to the [[http://www-unix.globus.org/api/c-globus-2.2/globus_gram_job_manager/html/globus_job_manager_rsl.html|Globus RSL Attribute Reference]].