Underworld

a long term geodynamics simulation platform

Using Underworld on the ARCS Grid & Cloud

About the ARCS Grid & Cloud

The ARCS Grid connects a range of High Performance Computing (HPC) facilities in Australia and New Zealand. The ARCS Compute Cloud (beta) is a variation of the Grid, providing more streamlined access to facilities. However not all facilities on the Grid are accessible via the Cloud (yet).

Grisu is a Java-based Grid submission client developed by ARCS, which provides a single graphical user interface for accessing facilities on both the Grid and the Cloud, which can be used to submit Underworld jobs to supported computer clusters, without needing to use command-line tools. The following steps will guide you through getting started with Grisu and submitting a test Underworld job to a supported computer cluster.

For further information on the ARCS Grid, Cloud and Grisu, see:

ARCS Grid & Cloud Overviews

ARCS Grid

ARCS Compute Cloud (beta)

Which Supported Computer Clusters have Underworld Modules Installed?

The Software Map (links below) provides lists of applications installed as modules on supported computer clusters. The most recent Underworld modules are also "grid-enabled" for use across the Grid and Cloud (click on "How to Use" next to the version entry for a site and scroll down to see whether the module is "Grid Enabled" (True) or not (False)):

A map of all sites on the ARCS Grid is provided by the Grid Operations Center. All grid-enabled software packages are listed by site in the ARCS WebMDS Interface.

Grid System & Software Requirements

You can connect to the Grid from linux, macs and Windows operating systems. Grisu v.0.2.2 (Grid and Cloud site selection) requires at least Java 1.5, however 1.6 is recommended. Grisu-dynamic (Cloud metascheduling only) requires Java 1.6.

Getting Started with the Grid & Cloud

We provide below a quick-start guide to getting started with Underworld on the ARCS Grid. See above for links to further information.

  1. Register on the ARCS website: Go to http://www.arcs.org.au/, click on the "Services Login" button and enter your IdP* credentials. (Note: an ARCS Data Fabric account will also be automatically created for you, which takes about 30 minutes to be processed).

  2. Request ARCS Compute Cloud Quota (even if you plan to only initially use the Grid): go to http://services.arcs.org.au/ and follow the links to join the ARCS Compute Cloud (this will take about 30 minutes to be processed).

  3. Start Grisu:
  4. Start Grisu and Authenticate: Double-click on grisu.jnlp (click on the "Trust" buttons to confirm that you trust the certificates) and select "Shibboleth login". Select your IdP* (e.g. Monash University), enter your IdP* username and password (e.g. Monash Authcate) and click on the "Login" button.

  5. Submit a Test Underworld Job: Follow the intructions at http://projects.arcs.org.au/trac/grisu/wiki/UnderworldTestCase (skipping the "Login and VO Selection" step, as you've already logged in using Shibboleth), which will guide you through a sample Underworld workflow, demonstrating many of Grisu's relevant capabilities. A guide to running a very simple (non-Underworld) test job is also supplied at https://www.arcs.org.au/index.php/component/content/article/37/307-grisu-quick-stat-guide.

* What is an IdP login? This is the username and password you use at your institution (e.g. Authcate at Monash), if your institution is a member of and set up with the Australian Access Federation. You can check your institution's AAF membership status at http://www.aaf.edu.au/index.php/join/member-institutes/#federationmembers. If you don't see your institution listed, or it is not fully set up with the AAF yet, you can join the ARCS IdP (secure transfer of your auEduPersonSharedToken from the ARCS IdP to your institutional IdP can be arranged later).

About Groups & Virtual Organisations

By using the ACC Group you are selecting to use the ARCS Cloud and will only have access to the faciities that have joined the Cloud, however this access is "free". If you use any other Group or Virtual Organisation (VO), you are using the ARCS Grid and still have access to a larger range of facilities, however there may be charges involved.

ARCS can create a Virtual Organisation (VO) for each research group, who then need to approach a site to support their VO (cluster usage charges may apply).

The "MonashGeo" VO has been set up for the AuScope Underworld user community at Monash University, to access the Monash Sun Grid (free to Monash users) and VPAC cluster resources (charges apply).

To apply to join an existing VO, you can email a manager of the VO directly (e.g. for the MonashGeo VO you can contact Wendy Mason), or you can apply for membership using Grix.

Support

Known issues for Grisu v.0.2.2: Grisu v.0.2.2 Known Issues
Known issues for Grisu-dynamic: Grisu-dynamic Known Issues
Help with using the ARCS Services including Grisu: ARCS Customer Service
Queries regarding the installation of Underworld release modules on the ARCS Grid: Wendy Mason, Underworld eResearch Officer
Instructions on how to use Underworld: Underworld User Manual
Help with using Underworld: contact underworld-users@vpac.org

-- Wendy Mason - 27 July 2010
-- Patrick Sunter - 13 June 2007