OpenOnDemand, HPC Portal

Introduction#


OpenOnDemand or OOD for short, is an open source Web portal for High-Performance computing, developed at Ohio Supercomputing Center. OOD makes it easier for beginner HPC users to access the resources via a Web interface. OOD also allows for interactive, visualization and other Linux Desktop applications to be accessed on HPC systems via a convenient Web user interface.

  • Since the end of October 2021, OpenOnDemand version 2 is officially in production on Grex.
  • Since the beginning of January 2023, OpenOnDemand version 3 is officially in production on Grex.
  • Since the beginning of February 2025, OpenOnDemand version 4 is officially in production on Grex.

For more general OOD information, see the OpenOnDemand paper

OpenOndemand on Grex#


Grex’s OOD instance runs on ood.hpc.umanitoba.ca and requires the Alliance’s Duo MFA to authenticate. The OOD instance is available only from UManitoba campus IP addresses – that is, your computer should be on the UM Campus network to connect.

To connect from outside the UM network, please install and start UManitoba Virtual Private Network: UM VPN . Note that you’d need the “VPN client” installation as described there; “VPN Gateway” will likely not work.

OOD relies on in-browser VNC sessions; so, a modern browser with HTML5 support is required; we recommend Google Chrome or Firefox or Safari, and their derivatives.

OOD expects user accounts and directories on Grex to be already created. Thus, new users who want to work with OOD should first connect to Grex normally, via SSH shell at least once, to make the creation of account, directories, and quota complete.

Also, OOD creates a state directory under users’ /home (/home/$USER/ondemand) where it keeps information about running and completed OOD jobs, shells, desktop sessions and such. Deleting the ondemand directory while a job or session is running would likely cause the job or session to fail.

It is better to leave the /home/$USER/ondemand directory alone!

Connect to OOD on campus:

1. Point your Web browser to https://ood.hpc.umanitoba.ca . This will redirect you to our Keycloack IDP screen.

2. Use your Alliance/CCDB username and password to log in to Grex OOD.

Use your Alliance username and password to log in to Grex OOD.
MFA second factor

3. Provide Alliance’s Duo second factor authentication when asked.

Connect to OOD off-campus, using UManitoba VPN:

  • Make sure UM Ivanti Secure VPN is connected. This may require using UManitoba MS Entra second factor authentication. Note that UManitoba uses a different MFA second factor than the Alliance!
  • Perform the steps 1-3 as above.

There are different options for the Alliance Duo MFA, like the 6 digits passcode generated by DUO mobile application:

Use your 6 digits passcode generated by DUO mobile app
MFA second factor

or use the passcode generated by your YubiKey:

Use your YubiKey: touch and hold to receive the code.
MFA second factor

Or any other option by clicking on the menu “Other options”.

Once connected, you will see the following screen with the current Grex Message-of-the-day (MOTD):

OpenOndemand front page
OpenOnDemand Front Page

There are several areas of interest on the OOD main webpage: the Dashboard bar on the top of the screen, various menu items (such as Files, Clusters, Jobs, Interactive Apps and Sessions).

  • OpenOnDemand: main Open OnDemand dashboard.
  • Apps: link to the available applications.
  • Files: file browser.
  • Jobs: links to active jobs and Grex job composer.
  • Clusters: Grex status and partition status.
  • Interactive Apps: list of interactive applicqations.
OpenOndemand main menus
OpenOnDemand Front Page

The use of the different menus is described in the following sections:

OpenOnDemand main dashboard#

The OpenOnDemand main dashboard menu shows the message of the day which is similar to the message you see when connecting to Grex via ssh. It shows the url for the documentation and support email to contact in case you need help. Some other information are also added to the message of the day.

If you scroll down from the front page, some icons with links to pinned applications and featured subset of all available applications:

Links to pinned interactive applications
Links to OpenOnDemand Interactive Apps
Please note that the list of applications may change over time. The snapshots shown on this page are taken from the current list of the available applications on the OpenOnDemand portal while updating this page.

Apps menu#


This menu show links to the pinned applications like Grex Simplified Desktop and a link to all application.

Link to pinned and all interactive applications
Links to OpenOnDemand Interactive Apps

Files#


One of the convenient and useful features of OOD is its Files app that allows you to browse the files and directories across all Grex filesystems: /home and /project.

File view on OpenOndemand web portal on Grex

The main features accessible vile the menu _Files are:

Access to storage: home, project directories. Create new directories and files via the sub-menus New File and New Directory View and edit text files Upload or download files via Upload and Download sub-menus. Delete data: files or directories. Copy or move data (files and directories). Access to a path to a file or directory using the sub-menu Copy Path. Open a terminal to a selected directory. While working with the directories, you could view the content of the folder, rename the folder, delete the folder. It is also possible to download the folder as zip file. While working with files, you can edit and change the text file, rename and delet files. A link to globus: this sub-menu start globus web interface. For more information about globus, please have a look to the dedicated page .

You can also upload your data to Grex using this Web interface. However, there are limits on the size of th uploads on the Web server and there can be practical limits on download sizes as well due to internet connection speed and stability. OOD on Grex has a 10Gb limit for maximal size of files to be uploaded through the File menu. For larger amount of data, please use globus.

Jobs#


This menu gives access to Active Jobs; Jobs Metrics and Grex Job Composer:

Jobs menu view on OpenOndemand web portal on Grex

Active Jobs:

From this menu, you can access the list of current jobs on the queue. In other terms, anything you could get from running squeue from the command line.

Active Jobs view on OpenOndemand web portal on Grex

Jobs Metrics:

From this menu, you can access the fairshare of your group and other metrics about the efficiency of the jobs from your group for the last 7 days. Similar metrics can be obtained using sacct command with appropriate format and options.

Jobs Metrics view on OpenOndemand web portal on Grex

Grex Job Composer:

From this menu. it is possible to access a form with predefined or generic slurm templates to generate slurm scripts. It offers the options to customize, save and submit jobs.

Jobs Metrics view on OpenOndemand web portal on Grex

This will be discussed in more details in another section.

Clusters#


From this menu, you can access the current partitions status and the Grex Cluster Cluster Status. This later shows a summary and the overview of the reources and their state, like number of available nodes, number of available processes, numper of the GPUs available and number of jobs in running and queued state.

Grex Cluster Cluster Status view on OpenOndemand web portal on Grex

From the menu Partitions Status, one can see the state of each partition where it shows the name of the partition, number of free nodes, number of free cores and memory.

Partitions Status view on OpenOndemand web portal on Grex

A variant of the above information is available via command line by running the command partition-list from any login node.

There is also a link to start a terminal from OOD session.

Interactive Apps#


From this menu, one can access different applications that classified into 3 categories:

  • Desktops like Grex Desktop and Grex Desktop Simplified.
  • GUI Apps like Matlab, Gaussview, Ovito, Stata, … etc.
  • Servers like Jupyter, Code Server and RStudio.

A lisf of ineractive applications is accessible from the top menu Interactive Apps as shown in the following screenshot:

OpenOndemand interactive applications
OpenOnDemand Interactive Apps
Some applications, like Stata and Gaussview may show up on the snapshots dispayed on this page but not under your session. These application are configured to show up only if you have access to a particular POSIX group that restricts access to the software.

Customized OOD apps on Grex#


The OOD Dashboard menu, Interactive Apps, shows interactive applications. This is the main feature of OOD, it allows interactive work and visualizations, all in the browser. These applications will run as SLURM Jobs on Grex compute nodes. Users can specify required SLURM resources such as time, number of cores and partitions.

OpenOndemand applications on Grex

After the Apps jobs are submitted, the corresponding jobs appear in the Interactive Sessions tab. There they can be monitored, connected to, and terminated.

There are numerous supported “applications” in OnDemand on Grex. These applications fall into two broad categories: Virtual Desktop apps (the ones delivering a Linux Desktop with some GUI software via NoVNC) and Servers that are delivered through a Web Proxy. A prominent example of a Server app is Jupyter Notebook or Jupyter Lab. Some Apps such as Matlab or Rstudio exists both as a Linux Desktop GUI and a Server version.

We keep actively developing the OOD Web Portal, and the list below may change as we add more popular applications or remove less used ones!

As for now, the following applications are supported:

ApplicationTypeAvailabilityNotes
Linux DesktopNoVNC DesktopGenerally available-
GaussViewNoVNC DesktopLicensed users only-
MatlabNoVNC DesktopGenerally available-
Matlab ServerServerGenerally available-
JupyterLab ServerServerGenerally availableComes for SBEnv and CCEnv
RStudio ServerServerGenerally availableComes for SBEnv and CCEnv
CodeServerServerGenerally available-
MetaShape ProNoVNC DesktopLicensed users only-
RELIONNoVNC DesktopGenerally available-
STATANoVNC DesktopLicensed users only-
FekoNoVNC DesktopLicensed users only
OvitoNoVNC DesktopGenerally available-

Note that only Apps available (licensed) to your research group will be visible in your group members’ OOD interface.

As with regular SLURM jobs, it is important to specify SLURM partitions for them to start faster. Perhaps the test partition for Desktop is the best place to start interactive Desktop jobs, so it is hardcoded in the Simplified Desktop item.

The following links are added to OOD:

  • From the menu Jobs, there is a link Grex SLURM Queues State that shows a summary of running and pending jobs. The same information can be accessed from any login node by running the grex-summarize-queue command.
  • From the menu Clusters, there is a link Grex SLURM Node State to get a summary of allocated and idle nodes by partition. The same information can be accessed from any login node by running the slurm-nodes-state command.