Award Abstract # 1534949
SI2-SSE: Open OnDemand: Transforming Computational Science through Omnidisciplinary Software Cyberinfrastructure

NSF Org: OAC
Office of Advanced Cyberinfrastructure (OAC)
Recipient: OHIO STATE UNIVERSITY, THE
Initial Amendment Date: July 9, 2015
Latest Amendment Date: July 29, 2018
Award Number: 1534949
Award Instrument: Standard Grant
Program Manager: Stefan Robila
OAC
 Office of Advanced Cyberinfrastructure (OAC)
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: July 1, 2015
End Date: January 31, 2019 (Estimated)
Total Intended Award Amount: $500,000.00
Total Awarded Amount to Date: $558,225.00
Funds Obligated to Date: FY 2015 = $500,000.00
FY 2018 = $58,225.00
History of Investigator:
  • David Hudak (Principal Investigator)
    dhudak@osc.edu
  • Douglas Johnson (Co-Principal Investigator)
Recipient Sponsored Research Office: Ohio State University
1960 KENNY RD
COLUMBUS
OH  US  43210-1016
(614)688-8735
Sponsor Congressional District: 03
Primary Place of Performance: Ohio Supercomputer Center
1224 Kinnear Road
Columbus
OH  US  43212-1163
Primary Place of Performance
Congressional District:
03
Unique Entity Identifier (UEI): DLWBSLWAJWR1
Parent UEI: MN4MDDMN8529
NSF Program(s): Special Projects - CCF,
Software Institutes
Primary Program Source: 01001516DB NSF RESEARCH & RELATED ACTIVIT
01001819DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 026Z, 7433, 8005, 8009
Program Element Code(s): 287800, 800400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Supercomputing, or High-Performance Computing (HPC), has the power to advance work in all fields of science and engineering. Unfortunately, the impact of HPC is often limited simply because the computers themselves are difficult to use and scientists and engineers would rather spend their time advancing their disciplines than learn HPC. Learning esoteric commands is a hurdle to many students and researchers when they first begin to work with traditional HPC systems, which has contributed to the relatively small proportions of women, minorities, and persons with disabilities within related STEM fields. The Open OnDemand project addresses this problem through innovative software that makes HPC no more difficult than using a desktop computer or a web site, hence reducing that initial learning curve. Open OnDemand will provide an enhanced infrastructure for research and education, in that students and educators will be exposed to the same tools and techniques on smaller departmental and classroom systems that they'll eventually utilize at larger HPC centers. This streamlines the pipeline for developing a more globally competitive STEM workforce that is prepared to dive right into computational problems and resources once they graduate from academia. Open OnDemand also allows scientists and engineers to make specialized domain-specific workflows and expertise available to more collaborators and users, both from academia and industry. This should result in increased partnerships, and the transfer of more technologies from the public to private sectors.

The web has become the dominant access mechanism for remote compute services in every computing area except high-performance computing (HPC). Accessing HPC cyberinfrastructure (CI) resources today, either at the campus or national level, typically requires advanced knowledge of UNIX, familiarity with command-line interfaces and installation and configuration of custom client software. Web applications in HPC today do exist in the form of science gateways. However, gateways have not proliferated in part due to the development and administrative overheads required for each individual gateway. These factors demonstrate an accessibility gap for HPC. Open OnDemand is an open source platform for HPC and remote computing access that addresses the accessibility gap. Open OnDemand will be a public release based on the successful OSC OnDemand platform. OSC OnDemand is a web platform providing Ohio Supercomputer Center (OSC) users integrated access to HPC systems, web applications, and VNC services. OSC OnDemand has been in production since January 2013, has over 800 distinct users from 27 different NSF fields of science, and its apps have been launched over 70,000 times. In addition to easing access to HPC services, Open OnDemand centralizes web app overheads, easing support for custom visualization and science gateway apps. Open OnDemand has the ability to transform cyberinfrastructure by providing a platform to enable a new delivery method for scientific web tools like HubZero apps, XSEDE Science Gateways, iPython notebooks and workflow tools like Pegasus.

Under this project, the Open OnDemand platform will be created by (a) transitioning the existing OSC OnDemand software to a community developed project hosted on GitHub, (b) extending the per-user web server to serve Rails apps, (c) replacing the custom-developed Proxy with an existing open source project like NGINX and (d) replacing the existing Java-based VNC client with an HTML5 solution. File usage will be improved by updating or replacing AjaXplorer and integrating high performance file transfer functions (sftp and Globus Online). The accessibly apps will be updated by by (a) upgrading or replacing AnyTerm, (b) updating Job Constructor and (c) integrating Open XDMoD and SUPREMM for job and cluster performance metrics. In addition, community infrastructure will be created including (a) system administrator documentation and discussion forums and (b) training materials based on existing OSC OnDemand materials. A beta program will be conducted including (a) assisting beta sites with installs, (b) updating training materials to include new functionality, (c) beginning metric reporting and (d) documenting a Galaxy case study for app integration. HPC center staff will be engaged by through the "boot camps" and "train the trainer" sessions. Finally, Open OnDemand will be proposed as a project to the XSEDE Campus Bridging Technology Insertion Service. These activities will help meet the following objectives: (1) Transition OSC OnDemand to a community-developed open source software package called Open OnDemand, (2) Improve the interface capabilities of Open OnDemand by updating and expanding the accessibility apps, including integration of Globus Online and Open XDMoD projects. (3) Conduct a program to engage departmental, campus and national HPC users and administrators on enhancing HPC inclusivity through Open OnDemand and (4) Leverage Open OnDemand as a platform to support existing web-based applications such XSEDE Science Gateways and HubZero applications based on our experience supporting a data-intensive biomedical package (the Galaxy Project).

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Chalker, Alan and Franz, Eric and Rodgers, Morgan and Dockendorf, Trey and Johnson, Doug and Sajdak, Doris and White, Joseph P. and Plessinger, Benjamin D. and Zia, Mohammad and Gallo, Steven M. and Settlage, Robert E. and Hudak, David E. "Open OnDemand: State of the platform, project, and the future" Concurrency and Computation: Practice and Experience , v.33 , 2020 https://doi.org/10.1002/cpe.6114 Citation Details
Dave Hudak, Doug Johnson, Alan Chalker, Jeremy Nicklas, Eric Franz, Trey Dockendorf, Brian McMichael "Open OnDemand: A web-based client portal for HPC Centers" The Journal of Open Source Software , v.3 , 2018 , p.622 https://doi.org/10.21105/joss.00622
David E. Hudak, Douglas Johnson, Jeremy Nicklas, Eric Franz, Brian McMichael, Basil Gohar "Open OnDemand: Transforming Computational Science Through Omnidisciplinary Software Cyberinfrastructure" XSEDE16, July 17-21, 2016, Miami, FL, USA? , 2016 http://dx.doi.org/10.1145/2949550.2949644
Settlage, Robert E. and Chalker, Alan and Ohrstrom, Jeff and Franz, Eric and Johnson, Doug and Hudak, David "Open OnDemand as a Platform for Virtual Learning in Higher Education" Lecture notes in networks and systems , v.216 , 2021 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

High performance computing (HPC) has led to remarkable advances in science and has become an indispensable tool for research. Unfortunately, HPC adoption by many scientists is hindered due to the complex way in which these resources are accessed. Indeed, while the web has become the dominant access mechanism for remote computing services, it had not yet for HPC. Users accessing HPC resources traditionally needed advanced knowledge of Linux, familiarity with command-line interfaces and installation and configuration of custom client software. These additional requirements created an accessibility gap that for many scientists still serves as an impediment to adopting HPC. Removing, or even reducing, this impediment to HPC use increases the productivity of computational researchers.

Under this project, we created Open OnDemand, an innovative, open-source, web-based platform for accessing HPC services that removes traditional barriers, and in so doing simplifies access to HPC resources. With OnDemand, a user interacts with a set of web-based applications ("apps") for files, job control, cluster access and interactive computing. OnDemand has proven very popular with users, with one installation having to date over 1,500 users, over 300,000 app launches and serving scientists and engineers from 28 distinct fields of science (a truly multidisciplinary impact). At that location, the median time from initial HPC login to first HPC job submission for clients using OnDemand was 10 times faster than those clients using traditional HPC access method, quantitatively demonstrating faster time-to-science.

This project has created a number of positive outcomes.  First, the Open OnDemand software platform is a modern, production-quality open source project freely available and hosted on GitHub (available at OpenOnDemand.org).  Second, a community of nearly fifty U.S. HPC university facilities have deployed the OnDemand platform and thus are providing new, more accessible, solutions for leveraging HPC.  Third, a community of thousands of university scientists are accomplishing more with HPC through OnDemand.  Fourth, a community of university students, including many undergraduates, are using OnDemand to complete HPC-enabled coursework.  Fifth, a growing volunteer community of experts and practitioners are supporting new OnDemand adoption.  Finally, a number of commercial companies have adopted OnDemand for their in-house HPC solutions or pre-installed on their shipping HPC systems.

 


Last Modified: 05/23/2019
Modified by: David E Hudak

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page