Skip to feedback

Award Abstract # 1032573
Collaborative Research: SDCI Net New: The Missing Link: Connecting Eucalyptus Clouds with Multi-Layer Networks

NSF Org: OAC
Office of Advanced Cyberinfrastructure (OAC)
Recipient: UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL
Initial Amendment Date: August 29, 2010
Latest Amendment Date: August 29, 2010
Award Number: 1032573
Award Instrument: Standard Grant
Program Manager: Daniel Katz
OAC
 Office of Advanced Cyberinfrastructure (OAC)
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: September 1, 2010
End Date: February 28, 2014 (Estimated)
Total Intended Award Amount: $295,000.00
Total Awarded Amount to Date: $295,000.00
Funds Obligated to Date: FY 2010 = $295,000.00
History of Investigator:
  • Ilya Baldin (Principal Investigator)
    ibaldin@renci.org
  • Anirban Mandal (Co-Principal Investigator)
  • Yufeng Xin (Co-Principal Investigator)
Recipient Sponsored Research Office: University of North Carolina at Chapel Hill
104 AIRPORT DR STE 2200
CHAPEL HILL
NC  US  27599-5023
(919)966-3411
Sponsor Congressional District: 04
Primary Place of Performance: University of North Carolina at Chapel Hill
104 AIRPORT DR STE 2200
CHAPEL HILL
NC  US  27599-5023
Primary Place of Performance
Congressional District:
04
Unique Entity Identifier (UEI): D3LHU66KBLD5
Parent UEI: D3LHU66KBLD5
NSF Program(s): SOFTWARE DEVELOPEMENT FOR CI
Primary Program Source: 01001011DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7683
Program Element Code(s): 768300
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

The backbone of IT infrastructure is evolving towards a service-oriented model, in which distributed resources (software services, virtualized hardware infrastructure, data repositories, sensors, and network overlays) can be composed as a customized IT service on demand. In particular, cloud computing infrastructure services manage a shared ``cloud'' of servers as a unified hosting substrate for diverse scientific applications, using various technologies to provision servers and orchestrate their operation. At the same time, high-speed networks increasingly offer dynamic provisioning services at multiple layers. Network-connected clouds offer a general, flexible, and powerful model to scale up computing power for data-intensive science applications running at multiple cloud sites. The software produced in this project offers interfaces and control policies for application-driven orchestration of federated clouds interconnected by advanced networks.

The project develops software to link cloud computing clusters to other cyberinfrastructure resources through dynamically provisioned networks. A principal focus is to extend popular cloud infrastructure software with hooks to connect provisioned machine instances running in the cloud to external resources through dynamic circuit networks. The project enables cloud applications to dynamically request compute resources at multiple points in the network, together with bandwidth-provisioned network pipes to interconnect them and link them with other services and data repositories. The orchestration framework is based on the Open Resource Control Architecture (ORCA), an extensible platform for dynamic leasing of resources in a shared networked infrastructure. The resource allocation policies are enabled through semantic resource descriptions and extended intelligent SPARQL queries. Driving applications for this project are MotifNetwork, IMG/JGI and Supernova Factory and sensor networks linked to cloud resources (CASA). Development and demonstrations leverage the Breakable Experimental Network (BEN, a multi-layer optical network testbed located in North Carolina), NLR and ESNet.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

A. Mandal, Y. Xin, I. Baldine, P. Ruth, C. Heermann, J. Chase, V. Orlikowski, and A. Yumerefendi. "Provisioning and Evaluating Multi-domain Networked Clouds for Hadoop- based Applications." Proceedings of the 3rd International Conference on Cloud Computing Technologies and Science 2011 (IEEE Cloudcom â??11) , 2011
Ilia Baldine and Yufeng Xin and Anirban Mandal and Chris Heerman and Jeff Chase and Varun Marupadi and Aydan Yumerefendi and David Irwin "Autonomic Cloud Network Orchestration: A GENI Perspective" GLOBECOM Workshops: 2nd IEEE International Workshop on Management of Emerging Networks and Services (MENS 2010) , 2010
J. L. Tilson, P. Ruth, R. J. Fowler, and W. C. Ermler "Spin-orbit configuration interaction method: A co-design inspired implementation for high performance computation in Solar Fuels." Science, Engineering, and Policy Symposium , 2012
S. Huang and I. Baldine "Performance Evaluation of 10GE NICs with SR-IOV Support: I/O Virtualization and Network Stack Optimizations." LNCS: Measurement, Modelling, and Evaluation of Computing Systems and Dependability and Fault Tolerance 16th International GI/ITG Conference, MMB and DFT 2012, Kaiserslautern, Germany, March 19-21, 2012. Proceedings , v.7201 , 2012 , p.197
Yufeng Xin and Ilia Baldine and Anirban Mandal and Chris Heerman and Jeff Chase and Aydan Yumerefendi "Embedding Virtual Topologies in Networked Clouds" 6th International Conference on Future Internet Technologies (CFI 2011) , 2011

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The main outcome of the "Missing Link" project was the development of a suite of technologies that enabled the creation of a world-wide networked cloud testbed called ExoGENI (http://www.exogeni.net). 

The testbed consists of a number of campus clouds  interconnected by programmable networks, like Internet2 (http://www.internet2.edu) and ESnet (http://www.es.net). These clouds are distributed across the US and the world and include computational, storage and network resource contributed by ExoGENI's  international partners.

The technologies developed in the "Missing Link" project are making it possible for experimenters - university students, faculty, researchers - to rapidly  create complex distributed "virtual networks" that support a variety of experiments in distributed systems and network science. The testbed also serves as a blueprint for developing the future architecture of widely-distributed cyber infrastructure spanning the globe, easily accessible by a multitude of researchers from different branches of science and helping them be more productive in their discovery. 

The included figures show what ExoGENI testbed looks like in the spring of 2014 - its deeply interconnected nature made possible by the "Missing Link" project and an example of an experiment run on ExoGENI that supports a complex application targeted at computational chemistry applications. 

One of the important outcomes of the project is the interest that the technologies enabling this type of rapid creation of on-demand cyber-infrastructure is getting from computational scientists struggling with configuring and running their computations on the traditional monolithic computational infrastructure. The ExoGENI technologies have deep implications to a number of sciences and sectors of industry struggling with the "big data" problems - astronomy, physics, chemistry, bio-informatics and healthcare. 


Last Modified: 04/04/2014
Modified by: Ilya Baldin