Award Abstract # 1850297
CRII: NeTS: Denoising Internet Delay Measurements using Weak Supervision

NSF Org: CNS
Division Of Computer and Network Systems
Recipient: UNIVERSITY OF OREGON
Initial Amendment Date: June 7, 2019
Latest Amendment Date: March 16, 2020
Award Number: 1850297
Award Instrument: Standard Grant
Program Manager: Ann Von Lehmen
CNS
 Division Of Computer and Network Systems
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: June 15, 2019
End Date: May 31, 2022 (Estimated)
Total Intended Award Amount: $174,999.00
Total Awarded Amount to Date: $190,999.00
Funds Obligated to Date: FY 2019 = $174,999.00
FY 2020 = $16,000.00
History of Investigator:
  • Ramakrishnan Durairajan (Principal Investigator)
    ram@cs.uoregon.edu
Recipient Sponsored Research Office: University of Oregon Eugene
1776 E 13TH AVE
EUGENE
OR  US  97403-1905
(541)346-5131
Sponsor Congressional District: 04
Primary Place of Performance: University of Oregon Eugene
OR  US  97403-5219
Primary Place of Performance
Congressional District:
04
Unique Entity Identifier (UEI): Z3FGN9MF92U2
Parent UEI: Z3FGN9MF92U2
NSF Program(s): CRII CISE Research Initiation,
Special Projects - CNS
Primary Program Source: 01001920DB NSF RESEARCH & RELATED ACTIVIT
01002021DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7363, 8228, 9251
Program Element Code(s): 026Y00, 171400
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Understanding the characteristics of the Internet is one of the key goals of Internet measurement researchers, and the service providers and content delivery networks that serve billions of users worldwide. To this end, a myriad of measurement tools and techniques have been developed. Despite these efforts, what is critically lacking is a systematic framework to interpret the results due to the presence of measurement noise. This research proposes to develop a new framework to solve this problem.

The main goal of this project is to design, develop and rigorously evaluate a framework for denoising latency measurements. The objectives are to make the denoising process easy, automatic, and rapid via two key research thrusts. In the first thrust, the goal is to design and develop the framework to generate measurement noise labels (i.e., ground truth data) automatically leveraging recent advancements in machine learning. The second thrust will expand the capabilities of the framework to remove and repair the noisy measurements in an automated and rapid fashion. The efficacy of the framework will be evaluated in lab-based settings and in a real-world setting by applying it on community datasets.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Babar Khalid, Nolan Rudolph "MicroMon: A Monitoring Framework for Tackling Distributed Heterogeneity" In Proceedings of 12th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage '20) , 2020 Citation Details
Chris, Misa and OConnor, Walt and Durairajan, Ramakrishnan and Rejaie, Reza and Willinger, Walter "Dynamic Scheduling of Approximate Telemetry Queries" NSDI , 2022 Citation Details
Chris, Misa and OConnor, Walt and Durairajan, Ramakrishnan and Rejaie, Reza and Willinger, Walter "Dynamic Scheduling of Approximate Telemetry Queries" USENIX NSDI , 2022 Citation Details
Knofczynski, Jared and Durairajan, Ramakrishnan and Willinger, Walter "ARISE: A Multitask Weak Supervision Framework for Network Measurements" IEEE Journal on Selected Areas in Communications , v.40 , 2022 https://doi.org/10.1109/JSAC.2022.3180783 Citation Details
Lavinia, Yukhe and Durairajan, Ramakrishnan and Rejaie, Reza and Willinger, Walter "Challenges in Using ML for Networking Research: How to Label If You Must" NetAI '20: Proceedings of the Workshop on Network Meets AI & ML , 2020 https://doi.org/10.1145/3405671.3405812 Citation Details
Misa, Chris and Durairajan, Ramakrishnan and Rejaie, Reza and Willinger, Walter "Revisiting Network Telemetry in COIN: A Case for Runtime Programmability" IEEE Network , v.35 , 2021 https://doi.org/10.1109/MNET.201.2100064 Citation Details
Misa, Chris and Kannan, Sudarsun and Durairajan, Ramakrishnan "Can we containerize internet measurements?" Proceedings of ACM/IRTF/ISOC Applied Networking Research Workshop (ANRW'19) co-located with IETF 105, Montreal, Canada, July 2019. , 2019 10.1145/3340301.3341130 Citation Details
Muthukumar, Anirudh and Durairajan, Ramakrishnan "Denoising Internet Delay Measurements using Weak Supervision" 18th IEEE International Conference On Machine Learning And Applications (ICMLA) , 2019 10.1109/ICMLA.2019.00089 Citation Details
Soheil, Jamshidi and Hammoudeh, Zayd and Durairajan, Ramakrishnan and Lowd, Daniel and Rejaie, Reza and Willinger, Walter "On the Practicality of Learning Models for Network Telemetry" Proceedings of Network Traffic Measurement and Analysis Conference , 2020 Citation Details
Sommers, Joel and Durairajan, Ramakrishnan "ELF: High-Performance In-band Network Measurement" IFIP Traffic Measurements and Analysis , 2021 Citation Details

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Systematically interpreting the results from Internet latency measurements from tools and datasets is a daunting task due to measurement noise. Here, noise is defined as the presence of non-representative values that are hard to discern from the actual network behavior. Consequently, noisy measurements lead to suboptimal operational changes and confound the actual network behavior. State-of-the-art denoising techniques are too simple, time-consuming, and labor-intensive. The main goal of this research is to investigate machine learning-based techniques to denoise Internet latency measurements. To this end, the major activities of this project are on four fronts: (a) research, (b) teaching, (c) student mentoring and professional development, and (d) dissemination and community outreach. 

(a) Research. We designed and developed a weak supervision-based framework to denoise network latency measurement. Next, we demonstrated the framework's efficacy in lab-based settings (e.g., on live latency measurements) and community datasets (e.g., CAIDA's Ark and RIPE's Atlas projects). Next, we deployed and tested the framework on live telemetry collected from modern programmable switches at the University of Oregon. Next, we extended the framework to consider multiple learning tasks (e.g., congestion, loss, noise removal). Finally, to facilitate independent validation of the results from this research, we have created a webpage (https://ix.cs.uoregon.edu/~ram/CRII.html) with project details and publications that contain analyses, results, and source code produced by this research.

(b) Teaching. We incorporated project-related outcomes in the form of new lectures on AI/ML for networking management, data features, and applications; and introduced students to some of the "good practices" in designing and evaluating data science systems for network management. These lectures were integrated into three courses (i.e., graduate networking course, graduate distributed systems, and senior- and graduate-level network measurements) at the University of Oregon. We also designed a new seminar on Internet data science at the University of Oregon. As part of the seminar, we reviewed and discussed research papers from top-tier networking, systems, and measurement conferences, emphasizing data science techniques. 

(c) Student mentoring and professional development. We mentored and trained two doctoral students, one master's student, and four undergraduate students on project-related activities. One of the undergraduate students later joined the PI's research group as a doctoral student. The undergraduate students earned jobs at companies, leveraging the data-driven skills gained from this project.

(d) Dissemination and community outreach. The above activities resulted in nine papers (two journals, four conferences, and three workshops), each of which are disseminated in prestigious networking and machine conferences and journals (e.g. NSDI, JSAC Machine Learning in Communications and Networks), and three theses. We also disseminated project outcomes via the RISE (netwoRkIng SystEms) summer school at the University of Oregon, and presentations at different fora (e.g. CAIDA's WOMBIR workshop, UO's Undergraduate Research Symposium).


Last Modified: 08/22/2022
Modified by: Ramakrishnan Durairajan

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page