Skip to feedback

Award Abstract # 1514780
EAGER: Data-Mining Driven Power-Efficient Intelligent Memory Storage for Mobile Video Applications

NSF Org: CCF
Division of Computing and Communication Foundations
Recipient: NORTH DAKOTA STATE UNIVERSITY
Initial Amendment Date: June 16, 2015
Latest Amendment Date: May 25, 2017
Award Number: 1514780
Award Instrument: Standard Grant
Program Manager: Yuanyuan Yang
CCF
 Division of Computing and Communication Foundations
CSE
 Directorate for Computer and Information Science and Engineering
Start Date: July 1, 2015
End Date: June 30, 2018 (Estimated)
Total Intended Award Amount: $199,976.00
Total Awarded Amount to Date: $215,576.00
Funds Obligated to Date: FY 2015 = $199,976.00
FY 2017 = $15,600.00
History of Investigator:
  • Na Gong (Principal Investigator)
    nagong@southalabama.edu
  • Wei Jin (Co-Principal Investigator)
Recipient Sponsored Research Office: North Dakota State University Fargo
1340 ADMINISTRATION AVE
FARGO
ND  US  58105
(701)231-8045
Sponsor Congressional District: 00
Primary Place of Performance: North Dakota State University Fargo
1411 Centennial Blvd.
Fargo
ND  US  58108-6050
Primary Place of Performance
Congressional District:
00
Unique Entity Identifier (UEI): EZ4WPGRE1RD5
Parent UEI: EZ4WPGRE1RD5
NSF Program(s): Software & Hardware Foundation
Primary Program Source: 01001516DB NSF RESEARCH & RELATED ACTIVIT
01001718DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7916, 7941, 9150, 9251
Program Element Code(s): 779800
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Mobile devices such as smart-phones and tablets have become the most important medium for delivering Internet traffic, especially multimedia content, to end users. One of the most popular multimedia applications is video streaming. During this process, video decoding has become the dominant energy-intensive application used in mobile devices. In particular, the major signal processing units in video decoders, such as motion estimation and compensation, forward and inverse discrete cosine transform, require a significant amount of calculations and frequent embedded memory accesses. It is understood that embedded SRAM consumes a large amount of power and limits battery life, and this situation is only expected to grow with the emerging popularity of high quality mobile video applications.

This project proposes to address this problem by incorporating advanced data mining techniques particularly suited to mobile video data applications into the hardware design process to yield an intelligent memory having high power efficiency. The PIs will explore and characterize the behaviors of video data and provide a better-informed low power hardware design. The goal is to create new power efficient mobile video memory designs that utilize the identified characteristics extracted by suitable data-mining techniques tailored to video data, which will serve as a core foundation to bring about drastic improvements in energy efficiency. The exploration of these intelligent low power techniques through the interaction of both hardware and software viewpoints will enable a new dimension for power savings. The success of this project will have a huge impact on the mobile computing community, architecture community, and everyday life. This project will also serve as an excellent educational platform to improve the understanding of green computing amongst future computer scientists and computer engineers. The PIs will jointly develop course modules focusing on software/hardware co-design for mobile devices, which can be integrated into a variety of different courses. The PIs will also continue to recruit underrepresented students, such as females and minorities, to participate in this project.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 11)
D. Chen, J. Edstrom, X. Chen, W. Jin, J. Wang, and N. Gong "Data-Driven Low-Cost On-Chip Memory with Adaptive Power-Quality Trade-off for Mobile Video Streaming" International Symposium on Low Power Electronics and Design (ISLPED'16) , 2016
D. Chen, J. Edstrom, Y. Gong, P. Gao, L. Yang, M. McCourt, J. Wang, and N. Gong "Viewer-Aware Intelligent Efficient Mobile Video Embedded Memory" IEEE Trans. on Very Large Scale Integration (VLSI) Systems , 2018
D. Chen, X. Wang, J. Wang, and N. Gong "VCAS: Viewing Context Aware Power-Efficient Mobile Video Embedded Memory" 28th IEEE International SoC Conference (SoCC?15) , 2015
Edstrom, Y. Gong, D. Chen, J. Wang, and N. Gong "Data-Driven Intelligent Efficient Synaptic Storage for Deep Learning" IEEE Transactions on Circuits and Systems II , 2017
J. Edstrom, D. Chen, J. Wang, H. Gu, E. A. Vazquez, M. McCourt, and N. Gong "Luminance Adaptive Smart Video Storage System" IEEE International Symposium on Circuits and Systems (ISCAS) , 2016
N. Gong, J. Edstrom, D. Chen, and J. Wang "Data-Pattern Enabled Self-Recovey Multimedia Storage System for Near-Threshold Computing" IEEE International Conference on Computer Design (ICCD'16) , 2016
N. Gong, S. A. Pourbakhsh, X. Chen, X. Wang, D. Chen, and J. Wang "SPIDER: Sizing-Priority Based Application-Driven Memory for Mobile Video Applications" IEEE Trans. on Very Large Scale Integration (VLSI) Systems , 2017
S. A. Pourbakhsh, X. Chen, D. Chen, X. Wang, N. Gong, and J. Wang "Sizing-Priority Based Low-Power Embedded Memory for Mobile Video Applications" International Symposium on Quality Electronic Design (ISQED) , 2016
X. Chen, S. Pourbakhsh, L. Hou, N. Gong, and J. Wang "Dummy TSV Based Bit-line Optimization in 3D On-chip Memory" IEEE 2016 International Electro-Information Technology Conference (EIT 2016) , 2016
Y. Gong, N. Gong, L. Hou, and J. Wang "MTJ Based Data Restoration in Non-Volatile SRAM" IEEE 13th International Conference on Solid -State and Integrated Circuit Technology (ICSICT'16) , 2016
Y. Gong, N. Gong, L. Hou, and J. Wang "Platform Design for Compatible Semi-custom Design Flow" IEEE 13th International Conference on Solid -State and Integrated Circuit Technology (ICSICT'16) , 2016
(Showing: 1 - 10 of 11)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The growing popularity of powerful mobile devices such as smart phones and tablet devices has resulted in the exponential growth of demand for video applications. However, due to the intensive computation of the video coding and display process, mobile video applications require frequent memory access, which consumes a large amount of power and limits battery life. Various low-power memory techniques have been explored by researchers. Unfortunately, existing solutions suffer from shortcomings, including high design complexity and significant implementation overhead. 

This project explores and characterizes the behaviors of video data and develops new power-efficient mobile video memory designs that utilize the identified video data characteristics. For example, we have applied association rule mining techniques and identified interesting data patterns existing in video data. Based on the obtained data patterns, we implemented a low-cost Data Driven power-efficient Adaptable SRAM Hardware (D-DASH) design with dynamic power-quality tradeoff for mobile video applications. D-DASH enables three levels of power-quality management (up to 43.7% power savings) with negligible area overhead (0.06%). This work was presented at International Symposium on Low Power Electronics and Design (ISLPED'16) and received a best paper nomination in the conference. Furthermore, by utilizing the discovered data correlation and association relationship in video chroma data, we presented another data-informed video memory with self-recovery ability in IEEE International Conference on Computer Design (ICCD’16). This technique successfully delivers good video quality for minimum-sized SRAM at near-threshold voltage (0.5V). Based on it, we extended the data-correlation/association-enabled recovery to video luma data, further enabling power savings. We developed a two-dimensional data pattern approach to explore horizontal data association and vertical data correlation characteristics. Such data relationship discovery and pattern identification enable a new dimension for the hardware design space and bring self-recovery ability to memories in the presence of bitcell failures. This work was published in IEEE Trans. on Big Data. To summarize, we have published a total of 14 peer-reviewed papers, including 4 IEEE journal papers and 10 conference papers.

Intellectual Merit: The exploration of these intelligent low power techniques through the interaction of both hardware and software viewpoints enables a new dimension for power savings. By introducing data mining to the hardware design process, the discovered data knowledge, combined with novel data-driven hardware design techniques, enable more intelligent video memory with a better trade-off among energy efficiency and cost, thereby relieving the current data storage burden for today’s video systems. Also, the research outcomes have great potential to extend to other data-intensive applications such as deep learning systems. More broadly, our cross-disciplinary research in integrating data-mining and hardware design can lead to significant advances in software/hardware co-design theory and practice.

Broad Impacts: The memory techniques developed by this project have increased the energy efficiency of mobile video systems, accelerating the creation of low-cost mobile devices with a longer battery life. This project serves as an excellent educational platform to improve the understanding of green computing amongst future computer scientists and computer engineers. The PIs have jointly developed a graduate-level course focusing on software/hardware co-design for mobile devices. The project also had an enormous impact of student engagement from different disciplines, particularly from computer science and computer engineering fields. The PIs continued their efforts to recruit underrepresented students, such as females and minorities, to work on this project. Special activities that demonstrate efficient hardware design have been conducted during the organized K-12 programs to girls and Native American high-school students

 

 


Last Modified: 07/28/2018
Modified by: Na Gong

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page