Award Abstract # 1843757
SBIR Phase I: Affordable Multi-Wavelength Lidar and Thermal Imager for Autonomous Vehicles

NSF Org: TI
Translational Impacts
Recipient: NBN TECHNOLOGIES, LLC
Initial Amendment Date: February 6, 2019
Latest Amendment Date: February 6, 2019
Award Number: 1843757
Award Instrument: Standard Grant
Program Manager: Muralidharan Nair
TI
 Translational Impacts
TIP
 Directorate for Technology, Innovation, and Partnerships
Start Date: February 1, 2019
End Date: January 31, 2020 (Estimated)
Total Intended Award Amount: $222,500.00
Total Awarded Amount to Date: $222,500.00
Funds Obligated to Date: FY 2019 = $222,500.00
History of Investigator:
  • Shimon Maimon (Principal Investigator)
    shimonmaimon@yahoo.com
Recipient Sponsored Research Office: NBN TECHNOLOGIES, LLC
136 WILSHIRE RD
Rochester
NY  US  14618-1221
(585)355-5556
Sponsor Congressional District: 25
Primary Place of Performance: NBN TECHNOLOGIES, LLC
Rochester
NY  US  14618-0001
Primary Place of Performance
Congressional District:
25
Unique Entity Identifier (UEI): TU6FJ4T78V84
Parent UEI:
NSF Program(s): SBIR Phase I
Primary Program Source: 01001920DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 1185, 5371, 8034
Program Element Code(s): 537100
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.084

ABSTRACT

The broader impact/commercial potential of this project is to provide a low cost Lidar+Thermal camera to the autonomous car market that will eventually enable level 4 and level 5 autonomy. The proposed innovation incorporates both a Lidar and a thermal detector to locate objects but also classify them, as this is the most crucial aspect of autonomous vehicles. The dual polarity Lidar+Thermal photodetector solves a few major issues in the current Lidar industry. First, current Lidars have to use advanced algorithms to classify the objects, whereas a Lidar+Thermal detector can easily distinguish between animate and inanimate objects, while continuing to establish their location. This is done due to the drastic heat signature of animate objects. Second, the dual polarity detector is able to detect and locate hazards on the road such as snow or puddles, which is vital if autonomous vehicles are used in northern regions. In addition, the frame rate of the Flash Lidar+Thermal is up to 200 Frames per second, which will drastically reduce smearing effects and allow for driving at speeds of 70+ MPH. Lastly, the high thermal resolution of the camera will ensure operation in bad weather conditions including fog and rain.

This Small Business Innovation Research (SBIR) Phase I project will provide a proof-of-concept of the dual polarity Lidar+Thermal detector. An array of 32x32 pixels will demonstrate that in one polarity, a thermal hot-mid-wave image and in the other polarity the pixels will operate in a time-of-flight mode for Flash Lidar operation. The pixel?s spectral response will range from 500nm up to 3.5?m in the Lidar mode. Characterization of the detector array will use the eye-safe 1550nm laser. The goal is to show a 200m Lidar operation with a high resolution of a few centimeters and thermal imaging with a thermal sensitivity of 4mK. The transition to Phase II will include an array size of 1000x500 with 10?m pixel pitch. The detector will be evaluated outdoors to demonstrate the detection of animate objects, snow and puddles and will be tested under fog conditions.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The NSF awarded NetzVision LLC with a Phase I SBIR award titled ?Affordable Multi-Wavelength Lidar and Thermal Imager for Autonomous Vehicles.? The broader impact of this technology is to provide sensors optimized for night and bad-weather conditions for the Autonomous Vehicles (AV) market. NetzVision has designed and developed state-of-the-art sensor technology for Infrared (IR) imagers and range-finding systems specifically for the AV market.

Detecting material has been fabricated with specs well beyond difficult LIDAR and imaging requirements. Layout of silicon unit cells corresponding to the detector for various LIDAR detection methods such as Time-of-Flight (TOF), and Amplitude Modulated Continuous Wave (AMCW) have been designed, developed and implemented into small arrays.

The initial testing for infrared imaging plus LIDAR will lead to a final dual operation detector to reduce the number of sensors required for autonomous vehicles, drastically increase the quality of object detection, provide clear vision at night, bad weather conditions, fog and haze, and locate hazards on the road such as snow, ice, and puddles. The In-Situ Fusion between the Lidar map and the Imaging eliminate the needs for AI Fusion, result in no AI mistakes, and achieved with no cost.

The systems that use these sensors were researched in order to ensure that the proposed solution was viable. Various LIDAR plus Imaging approaches were studied to determine where the solution would offer the greatest performance benefit.

 

 


Last Modified: 04/27/2020
Modified by: Shimon Maimon

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page