Award Abstract # 1951250
STTR Phase II: TerraSentia: Ultra-compact, Autonomous, Teachable Under-canopy Phenotyping Robot for Plant Breeders and Crop Scientists

NSF Org: TI
Translational Impacts
Recipient: EARTHSENSE INC
Initial Amendment Date: April 10, 2020
Latest Amendment Date: October 24, 2022
Award Number: 1951250
Award Instrument: Standard Grant
Program Manager: Anna Brady-Estevez
TI
 Translational Impacts
TIP
 Directorate for Technology, Innovation, and Partnerships
Start Date: April 15, 2020
End Date: May 31, 2023 (Estimated)
Total Intended Award Amount: $750,000.00
Total Awarded Amount to Date: $832,000.00
Funds Obligated to Date: FY 2020 = $816,000.00
FY 2021 = $16,000.00
History of Investigator:
  • Chinmay Soman (Principal Investigator)
    chinmay@earthsense.co
Recipient Sponsored Research Office: EarthSense, Inc.
1800 S OAK ST STE 111
CHAMPAIGN
IL  US  61820-6974
(217)402-4767
Sponsor Congressional District: 13
Primary Place of Performance: EarthSense, Inc.
60 Hazelwood Drive
Champaign
IL  US  61820-7460
Primary Place of Performance
Congressional District:
13
Unique Entity Identifier (UEI): JAM3S4174UP6
Parent UEI:
NSF Program(s): STTR Phase II,
SBIR Phase II
Primary Program Source: 01002021DB NSF RESEARCH & RELATED ACTIVIT
01002122DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 8030, 8032, 8240, 9251
Program Element Code(s): 159100, 537300
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.084

ABSTRACT

The broader impact of this Small Business Technology Transfer (STTR) Phase II project include improving food security, while at the same time enhancing the economic viability and environmental sustainability of large-scale production agriculture. In order to improve crop varieties, agricultural production, and sustainability of farming, there is an urgent need for better technologies to acquire under-canopy plant trait and health data. Examples of high-value under-canopy data include emergence, stem width, corn ear height, plant life-cycle events like flowering and fruiting, and symptoms of pathogens, diseases, and nutrient deficiency. Because these data cannot be obtained by aerial imaging, under-canopy data collection has dramatically greater actionability and value compared to aerial data. However no cost-effective, scalable ways of collecting this data are currently available. In fact, the state of the art is manual data collection by crop scientists (and their students or interns), agronomists, crop-scouts or farmers - an extremely labor intensive, and therefore expensive way of collecting this highly valuable data. Our work will greatly enhance the availability of under-canopy data from field crops, benefiting crop scientists and agricultural product development professionals as well as enable large scale field monitoring and management in production agriculture. The commercial value of the field data for crop breeding is in excess of $50 Million/year for breeding major row-crops in the US.

This STTR Phase II project proposes to establish autonomous data collection under-canopy from field crops using a low-cost ground robot. The proposed work will enhance the ability to collect data autonomously in full-scale crop-breeding fields throughout the season and enable on-site data analytics for remote sites with limited connectivity. Long-term field adaptive autonomy will be achieved through implementation of multiple low-cost sensors. Robot's real-time control algorithms will be developed to adapt camera perspective and robot path in order to obtain the highest quality information from the complex and dynamic under-canopy field environments. Finally, the research will develop hardware specific edge-compute versions of the analytics algorithms to enable on-site data analysis. These innovations will together enable global deployment of the system for effective data collection and phenotyping.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

This STTR Phase II Award has been critical in enabling EarthSense, Inc. to mature our field autonomy and machine-vision technologies for agriculture. These technologies form the core of our "Terra" Autonomy and AI platform that powers our commercial products:

  1. TerraSentia: the high-throughput field phenotyping system, including the ultracompact, autonomous robots and teachable autonomy and AI algorithms that's being used worldwide to accelerate the creation of the next generation of productive, sustainable crops
  2. TerraSentia+: the autonomous robots for advanced applications in seed breeding, production, and agricultural research.
  3. TerraPreta: robots for large-scale soil regeneration and gigaton scale soil carbon sequestration
  4. TerraMax: high-payload robots for large scale precision management of sustainable agricultural systems

The TerraSentia field phenotyping platform was the primary focus of this award. The TerraSentia platform was designed with initial support from NSF SBIR Phase I (Award # 1820332, July 2018-June 2019). Some of the underlying technologies of TerraSentia were created at the University of Illinois at Urbana Champaign through funding from the ARPA-e TERRA program for creating high-throughput field phenotyping technologies.

Since 2018 EarthSense's public and private sector customers have deployed the increasingly autonomous and capable TerraSentia field robots around the world, resulting in the breaking of the "field phenotyping bottleneck".

Phenotyping is the mesurement of physical characgeristic of plants. Measuring the physical properties of a large variety of plants is critical for identifying the genetic characteristics of plants that will result in the best performance under the enivironmental conditions (such as soil conditions, drought, heat, cold, excess rainfaill, diseases and pests, etc.) and management practices (fertilizing, irrigation, etc.) that the plants will experience. In other words, phenotyping plants at high volume and high frequency is critical for enabling crop scientsts to create the next generation of productive, sustainable, climate resilient, and profitable crops.

However, before the TerraSentia system, filed phenotyping was extremely labor intensive and inefficient, since many of the important traits of crops exist under the plant canopy. These traits, such as stem width, fruit count and dminesions, leaf and canopy architecture, etc. have to be meausred by hand, one plant at a time. This causes the field phenotyping bottleneck, resulting in a crop improvement process that is much slower than it can be.

To break the field phenotyping bottleneck, EarthSense had to solve three key problems: reliable autonomy, machine-learning algorithms capable extracting accurate plant traits from complex real-world field data, and capacity to analyze this data in a computationally efficient manner - including on the low-cost, compact TerraSentia robots with limited onboard compute capacity.

The TerraSentia field phenotyping system is now being used by a variety of field research scientists inculding at major resarch universities inclusing Cornell, UC Davis, Michigan State, Iowa State, Purdue, University of Illinois, Texas A&M, Washington State, University of Missouri, and others. It is also being used by United States Department of Agriculture - Agricultural Research Service, for crops including corn, field beans, sugarcane, and others. Finally, it is being widely used by major global  agricultural companies to customize their products for regions including in the US, South America, Europe, and South & South-East Asia.

Based on the commercial success of the TerraSentia platform, EarthSense has been able to attract some venture capital funding to supplement this grant and our revenues.

In addition, EarthSense has filed a series of patents relating to our autonomy and AI capabilities developed with the support of this NSF funding.

Finally, building on the core AI and autonomy capabilities, as well as hardware designed to be low cost and scalable, and our credibility for developing these products, EarthSense has developing a whole family of robots for enabling large-scale sustainable, regenerative, agriculture that can be  profitable to farmers all around the world.


Last Modified: 06/26/2023
Modified by: Chinmay Soman

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page