Published in the ISPRS Journal of Photogrammetry and Remote Sensing, the study showcases how unmanned aerial vehicles (UAVs) equipped with hyperspectral, thermal, and RGB sensors, can work in tandem with artificial intelligence models to diagnose complex crop stress scenarios.

JERUSALEM, July 14, 2025 --- A team of researchers led by Dr. Ittai Herrmann at the Hebrew University of Jerusalem in collaboration with Virginia State University, University of Tokyo, and the Volcani Institute has developed an advanced drone-based system that offers, for the first time, a smarter way to monitor crop stress and health.

Published in the ISPRS Journal of Photogrammetry and Remote Sensing, the study showcases how unmanned aerial vehicles (UAVs) equipped with hyperspectral, thermal, and RGB sensors, can work in tandem with artificial intelligence models to diagnose complex crop stress scenarios.

Traditional remote sensing methods often fall short of detecting combined environmental stresses such as water and nutrient shortages. The researchers have developed a powerful method for detecting simultaneous nitrogen and water deficiencies in field-grown sesame plants. This innovative approach leverages cutting-edge UAV imaging technology and artificial intelligence to improve the accuracy of stress detection in crops. The integration of multiple data sources enables the identification of combined nutrient and water-related deficiencies.

"By integrating data from multiple UAV-imaging sources and training deep learning models to analyze it, we can now distinguish between stress factors that were previously challenging to tell apart," said Dr. Ittai Herrmann of the Robert H. Smith Faculty of Agriculture, Food & Environment, where the experiments were conducted. "This capability is vital for precision agriculture and for adapting to the challenges of climate change."

The team of researchers applied an advanced drone-based system that accurately detects combined nitrogen and water deficiencies in field-grown sesame, paving the way for more efficient and sustainable farming. Sesame, a climate-resilient oilseed crop with growing global demand, was chosen due to its nutritional importance and potential for expansion into new agroecosystems.

The team's multimodal ensemble approach improved classification accuracy of combined nutrient and water stress from just 40-55% using conventional methods to an impressive 65-90% with their custom-developed deep learning system.

This new remote-sensing method may enable growers to reduce fertilizer and water use while maintaining yield, improving both economic and environmental outcomes.
The research paper titled "Multimodal ensemble of UAV-borne hyperspectral, thermal, and RGB imagery to identify combined nitrogen and water deficiencies in field-grown sesame" is now available in ISPRS Journal of Photogrammetry and Remote Sensing and can be accessed at https://doi.org/10.1016/j.isprsjprs.2025.02.011.

Note to editors: During these challenging times for Israel, the Hebrew University of Jerusalem (HU) remains steadfast in its commitment to advancing research and education. For over 100 years, through crises and conflicts, HU has upheld its pursuit of excellence, maintaining its standing as Israel's preeminent academic and research institution. American Friends of the Hebrew University shares this enduring commitment and stands in solidarity with all those impacted by the current conflict.

Researchers:
Maitreya Mohan Sahooa, Rom Tarshisha, Yaniv Tubula, Idan Sabaga, Yaron Gadria, Gota Morotab,d, Zvi Pelega, Victor Alchanatisc, Ittai Herrmanna
Institutions:
1. The Hebrew University of Jerusalem, Rehovot 7610001, Israel
2. The University of Tokyo, Bunkyo, Tokyo 113-8657, Japan
3. Agricultural Research Organization - Volcani Institute, Rishon LeZion 7505101, Israel
4. School of Animal Sciences, Virginia Polytechnic Institute and State University

About the Hebrew University of Jerusalem
This year marks 100 years of excellence in research, education, and innovation at the Hebrew University of Jerusalem, Israel's premier institution of higher learning and research. The University is dedicated to advancing knowledge, fostering leadership, and promoting diversity, serving over 23,000 students from over 80 countries. As home to founder Albert Einstein's archives, the University produces nearly 40% of Israel's civilian scientific research and has received over 11,000 patents. Faculty and alumni of the Hebrew University have won nine Nobel Prizes and a Fields Medal, and continue to shape the future. For more information about Hebrew University's academic programs, research, and achievements, please visit http://new.huji.ac.il/en.

About American Friends of the Hebrew University
American Friends of the Hebrew University (AFHU) is a national, not-for-profit organization based in the United States. AFHU is headquartered in New York and has seven regional offices working in close partnership with the Hebrew University of Jerusalem. AFHU provides supporters, Hebrew University alumni, and the public with stimulating programs and events, and organizes missions to Israel. For the past century, the organization's activities have supported scholarly and scientific achievement at HU, created scholarships, funded new facilities, and assisted the University's efforts to recruit outstanding new faculty. For more information, please visit http://www.afhu.org.