To address physical limitations and data overload in modern agriculture, researchers at Binghamton University, State University of New York, have developed a virtual reality system that creates real-time, interactive 3D “digital twins” of physical farms. The system allows users to put on VR goggles and explore virtual replicas of their greenhouses from anywhere, observing microclimates and plant health without physically walking the grounds.
“This project is designed for accessibility. So, if someone is elderly and can’t walk around the farm or the greenhouse, they can use this interactive setup and see the data, see how everything is working,” says Mohamed Gallai, a doctoral student in electrical and computer engineering at Binghamton University and lead author of the research paper.
Gallai explains the core problem they aim to solve: “Statistically, the average age for a farmer is 58, which creates physical constraints when trying to manage large farm areas with small crews. Typically, an operator has to walk the land to inspect each plant or tree, checking humidity and water levels. Instead of the operator physically going to the crop, our goal is to bring the crop to the operator so it’s easier to make decisions.”
While many modern greenhouse operations rely on internet-connected sensors to collect metrics like soil moisture, ambient temperature and gas levels, the data is usually delivered through flat 2D dashboards. According to Gallai, standard graphs lack context and lead to what researchers call “spatial blindness.”
“It strips away the biological and physical reality behind the metrics,” he says. “By using virtual reality instead, if there’s a sudden spike in data, the operator can immediately see the exact location, check if it’s near a vent or if a plant’s leaves are discolored and easily make a diagnosis.”
In its current stage, the framework builds 3D models of real plants via photographed 3D reconstruction and links them to low-power microcontrollers installed at each plant. While metric data updates dynamically, physical transformations — such as leaf discoloration or plant growth — currently require updated photography.
“We are working now to automate this process so whenever a change in a plant occurs, photos are taken automatically and reflected in the system,” Gallai says.
Ultimately, the team views the system as far more than a niche tool for agriculture. By pairing 3D digital twins with internet-connected sensors and conversational artificial intelligence, the framework provides a universal blueprint for making dense data accessible and intuitive.
Whether applied in large manufacturing facilities, used to train agricultural students or deployed to help aging farmers stay connected to their land, the technology bridges the gap between raw numbers and human understanding. As research continues at Binghamton University, the project moves closer to a future where physical distance and accessibility constraints no longer stand in the way of managing complex real-world environments.
