The Virtual Plant Breeder: assessing plants remotely

What if a plant breeder could assess a plant in Kenya, Colombia, or Japan just as accurately as in a Dutch greenhouse? Without an airplane, a physical inspection or any loss of detail? That is exactly what researchers and enterprises in The Virtual Plant Breeder project are working on.

The Hague University of Applied Sciences, Inholland University of Applied Sciences, AgriData Innovations and Deliflor Chrysanten are joining forces to develop an innovative digital tool. With use of a smartphone video, a plant is converted into a detailed 3D model that can be viewed, analysed and compared remotely.

From smartphone to 3D model

The technology behind the virtual plant breeder sounds complex, but its use is actually intended to be simple. ‘The idea is for someone on-site to make a video of a plant with their smart phone’, begins Sam Aerts, project leader for the project within the Smart Sensor Systems research group, part of the Centre of Expertise in Digital Operations & Finance at The Hague University of Applied Sciences. ‘Next, special software based on Gaussian splatting converts those images into an accurate 3D model, after which plant breeders can view the plant digitally as if they were standing next to it.’ The technology makes it possible to view plants from all angles. Moreover, researchers and plant breeders will soon be able to automatically measure characteristics such as plant size, leaf area, compactness, or the number of flower buds.

A solution to a growing problem

The project arose from a practical issue in the plant breeding sector. 'Dutch plant breeding enterprises now often fly to locations in, for example, Africa or South America to assess with their own eyes how crops are developing,' Sam explains. ‘That takes a lot of time and money and makes it difficult to monitor regularly.’ In addition, experienced plant breeders are scarce. Their assessments are valuable, but also depend on personal expertise and interpretation. The sector is therefore looking for ways to make assessments more objective, consistent, and efficient.

A digital perspective on plant quality

The virtual plant breeder must make that step possible. Instead of individual photos or occasional visits, a complete digital picture of the plant’s development is created. By making videos on a regular basis, plant breeders are able to track plants throughout their entire growth process. Consider the plant height, the number of leaves, the colour of the flowers, and the thickness of the stem. According to Sam, this offers significant benefits. You no longer get a single snapshot, but can track the development of a plant over time. 

This provides a lot more information. This technology also paves the way for automated analyses. Whilst plant measurements are currently often carried out manually, algorithms will soon be able to help record characteristics objectively and compare different plants with one another.

Chrysanthemums as a testing ground

The technology is being tested in practice at Deliflor Chrysanten, one of the world's largest chrysanthemum breeders. That is where the universities of applied sciences and AgriData Innovations are investigating how they can use the digital models for plant breeding and quality control of cuttings. Students play an important role in this. Students from various study programmes are contributing to the project, such as Applied Data Science & AI and the Minor in Innovative Data Visualisation. This is how students at The Hague University of Applied Sciences collect and analyse data and develop visualisations. Students from Inholland carry out practical plant measurements. ‘We bring together different areas of expertise’, says Sam. ‘From sensor technology and data science to plant knowledge and applied research. “It is precisely this combination that makes it possible to develop this technology further.’

Leader

Although the project leader has no background in horticulture, he became fascinated by the sector when he was involved in the "Gewasgroei Goed Meten” (Crop Growth Measured Well) greenhouse project. ‘The Netherlands is one of the world’s leading nations in horticulture and horticultural technology. The Hague University of Applied Sciences is right at the heart of this and can truly make a contribution.’ The combination of practical experience, technology and education appeals to Sam. ‘The students’ work on this project is tangible. You can measure, compare, and improve results. Moreover, the enterprises are just round the corner from us. As a result, we conduct research that directly addresses questions from the field.’ 

Less travel, more knowledge

The impact of the project extends beyond mere efficiency. When specialists can assess plants remotely, fewer international trips are required and costs decrease significantly. At the same time, companies can monitor more frequently and take action more quickly when deviations occur. The researchers expect that the technology will eventually be of interest not only to plant breeders, but also to growers and propagators. Moreover, the project generates new knowledge for education and research, allowing students to gain experience with current issues related to digitalisation, AI, and sustainable horticulture.

Read more: Project The Virtual Plant Breeder