BEESMART – A CROWDSOURCING PROJECT WITH SMARTPHONES

Abstract. The project Beesmart aims at the derivation of a geolocation yield catalogue for honey bees by using a crowd-sourcing approach with the help of smartphones. A central issue are thus the design of an application (App2bee) for smartphones and the design of a software for flower recognition, which uses sensor information of the smart phone and information about blooming times to recognize and localise flowers. The implemented flower recognition is based on the approach “Minimal-bag-of-visual-Words“. A classification accuracy of about 60-70% can be reached, which is of course affected by the big variety of flowers, by the way on how images are taken and how the image quality and resolution actually are. The classification results are further improved by applying apriori a simple manual segmentation on the touch screen to put the focus in the image on the flower in question. The design and the functionality of the App2Bee are presented followed by details on the communication, database and Web-portal components. In a second part of the project the classification of larger areas of flowers important for honey bees are investigate using a fixed-wing UAV system with two different types of cameras, a RGB digital camera and a NIR digital camera. It is certainly not possible to recognize single flowers, but it could be shown, that larger fields of the same flower, like e.g. Red Clover, can be classified with this approach. With the data available it was also possible to classify bare-ground, roads, low pasture, high pasture as well as mixed pasture. For the high pasture it was possible to automatically identify clusters of flowers, like Yarrow.