Bait station
Bait stations consisted of a Dragon Touch Vision 1 1080p camera, suspended at a height of 210mm above a featureless detection board, shielded by an opaque baffle (Fig.4). This setup minimised background and lighting variability, thus simplifying the computational complexity of hornet detection, while ensuring that only hornets and other insects visiting the station were captured in videos. A sponge cloth impregnated with commercial vespid attractantVespaCatch (Vto-pharma) or Trappit (Agrisense)was placed in a 90mm diameter Petri dish at the centre of the bait station, thus attracting hornets to land directly beneath the camera. We used these bait stations to collect and extract an extensive training dataset, comprising images of V. velutina, V. crabro, and other insects across locations in Jersey, Portugal, France, and the UK.
To ensure dataset fidelity, resultant images of both V. velutina and V. crabro were visually identified via expert assessment of colouration, abdominal markings, and morphology. Additionally, the identity of each hornet species was confirmed through utilisation of the appropriate taxonomic keys65,66.
Data were collected in 2021 and 2022, with selected images being extracted from the raw video footage, and divided into three subsets. All training images were collected in 2021, while the final validation images were collected in 2022, ensuring complete spatiotemporal and biological novelty. Images yielded a maximum simultaneous co-occurrence of six V. velutina, this being observed in Jersey; and five V. crabro, this being recorded in the UK. As a processing step prior to training, images were letterboxedthis being the process of downsampling to 640640 for enhanced throughput performance, while maintaining a 16:9 aspect ratio and filling any residual image space with blank pixels. This then allowed for extensive image augmentation during training, producing three additional variations to supplement each original frame, and thus increasing the total number of images by a factor of four. The specific details of each training data subset are outlined in the following sections.
A collection of 1717 images for training and 430 for initial validation metrics, totalling 8,588 after augmentation. This set contained hornet images with a 50:50 split between V. velutina and V. crabro, while the number of non-target insects was intentionally limited. Data were collected from bait stations at sites in the UK and Portugal.
A collection of 2196 images for training and 549 for initial validation metrics, totalling 10,980 after augmentation. This set contained all hornet images from the HTS, in addition to 598 images of non-target insects. Images of non-target insects included a representative selection of species attracted to the bait station, with a focus on visually similar genera such as Vespula, Dolichovespula, and Polistes. All insects were identified to the genus level, utilising a combination of expert assessment and the relevant taxonomic identification resources65,67. A full list of non-target taxa is provided in (TableS1). These data were collected from bait stations at sites in the UK, Jersey, and Portugal.
A collection of 557 images for final validation only, totalling 2228 after augmentation. Of these, 433 contained instances of V. velutina and V. crabro in a 50:50 split, including multiple co-occurrences of both species and non-target insects. The remaining images contained a combination of non-target species and empty bait stations under different lighting and climatic conditions. Validation data were collected from bait stations at sites in the UK, Jersey, France, and Portugal.
Annotation was performed using the Plainsight AI (Plainsight) software interface. This allowed for expedited labelling via automated polygon selection and AI-assisted predictive annotation. Two classes of annotation were generated, corresponding to V. velutina and V. crabro, and these were then manually applied to a random selection of training frames. Polygonal masks included hornet bodies and wings, and excluded legs and antennaeas we found these to be redundant during testing. Once ~500 frames had been annotated manually, we then used this data to train an automated detection and segmentation model within the labelling interface, allowing us to more rapidly generate further annotations for training. Prior to data export, all annotations were reviewed manually, and corrections made where required. Annotations were exported in COCO format, enabling full segmentation of hornet features from the background68.
To develop a hardware-specific hornet detection and classification model, we combined our extensive image dataset with bespoke augmentations to obtain high predictive confidence. The VespAI detection algorithm is built on the YOLOv5 family of machine vision models, specifically YOLOv5sa variant optimised to run on portable processors such as the Raspberry Pi 448. As a front-end pre-filter to this, we incorporated the lightweight ViBe50 background subtraction algorithm, allowing the system to remain passive in the absence of motion (Fig.2a). Specifically, this pre-filter detects motion from the raw video input, extracts the contours of moving insects, and retains only objects within a reference size range generated from known hornet detections (Fig.2a and S1). Consequently, energy is conserved, as only relevant candidate frames are passed on to the YOLOv5 detection algorithm itself. This then applies a single fully convolutional neural network (F-CNN) to images (Fig.2b), providing superior speed, accuracy, and contextual awareness when compared to traditional regional convolutional neural networks (R-CNN)49,69.
All models were built and optimised using the PyTorch70 machine learning environment, with the aim of generating an end-to-end software package that would run on a Raspberry Pi 4. This was achieved by testing models on a range of YOLOv5 architectures, specifically YOLOv5m, YOLOv5s, and YOLOv5n; thus optimising them to include the minimum number of parametersthis being ~7 millionwhilst maintaining their performance (Fig. S2b).
Final models were trained and tested utilising a NVIDIA Tesla V100 Tensor Core GPU (NVIDIA), with a total of 200300 epochs per model, and a batch size of nine images. Model optimisation was evaluated via three loss functions; bounding box loss, this being the difference between the predicted and manually annotated bounding boxes; objectness loss, defined as the probability that bounding boxes contained target images; and cross-entropy classification loss, encompassing the probability that image classes were correctly classified (Fig. S2). In all cases, training concluded when there was no improvement in these three loss functions for a period of 50 epochs.
The prototype system was developed to provide proof-of-concept for remote detection under field-realistic conditions. The VespAI software was installed on a Raspberry Pi 4, running an Ubuntu desktop 22.04.1 LTS 64-bit operating system. This was then connected via USB to a variety of 1080p cameras, and tested using both mains and battery power supplies. These components were mounted on top of a bait station in the standard camera position, and a remote device was connected to the Pi server via the secure shell command. This allowed the hardware to be controlled remotely, and hornet detections viewed from a corresponding computer.
The setup was validated in Jersey during 2023, testing five candidate camera models and four prototype systems over a total of 55 trials at two field sites, yielding >5500 frames for analysis. Cameras were selected to test system robustness to differing lens and sensor options, while maintaining a standard resolution of 1080p across a range of cost-effective models (Fig. S5 and TableS2). Prior to testing, each camera was calibrated to a specific height, thus ensuring that the relative size of objects in frame remained constant across differences in lens angle and focal length (TableS2). Field sites were situated in Jersey to allow visits from both V. velutina, and V. crabro workers, along with a variety of common non-target insects, thus providing a rigorous test of the system under representative conditions.
Each trial consisted of a100-frame test, with the monitor capturing and analysing frames in real-time at intervals of either 5 or 30sthese being based on known hornet visitation durations (Fig. S4). Specifically, in the first 38 trials, the system was set to collect images at 5s intervals; before optimising to 30s intervals in the final 17 trials (TableS3), thus allowing for maximum power and data storage conservation, in tandem with reliable hornet detection. (Fig. S4). Results were then manually validated, and compared to the corresponding model predictions to calculate evaluation metrics.
Following field testing, the system was configured to integrate a DS3231 Real-Time Clock module, thus ensuring accurate timestamps for detections in the absence of external calibration.
To train the detection models and enable customised image augmentation, we employed the Python packages PyTorch, Torchvision, and Albumentations. Models were then evaluated via k-fold cross-validation, specifically utilising the metrics of precision, recall, box loss, objectness loss, classification loss, mean average precision (mAP), and F1 score (Fig. S2 and Table1). Cross-validation analyses employed a subsample (k) of 5, as this proved sufficient to select an optimised detection classifier that balanced model size with performance. Resultant model rankings were based on mean cross-validation scores, calculated using the Python packages scikit-learn and PaddlePaddle, and the YOLOv5 integrated validation functionality. Additional performance visualisations were generated via the packages Seaborn, Matplotlib, and NumPy. All statistical analyses were performed in SPSS (release v. 28.0.1.1) and Python (release v. 3.9.12).
Cross-validation of polygonal and box annotation techniques utilised precision, recall, box loss, objectness loss, classification loss, and mAP as response variables, and compared models with copy-paste augmentation levels of 0%, 30%, and 90%, with the former of these corresponding to box annotations.
Visualisation of training data subsets to ensure sufficient image novelty utilised frequency distribution analyses of blur, area, brightness, colour, and object density between the HTS, H/NTS, and VS.
Cross-validation of model architectures employed precision, recall, box loss, objectness loss, classification loss, and mAP as response variables, and compared models using the YOLOv5m, YOLOv5s, and YOLOv5n architectures.
Cross-validation of models trained on the hornet training subset and hornet/non-target training subset used F1 score and mAP as response variables, and compared models trained on the HTS and H/NTS, validated against the VS.
The LRP class classification model employed normalised contributions to classification decisions as a response variable, and compared same and opposite class pixel contributions. The LRP training subset classification model used normalised contributions to classification decisions as a response variable, and compared models trained on the HTS and N/HTS.
Precision and recall analyses were utilised to compare camera models, with comparisons based on median performance across test types for each metric.
Model development utilised a sample of 3302 images collected from a total of four countries, each consisting of multiple sampling sites. Data augmentation further expanded this sample to 13,208 images and provided additional variation to enhance model robustness. Analyses of the prototype system employed a sample of >5500 frames, collected across 55 field trials at two sites in Jersey. The source data underlying all figures and analyses are available within the supplementary data. Full details of statistical tests, subset sample sizes, and model selection procedures are provided in the results and statistical analyses sections.
Further information on research design is available in theNature Portfolio Reporting Summary linked to this article.
Originally posted here:
- AACR 2024 Plenary: New Insights Into Early Cancer Biology - American Association for Cancer Research (AACR) - April 15th, 2024 [April 15th, 2024]
- Students create 3 D skulls in project funded by Costello award connecting biology, computer science and art | Fredonia ... - Fredonia.edu - April 15th, 2024 [April 15th, 2024]
- Seed Health launches computational biology platform to expand pipeline beyond the gut - NutraIngredients-usa.com - April 15th, 2024 [April 15th, 2024]
- Analytics for Spatial Biology: DNA and RNA Imaging - LCGC Chromatography Online - April 15th, 2024 [April 15th, 2024]
- Here's what I teach my students about finding jobs in marine biology and conservation - Southern Fried Science - April 15th, 2024 [April 15th, 2024]
- Biology, not technology, will save the planet | Vashon-Maury Island Beachcomber - Vashon-Maury Island Beachcomber - April 15th, 2024 [April 15th, 2024]
- Bonobos are more aggressive than previously thought - EurekAlert - April 15th, 2024 [April 15th, 2024]
- Debating sex and gender: Whose 'biological reality' is it anyway? - The Boston Globe - April 15th, 2024 [April 15th, 2024]
- Why detecting the earliest biological signs of Parkinson's disease is so crucial - Scope - April 15th, 2024 [April 15th, 2024]
- Cicada experts and resources available from UWMadison - University of Wisconsin-Madison - April 15th, 2024 [April 15th, 2024]
- Iconic savanna mammals face genetic problems due to fences and roads - EurekAlert - April 15th, 2024 [April 15th, 2024]
- Advice to a Young Mathematical Biologist - University of Birmingham - April 15th, 2024 [April 15th, 2024]
- New project explores warfare in animal societies - EurekAlert - April 15th, 2024 [April 15th, 2024]
- Unheard of in Structural Biology New Research Unveils Enzymatic Keys to Immune System Regulation - SciTechDaily - April 7th, 2024 [April 7th, 2024]
- Pygmy Slow Lorises Are Born at Smithsonian's National Zoo and Conservation Biology Institute - Smithsonian's National Zoo and Conservation Biology... - April 7th, 2024 [April 7th, 2024]
- Inside the new Seattle Hub for Synthetic Biology, which uses DNA to 'record biology over time' - GeekWire - April 7th, 2024 [April 7th, 2024]
- The Biology of Kindness review: Living well and prospering - New Scientist - April 7th, 2024 [April 7th, 2024]
- UND biologist explains composition of dirt to kids - UND Today - UND Blogs and E-Newsletters - April 7th, 2024 [April 7th, 2024]
- In the evolution of walking, the hip bone connected to the rib bones - EurekAlert - April 7th, 2024 [April 7th, 2024]
- Synaptic ribbon dynamics after noise exposure in the hearing cochlea | Communications Biology - Nature.com - April 7th, 2024 [April 7th, 2024]
- Biologist Beth Shapiro on the 'de-extinction' of woolly mammoths - STAT - April 7th, 2024 [April 7th, 2024]
- MCC students inducted into new honor society geared toward biology - Mohave Valley News - April 7th, 2024 [April 7th, 2024]
- FRIDAY FACULTY FEATURE: Boente's Biology Background the Rock Online - The Rock Online - April 7th, 2024 [April 7th, 2024]
- Measuring the Intelligence of a Cell - University of California San Diego - April 7th, 2024 [April 7th, 2024]
- Shy sea anemones are more likely to survive heatwaves - EurekAlert - April 7th, 2024 [April 7th, 2024]
- Akoya Biosciences Showcases Spatial Biology 2.0 Solutions at AACR Annual Meeting with Case Studies ... - GlobeNewswire - April 7th, 2024 [April 7th, 2024]
- BD Increases Access to Cutting-Edge Image-Enabled, Spectral Cell Sorters - BioSpace - April 7th, 2024 [April 7th, 2024]
- We've had bird evolution all wrong - EurekAlert - April 7th, 2024 [April 7th, 2024]
- Altered brain morphology and functional connectivity in postmenopausal women - EurekAlert - April 7th, 2024 [April 7th, 2024]
- BPGbio Presents Key Advances in its Oncology Pipeline related to the NAi Interrogative Biology Platform - StreetInsider.com - April 7th, 2024 [April 7th, 2024]
- Research Technician in the Center for Genomics and Systems Biology, Dr. Kristin Gunsalus job with NEW YORK ... - Times Higher Education - April 7th, 2024 [April 7th, 2024]
- The Road to Biology 2.0 Will Pass Through Black-Box Data - Towards Data Science - March 19th, 2024 [March 19th, 2024]
- Nobel-winning biologist on the most promising ways to stop ageing - New Scientist - March 19th, 2024 [March 19th, 2024]
- How to better research the possible threats posed by AI-driven misuse of biology - Bulletin of the Atomic Scientists - March 19th, 2024 [March 19th, 2024]
- Fired Biology Professor Fights Back and Wins, Has a Message For Fellow Christians - CBN.com - March 19th, 2024 [March 19th, 2024]
- Understanding Reductionism and ID - Discovery Institute - March 19th, 2024 [March 19th, 2024]
- All creatures great and small: Sequencing the blue whale and Etruscan shrew genomes - University of Wisconsin-Madison - March 19th, 2024 [March 19th, 2024]
- Seeing Double: USU Biologist Carl Rothfels is Developing Novel Polyploid Phylogenetics Tools - Utah State University - March 19th, 2024 [March 19th, 2024]
- Department of Biology Special Seminar: Angela Hancock - The Hub at Johns Hopkins - March 19th, 2024 [March 19th, 2024]
- New Imaging Tool Advances Study of Lipid Biology - University of California San Diego - March 19th, 2024 [March 19th, 2024]
- Saving Biology With Blue Biotechnology - The Maritime Executive - March 19th, 2024 [March 19th, 2024]
- The Human Element: For Student Scientists, Learning to Place Biology in Social Context - Tufts Now - March 19th, 2024 [March 19th, 2024]
- A theoretical framework to improve the adoption of green Integrated Pest Management tactics | Communications Biology - Nature.com - March 19th, 2024 [March 19th, 2024]
- Advancing the scale of synthetic biology via cross-species transfer of cellular functions enabled by iModulon engraftment - Nature.com - March 19th, 2024 [March 19th, 2024]
- A.I. Is Learning What It Means to Be Alive - The New York Times - March 19th, 2024 [March 19th, 2024]
- This Towson University senior found her purpose in biology - Technical.ly - March 19th, 2024 [March 19th, 2024]
- W&M Experiential Courses Bring Biology to Life and Transform the Student Experience - WYDaily - March 19th, 2024 [March 19th, 2024]
- The hidden value of herbariums | On Point - WBUR News - March 19th, 2024 [March 19th, 2024]
- Professor of Biology/Zoology/Physiology (Tenure-Track) job with BLACKBURN COLLEGE | 37620424 - The Chronicle of Higher Education - March 19th, 2024 [March 19th, 2024]
- Generative AI in Biology Market Poised for Remarkable Growth, to Surpass USD 346.9 Billion by 2032, - PharmiWeb.com - March 19th, 2024 [March 19th, 2024]
- Advancements in Understanding the Immune System Biology: Research Contributions - Medriva - February 13th, 2024 [February 13th, 2024]
- Developing Cancer Therapies at the Intersection of Chemistry and Biology - American Association for Cancer Research (AACR) - February 13th, 2024 [February 13th, 2024]
- Recent Advances in the Understanding of MCL Biology - Cancer Network - February 13th, 2024 [February 13th, 2024]
- Biological Mechanism of Noise-Induced Hearing Loss Discovered - The Hearing Review - February 13th, 2024 [February 13th, 2024]
- Genomic attributes of airway commensal bacteria and mucosa | Communications Biology - Nature.com - February 13th, 2024 [February 13th, 2024]
- UCLA Receives $4.6 Million Grant from The Warren Alpert Foundation to Launch Computational Biology/AI Training ... - UCLA Health Connect - February 13th, 2024 [February 13th, 2024]
- Former Zookeeper Hopes to Share Passion for Biology as a Science Educator - Georgia State University News - February 13th, 2024 [February 13th, 2024]
- Uses BgRT Radiation Therapy to Target Tumor - City of Hope - February 13th, 2024 [February 13th, 2024]
- Renowned evolutionary biologist to speak for SFA's Darwin Day event | SFA - Stephen F. Austin State University - February 13th, 2024 [February 13th, 2024]
- State biologists want you to send them owl vomit - Bangor Daily News - February 13th, 2024 [February 13th, 2024]
- Dan Bush named a pioneer member for the American Society of Plant Biology - College of Natural Sciences - Colorado State University - February 13th, 2024 [February 13th, 2024]
- Real-time simultaneous refractive index and thickness mapping of sub-cellular biology at the diffraction limit ... - Nature.com - February 13th, 2024 [February 13th, 2024]
- Letter: Unraveling the threat of misinformation in ballot biology and mountain lion hunting - Vail Daily - February 13th, 2024 [February 13th, 2024]
- Clownfish: Studying their Complex Lives and Anemone Homes | The Brink - Boston University - February 13th, 2024 [February 13th, 2024]
- Rucaparib and its major metabolite exhibit differential biological activity and synergy - News-Medical.Net - February 13th, 2024 [February 13th, 2024]
- Beyond Nature's Limits: Ethical Dilemmas in the Age of Synthetic Biology - Medium - February 13th, 2024 [February 13th, 2024]
- Biological Research And Self-driving Labs In Deep Space Supported By Artificial Intelligence - Astrobiology - Astrobiology News - February 13th, 2024 [February 13th, 2024]
- Surprising behavior in one of the least studied mammals in the world - EurekAlert - February 13th, 2024 [February 13th, 2024]
- Exploring the Role of Non-Protein Ubiquitination in Cellular Biology - Medriva - February 13th, 2024 [February 13th, 2024]
- Researchers call for antitrust measures to safeguard innovation in spatial biology - Phys.org - February 13th, 2024 [February 13th, 2024]
- Lost Loves: USU Neuroscientists Learn About Grief From Widowed Coyotes - Utah State University - February 13th, 2024 [February 13th, 2024]
- Unraveling the Complexities of Multiple Sclerosis: A New Approach to Understanding Chronic Diseases - Medriva - February 13th, 2024 [February 13th, 2024]
- Synthetic biology aims to tackle disease and give cells superpowers - Science News Explores - January 19th, 2024 [January 19th, 2024]
- Ecological determinants of Cope's rule and its inverse | Communications Biology - Nature.com - January 19th, 2024 [January 19th, 2024]
- New Evolution Theory Explains Why Animals Shrink Over Time - SciTechDaily - January 19th, 2024 [January 19th, 2024]
- Biology major finds UWO perfect for college education and first professional job - UW Oshkosh Today - January 19th, 2024 [January 19th, 2024]
- Gustavus BMB Major Earns Prestigious Accreditation - The American Society of Biochemistry and Molecular Biology ... - Gustavus Adolphus College - January 19th, 2024 [January 19th, 2024]
- SARS-CoV-2 biology and host interactions - Nature.com - January 19th, 2024 [January 19th, 2024]
- Biology faculty member rethinks office hours with student needs first - University Times - January 19th, 2024 [January 19th, 2024]
- Penn State Altoona biology student to offer research presentation - Pennsylvania State University - January 19th, 2024 [January 19th, 2024]