What happened?

A new study authored by Danial Sharifrazi, Saadat Behzadi, and seven research partners presents an AI model that detects mosquitoes infected with dengue virus serotype 2 (DENV2) from video footage. The research was published on arXiv on August 13, 2026.

The system first uses the YOLO object detection model to separate mosquitoes from the background, then matches image features with biologically meaningful text descriptions in a shared embedding space. This matching is performed using a vision-language model architecture called Contrastive Language-Image Pre-training (CLIP).

Why does it matter?

The small size of mosquitoes, their erratic and fast movements, and environmental factors such as lighting and shadows make reliable feature extraction from video-based analysis difficult. The model proposed by the researchers aims to overcome these challenges through fine-tuning with supervised bidirectional contrastive learning.

The model's achievement of 98.54% accuracy and 99.91% sensitivity at the frame level shows that infection-driven behavioral changes can be automatically tracked from video data. When information from video frames was aggregated over time, the model achieved complete performance at the full video level.

Findings

  • YOLO-based segmentation successfully separated mosquitoes from the background.
  • CLIP-based representations and fine-tuning were decisive for accurate classification.
  • The text component provided semantic alignment between image and text rather than boosting accuracy.
  • The model showed no performance loss when moving from frame level to video level.

What's next?

The researchers note that this vision-language framework could also be used to analyze other infection-driven biological behaviors from video data. No detailed timeline for further stages of the study or clinical or field applications has been shared so far.