Malaria is a major public health concern, causing significant morbidity and mortality globally. Monitoring the local population density and diversity of the vectors transmitting malaria is critical to implementing targeted control strategies. However, the current manual identification of mosquitoes is a time-consuming and intensive task, posing challenges in low-resource areas like sub-Saharan Africa; in addition, existing automated identification methods lack scalability, mobile deployability, and field-test validity. To address these bottlenecks, a mosquito image database with fresh wild-caught specimens using basic smart phones is introduced, and we present a novel CNN-based architecture, VectorBrain, designed for identifying the species, sex, and abdomen status of a mosquito concurrently while being efficient and lightweight in computation and size. Overall, our proposed approach achieves 94.44±2% accuracy with a macro-averaged F1 score of 94.10±2% for the species classification,97.00±1% accuracy with a macro-averaged F1 score of 94.00±1% for the sex classification, and 83.20±3.1% accuracy with a macro-averaged F1 score of 80.54±3% for the abdominal status classification. VectorBrain running on local mobile devices, paired with a low-cost handheld imaging tool, is promising in transforming the mosquito vector surveillance programs by reducing the burden of expertise required and facilitating timely response based on accurate monitoring.