Ofer Hadar

Senior Academic

WARLearn

Weather-Adaptive Representation Learning

Shubham Agarwal, Raz Birman, Ofer Hadar

This paper introduces WARLearn, a novel framework designed for adaptive representation learning in challenging and adversarial weather conditions. Leveraging the invariance principal used in Barlow Twins, we demonstrate the capability to port the existing models initially trained on clear weather data to effectively handle ad-verse weather conditions. With minimal additional training, our method exhibits remarkable performance gains in scenarios characterized by fog and low-light conditions. This adaptive framework extends its applicability beyond adverse weather settings, offering a versatile solution for domains exhibiting variations in data distributions. Fur-thermore, WARLearn is invaluable in scenarios where data distributions undergo significant shifts over time, enabling models to remain updated and accurate. Our experimental findings reveal a remarkable performance, with a mean average precision (mAP) of 52.6% on unseen real-world foggy dataset (RTTS). Similarly, in low light conditions, our framework achieves a mAP of 55.7% on unseen real-world low light dataset (ExDark). Notably, WARLearn surpasses the performance of state-of-the-art frameworks including FeatEnHancer, Image Adaptive YOLO, DENet, C2PNet, PairLIE and ZeroDCE, by a substantial margin in adverse weather, improving the baseline performance in both foggy and low light conditions. The WARLearn code is available at https://github.com/ShubhamAgarwa112/WARLearn

Publication language English
Pages 4978-4987
Publication status Published - 01.01.2025

Keywords

adverse conditions
barlow
computer vision
fogg
knowledge distillation
low-light
object detection
self-supervised learning

ASJC Scopus subject areas

Artificial Intelligence
Computer Science Applications
Computer Vision and Pattern Recognition
Human-Computer Interaction
Modeling and Simulation
Radiology Nuclear Medicine and imaging