Yuval Elovici

Senior Academic

Analyst intuition inspired neural network based cyber security anomaly detection

Teik Toe Teoh, Yok Yen Nguwi, Yuval Elovici, Wai Loong Ng, Soon Yao Thiang

Internet revolution has brought advancement to the world’s economy, business, technology and communication. It also brings forth the risk of cyber-attack penetration. It is a challenge to detect cyber-attack accurately and timely. In this work, we adopted a large network dataset containing malware attack data and trained it to recognize a cyber security attack to establish an expert system. The characteristics of attacker’s IP addresses can be extracted from our integrated dataset for statistical data extraction. The cyber security expert annotates the weight of each attribute and constructs a scoring system through log history annotation. We adopted a special semi supervise method to classify cyber security log into attack, unsure and no attack by first splitting the data into 3 clusters using fuzzy K-means (FKM), then manually label a small data (analyst intuition) and finally train the neural network classifier multi-layer perceptron (MLP) based on the manually labelled data. By doing so, our results were more encouraging as compared to finding anomalies within cyber security logs without analyst intuition’s labelling. The latter generally creates a large amount of false detections.

Publication language English
Pages 379-386
Journal International Journal of Innovative Computing, Information and Control
Volume 14
Issue number 1
Publication status Published - 01.02.2018

Keywords

Big data
Cyber security
High velocity
Multi-layer perceptron (MLP)
Neural network

ASJC Scopus subject areas

Software
Theoretical Computer Science
Information Systems
Computational Theory and Mathematics
Access to Document
10.24507/ijicic.14.01.379
Other files and links
Link to publication in Scopus