← Ch. 2 — Work10 · Project · 2024
Soteria: CIC-DDoS2019 Dataset Analysis, Classification and Real-time Log Processing using Kafka
Network traffic analysis system achieving 98% accuracy and F1 score on CIC-DDoS2019 dataset using decision trees, with Kafka integration for real-time log processing.
- Year
- 2024
- Stack
- Pyspark · Spark-ML · F1 Score · Apache Kafka · Docker · Kubernetes
Successfully modeled network traffic patterns in the CIC-DDoS2019 big data dataset using decision trees, achieving a notable accuracy of 98% and an impressive 98% F1 score.
This in-depth analysis involved exploratory data examination techniques to identify key features for classification. Additionally, I investigated the potential of Kafka as a real-time log streaming platform for future analysis with high-volume data.