University of Twente Student Theses

Login

Benchmarking Facebook's Prophet, PELT and Twitter's Anomaly detection and automated deployment to cloud

Srivastava, Siddhartha (2019) Benchmarking Facebook's Prophet, PELT and Twitter's Anomaly detection and automated deployment to cloud.

[img] PDF
7MB
Abstract:We perform benchmark and do a comparison of three algorithms, namely Facebook's Prophet and PELT, which are changepoint detection algorithms, and Twitter's Anomaly Detection, which is an anomaly detec tion algorithm, to see which one is better. The benchmarking is done over synthetic and real datasets, and they have been chosen to accommodate as many real world cases as possible. The metric chosen to compare them are Accuracy, Error rate, Specificity, Precision, Recall and F-measure. Out of these metrics, Precision, Recall and F-measure have been given more weight because they are dependent on number of true positives de tected, the points that actually are anomalies/changepoint, which is what we are interested in. Less importance is given to Accuracy, Error rate and Specificity as they are dependent on number of true negatives, the points that are not changepoints/anomalies, which we are less interested in. Run time of the algorithms is also taken into account. We found that PELT is better than Prophet in terms of Precision, Recall and F-measure, and also it is faster than Prophet. Twitter's Anomaly Detection works best on real data. One of the algorithms, PELT, was deployed to cloud over Kubernetes, a container orchestration engine.
Item Type:Essay (Master)
Faculty:EEMCS: Electrical Engineering, Mathematics and Computer Science
Subject:54 computer science
Programme:Computer Science MSc (60300)
Link to this item:https://purl.utwente.nl/essays/77529
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page