Forecasting Subscriber Churn: Comparison of Machine Learning Methods

Authors

  • Святослав Александрович Арзамасцев Saint Petersburg State University, Russia, Saint Petersburg, Russia
  • Михаил Владимирович Бгатов Saint Petersburg State University, Russia, Saint Petersburg, Russia
  • Елена Николаевна Картышева Saint Petersburg State University, Russia, Saint Petersburg, Russia
  • Виктор Артурович Деркунский Saint Petersburg State University, Russia, Saint Petersburg, Russia
  • Дмитрий Николаевич Семенчиков Saint Petersburg State University, Russia, Saint Petersburg, Russia

DOI:

https://doi.org/10.32603/2071-2340-2018-3-5-23

Keywords:

datamining, machine learning, data balancing, data preparation, ensemble

Abstract

In order to remain competitive today in the telecommunications business, it is necessary to identify customers who are dissatisfied with the services provided. Therefore, forecasting subscriber churn has become an essential issue in this area. This article overviews different machine learning techniques including Decision Trees (DT), Naive Bayes Classifier (NB), Random Forest (RF), Artificial Neural Network (NN), KNearest Neighbors (KNN), Linear Discriminant Analysis (LDA), Support Vector Machine (SVM) and their ensembles (bagging and boosting) in order to demonstrate the superiority of the CatBoost technology in gaging the effectiveness of classifiers. To achieve the goal, data was classified and the specific advantages, when compared to others, of the CatBoost method were revealed based on obtained results. For the study, we analyzed four databases: 3 datasets are in open access and 1 dataset was provided by a Russian mobile company. Often, the dimension of these databases is high, which leads to a number of problems (including class imbalances, parameter correlations), which are solved by employing the dimensionality reduction method: Principal Component Analysis (PCA). The results obtained are compared with each other as well as with the results presented by other researchers based on open databases. The effectiveness of classifiers is evaluated using measures such as the area under the curve (AUC), accuracy, F1 -measure, and time.

Author Biographies

  • Святослав Александрович Арзамасцев, Saint Petersburg State University, Russia, Saint Petersburg, Russia

    Arzamastsev Svyatoslav Aleksandrovich, student of SPbSU, Mathematics & Mechanics Faculty, Department of Statistical Modelling; 198504 Saint Petersburg, Stary Peterhof, Universitetsky pr., 28, cab. 4399, st037590@student.spbu.ru

  • Михаил Владимирович Бгатов, Saint Petersburg State University, Russia, Saint Petersburg, Russia

    Bgatov Mikhail Vladimirovich, student of SPbSU, Mathematics & Mechanics Faculty, st047070@student.spbu.ru

  • Елена Николаевна Картышева, Saint Petersburg State University, Russia, Saint Petersburg, Russia

    Kartysheva Elena Nikolavevna, student of SPbSU, Mathematics & Mechanics Faculty, st048188@student.spbu.ru

  • Виктор Артурович Деркунский, Saint Petersburg State University, Russia, Saint Petersburg, Russia

    Derkunskii Viktor Arturovich, student of SPbSU, Mathematics & Mechanics Faculty, st047728@student.spbu.ru

  • Дмитрий Николаевич Семенчиков, Saint Petersburg State University, Russia, Saint Petersburg, Russia

    Semenchikov Dmitrii Nikolaevich, postgraduate student of SPbSU, Faculty of Applied Mathematics and Control Processes, st016311@student.spbu.ru

Downloads

Published

2018-10-30

Issue

Section

Software Engineering

How to Cite

[1]
С. А. Арзамасцев, М. В. Бгатов, Е. Н. Картышева, В. А. Деркунский, and Д. Н. Семенчиков, “Forecasting Subscriber Churn: Comparison of Machine Learning Methods”, Компьютерные инструменты в образовании, no. 5, pp. 5–23, Oct. 2018, doi: 10.32603/2071-2340-2018-3-5-23.

Similar Articles

1-10 of 348

You may also start an advanced similarity search for this article.