Comparing performances of intelligent classifier algorithms for predicting type of pain in patients with spinal cord injury

Authors

  • Reza Safdari Ph.D. of Health Information Management, Department of Health Information Management, School of Allied Medical Sciences, Tehran University of Medical Sciences, Iran

Keywords:

Bayesian Networks, Decision Tree, Support Vector Machines, Neural Networks, Spinal cord injury, pain; Accuracy

Abstract

Background and aim: In this study, performances of classification techniques were compared in order to predict type of pain in patients with spinal cord injury. Pain is one of the main problems in people with spinal cord injury. Identifying the optimal classification technique will help improve decision support systems in clinical settings. 

Methods: A descriptive retrospective analysis was performed in 253 patients. We compared performances of "Bayesian Networks", "Decision Tree", neural networks: “Multi-Layer Perceptron” (MLP), and "Support Vector Machines” (SVM). Predictor variables were collected in data set in SCI patients referred to Shefa Neuroscience Research Center, Tehran, Iran from 2010 through 2016. Performances of classification techniques were compared using ”Accuracy”, ”Sensitivity or True Positive Rate” (TPR), ”Specificity or True Negative Rate” (SPC), ”Positive Predictive Value” (PPV), ”Negative Predictive Value” (NPV).

Results: MLP with Boosting technique was found to have the best accuracy (91%), best sensitivity (89%), best specificity (95%) best PPV (91%), and best NPV (96%) to predict spinal cord injury in this data set, given its good classificatory performance. 

Conclusion: Computer-aided decision support systems (CAD) are dependent on a wide range of classification methods such as statistical methods, Bayesian methods, deductive classifiers based on the state or case, decision-making trees and neural networks: Multi-Layer Perceptron. Neural network classifiers especially, are very popular choices for medical decision-making, with proven effectiveness in the clinical field.

 

References

Bonica JJ, Fishman S, Ballantyne J, Rathmell JP. Bonica’s management of pain. Lippincott Williams &

Wilkins; 2010.

Turk DC, Dworkin RH. What should be the core outcomes in chronic pain clinical trials? Arthritis Res

Ther. 2004; 6(4): 151–4. doi: 10.1186/ar1196. PMID: 15225358, PMCID: PMC464897.

Mohammadzadeh F, Faghihzadeh S, Asadi Lari M, Vaez Mahdavi MR, Arab Kheradmand J, Noorbala AA,

et al. A Fairly Comprehensive Survey of Chronic Pain in Iranian Population: Prevalence, Risk Factors, and

Impact on Daily Life. Health Scope. 2015; 4(3); e25467. doi: 10.17795/jhealthscope-25467.

Breivik H, Borchgrevink P, Allen S, Rosseland L, Romundstad L, Hals EK, et al. Assessment of pain. Br J

Anaesth. 2008; 101(1): 17–24. doi: 10.1093/bja/aen103. PMID: 18487245.

Pain management. In: Wikipedia, the free encyclopedia. 2015. Available from:

https://en.wikipedia.org/w/index.php?title=Pain_management&oldid=673213088.

Bassols A, Bosch F, Campillo M, Cañellas M, Baños JE. An epidemiological comparison of pain

complaints in the general population of Catalonia (Spain). Pain. 1999; 83(1): 9–16. doi: 10.1016/S0304- 3959(99)00069-X. PMID: 10506667.

Sternbach RA. Survey of Pain in the United States: The Nuprin Pain Report. Clinical Journal of Pain. 2016.

Siddall P, Taylor D, Cousins M. Classification of pain following spinal cord injury. Spinal Cord. 1997;

(2): 69–75. doi: 10.1038/sj.sc.3100365. PMID: 9044512.

Westgren N, Levi R. Quality of life and traumatic spinal cord injury. Arch Phys Med Rehabil. 1998; 79:

–9. doi: 10.1016/S0003-9993(98)90240-4. PMID: 9821906.

Breivik H, Borchgrevink PC, Allen SM, Rosseland LA, Romundstad L, Hals EK, et al. Assessment of pain.

Br J Anaesth. 2008; 101(1): 17–24. doi: 10.1093/bja/aen103. PMID: 18487245.

Roshanov PS, Misra S, Gerstein HC, Garg AX, Sebaldt RJ, Mackay JA, et al. Computerized clinical

decision support systems for chronic disease management: a decision-maker-researcher partnership

systematic review. Implement Sci. 2011; 6: 92. doi: 10.1186/1748-5908-6-92. PMID: 21824386, PMCID:

PMC3170626.

Neill DB. Using Artificial Intelligence to Improve Hospital Inpatient Care. IEEE Intelligent Systems. 2013;

(2): 92–5. doi: 10.1109/MIS.2013.51.

Friedman N, Geiger D, Goldszmidt M. Bayesian network classifiers. Mach Learn. 1997; 29(2–3): 131–63.

doi: 10.1023/A:1007465528199.

Basheer IA, Hajmeer M. Artificial neural networks: fundamentals, computing, design, and application. J

Microbiol Methods. 2000; 43(1): 3–31. doi: 10.1016/S0167-7012(00)00201-3. PMID: 11084225.

Baxt WG. Use of an artificial neural network for the diagnosis of myocardial infarction. Ann Intern Med.

; 115(11): 843–8. doi: 10.7326/0003-4819-115-11-843. PMID: 1952470.

Forsström JJ, Dalton KJ. Artificial neural networks for decision support in clinical medicine. Ann Med.

; 27(5): 509-17. doi: 10.3109/07853899509002462. PMID: 8541025.

Kurt I, Ture M, Kurum AT. Comparing performances of logistic regression, classification and regression

tree, and neural networks for predicting coronary artery disease. Expert Syst Appl. 2008; 34(1): 366–74.

doi: 10.1016/j.eswa.2006.09.004.

Delen D, Walker G, Kadam A. Predicting breast cancer survivability: a comparison of three data mining

methods. Artif Intell Med. 2005; 34(2): 113–27. doi: 10.1016/j.artmed.2004.07.002. PMID: 15894176.

Khalilinezhad M, Minaei B, Vernazza G, Dellepiane S. Prediction of healthy blood with data mining

classification by using Decision Tree, Naive Baysian and SVM approaches. In: International Society for

Optics and Photonics. 2015: 94432. doi: 10.1117/12.2179871.

Stärk KD, Pfeiffer DU. The application of non-parametric techniques to solve classification problems in

complex data sets in veterinary epidemiology–an example. Intell Data Anal. 1999; 3(1): 23–35. doi:

1016/S1088-467X(99)00003-7.

Lee HK. Model selection for neural network classification. J Classif. 2001; 18(2): 227–43.

Amato F, López A, Peña-Méndez EM, Vaňhara P, Hampl A, Havel J. Artificial neural networks in medical

diagnosis. Journal of Applied Biomedicine. 2013; 11(2): 47–58. doi: 10.2478/v10136-012-0031-x.

Haykin S. A comprehensive foundation. Neural Networks. 2004.

Friedman N, Geiger D, Goldszmidt M. Bayesian network classifiers. Mach Learn. 1997; 29(2–3): 131–63.

doi: 10.1023/A:1007465528199.

Bayesian network - Wikipedia. 2017. Available from: https://en.wikipedia.org/wiki/Bayesian_network.

Kikuti D, Cozman FG, Shirota Filho R. Sequential decision making with partially ordered preferences.

Artif Intell. 2011; 175(7): 1346–65. doi: 10.1016/j.artint.2010.11.017.

Cortes C, Vapnik V. Support-vector networks. Mach Learn. 1995; 20(3): 273–97. doi:

1007/BF00994018.

Ben-Hur A, Horn D, Siegelmann HT, Vapnik V. Support vector clustering. J Mach Learn Res. 2001; 2:

–37.

Olson DL, Delen D. Advanced data mining techniques. Springer Science & Business Media. 2008.

Tashani OA, Alabas OA, Johnson MI. Development of a Short-Form McGill Pain Questionnaire for use in

Libyan Populations. Pain and Rehabilitation. 2016; 2016(41): 25–30.

Breiman L. Bias, variance, and arcing classifiers. 1996.

Zhaoqian C, Hong L, Rong Z, Shifu C. A hybrid algorithm for multi-concept acquisition and its

application. Chin J Comput. 1996; 10.

Breiman L. Bagging predictors. Mach Learn. 1996; 24(2): 123–40. doi: 10.1007/BF00058655.

Mazurowski MA, Habas PA, Zurada JM, Lo JY, Baker JA, Tourassi GD. Training Neural Network

Classifiers for Medical Decision Making: The Effects of Imbalanced Datasets on Classification

Performance. Neural Netw. 2008; 21(2–3): 427–36. doi: 10.1016/j.neunet.2007.12.031. PMID: 18272329,

PMCID: PMC2346433.

Published

2022-01-18

Issue

Section

Articles