Predictive Ensemble Modelling: An Experimental Comparison of Boosting Implementation Methods

Conference item


Adegoke, V, Chen, D, Barikzai, S and Banissi, E (2017). Predictive Ensemble Modelling: An Experimental Comparison of Boosting Implementation Methods. 2017 European Modelling Symposium (EMS). Manchester 20 - 21 Nov 2017 London South Bank University.
AuthorsAdegoke, V, Chen, D, Barikzai, S and Banissi, E
Abstract

This paper presents the empirical comparison of boosting implementation by reweighting and resampling methods. The goal of this paper is to determine which of the two methods performs better. In the study, we used four algorithms namely: Decision Stump, Neural Network, Random Forest and Support Vector Machine as base classifiers and AdaBoost as a technique to develop various ensemble models. We applied 10-fold cross validation method in measuring and evaluating the performance metrics of the models. The results show that in both methods the average of the correctly classified and incorrectly classified are relatively the same. However, average values of the RMSE in both methods are insignificantly different. The results further show that the two methods are independent of the datasets and the base classier used. Additionally, we found that the complexity of the chosen ensemble technique and boosting method does not necessarily lead to better performance.

KeywordsAdaBoost; ensemble based system; machine learning; resampling; reweighting
Year2017
PublisherLondon South Bank University
Accepted author manuscript
License
CC BY 4.0
Publication dates
Print20 Nov 2017
Publication process dates
Deposited29 Nov 2017
Accepted20 Oct 2017
Permalink -

https://openresearch.lsbu.ac.uk/item/86ww8

  • 0
    total views
  • 8
    total downloads
  • 0
    views this month
  • 5
    downloads this month

Related outputs

Distributed deep networks based on Bagging-Down SGD algorithm
Qin, C, Gao, X and Chen, D (2019). Distributed deep networks based on Bagging-Down SGD algorithm. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics. 41 (5), pp. 1021-1027.
Design of a voice control 6DoF grasping robotic arm based on ultrasonic sensor, computer vision and Alexa voice assistance
Wang, Z, Chen, D and Xiao, P (2019). Design of a voice control 6DoF grasping robotic arm based on ultrasonic sensor, computer vision and Alexa voice assistance. International Conference on Information Technology in Medicine and Education. Qingdao, China 23 - 25 Aug 2019
Towards automated cost analysis, benchmarking and estimating in construction: a machine learning approach
Chen, D, Hajderanj, L and Fiske, J (2019). Towards automated cost analysis, benchmarking and estimating in construction: a machine learning approach. 13th Multi Conference on Computer Science and Information Systems (MCCSIS). Porto, Portugal 16 - 18 Jul 2019
Improving Prediction Accuracy of Breast Cancer Survivability and Diabetes Diagnosis via RBF Networks trained with EKF models
Adegoke, V, Chen, D and Banissi, E (2019). Improving Prediction Accuracy of Breast Cancer Survivability and Diabetes Diagnosis via RBF Networks trained with EKF models. International Journal of Computer Information Systems and Industrial Management.
On Distributed Deep Network for Processing Large-Scale Sets of Complex Data
Qin, C, Gao, X and Chen, D (2016). On Distributed Deep Network for Processing Large-Scale Sets of Complex Data. 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC). Hangzhou, China. 27 - 28 Aug 2016 doi:10.1109/IHMSC.2016.55
Enhancing Ensemble Prediction Accuracy of Breast Cancer Survivability and Diabetes Diagnostic using optimized EKF-RBFN trained prototypes, The 10th International Conference on Soft Computing and Pattern Recognition
Adegoke, V, Chen, D, Banissi, E and Barikzai, S (2019). Enhancing Ensemble Prediction Accuracy of Breast Cancer Survivability and Diabetes Diagnostic using optimized EKF-RBFN trained prototypes, The 10th International Conference on Soft Computing and Pattern Recognition. The 10th International Conference on Soft Computing and Pattern Recognition. Porto, Portugal 13 - 15 Dec 2018
Decoder-Encoder LSTM for Lip Reading
Fanghour, S, Chen, D and Xiao, P (2019). Decoder-Encoder LSTM for Lip Reading. 2019 8th International Conference on Software and Information Engineering (ICSIE 2019). Cairo, Eygpt 09 - 12 Apr 2019
Learning Bayesian network parameters via minimax algorithm
Gao, X, Gao, G, Ren, H, Chen, D and He, C (2019). Learning Bayesian network parameters via minimax algorithm. International Journal of Approximate Reasoning. 108, pp. 62-75.
A New Supervised t-SNE with Dissimilarity Measure for Effective Data Visualization and Classification
Hajderanj, L, Weheliye, I and Chen, D (2019). A New Supervised t-SNE with Dissimilarity Measure for Effective Data Visualization and Classification. 2019 8th International Conference on Software and Information Engineering. Cairo 09 - 12 Apr 2019
Recurrent Neural Networks for Decoding Lip Read Speech
Fenghour, S, Chen, D and Xiao, P (2019). Recurrent Neural Networks for Decoding Lip Read Speech. 2019 8th International Conference on Software and Information Engineering (ICSIE 2019). Cairo 09 - 12 Apr 2019
Learning Bayesian Networks using the Constrained Maximum a Posteriori Probability Method
Yang, Y, Gao, X, Guo, Z and Chen, D (2019). Learning Bayesian Networks using the Constrained Maximum a Posteriori Probability Method. Pattern Recognition. 91, pp. 123-134.
Contour Mapping for Speaker-Independent Lip Reading System
Fenghour, S, Chen, D and Xiao, P (2018). Contour Mapping for Speaker-Independent Lip Reading System. The 11th International Conference on Machine Vision (ICMV 2018). Munich, Germany 01 - 03 Nov 2018
Predicting Customer Profitability Dynamically over Time: An Experimental Comparative Study
Chen, D., Guo, K. and Li, B. (2019). Predicting Customer Profitability Dynamically over Time: An Experimental Comparative Study. 24th Iberoamerican Congress on Pattern Recognition (CIARP 2019). Havana, Cuba 28 - 31 Oct 2019
Preface
Banissi, E, Sarfraz, M and Fakir, M (2016). Preface. in: 2016 13th International Conference Computer Graphics, Imaging and Visualization IEEE. pp. xii
Preface
Banissi, E and Wyeld, T (2016). Preface. in: 2016 20th International Conference Information Visualisation (IV) IEEE.
Preface
Banissi, E (2017). Preface. in: 2017 21st International Conference Information Visualisation (IV) IEEE. pp. xii
Preface
Banissi, E, Sarfraz, M, Zeroual, A and Fakir, M (2018). Preface. 14th International Conference on Computer Graphics, Imaging and Visualization. Marrakesh, Morocco 23 - 25 May 2017 The Institute of Electrical and Electronics Engineers, Inc.. pp. viii doi:10.1109/CGiV.2017.4
Bertin’s Forgotten Typographic Variables and New Typographic Visualization
Brath, R and Banissi, E (2018). Bertin’s Forgotten Typographic Variables and New Typographic Visualization. Cartography and Geographic Information Science.
Stem and leaf plots extended for text visualizations
Brath, R and Banissi, E (2018). Stem and leaf plots extended for text visualizations. 14th International Conference on Computer Graphics, Imaging and Visualization. Marrakesh, Morocco 23 - 25 May 2017 London South Bank University. pp. 99-104 doi:10.1109/CGiV.2017.32
Visual analytics in the public sector: An analysis on diversities and similarities of London’s wards
Chen, D, Sanz, BM and Zhao, E (2018). Visual analytics in the public sector: An analysis on diversities and similarities of London’s wards. International Conference on Big Data Analytics, Data Mining and Computational Intelligence 2018 (BigDaCI 2018). Madrid, Spain 18 - 20 Jul 2018 Bigdaci.
Nurturing Women Entrepreneurship, UK and Bahrain perspectives
Taqi, N, Barikzai, S and Cole, L (2016). Nurturing Women Entrepreneurship, UK and Bahrain perspectives. International Entrepreneurship Educators Conference. Liverpool John Moores University, Liverpool, UK 07 - 09 Sep 2016 London South Bank University.
Multivariate label-based thematic maps
Brath, R and Banissi, E (2017). Multivariate label-based thematic maps. International Journal of Cartography. 3 (1), pp. 45-60.
Using font attributes in knowledge maps and information retrieval
Brath, R and Banissi, E (2014). Using font attributes in knowledge maps and information retrieval. Knowledge Maps and Information Retrieval 2014. London 11 Sep 2014 London South Bank University.
Evaluating Lossiness and Fidelity in Visualization
Banissi, E and Brath, R (2015). Evaluating Lossiness and Fidelity in Visualization. Visualization and Data Analysis 2015. San Francisco, USA 08 - 12 Feb 2015 London South Bank University.
The Design Space of Typeface
Brath, R and Banissi, E (2014). The Design Space of Typeface. IEEE Conference on Information Visualisation VIS 2014. Paris, France 09 - 14 Nov 2015 London South Bank University.
Using text in visualizations for micro/macro readings
Brath, R and Banissi, E (2015). Using text in visualizations for micro/macro readings. IUI Workshop on Visual Text Analytics. Atlanta, USA 29 Mar 2015 London South Bank University. doi:10.13140/RG.2.1.1651.2084
Using Type to Add Data to Data Visualizations
Brath, R and Banissi, E (2015). Using Type to Add Data to Data Visualizations. TypeCon 2015. Denver, Colorado, USA 12 - 16 Aug 2015 Society of Typographic Aficionados.
Guest editorial: Special issue on information visualisation
Banissi, E and Huang, W (2018). Guest editorial: Special issue on information visualisation. Journal of Visual Languages and Computing. 44, pp. 70-71.
Hardware aspects of algorithm generation
Pitteway, MLV and Banissi, E (1987). Hardware aspects of algorithm generation. in: Theoretical foundations of computer graphics and CAD Springer.
Making Better Use of Big Data
Chen, D (2016). Making Better Use of Big Data. LSBU Enterprise Count Event, March 2016. London Southbank University 18 - 18 Mar 2016 London South Bank University.
Determining Key (Predictor) Modules for Early Identification of Students At-Risk
Chen, D and Elliott, G (2013). Determining Key (Predictor) Modules for Early Identification of Students At-Risk. International Conference on Advanced Information Engineering and Education Science (ICAIEES 2013). Beijing, China 19 - 20 Dec 2013 London South Bank University. doi:10.2991/icaiees-13.2013.22
Big Data Analytics System for Fact/Data-driven Decision Making
Chen, D (2015). Big Data Analytics System for Fact/Data-driven Decision Making. The Royal Statistical Society, Business and Industry Section. London, UK 18 Nov 2015 London South Bank University.
A Bayesian Approach to Learn Bayesian Networks Using Data and Constraints
Gao, X, Yu, Y, Zhi-gao, G and Chen, D (2016). A Bayesian Approach to Learn Bayesian Networks Using Data and Constraints. 23rd International Conference on Pattern Recognition (ICPR 2016). Cancún, México 04 - 08 Dec 2016 London South Bank University. doi:10.1109/ICPR.2016.7900204
Data mining for the online retail industry: A case study of RFM model-based customer segmentation using data mining
Chen, D (2012). Data mining for the online retail industry: A case study of RFM model-based customer segmentation using data mining. Journal of Database Marketing and Customer Strategy Management. 19 (3), pp. 197-208.
Computer Graphics, Imaging & Visualization — New Techniques and Trends
Banissi, E, Sarfraz, M and Fakir, M Banissi, E (ed.) (2016). Computer Graphics, Imaging & Visualization — New Techniques and Trends. CPS.
Typographic sets: Labeled set elements with font attributes
Brath, R and Banissi, E (2016). Typographic sets: Labeled set elements with font attributes. International Workshop on Set Visualization and Reasoning. Philadelphia, United States of America 07 Aug 2016 London South Bank University. pp. 29-43
Prediction of Breast Cancer Survivability using Ensemble Algorithms
Adegoke, V, Chen, D, Banissi, E and Barikzai, S (2017). Prediction of Breast Cancer Survivability using Ensemble Algorithms. International Conference on Smart System and Technologies 2017 (SST 2017),. Osijek, Croatia 18 - 20 Oct 2017 London South Bank University.
Learning Bayesian Network Parameters from a Small Data Set: A Further Constrained Qualitatively Maximum a Posteriori Method
Guo, Zhi-gao, Gao, Xiao-guang, Hao, Ren, Yang, Yu, Di, Ruo-hai and Chen, D (2017). Learning Bayesian Network Parameters from a Small Data Set: A Further Constrained Qualitatively Maximum a Posteriori Method. International Journal of Approximate Reasoning. 91 (Dec), pp. 22-35.
Feature Extraction and Labelling Large Data Sets Using Deep Learning
Chen, D (2017). Feature Extraction and Labelling Large Data Sets Using Deep Learning. RESEARCHER LINK: Smart Technology for Fighting Virus Epidemics & Bioinformatics. Recife, Pernambuco, Brazil 10 - 13 Sep 2017 London South Bank University.
Stem & Leaf Plots Extended to Various Ranges of Text
Brath, R and Banissi, E (2017). Stem & Leaf Plots Extended to Various Ranges of Text. 14th International Conference Computer Graphics, Imaging and Visualization. Marrakesh, Morocco 22 - 25 May 2017 London South Bank University.
Microtext Line Charts
Brath, R and Banissi, E (2017). Microtext Line Charts. 21st International Conference Information Visualisation. London 11 - 14 Jul 2017 London South Bank University.
User acceptance of information technology: A critical review of technology acceptance models and the decision to invest in Information Security
Ubakanma, G, Seuwou, P and Banissi, E (2017). User acceptance of information technology: A critical review of technology acceptance models and the decision to invest in Information Security. in: Global Security, Safety and Sustainability - The Security Challenges of the Connected World Springer. pp. 230-251
User concerns about Facebook: Are they important
Al-Shamaileh, O, Aloudat, A and Barikzai, S (2017). User concerns about Facebook: Are they important. ICIT 2017 The 8th International Conference on Information Technology. Amman, Jordan 17 - 18 May 2017 London South Bank University. doi:10.15849/icit.2017.0000
Set Visualization
Brath, R and Banissi, E (2016). Set Visualization. SetVR 2016. Philadelphia, USA 07 - 10 Aug 2016 London South Bank University.
Mutlivariate Labeled Cartograms
Brath, R and Banissi, E (2016). Mutlivariate Labeled Cartograms. North American Cartographic Information Society Annual Meeting. Colorado Springs, USA 19 - 22 Oct 2016 London South Bank University.
Evaluation of Visualization by Critiques
Brath, R and Banissi, E (2016). Evaluation of Visualization by Critiques. BELIV '16 Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization. Baltimore, MD, USA 24 Oct 2016 ACM. doi:10.1145/2993901.2993904
QL-282 - Emerging Medical Sensory Technology
Banissi, E and Benjamin, EL (2016). QL-282 - Emerging Medical Sensory Technology. Qinetiq.
BIG DATA ANALYTICS IN THE PUBLIC SECTOR: A CASE STUDY OF NEET ANALYSIS FOR THE LONDON BOROUGHS
Chen, D, Asaolu, B and Qin, C (2016). BIG DATA ANALYTICS IN THE PUBLIC SECTOR: A CASE STUDY OF NEET ANALYSIS FOR THE LONDON BOROUGHS. International Conference on Big Data Analytics, Data Mining and Computational Intelligence. Funchal, Madeira, Portugal 02 - 04 Jul 2016 London South Bank University.
Font attributes enrich knowledge maps and information retrieval: Skim formatting, proportional encoding, text stem and leaf plots, and multi-attribute labels
Brath, R and Banissi, E (2016). Font attributes enrich knowledge maps and information retrieval: Skim formatting, proportional encoding, text stem and leaf plots, and multi-attribute labels. International Journal on Digital Libraries. 18 (1), pp. 5-24.
On Distributed Deep Network for Processing Large-Scale Sets of Complex Data
Chen, D (2016). On Distributed Deep Network for Processing Large-Scale Sets of Complex Data. 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC). Hangzhou, China 27 - 28 Aug 2016 London South Bank University.
Using Typography to Expand the Design Space of Data Visualization
Brath, R and Banissi, E (2016). Using Typography to Expand the Design Space of Data Visualization. She Ji: The Journal of Design, Economics, and Innovation. 2 (1), pp. 59-87.