A Variant Q-Sorting Methodology for Building Diagnostic Trees

Journal article


Sabbaghan, S., Chua, C. and Gardner, L. (2021). A Variant Q-Sorting Methodology for Building Diagnostic Trees. IEEE Transactions on Engineering Management. https://doi.org/10.1109/TEM.2021.3078582.
AuthorsSabbaghan, S., Chua, C. and Gardner, L.
Abstract

Diagnostic theories are fundamental to information system (IS) practice and are represented as trees. While there are approaches for validating diagnostic trees, these validate the overall performance of the tree rather than identifying ways incorrect diagnoses can occur. It is important to fully validate diagnostic trees because even if the tree gives the correct decision “most of the time,” it is possible for incorrect decisions traveling down little-used branches of the tree to result in catastrophic decisions. In this article, we describe the process of using a variant of q-sorting to validate diagnostic trees. In this methodology, diagnostic trees that independent experts develop are transformed into a quantitative form, and that quantitative form is tested to determine the inter-rater reliability of the individual branches in the tree. The trees are then successively transformed to incrementally test if they branch in the same way. The results help researchers not only identify quality items for use in a diagnostic tree but also facilitate diagnoses of problems with those items and facilitate the reconciliation of discrepant trees by experts. The methodology validates not only the whole tree but also its subparts.

KeywordsDiagnostic theories , diagnostic-tree , inter-rater reliability , q-sorting , tree
Year2021
JournalIEEE Transactions on Engineering Management
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Digital Object Identifier (DOI)https://doi.org/10.1109/TEM.2021.3078582.
Web address (URL)https://ieeexplore.ieee.org/document/9445573/keywords#keywords
Publication dates
Print02 Jun 2021
Publication process dates
Accepted02 Jun 2021
Deposited30 Sep 2021
Accepted author manuscript
License
File Access Level
Open
Additional information

This article has been accepted for inclusion in a future issue of this journal and its content is final as presented with the exception of pagination and issue designation.

Permalink -

https://openresearch.lsbu.ac.uk/item/8x678

Download files


Accepted author manuscript
  • 9
    total views
  • 5
    total downloads
  • 8
    views this month
  • 1
    downloads this month

Export as

Related outputs

Statistical measurement of trees’ similarity
Sabbaghan, S., Cecil Eng Huang Chua and Lesley Ann Gardner (2020). Statistical measurement of trees’ similarity. Quality and Quantity: international journal of methodology. https://doi.org/10.1007/s11135-019-00957-8
A test of a computer-adaptive survey using online reviews
Sabbaghan, S, Chua, CEH and Gardner, LA (2018). A test of a computer-adaptive survey using online reviews.
A threshold for a q-sorting methodology for computer-adaptive surveys
Sabbaghan, S, Gardner, L and Chua, CEH (2017). A threshold for a q-sorting methodology for computer-adaptive surveys. pp. 2896-2906
Computer-Adaptive Surveys (CAS) as a means of answering questions of why
Sabbaghan, S, Gardner, L and Chua, CEH (2017). Computer-Adaptive Surveys (CAS) as a means of answering questions of why.
A Q-sorting methodology for Computer-Adaptive Surveys - Style "Research"
Sabbaghan, S, Gardner, L and Chua, CEH (2016). A Q-sorting methodology for Computer-Adaptive Surveys - Style "Research".