Development of an item bank for a computerised adaptive test of upper-extremity function

Leigh Ann Lehman, Michelle Woodbury, Orit Shechtman, Ying Chih Wang, Jamie Pomeranz, David B. Gray, Craig A. Velozo

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Purpose.The purpose of this study was to determine the psychometric characteristics of an upper-extremity item bank as a precursor to developing a computer adaptive patient reported outcome instrument. The Activity dimension of the World Health Organization's International Classification of Functioning, Disability and Health (ICF) provided the conceptual framework for the items. Method.Factor and Rasch analyses were used to evaluate the psychometric properties of the item bank, including: monotonicity, local independence, dimensionality, item difficulty hierarchy and match between sample ability and item difficulty. Results.Monotonicity of the rating scale was supported. Nine item pairs were locally dependent, and thus one item from each pair was removed from subsequent analyses. There was evidence for two unidimensional constructs; gross upper-extremity and fine hand. Both constructs showed good internal consistency and person separation. In general, the order of item difficulty within each construct replicated the hypothesised item difficulty order. The fine hand construct had a ceiling effect. Conclusions.The above study of our newly developed upper-extremity item bank empirically verified the intended item difficulty order, identified separate constructs (i.e. gross upper-extremity and fine hand) and provided insights into eliminating the ceiling effect of one of the constructs. These findings are critical precursors to the development of upper-extremity components of the ICF Activity Measure, an ICF-based, CAT located on the web at: www.icfmeasure.phhp.ufl.edu.

Original languageEnglish (US)
Pages (from-to)2092-2104
Number of pages13
JournalDisability and Rehabilitation
Volume33
Issue number21-22
DOIs
StatePublished - Oct 11 2011

Fingerprint

Upper Extremity
Hand
Psychometrics
International Classification of Functioning, Disability and Health
Aptitude
Statistical Factor Analysis

Keywords

  • ICF
  • ICF activity measure
  • computer adaptive testing
  • upper-extremity

ASJC Scopus subject areas

  • Rehabilitation

Cite this

Lehman, L. A., Woodbury, M., Shechtman, O., Wang, Y. C., Pomeranz, J., Gray, D. B., & Velozo, C. A. (2011). Development of an item bank for a computerised adaptive test of upper-extremity function. Disability and Rehabilitation, 33(21-22), 2092-2104. https://doi.org/10.3109/09638288.2011.560336

Development of an item bank for a computerised adaptive test of upper-extremity function. / Lehman, Leigh Ann; Woodbury, Michelle; Shechtman, Orit; Wang, Ying Chih; Pomeranz, Jamie; Gray, David B.; Velozo, Craig A.

In: Disability and Rehabilitation, Vol. 33, No. 21-22, 11.10.2011, p. 2092-2104.

Research output: Contribution to journalArticle

Lehman, LA, Woodbury, M, Shechtman, O, Wang, YC, Pomeranz, J, Gray, DB & Velozo, CA 2011, 'Development of an item bank for a computerised adaptive test of upper-extremity function', Disability and Rehabilitation, vol. 33, no. 21-22, pp. 2092-2104. https://doi.org/10.3109/09638288.2011.560336
Lehman LA, Woodbury M, Shechtman O, Wang YC, Pomeranz J, Gray DB et al. Development of an item bank for a computerised adaptive test of upper-extremity function. Disability and Rehabilitation. 2011 Oct 11;33(21-22):2092-2104. https://doi.org/10.3109/09638288.2011.560336
Lehman, Leigh Ann ; Woodbury, Michelle ; Shechtman, Orit ; Wang, Ying Chih ; Pomeranz, Jamie ; Gray, David B. ; Velozo, Craig A. / Development of an item bank for a computerised adaptive test of upper-extremity function. In: Disability and Rehabilitation. 2011 ; Vol. 33, No. 21-22. pp. 2092-2104.
@article{04caaf3e4d814985bec5192f91efba57,
title = "Development of an item bank for a computerised adaptive test of upper-extremity function",
abstract = "Purpose.The purpose of this study was to determine the psychometric characteristics of an upper-extremity item bank as a precursor to developing a computer adaptive patient reported outcome instrument. The Activity dimension of the World Health Organization's International Classification of Functioning, Disability and Health (ICF) provided the conceptual framework for the items. Method.Factor and Rasch analyses were used to evaluate the psychometric properties of the item bank, including: monotonicity, local independence, dimensionality, item difficulty hierarchy and match between sample ability and item difficulty. Results.Monotonicity of the rating scale was supported. Nine item pairs were locally dependent, and thus one item from each pair was removed from subsequent analyses. There was evidence for two unidimensional constructs; gross upper-extremity and fine hand. Both constructs showed good internal consistency and person separation. In general, the order of item difficulty within each construct replicated the hypothesised item difficulty order. The fine hand construct had a ceiling effect. Conclusions.The above study of our newly developed upper-extremity item bank empirically verified the intended item difficulty order, identified separate constructs (i.e. gross upper-extremity and fine hand) and provided insights into eliminating the ceiling effect of one of the constructs. These findings are critical precursors to the development of upper-extremity components of the ICF Activity Measure, an ICF-based, CAT located on the web at: www.icfmeasure.phhp.ufl.edu.",
keywords = "ICF, ICF activity measure, computer adaptive testing, upper-extremity",
author = "Lehman, {Leigh Ann} and Michelle Woodbury and Orit Shechtman and Wang, {Ying Chih} and Jamie Pomeranz and Gray, {David B.} and Velozo, {Craig A.}",
year = "2011",
month = "10",
day = "11",
doi = "10.3109/09638288.2011.560336",
language = "English (US)",
volume = "33",
pages = "2092--2104",
journal = "Disability and Rehabilitation",
issn = "0963-8288",
publisher = "Informa Healthcare",
number = "21-22",

}

TY - JOUR

T1 - Development of an item bank for a computerised adaptive test of upper-extremity function

AU - Lehman, Leigh Ann

AU - Woodbury, Michelle

AU - Shechtman, Orit

AU - Wang, Ying Chih

AU - Pomeranz, Jamie

AU - Gray, David B.

AU - Velozo, Craig A.

PY - 2011/10/11

Y1 - 2011/10/11

N2 - Purpose.The purpose of this study was to determine the psychometric characteristics of an upper-extremity item bank as a precursor to developing a computer adaptive patient reported outcome instrument. The Activity dimension of the World Health Organization's International Classification of Functioning, Disability and Health (ICF) provided the conceptual framework for the items. Method.Factor and Rasch analyses were used to evaluate the psychometric properties of the item bank, including: monotonicity, local independence, dimensionality, item difficulty hierarchy and match between sample ability and item difficulty. Results.Monotonicity of the rating scale was supported. Nine item pairs were locally dependent, and thus one item from each pair was removed from subsequent analyses. There was evidence for two unidimensional constructs; gross upper-extremity and fine hand. Both constructs showed good internal consistency and person separation. In general, the order of item difficulty within each construct replicated the hypothesised item difficulty order. The fine hand construct had a ceiling effect. Conclusions.The above study of our newly developed upper-extremity item bank empirically verified the intended item difficulty order, identified separate constructs (i.e. gross upper-extremity and fine hand) and provided insights into eliminating the ceiling effect of one of the constructs. These findings are critical precursors to the development of upper-extremity components of the ICF Activity Measure, an ICF-based, CAT located on the web at: www.icfmeasure.phhp.ufl.edu.

AB - Purpose.The purpose of this study was to determine the psychometric characteristics of an upper-extremity item bank as a precursor to developing a computer adaptive patient reported outcome instrument. The Activity dimension of the World Health Organization's International Classification of Functioning, Disability and Health (ICF) provided the conceptual framework for the items. Method.Factor and Rasch analyses were used to evaluate the psychometric properties of the item bank, including: monotonicity, local independence, dimensionality, item difficulty hierarchy and match between sample ability and item difficulty. Results.Monotonicity of the rating scale was supported. Nine item pairs were locally dependent, and thus one item from each pair was removed from subsequent analyses. There was evidence for two unidimensional constructs; gross upper-extremity and fine hand. Both constructs showed good internal consistency and person separation. In general, the order of item difficulty within each construct replicated the hypothesised item difficulty order. The fine hand construct had a ceiling effect. Conclusions.The above study of our newly developed upper-extremity item bank empirically verified the intended item difficulty order, identified separate constructs (i.e. gross upper-extremity and fine hand) and provided insights into eliminating the ceiling effect of one of the constructs. These findings are critical precursors to the development of upper-extremity components of the ICF Activity Measure, an ICF-based, CAT located on the web at: www.icfmeasure.phhp.ufl.edu.

KW - ICF

KW - ICF activity measure

KW - computer adaptive testing

KW - upper-extremity

UR - http://www.scopus.com/inward/record.url?scp=80053466177&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80053466177&partnerID=8YFLogxK

U2 - 10.3109/09638288.2011.560336

DO - 10.3109/09638288.2011.560336

M3 - Article

C2 - 21401332

AN - SCOPUS:80053466177

VL - 33

SP - 2092

EP - 2104

JO - Disability and Rehabilitation

JF - Disability and Rehabilitation

SN - 0963-8288

IS - 21-22

ER -