Quality evaluation of controlled clinical information service trials.

E. A. Balas, S. M. Austin, G. D. Brown, J. A. Mitchell

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

Randomized controlled clinical trials are increasingly accepted as tools of computer technology assessment and, therefore, quality evaluation of trials has great theoretical and practical significance. The purpose of this study was to assist the design of evaluation studies and synthesis of published results by developing and validating an easy-to-use quality scoring method. The development of the new scoring system was based on the available quality evaluation methods and the analysis of 19 trial reports registered in the Columbia Registry of Controlled Clinical Information Service Trials. First critical aspects and afterwards the levels of quality were defined. In spite of the fact that all quality requirements were met by some trials, the average overall quality score was 52.6 (+/- 8.7) per cent. The minimum score was 37 and the maximum was 72 per cent. Data collection and site/sample definition were better in the good quality trials, but improvement in statistical analysis was erratic. The quality scoring method was validated by using another sample of 20 registered trials. While the number of published controlled clinical trials is increasing in medical informatics, the analysis was unable to demonstrate a significant positive correlation between the quality and year of publication.

Original languageEnglish (US)
Pages (from-to)586-590
Number of pages5
JournalProceedings / the ... Annual Symposium on Computer Application [sic] in Medical Care. Symposium on Computer Applications in Medical Care
StatePublished - Jan 1 1993
Externally publishedYes

Fingerprint

Information Services
Research Design
Medical Informatics
Biomedical Technology Assessment
Controlled Clinical Trials
Quality Improvement
Registries
Publications
Randomized Controlled Trials

Cite this

@article{550da6802a0b46bbbeae9f5ad377717d,
title = "Quality evaluation of controlled clinical information service trials.",
abstract = "Randomized controlled clinical trials are increasingly accepted as tools of computer technology assessment and, therefore, quality evaluation of trials has great theoretical and practical significance. The purpose of this study was to assist the design of evaluation studies and synthesis of published results by developing and validating an easy-to-use quality scoring method. The development of the new scoring system was based on the available quality evaluation methods and the analysis of 19 trial reports registered in the Columbia Registry of Controlled Clinical Information Service Trials. First critical aspects and afterwards the levels of quality were defined. In spite of the fact that all quality requirements were met by some trials, the average overall quality score was 52.6 (+/- 8.7) per cent. The minimum score was 37 and the maximum was 72 per cent. Data collection and site/sample definition were better in the good quality trials, but improvement in statistical analysis was erratic. The quality scoring method was validated by using another sample of 20 registered trials. While the number of published controlled clinical trials is increasing in medical informatics, the analysis was unable to demonstrate a significant positive correlation between the quality and year of publication.",
author = "Balas, {E. A.} and Austin, {S. M.} and Brown, {G. D.} and Mitchell, {J. A.}",
year = "1993",
month = "1",
day = "1",
language = "English (US)",
pages = "586--590",
journal = "Proceedings / the ... Annual Symposium on Computer Application [sic] in Medical Care. Symposium on Computer Applications in Medical Care",
issn = "0195-4210",

}

TY - JOUR

T1 - Quality evaluation of controlled clinical information service trials.

AU - Balas, E. A.

AU - Austin, S. M.

AU - Brown, G. D.

AU - Mitchell, J. A.

PY - 1993/1/1

Y1 - 1993/1/1

N2 - Randomized controlled clinical trials are increasingly accepted as tools of computer technology assessment and, therefore, quality evaluation of trials has great theoretical and practical significance. The purpose of this study was to assist the design of evaluation studies and synthesis of published results by developing and validating an easy-to-use quality scoring method. The development of the new scoring system was based on the available quality evaluation methods and the analysis of 19 trial reports registered in the Columbia Registry of Controlled Clinical Information Service Trials. First critical aspects and afterwards the levels of quality were defined. In spite of the fact that all quality requirements were met by some trials, the average overall quality score was 52.6 (+/- 8.7) per cent. The minimum score was 37 and the maximum was 72 per cent. Data collection and site/sample definition were better in the good quality trials, but improvement in statistical analysis was erratic. The quality scoring method was validated by using another sample of 20 registered trials. While the number of published controlled clinical trials is increasing in medical informatics, the analysis was unable to demonstrate a significant positive correlation between the quality and year of publication.

AB - Randomized controlled clinical trials are increasingly accepted as tools of computer technology assessment and, therefore, quality evaluation of trials has great theoretical and practical significance. The purpose of this study was to assist the design of evaluation studies and synthesis of published results by developing and validating an easy-to-use quality scoring method. The development of the new scoring system was based on the available quality evaluation methods and the analysis of 19 trial reports registered in the Columbia Registry of Controlled Clinical Information Service Trials. First critical aspects and afterwards the levels of quality were defined. In spite of the fact that all quality requirements were met by some trials, the average overall quality score was 52.6 (+/- 8.7) per cent. The minimum score was 37 and the maximum was 72 per cent. Data collection and site/sample definition were better in the good quality trials, but improvement in statistical analysis was erratic. The quality scoring method was validated by using another sample of 20 registered trials. While the number of published controlled clinical trials is increasing in medical informatics, the analysis was unable to demonstrate a significant positive correlation between the quality and year of publication.

UR - http://www.scopus.com/inward/record.url?scp=0027755633&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0027755633&partnerID=8YFLogxK

M3 - Article

C2 - 8130541

AN - SCOPUS:0027755633

SP - 586

EP - 590

JO - Proceedings / the ... Annual Symposium on Computer Application [sic] in Medical Care. Symposium on Computer Applications in Medical Care

JF - Proceedings / the ... Annual Symposium on Computer Application [sic] in Medical Care. Symposium on Computer Applications in Medical Care

SN - 0195-4210

ER -