Skip to main page content

• HOME
• Current
• Past issues
• Contact us
• Subscribe
• Sign up for e-Alerts
• Help

This Article Full Text Full Text (PDF) All Versions of this Article: ptj.20080137v1 90/7/1026    most recent Submit a response Alert me when this article is cited Alert me when Rapid Responses are posted Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Google Scholar Articles by Miller, P. A. Articles by Eva, K. W. PubMed PubMed Citation Articles by Miller, P. A. Articles by Eva, K. W. Related Collections Clinical Competence Professional Issues Social Bookmarking                      What's this?

Psychometric Properties of a Peer-Assessment Program to Assess Continuing Competence in Physical Therapy

P.A. Miller, PT, PhD, is Associate Clinical Professor, School of Rehabilitation Science, McMaster University, IAHS Room 403, 1400 Main St West, Hamilton, Ontario, Canada, L8S 1C7, and currently holds the Raymond and Margaret Labarge Post-doctoral Fellowship for Research and Knowledge Application for Optimal Aging, School of Social Work, McMaster University.
M. Nayer, PT, PhD, is Lecturer, Department of Physical Therapy, University of Toronto, Toronto, Ontario, Canada. At the time this work was completed, she was Director, Quality Management, College of Physiotherapists of Ontario, Toronto, Ontario, Canada.
K.W. Eva, PhD, is Associate Professor, Department of Clinical Epidemiology and Biostatistics, McMaster University.

Address all correspondence to Dr Miller at: pmiller{at}mcmaster.ca.

Background: The College of Physiotherapists of Ontario implemented an Onsite Assessment to evaluate the continuing competence of physical therapists.

Objective: This study was undertaken to examine the reliability of the various tools used in the Onsite Assessment and to consider the relationship between the final decision and demographic factors.

Design: This was a psychometric study.

Methods: Trained peer assessors (n=63) visited randomly selected physical therapists (n=106) in their workplace. Fifty-three physical therapists were examined by 2 assessors simultaneously. The assessment included a review of practice issues, record keeping, billing practices, the physical therapist's professional portfolio, and a chart-stimulated recall process. The Quality Management Committee made the final decision regarding the physical therapist's performance using the assessor's summary report. Generalizability theory was used to examine the interrater reliability of the tools. Correlation coefficients and regression analyses were used to examine the relationships between demographic factors and performance.

Results: The majority of the physical therapists (88%) completed the program successfully, 11% required remediation, and 1% required further assessment. The interrater reliability of the components was above .70 for 2 raters’ evaluations, with the exception of billing practices. There was no relationship between the final decision and age or years since graduation (r<.05).

Limitations: Limitations include a small sample and a lack of data on system-related factors that might influence performance.

Conclusions: The vast majority of the physical therapists met the College of Physiotherapists of Ontario's professional standards. Reliability analysis indicated that the number of charts reviewed could be reduced. Strategies to improve the reliability of the various components must take into account feasibility issues related to financial and human resources. Further research to examine factors associated with failure to adhere to professional standards should be considered. These results can provide valuable information to regulatory agencies or managers considering similar continuing competence assessment programs.

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?