44-5 Development and Initial Validation of the Intake Objective Structured Clinical Examination
Influenced by the competency-based movement, psychologists have begun to reconsider what has been missing in the education and evaluation of psychologists, and advocate the importance of competency- based evaluation in professional psychology. In the last four decades, Objective Structured Clinical Examination (OSCE) has been widely adopted in health-related disciplines to measure clinician's knowledge, skills and attitudes. The purpose of this study was to develop and validate the intake OSCE, a competency-based evaluation for measuring master students' competencies in psychological assessment when conducting an intake interview. The intake OSCE included a standardized patient test (SP test), a follow-up short answer test (S test), and a multiple-choice test (M test). In this study, 27 graduate students in training were recruited to examine the psychometric properties of this test. Results of this study indicated that the Cronbach's alpha values of the total and subscale scores of the SP test were all above .80; and the inter-rater reliability of the S test was .75. The moderate positive correlation between the history taking subscale scores of the SP test and the S test total scores suggested the convergent validity of the intake OSCE. The weak positive association between the M test total scores and the SP subscale scores also indicated the divergent validity of this test. As a newly developed test, intake OSCE demonstrates good reliability and validity. Since the present study only provided initial validation of this test, more research needs to be done to provide further psychometric evidence for the intake OSCE.
Keywords
objective structured clinical examination ； performance assessment ； psychological assessment competency
Download