ORCID Profile
0000-0003-1992-8485
Current Organisation
UNSW Sydney
Does something not look right? The information on this page has been harvested from data sources that may not be up to date. We continue to work with information providers to improve coverage and quality. To report an issue, use the Feedback Form.
Publisher: Informa UK Limited
Date: 09-04-2020
Publisher: JMIR Publications Inc.
Date: 12-09-2016
DOI: 10.2196/JMIR.6299
Abstract: In the interests of patient health outcomes, it is important for medical students to develop clinical communication skills. We previously proposed a telehealth communication skills training platform (EQClinic) with automated nonverbal behavior feedback for medical students, and it was able to improve medical students' awareness of their nonverbal communication. This study aimed to evaluate the effectiveness of EQClinic to improve clinical communication skills of medical students. We conducted a 2-group randomized crossover trial between February and June 2016. Participants were second-year medical students enrolled in a clinical communication skills course at an Australian university. Students were randomly allocated to complete online EQClinic training during weeks 1-5 (group A) or to complete EQClinic training during weeks 8-11 (group B). EQClinic delivered an automated visual presentation of students' nonverbal behavior coupled with human feedback from a standardized patient (SP). All students were offered two opportunities to complete face-to-face consultations with SPs. The two face-to-face consultations were conducted in weeks 6-7 and 12-13 for both groups, and were rated by tutors who were blinded to group allocation. Student-Patient Observed Communication Assessment (SOCA) was collected by blinded assessors (n=28) at 2 time points and also by an SP (n=83). Tutor-rated clinical communications skill in face-to-face consultations was the primary outcome and was assessed with the SOCA. We used t tests to examine the students' performance during face-to-face consultations pre- and postexposure to EQClinic. We randomly allocated 268 medical students to the 2 groups (group A: n=133 group B: n=135). SOCA communication skills measures (score range 4-16) from the first face-to-face consultation were significantly higher for students in group A who had completed EQClinic training and reviewed the nonverbal behavior feedback, compared with group B, who had completed only the course curriculum components (P=.04). Furthermore, at the second face-to-face assessment, the group that completed a teleconsultation between the two face-to-face consultations (group B) showed improved communication skills (P=.005), and the one that had teleconsultations before the first face-to-face consultation (group A) did not show improvement. The EQClinic is a useful tool for medical students' clinical communication skills training that can be applied to university settings to improve students clinical communication skills development.
Publisher: Korea Health Personnel Licensing Examination Institute
Date: 18-07-2018
Abstract: Purpose: The biases that may influence objective structured clinical examination (OSCE) scoring are well understood, and recent research has attempted to establish the magnitude of their impact. However, the influence of examiner experience, clinical seniority, and occupation on communication and physical examination scores in OSCEs has not yet been clearly established. Methods: We compared the mean scores awarded for generic and clinical communication and physical examination skills in 2 undergraduate medicine OSCEs in relation to examiner characteristics (gender, examining experience, occupation, seniority, and speciality). The statistical significance of the differences was calculated using the 2-tailed independent t-test and analysis of variance. Results: Five hundred and seventeen students were examined by 237 examiners at the University of New South Wales in 2014 and 2016. Examiner gender, occupation (academic, clinician, or clinical tutor), and job type (specialist or generalist) did not significantly impact scores. Junior doctors gave consistently higher scores than senior doctors in all domains, and this difference was statistically significant for generic and clinical communication scores. Examiner experience was significantly inversely correlated with generic communication scores. Conclusion: We suggest that the assessment of examination skills may be less susceptible to bias because this process is fairly prescriptive, affording greater scoring objectivity. We recommend training to define the marking criteria, teaching curriculum, and expected level of performance in communication skills to reduce bias in OSCE assessment.
Publisher: Korea Health Personnel Licensing Examination Institute
Date: 11-01-2019
Abstract: Purpose: Optimal methods for communication skills training (CST) are an active research area, but the effects of CST on communication performance in objective structured clinical examinations (OSCEs) has not been closely studied. Student roleplay (RP) for CST is common, although volunteer simulated patient (SP) CST is cost-effective and provides authentic interactions. We assessed whether our volunteer SP CST program improved OSCE performance compared to our previous RP strategy. Methods: We performed a retrospective, quasi-experimental study of 2 second-year medical student cohorts’ OSCE data in Australia. The 2014 cohort received RP-only CST (N=182) while the 2016 cohort received SP-only CST (N=148). The t-test and analysis of variance were used to compare the total scores in 3 assessment domains: generic communication, clinical communication, and physical examination rocedural skills. Results: The baseline characteristics of groups (scores on the Australian Tertiary Admission Rank, Undergraduate Medicine and Health Sciences Admission Test, and medicine program interviews) showed no significant differences between groups. For each domain, the SP-only CST group demonstrated superior OSCE outcomes, and the difference between cohorts was significant (P .01). The superiority of volunteer SP CST over student RP CST in terms of OSCE performance outcomes was found for generic communication, clinical communication, and physical examination rocedural skills. Conclusion: The better performance of the SP cohort in physical examination rocedural skills might be explained by the requirement for patient compliance and cooperation, facilitated by good generic communication skills. We recommend a volunteer SP program as an effective and efficient way to improve CST among junior medical students.
Publisher: Elsevier BV
Date: 05-2019
Publisher: Informa UK Limited
Date: 2016
Abstract: Doctors' verbal and non-verbal communication skills have an impact on patients' health outcomes, so it is important for medical students to develop these skills. Traditional, non-verbal communication skills training can involve a tutor manually annotating a student's non-verbal behaviour during patient-doctor consultations, but this is very time-consuming. Tele-conference systems have been used in verbal communication skills training. We describe EQClinic, a system that enables verbal and non-verbal communication skills training during tele-consultations with simulated patients (SPs), with evaluation exercises promoting reflection. Students and SPs can have tele-consultations through the tele-consultation component. In this component, SPs can provide feedback to students through a thumbs-up/ thumbs-down tool and a comments box. EQClinic automatically analyses communication features in the recorded consultations, such as facial expressions, and provides graphical representations. Our 2015 pilot study investigated whether EQClinic helped students be aware of their non-verbal behaviour and improve their communication skills, and evaluated the usability of the platform. Students received automated feedback, and SP and tutor evaluations, and then completed self-assessment and reflection questionnaires. Eight medical students and three SPs conducted 13 tele-consultations using EQClinic. More students paid attention to their non-verbal communication and students who were engaged in two consultations felt more confident in their second consultation. Students rated the system positively, felt comfortable using it (5.9/7), and reported that the structure (5.4/7) and information (5.8/7) were clear. This pilot provides evidence that EQClinic helps, and positively influences, medical students practise their communication skills with SPs using a tele-conference platform. It is not easy to improve non-verbal communication skills in a short time period. Further evaluation of EQClinic with larger numbers will ascertain learning gains and application in health professional training. Developing a standard model for the assessment of non-verbal behaviour in tele-consultations and providing students with more valuable evaluation and suggestions are part of our future work.
Publisher: Korea Health Personnel Licensing Examination Institute
Date: 23-11-2016
Abstract: Purpose: Peer physical examination (PPE), by which junior medical students learn physical examination skills before practicing on patients, is a widely implemented and accepted part of medical curricula. However, the ethical implications of PPE have been debated, since issues including student gender impact on its acceptability. Research has previously demonstrated the phenomenon of ‘attitude-behavior inconsistency’ showing that students’ predictions about their participation in PPE differ from what they actually do in practice. This study asks whether gender and student self-ratings of outlook affect engagement in PPE. Methods: This study gathered data from students who had completed PPE with the objective of determining what factors have the greatest impact on the actual practice of PPE by students. Data were used to derive the number of opportunities students had to examine a peer, for various body parts. Respondent gender and self-ratings of outlook were recorded. Results: Responses from 130 students were analysed: 74 female (57%) and 56 male (43%). Students have fewer opportunities to examine peers of the opposite gender this is statistically significant for all body parts when male students examine female peers. Conclusion: Gender is the factor of overriding importance on whether these peer interactions actually occur, such that students have fewer opportunities to examine peers of the opposite gender, particularly male students examining female peers. Student outlook has little impact. We speculate that the more acceptable PPE is to participants, paradoxically, the more complicated these interactions become, possibly with implications for future practice.
Publisher: Korea Health Personnel Licensing Examination Institute
Date: 23-09-2021
Abstract: Purpose: It aimed to compare the use of the tele-objective structured clinical examination (teleOSCE) with in-person assessment in high-stakes clinical examination so as to determine the impact of the teleOSCE on the assessment undertaken. Discussion follows regarding what skills and domains can effectively be assessed in a teleOSCE.Methods: This study is a retrospective observational analysis. It compares the results achieved by final year medical students in their clinical examination, assessed using the teleOSCE in 2020 (n=285), with those who were examined using the traditional in-person format in 2019 (n=280). The study was undertaken at the University of New South Wales, Australia.Results: In the domain of physical examination, students in 2020 scored 0.277 points higher than those in 2019 (mean difference=–0.277, P .001, effect size=0.332). Across all other domains, there was no significant difference in mean scores between 2019 and 2020.Conclusion: The teleOSCE does not negatively impact assessment in clinical examination in all domains except physical examination. If the teleOSCE is the future of clinical skills examination, assessment of physical examination will require concomitant workplace-based assessment.
Publisher: Korea Health Personnel Licensing Examination Institute
Date: 27-12-2017
Abstract: Purpose: The objective structured clinical examination (OSCE) is considered to be one of the most robust methods of clinical assessment. One of its strengths lies in its ability to minimise the effects of examiner bias due to the standardisation of items and tasks for each candidate. However, OSCE examiners’ assessment scores are influenced by several factors that may jeopardise the assumed objectivity of OSCEs. To better understand this phenomenon, the current review aims to determine and describe important sources of examiner bias and the factors affecting examiners’ assessments. Methods: We performed a narrative review of the medical literature using Medline. All articles meeting the selection criteria were reviewed, with salient points extracted and synthesised into a clear and comprehensive summary of the knowledge in this area. Results: OSCE examiners’ assessment scores are influenced by factors belonging to 4 different domains: examination context, examinee characteristics, examinee-examiner interactions, and examiner characteristics. These domains are composed of several factors including halo, hawk/dove and OSCE contrast effects the examiner’s gender and ethnicity training lifetime experience in assessing leadership and familiarity with students station type and site effects. Conclusion: Several factors may influence the presumed objectivity of examiners’ assessments, and these factors need to be addressed to ensure the objectivity of OSCEs. We offer insights into directions for future research to better understand and address the phenomenon of examiner bias.
Publisher: Springer Science and Business Media LLC
Date: 06-01-2018
Publisher: Korea Health Personnel Licensing Examination Institute
Date: 06-2021
Abstract: The coronavirus disease 2019 (COVID-19) pandemic has required educators to adapt the in-person objective structured clinical examination (OSCE) to online settings in order for it to remain a critical component of the multifaceted assessment of a student’s competency. This systematic scoping review aimed to summarize the assessment methods and validity and reliability of the measurement tools used in current online OSCE (hereafter, referred to as teleOSCE) approaches. A comprehensive literature review was undertaken following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. Articles were eligible if they reported any form of performance assessment, in any field of healthcare, delivered in an online format. Two reviewers independently screened the results and analyzed relevant studies. Eleven articles were included in the analysis. Pre-recorded videos were used in 3 studies, while observations by remote examiners through an online platform were used in 7 studies. Acceptability as perceived by students was reported in 2 studies. This systematic scoping review identified several insights garnered from implementing teleOSCEs, the components transferable from telemedicine, and the need for systemic research to establish the ideal teleOSCE framework. TeleOSCEs may be able to improve the accessibility and reproducibility of clinical assessments and equip students with the requisite skills to effectively practice telemedicine in the future.
Location: United Kingdom of Great Britain and Northern Ireland
Location: United Kingdom of Great Britain and Northern Ireland
Start Date: 2014
End Date: 2014
Funder: Department of Health, Australian Government
View Funded ActivityStart Date: 2015
End Date: 2015
Funder: Department of Health, Australian Government
View Funded Activity