Navegar

Colección

Datos Estadísticas

Artículo

Alves de Lima, A.; Conde, D.; Costabel, J.; Corso, J.; van der Vleuten, C. "A laboratory study on the reliability estimations of the mini-CEX" (2013) Advances in Health Sciences Education. 18(1):5-13
Estamos trabajando para incorporar este artículo al repositorio
Consulte el artículo en la página del editor
Consulte la política de Acceso Abierto del editor

Abstract:

Reliability estimations of workplace-based assessments with the mini-CEX are typically based on real-life data. Estimations are based on the assumption of local independence: the object of the measurement should not be influenced by the measurement itself and samples should be completely independent. This is difficult to achieve. Furthermore, the variance caused by the case/patient or by assessor is completely confounded. We have no idea how much each of these factors contribute to the noise in the measurement. The aim of this study was to use a controlled setup that overcomes these difficulties and to estimate the reproducibility of the mini-CEX. Three encounters were videotaped from 21 residents. The patients were the same for all residents. Each encounter was assessed by 3 assessors who assessed all encounters for all residents. This delivered a fully crossed (all random) two-facet generalizability design. A quarter of the total variance was associated with universe score variance (28%). The largest source of variance was the general error term (34%) followed by the main effect of assessors (18%). Generalizability coefficients indicated that an approximate sample of 9 encounters was needed assuming a single different assessor per encounter and assuming different cases per encounter (the usual situation in real practice), 4 encounters when 2 raters were used and 3 encounters when 3 raters are used. Unexplained general error and the leniency/stringency of assessors are the major causes for unreliability in mini-CEX. To optimize reliability rater training might have an effect. © 2011 The Author(s).

Registro:

Documento: Artículo
Título:A laboratory study on the reliability estimations of the mini-CEX
Autor:Alves de Lima, A.; Conde, D.; Costabel, J.; Corso, J.; van der Vleuten, C.
Filiación:Instituto Cardiovascular de Buenos Aires, Blanco Encalada 1525, 1428 Ciudad de Buenos Aires, Buenos Aires, Argentina
Maastricht University, Maastricht, Netherlands
Palabras clave:Full crossed design; Laboratory study; Mini-CEX; Post-graduate training; Reliability; Residents; Argentina; cardiology; clinical competence; education; female; human; male; medical education; medical staff; procedures; reproducibility; standards; teaching; videorecording; Argentina; Cardiology; Clinical Competence; Education, Medical, Graduate; Educational Measurement; Female; Humans; Male; Medical Staff, Hospital; Patient Simulation; Reproducibility of Results; Videotape Recording
Año:2013
Volumen:18
Número:1
Página de inicio:5
Página de fin:13
DOI: http://dx.doi.org/10.1007/s10459-011-9343-y
Título revista:Advances in Health Sciences Education
Título revista abreviado:Adv. Health Sci. Educ.
ISSN:13824996
Registro:https://bibliotecadigital.exactas.uba.ar/collection/paper/document/paper_13824996_v18_n1_p5_AlvesdeLima

Referencias:

  • Alves de Lima, A., Barrero, C., Baratta, S., Castillo Costa, Y., Bortman, G., Carabajales, J., Validity, reliability, feasibility and satisfaction of the Mini-Clinical Evaluation Exercise (Mini-CEX) for cardiology residency training (2007) Medical Teacher, 29, pp. 785-790
  • Cook, D.A., Beckman, T.J., Mandrekar, J.N., Pankratz, V.S., Internal structure of the mini-CEX for internal medicine residents: factor analysis and generalisability (2010) Advances in Health Sciences Education: Theory Practice, 15, pp. 633-645
  • Cook, K.F., Kallen, M.K., Amtmann, D., Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT's unidimensionality (2009) Assumption Quality of Life Research, 18, pp. 447-460
  • Crossley, J., Davies, H., Humphris, G., Jolly, B., Generalisability: a key to unlock professional assessment (2002) Medical Education, 36, pp. 972-978
  • Durning, S.J., Cation, L.J., Markert, R.J., Pangaro, L.N., Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training (2002) Academic Medicine, 77, pp. 900-904
  • Hill, F., Kendall, K., Galbraith, K., Crossley, J., Implementing the undergraduate mini-CEX: a tailored approach at Southampton University (2009) Medical Education, 43, pp. 326-334
  • Kogan, J.R., Conforti, L., Bernabeo, E., Iobst, W., Holmboe, E., Opening the black box of clinical skills assessment via observation: a conceptual model (2011) Medical Education, 45, pp. 1048-1060
  • Kogan, J.R., Holmboe, E.S., Hauer, K., Tools for direct observation and assessment of clinical skills of medical trainees (2009) Journal of the American Medical Association, 302, pp. 1316-1326
  • Margolis, M.J., Clauser, B.E., Cuddy, M.M., Ciccone, A., Mee, J., Harik, P., Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station skills examination: a validity study (2006) Academic Medicine, 81, pp. S56-S60
  • Norcini, J., Blank, L.L., Duffy, F.D., Fortna, G.S., The Mini-CEX: A method for assessing clinical skills (2003) Annals of Internal Medicine, 138, pp. 476-481
  • Pelgrim, E.A.M., Kramer, A.W.M., Mokkinik, H.G.A., van den Elsen, L., Grol, R.P.T.M., van der Vleuten, C.P.M., In-training assessment using direct observation of single-patient encounters: A literature review (2011) Advances in Health Science Education: Theory and Practice, 16, pp. 131-142
  • van der Vleuten, C.P.M., Schuwirth, L.W.T., Scheele, F., Driessen, E.W., Hodges, B., Currie, R., The assessment of professional competence: Building blocks for theory development (2010) Best Practice & Research. Clinical Obstetrics & Gynaecology, 24, pp. 703-719
  • Weller, J.M., Jolly, B., Misur, M.P., Merry, A.F., Jones, A., Crossley, J.G.M., Mini-clinical evaluation exercise in anesthesia training (2009) British Journal of Anaesthesia, 102, pp. 633-641

Citas:

---------- APA ----------
Alves de Lima, A., Conde, D., Costabel, J., Corso, J. & van der Vleuten, C. (2013) . A laboratory study on the reliability estimations of the mini-CEX. Advances in Health Sciences Education, 18(1), 5-13.
http://dx.doi.org/10.1007/s10459-011-9343-y
---------- CHICAGO ----------
Alves de Lima, A., Conde, D., Costabel, J., Corso, J., van der Vleuten, C. "A laboratory study on the reliability estimations of the mini-CEX" . Advances in Health Sciences Education 18, no. 1 (2013) : 5-13.
http://dx.doi.org/10.1007/s10459-011-9343-y
---------- MLA ----------
Alves de Lima, A., Conde, D., Costabel, J., Corso, J., van der Vleuten, C. "A laboratory study on the reliability estimations of the mini-CEX" . Advances in Health Sciences Education, vol. 18, no. 1, 2013, pp. 5-13.
http://dx.doi.org/10.1007/s10459-011-9343-y
---------- VANCOUVER ----------
Alves de Lima, A., Conde, D., Costabel, J., Corso, J., van der Vleuten, C. A laboratory study on the reliability estimations of the mini-CEX. Adv. Health Sci. Educ. 2013;18(1):5-13.
http://dx.doi.org/10.1007/s10459-011-9343-y