Conceptualising spaced learning in health professions education: A scoping review · Versteeg M, Hendriks RA, Thomas A et al.

References

  1. Cepeda NJ , Coburn N , Rohrer D , Wixted JT , Mozer MC , Pashler H . Optimizing distributed practice: theoretical analysis and practical implications. Exp Psychol. 2009;56:236‐246.1943939510.1027/1618-3169.56.4.236
  2. Carpenter SK , Cepeda NJ , Rohrer D , Kang SH , Pashler H . Using spacing to enhance diverse forms of learning: review of recent research and implications for instruction. Educ Psychol Rev. 2012;24:369‐378.
  3. Schneid SD , Pashler H , Armour C . How much basic science content do second‐year medical students remember from their first year? Med Teach. 2018;41:231‐233.2936189810.1080/0142159X.2018.1426845
  4. Weggemans MM , Custers EJ , ten Cate OTJ . Unprepared retesting of first year knowledge: how much do second year medical students remember? Med Sci Educ. 2017;27:597‐605.
  5. Simanton E , Hansen L . Long‐term retention of information across the undergraduate medical school curriculum. South Dakota Med. 2012;65:261‐263.22866346
  6. Sullivan PB , Gregg N , Adams E , Rodgers C , Hull J . How much of the paediatric core curriculum do medical students remember? Adv Health Sci Educ. 2013;18:365‐373.10.1007/s10459-012-9375-y22566036
  7. Marcel FD . Knowledge loss of medical students on first year basic science courses at the University of Saskatchewan. BMC Med Educ. 2006;6:5.1641224110.1186/1472-6920-6-5PMC1397826
  8. Yeh DD , Park YS . Improving learning efficiency of factual knowledge in medical education. J Surg Educ. 2015;72:882‐889.2592057310.1016/j.jsurg.2015.03.012
  9. Augustin M . How to learn effectively in medical school: test yourself, learn actively, and repeat in intervals. Yale J Biol Med. 2014;87:207‐212.24910566PMC4031794
  10. Friedlander MJ , Andrews L , Armstrong EG , et al. What can medical education learn from the neurobiology of learning? Acad Med. 2011;86:415‐420.2134650410.1097/ACM.0b013e31820dc197
  11. Phillips JL , Heneka N , Bhattarai P , Fraser C , Shaw T . Effectiveness of the spaced education pedagogy for clinicians’ continuing professional development: a systematic review. Med Educ. 2019;53:886‐902.3114434810.1111/medu.13895
  12. Van Hoof TJ , Doyle TJ . Learning science as a potential new source of understanding and improvement for continuing education and continuing professional development. Med Teach. 2018;40:880‐885.2933430610.1080/0142159X.2018.1425546
  13. Cepeda NJ , Vul E , Rohrer D , Wixted JT , Pashler H . Spacing effects in learning: a temporal ridgeline of optimal retention. Psychol Sci. 2008;19:1095‐1102.1907648010.1111/j.1467-9280.2008.02209.x
  14. Arksey H , O'Malley L . Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8:19‐32.
  15. Levac D , Colquhoun H , O'Brien KK . Scoping studies: advancing the methodology. Implement Sci. 2010;5:69.2085467710.1186/1748-5908-5-69PMC2954944
  16. Mateen F , Oh J , Tergas A , Bhayani N , Kamdar B . Titles versus titles and abstracts for initial screening of articles for systematic reviews. Clin Epidemiol. 2013;5:89‐95.2352633510.2147/CLEP.S43118PMC3604876
  17. Thomas A , Lubarsky S , Durning SJ , Young ME . Knowledge syntheses in medical education: demystifying scoping reviews. Acad Med. 2017;92:161‐166.2778291810.1097/ACM.0000000000001452
  18. Al‐Rawi W , Easterling L , Edwards PC . Development of a mobile device optimized cross platform‐compatible oral pathology and radiology spaced repetition system for dental education. J Dent Educ. 2015;79:439‐447.25838016
  19. Boespflug A , Guerra J , Dalle S , Thomas L . Enhancement of customary dermoscopy education with spaced education e‐learning: a prospective controlled trial. JAMA Dermatol. 2015;151:847‐853.2590233910.1001/jamadermatol.2015.0214
  20. Bruckel J , Carballo V , Kalibatas O , et al. Use of spaced education to deliver a curriculum in quality, safety and value for postgraduate medical trainees: trainee satisfaction and knowledge. Postgrad Med J. 2016;92:137‐144.2673984610.1136/postgradmedj-2015-133446
  21. Dobson JL . Effect of selected “desirable difficulty” learning strategies on the retention of physiology information. Adv Physiol Educ. 2011;35:378‐383.2213977410.1152/advan.00039.2011
  22. Flett KB , Bousvaros A , Carpenter J , Millrinen CE , Martin P , Sandora TJ . Reducing redundant anaerobic therapy through spaced education and antimicrobial stewardship interventions. J Pediatric Infect Dis Soc. 2017;7:317‐322.10.1093/jpids/pix09029165636
  23. Gandhi M , Beasley A , Vinas E , Sangi‐Haghpeykar H , Ramin SM , Kilpatrick CC . Electronic learning‐spaced education to facilitate resident knowledge and guide program didactics. Obstet Gynecol. 2016;128:S23‐S26.10.1097/AOG.000000000000157627662002
  24. Gyorki DE , Shaw T , Nicholson J , et al. Improving the impact of didactic resident training with online spaced education. ANZ J Surg. 2013;83:477‐480.2361760710.1111/ans.12166
  25. Hernick M . Test‐enhanced learning in an immunology and infectious disease medicinal chemistry/pharmacology course. Am J Pharm Educ. 2015;79:97.2716861010.5688/ajpe79797PMC4812785
  26. Horn S , Hernick M . Improving student understanding of lipids concepts in a biochemistry course using test‐enhanced learning. Chem Educ Res Pract. 2015;16:918‐928.
  27. Kerfoot BP . Adaptive spaced education improves learning efficiency: a randomized controlled trial. J Urol. 2010;183:678‐681.2002203210.1016/j.juro.2009.10.005
  28. Kerfoot BP . Learning benefits of on‐line spaced education persist for 2 years. J Urol. 2009;181:2671‐2673.1937509510.1016/j.juro.2009.02.024
  29. Kerfoot BP . Interactive spaced education versus web based modules for teaching urology to medical students: a randomized controlled trial. J Urol. 2008;179:2351‐2356; discussion 2356‐2357.1842371510.1016/j.juro.2008.01.126
  30. Kerfoot BP , Armstrong EG , O'Sullivan PN . Interactive spaced‐education to teach the physical examination: a randomized controlled trial. J Gen Intern Med. 2008;23:973‐978.1861272710.1007/s11606-008-0533-0PMC2517927
  31. Kerfoot BP , Baker H . An online spaced‐education game for global continuing medical education: a randomized trial. Ann Surg. 2012;256:33‐38.2266455810.1097/SLA.0b013e31825b3912
  32. Kerfoot BP , Baker H . An online spaced‐education game to teach and assess residents: a multi‐institutional prospective trial. J Am Coll Surg. 2012;214:367‐373.2222564710.1016/j.jamcollsurg.2011.11.009
  33. Kerfoot BP , Baker H , Pangaro L , et al. An online spaced‐education game to teach and assess medical students: a multi‐institutional prospective trial. Acad Med. 2012;87:1443‐1449.2291452410.1097/ACM.0b013e318267743a
  34. Kerfoot BP , Baker HE , Koch MO , Connelly D , Joseph DB , Ritchey ML . Randomized, controlled trial of spaced education to urology residents in the United States and Canada. J Urol. 2007;177:1481‐1487.1738276010.1016/j.juro.2006.11.074
  35. Kerfoot BP , Brotschi E . Online spaced education to teach urology to medical students: a multi‐institutional randomized trial. Am J Surg. 2009;197:89‐95.1861414510.1016/j.amjsurg.2007.10.026
  36. Kerfoot BP , DeWolf WC , Masser BA , Church PA , Federman DD . Spaced education improves the retention of clinical knowledge by medical students: a randomised controlled trial. Med Educ. 2007;41:23‐31.1720988910.1111/j.1365-2929.2006.02644.x
  37. Kerfoot BP , Fu Y , Baker H , Connelly D , Ritchey ML , Genega EM . Online spaced education generates transfer and improves long‐term retention of diagnostic skills: a randomized controlled trial. J Am Coll Surg. 2010;211:331‐337.2080018910.1016/j.jamcollsurg.2010.04.023
  38. Kerfoot BP , Kearney MC , Connelly D , Ritchey ML . Interactive spaced education to assess and improve knowledge of clinical practice guidelines: a randomized controlled trial. Ann Surg. 2009;249:744‐749.1938733610.1097/SLA.0b013e31819f6db8
  39. Kerfoot BP , Lawler EV , Sokolovskaya G , Gagnon D , Conlin PR . Durable improvements in prostate cancer screening from online spaced education a randomized controlled trial. Am J Prev Med. 2010;39:472‐478.2096538710.1016/j.amepre.2010.07.016PMC2994103
  40. Kerfoot BP , Shaffer K , McMahon GT , et al. Online “spaced education progress‐testing” of students to confront two upcoming challenges to medical schools. Acad Med. 2011;86:300‐306.2124860010.1097/ACM.0b013e3182087bef
  41. Kerfoot BP , Turchin A , Breydo E , Gagnon D , Conlin PR . An online spaced‐education game among clinicians improves their patients’ time to blood pressure control: a randomized controlled trial. Circ Cardiovasc Qual Outcomes. 2014;7:468‐474.2484708410.1161/CIRCOUTCOMES.113.000814PMC4040124
  42. Mathes EF , Frieden IJ , Cho CS , Boscardin CK . Randomized controlled trial of spaced education for pediatric residency education. J Grad Med Educ. 2014;6:270‐274.2494913010.4300/JGME-D-13-00056.1PMC4054725
  43. Matos J , Petri CR , Mukamal KJ , Vanka A . Spaced education in medical residents: an electronic intervention to improve competency and retention of medical knowledge. PLoS One. 2017;12:e0181418.2875960610.1371/journal.pone.0181418PMC5536283
  44. Matzie KA , Kerfoot BP , Hafler JP , Breen EM . Spaced education improves the feedback that surgical residents give to medical students: a randomized trial. Am J Surg. 2009;197:252‐257.1872258510.1016/j.amjsurg.2008.01.025
  45. Miller JO , Thammasitboon S , Hsu DC , Shah MI , Minard CG , Graf JM . Continuing medical education for air medical providers: the successes and challenges. Pediatr Emerg Care. 2016;32:87‐92.2684111110.1097/PEC.0000000000000416
  46. Nakata BN , Cavalini W , Bonin EA , Salvalaggio PR , Loureiro MP . Impact of continuous training through distributed practice for acquisition of minimally invasive surgical skills. Surg Endosc. 2017;31:4051‐4057.2823601510.1007/s00464-017-5451-y
  47. Nkenke E , Vairaktaris E , Bauersachs A , et al. Spaced education activates students in a theoretical radiological science course: A pilot study. BMC Med Educ. 2012;12:32.2262140910.1186/1472-6920-12-32PMC3517336
  48. Ojha R , Liu A , Champion BL , Hibbert E , Nanan RK . Spaced scenario demonstrations improve knowledge and confidence in pediatric acute illness management. Front Pediatr. 2014;2:133.2550578010.3389/fped.2014.00133PMC4241830
  49. Patocka C , Khan F , Dubrovsky AS , Brody D , Bank I , Bhanji F . Pediatric resuscitation training‐instruction all at once or spaced over time? Resuscitation. 2015;88:6‐11.2551151910.1016/j.resuscitation.2014.12.003
  50. Raman M , McLaughlin K , Violato C , Rostom A , Allard JP , Coderre S . Teaching in small portions dispersed over time enhances long‐term knowledge retention. Med Teach. 2010;32:250‐255.2021884110.3109/01421590903197019
  51. Shaikh U , Afsar‐Manesh N , Amin AN , Clay B , Ranji SR . Using an online quiz‐based reinforcement system to teach healthcare quality and patient safety and care transitions at the University of California. Int J Qual Health Care. 2017;29:735‐739.2899214910.1093/intqhc/mzx093
  52. Shaw T , Long A , Chopra S , Kerfoot BP . Impact on clinical behavior of face‐to‐face continuing medical education blended with online spaced education: a randomized controlled trial. J Contin Educ Health Prof. 2011;31:103‐108.2167127610.1002/chp.20113
  53. Shaw TJ , Pernar LI , Peyre SE , et al. Impact of online education on intern behaviour around joint commission national patient safety goals: a randomised trial. BMJ Qual Saf. 2012;21:819‐825.10.1136/bmjqs-2011-000702PMC406882322706930
  54. Shenoi R , Rubalcava D , Naik‐Mathuria B , et al. Interactive spaced online education in pediatric trauma. Sage Open. 2016;6:215824401665316.
  55. Smeds MR , Thrush CR , Mizell JS , Berry KS , Bentley FR . Mobile spaced education for surgery rotation improves National Board of Medical Examiners scores. J Surg Res. 2016;201:99‐104.2685019010.1016/j.jss.2015.10.010
  56. Spruit EN , Band GP , Hamming JF . Increasing efficiency of surgical training: effects of spacing practice on skill acquisition and retention in laparoscopy training. Surg Endosc. 2015;29:2235‐2243.2531837210.1007/s00464-014-3931-x
  57. Taveira‐Gomes T , Saffarzadeh A , Severo M , Guimaraes MJ , Ferreira MA . A novel collaborative e‐learning platform for medical students—ALERT STUDENT. BMC Med Educ. 2014;14:143.2501702810.1186/1472-6920-14-143PMC4131539
  58. Bekkink MO , Donders R , van Muijen GNP , Ruiter DJ . Challenging medical students with an interim assessment: a positive effect on formal examination score in a randomized controlled study. Adv Health Sci Educ. 2012;17:27‐37.10.1007/s10459-011-9291-6PMC327467421442416
  59. Burdo J , O'Dwyer L . The effectiveness of concept mapping and retrieval practice as learning strategies in an undergraduate physiology course. Adv Physiol Educ. 2015;39:335‐340.2662865710.1152/advan.00041.2015
  60. Dobson JL , Perez J , Linderholm T . Distributed retrieval practice promotes superior recall of anatomy information. Anat Sci Educ. 2017;10:339‐347.2786039610.1002/ase.1668
  61. Freda NM , Lipp MJ . Test‐enhanced learning in competence‐based predoctoral orthodontics: a four‐year study. J Dent Educ. 2016;80:348‐354.26933111
  62. Galvagno SM Jr , Segal BS . Critical action procedures testing: a novel method for test‐enhanced learning. Med Educ. 2009;43:1182‐1187.1993050910.1111/j.1365-2923.2009.03533.x
  63. Jackson TH , Hannum WH , Koroluk L , Proffit WR . Effectiveness of web‐based teaching modules: test‐enhanced learning in dental education. J Dent Educ. 2011;75:775‐781.21642523
  64. Kerfoot BP , Kearney MC , Connelly D , Ritchey ML . Interactive spaced education to assess and improve knowledge of clinical practice guidelines: a randomized controlled trial. Ann Surg. 2009;249:744‐749.1938733610.1097/SLA.0b013e31819f6db8
  65. Larsen DP , Butler AC , Lawson AL , Roediger HL 3rd . The importance of seeing the patient: test‐enhanced learning with standardized patients and written tests improves clinical application of knowledge. Adv Health Sci Educ Theory Pract. 2013;18:409‐425.2261885610.1007/s10459-012-9379-7
  66. Terenyi J , Anksorus H , Persky AM . Impact of spacing of practice on learning brand name and generic drugs. Am J Pharm Educ. 2018;82:6179.2949149910.5688/ajpe6179PMC5822942
  67. Andersen SA , Konge L , Caye‐Thomasen P , Sorensen MS . Retention of mastoidectomy skills after virtual reality simulation training. JAMA Otolaryngol Head Neck Surg. 2016;142:635‐640.2712450610.1001/jamaoto.2016.0454
  68. Andersen SA , Mikkelsen PT , Konge L , Caye‐Thomasen P , Sorensen MS . Cognitive load in distributed and massed practice in virtual reality mastoidectomy simulation. Laryngoscope. 2016;126:E74‐E79.2615378310.1002/lary.25449
  69. Dobson JL . Effect of uniform versus expanding retrieval practice on the recall of physiology information. Adv Physiol Educ. 2012;36:6‐12.2238340610.1152/advan.00090.2011
  70. Baghdady M , Carnahan H , Lam EW , Woods NN . Test‐enhanced learning and its effect on comprehension and diagnostic accuracy. Med Educ. 2014;48:181‐188.2452840010.1111/medu.12302
  71. Spreckelsen C , Juenger J . Repeated testing improves achievement in a blended learning approach for risk competence training of medical students: Results of a randomized controlled trial. BMC Med Educ. 2017;17:177.2895085510.1186/s12909-017-1016-yPMC5615441
  72. Breckwoldt J , Ludwig JR , Plener J , Schroder T , Gruber H , Peters H . Differences in procedural knowledge after a “spaced” and a “massed” version of an intensive course in emergency medicine, investigating a very short spacing interval. BMC Med Educ. 2016;16:249.2767078210.1186/s12909-016-0770-6PMC5037615
  73. Bude L , Imbos T , van de Wiel MW , Berger MP . The effect of distributed practice on students’ conceptual understanding of statistics. High Educ. 2011;62:69‐79.10.1348/000709910X51393321542821
  74. Scales CD Jr , Moin T , Fink A , et al. A randomized, controlled trial of team‐based competition to increase learner participation in quality‐improvement education. Int J Qual Health Care. 2016;28:227‐232.2685794110.1093/intqhc/mzw008
  75. Boettcher M , Boettcher J , Mietzsch S , Krebs T , Bergholz R , Reinshagen K . The spaced learning concept significantly improves training for laparoscopic suturing: a pilot randomized controlled study. Surg Endosc. 2018;32:154‐159.2864305210.1007/s00464-017-5650-6
  76. Schoeff S , Hernandez B , Robinson DJ , Jameson MJ , Shonka DC Jr . Microvascular anastomosis simulation using a chicken thigh model: Interval versus massed training. Laryngoscope. 2017;127:2490‐2494.2840726410.1002/lary.26586
  77. Pashler H , Rohrer D , Cepeda NJ , Carpenter SK . Enhancing learning and retarding forgetting: choices and consequences. Psychon Bull Rev. 2007;14:187‐193.1769489910.3758/bf03194050
  78. Barsoumian AE , Yun HC . Augmenting fellow education through spaced multiple‐choice questions. Mil Med. 2018;183:e122‐e126.2940133210.1093/milmed/usx020
  79. Blazek MC , Dantz B , Wright MC , Fiedorowicz JG . Spaced learning using emails to integrate psychiatry into general medical curriculum: keep psychiatry in mind. Med Teach. 2016;38:1049‐1055.2702638010.3109/0142159X.2016.1150982
  80. Larsen DP , Butler AC , Aung WY , Corboy JR , Friedman DI , Sperling MR . The effects of test‐enhanced learning on long‐term retention in AAN annual meeting courses. Neurology. 2015;84:748‐754.2560976110.1212/WNL.0000000000001264PMC4336103
  81. Pernar LI , Corso K , Lipsitz SR , Breen E . Using spaced education to teach interns about teaching skills. Am J Surg. 2013;206:120‐127.2333268910.1016/j.amjsurg.2012.05.034
  82. Phillips JL , Heneka N , Hickman L , Lam L , Shaw T . Can a complex online intervention improve cancer nurses’ pain screening and assessment practices? Results from a multicenter, pre‐post test pilot study. Pain Manag Nurs. 2017;18:75‐89.2836332610.1016/j.pmn.2017.01.003
  83. Phillips JL , Heneka N , Hickman L , Lam L , Shaw T . Impact of a novel online learning module on specialist palliative care nurses’ pain assessment competencies and patients’ reports of pain: Results from a quasi‐experimental pilot study. Palliat Med. 2014;28:521‐529.2468564910.1177/0269216314527780
  84. Robinson T , Janssen A , Kirk J , et al. New approaches to continuing medical education: a QStream (spaced education) program for research translation in ovarian cancer. J Cancer Educ. 2017;32:476‐482.2657404110.1007/s13187-015-0944-7PMC5543185
  85. Tshibwabwa E , Mallin R , Fraser M , et al. An integrated interactive‐spaced education radiology curriculum for preclinical students. J Clin Imaging Sci. 2017;7:22.2858468910.4103/jcis.JCIS_1_17PMC5450459
  86. Akdemir A , Zeybek B , Ergenoglu AM , Yeniel AO , Sendag F . Effect of spaced training with a box trainer on the acquisition and retention of basic laparoscopic skills. Int J Gynaecol Obstet. 2014;127:309‐313.2517641410.1016/j.ijgo.2014.07.015
  87. Andersen SA , Konge L , Caye‐Thomasen P , Sorensen MS . Learning curves of virtual mastoidectomy in distributed and massed practice. JAMA Otolaryngol Head Neck Surg. 2015;141:913‐918.2633461010.1001/jamaoto.2015.1563
  88. Bjerrum AS , Eika B , Charles P , Hilberg O . Distributed practice. The more the merrier? A randomised bronchoscopy simulation study. Med Educ Online. 2016;21(1):30517.2717242310.3402/meo.v21.30517PMC4864846
  89. Connor EV , Raker C , Wohlrab KJ . Effects of repetition and inactivity on laparoscopic skills training. J Minim Invasive Gynecol. 2016;23:194‐197.2639105710.1016/j.jmig.2015.09.008
  90. Ernst KD , Cline WL , Dannaway DC , et al. Weekly and consecutive day neonatal intubation training: comparable on a pediatrics clerkship. Acad Med. 2014;89:505‐510.2444803610.1097/ACM.0000000000000150
  91. Fann JI , Caffarelli AD , Georgette G , et al. Improvement in coronary anastomosis with cardiac surgery simulation. J Thorac Cardiovasc Surg. 2008;136:1486‐1491.1911419510.1016/j.jtcvs.2008.08.016
  92. Mackay S , Morgan P , Datta V , Chang A , Darzi A . Practice distribution in procedural skills training: a randomized controlled trial. Surg Endosc. 2002;16:957‐961.1216396310.1007/s00464-001-9132-4
  93. Moulton CA , Dubrowski A , Macrae H , Graham B , Grober E , Reznick R . Teaching surgical skills: what kind of practice makes perfect?: a randomized, controlled trial. Ann Surg. 2006;244:400‐409.1692656610.1097/01.sla.0000234808.85789.6aPMC1856544
  94. Nesbitt JC , St Julien J , Absi TS , et al. Tissue‐based coronary surgery simulation: medical student deliberate practice can achieve equivalency to senior surgery residents. J Thorac Cardiovasc Surg. 2013;145:1453‐1458; discussion 1458‐1459.2349947410.1016/j.jtcvs.2013.02.048
  95. Stransky D , Wilcox LM , Dubrowski A . Mental rotation: cross‐task training and generalization. J Exp Psychol Appl. 2010;16:349‐360.2119825210.1037/a0021702
  96. Stefanidis D , Korndorffer JR Jr , Markley S , Sierra R , Scott DJ . Proficiency maintenance: impact of ongoing simulator training on laparoscopic skill retention. J Am Coll Surg. 2006;202:599‐603.1657142910.1016/j.jamcollsurg.2005.12.018
  97. Kesser BW , Hallman M , Murphy L , Tillar M , Keeley M , Peirce S . Interval vs massed training: how best do we teach surgery? Otolaryngol Head Neck Surg. 2014;150:61‐67.2427016510.1177/0194599813513712
  98. Verdaasdonk E , Stassen L , Van Wijk R , Dankelman J . The influence of different training schedules on the learning of psychomotor skills for endoscopic surgery. Surg Endosc. 2007;21:214‐219.1712297910.1007/s00464-005-0852-8
  99. Mitchell EL , Lee DY , Sevdalis N , et al. Evaluation of distributed practice schedules on retention of a newly acquired surgical skill: a randomized trial. Am J Surg. 2011;201:31‐39.2116736310.1016/j.amjsurg.2010.07.040
  100. Kurosawa H , Ikeyama T , Achuff P , et al. A randomized, controlled trial of in situ pediatric advanced life support recertification (“pediatric advanced life support reconstructed”) compared with standard pediatric advanced life support recertification for ICU frontline providers. Crit Care Med. 2014;42:610‐618.2423175910.1097/CCM.0000000000000024
  101. Stefanidis D , Walters KC , Mostafavi A , Heniford BT . What is the ideal interval between training sessions during proficiency‐based laparoscopic simulator training? Am J Surg. 2009;197:126‐129.1910125510.1016/j.amjsurg.2008.07.047
  102. Kleiman AM , Forkin KT , Bechtel AJ , et al. Generative retrieval improves learning and retention of cardiac anatomy using transesophageal echocardiography. Anest Analg. 2017;124:1440‐1444.10.1213/ANE.000000000000200428431420
  103. Moore FG , Chalk C . Improving the neurological exam skills of medical students. Can J Neurol Sci. 2012;39:83‐86.2238450110.1017/s0317167100012749
  104. Murrihy RC , Byrne MK , Gonsalvez CJ . Testing an empirically derived mental health training model featuring small groups, distributed practice and patient discussion. Med Educ. 2009;43:140‐145.1916148410.1111/j.1365-2923.2008.03256.x
  105. Rozenshtein A , Pearson GD , Yan SX , Liu AZ , Toy D . Effect of massed versus interleaved teaching method on performance of students in radiology. J Am Coll Radiol. 2016;13:979‐984.2723628610.1016/j.jacr.2016.03.031
  106. Barrington MJ , Viero LP , Kluger R , Clarke AL , Ivanusic JJ , Wong DM . Determining the learning curve for acquiring core sonographic skills for ultrasound‐guided axillary brachial plexus block. Reg Anesth Pain Med. 2016;41:667‐670.2768534810.1097/AAP.0000000000000487
  107. Ayyub A , Mahboob U . Effectiveness of Test‐Enhanced Learning (TEL) in lectures for undergraduate medical students. Pak J Med Sci. 2017;33:1339‐1343.2949205510.12669/pjms.336.13358PMC5768821
  108. Akkaraju S . The role of flipped learning in managing the cognitive load of a threshold concept in physiology. J Effect Teach. 2016;16:28‐43.
  109. Dobson JL . Retrieval practice is an efficient method of enhancing the retention of anatomy and physiology information. Adv Physiol Educ. 2013;37:184‐191.2372813610.1152/advan.00174.2012
  110. LaBossiere MD , Dell KA , Sunjic K , Wantuch GA . Student perceptions of group examinations as a method of exam review in pharmacotherapeutics. Curr Pharm Teach Learn. 2016;8:375‐379.3007024810.1016/j.cptl.2016.02.002
  111. Larsen DP , Butler AC , Roediger HL 3rd . Comparative effects of test‐enhanced learning and self‐explanation on long‐term retention. Med Educ. 2013;47:674‐682.2374615610.1111/medu.12141
  112. Halliday N , O'Donoghue D , Klump KE , Thompson B . Human structure in six and one‐half weeks: one approach to providing foundational anatomical competency in an era of compressed medical school anatomy curricula. Anat Sci Educ. 2015;8:149‐157.2499615910.1002/ase.1476PMC4374441
  113. Marcotte DB , Geyer PR , Kilpatrick DG . The effect of a spaced sex education course on medical students’ sexual knowledge and attitudes. Med Educ. 1976;10:117‐121.126389510.1111/j.1365-2923.1976.tb00543.x
  114. Pernar LI , Beleniski F , Rosen H , Lipsitz S , Hafler J , Breen E . Spaced education faculty development may not improve faculty teaching performance ratings in a surgery department. J Surg Educ. 2012;69:52‐57.2220883310.1016/j.jsurg.2011.06.013
  115. Raupach T , Andresen JC , Meyer K , et al. Test‐enhanced learning of clinical reasoning: a crossover randomised trial. Med Educ. 2016;50:711‐720.2729547510.1111/medu.13069
  116. Taveira‐Gomes T , Prado‐Costa R , Severo M , Ferreira MA . Characterization of medical students recall of factual knowledge using learning objects and repeated testing in a novel e‐learning system. BMC Med Educ. 2015;15:4.2561635310.1186/s12909-014-0275-0PMC4326410
  117. Kerdijk W , Cohen‐Schotanus J , Mulder BF , Muntinghe FLH , Tio RA . Cumulative versus end‐of‐course assessment: effects on self‐study time and test performance. Med Educ. 2015;49:709‐716.2607721810.1111/medu.12756
  118. Kerdijk W , Tio RA , Mulder BF , Cohen‐Schotanus J . Cumulative assessment: strategic choices to influence students’ study effort. BMC Med Educ. 2013;13.2437011710.1186/1472-6920-13-172PMC3880587
  119. LaDisa AG , Biesboer A . Incorporation of practice testing to improve knowledge acquisition in a pharmacotherapy course. Curr Pharm Teach Learn. 2017;9:660‐665.2923344010.1016/j.cptl.2017.03.002
  120. Ebbinghaus H . Memory: A Contribution to Experimental Psychology. New York, NY: Teachers College, Columbia University; 1885/1913.
  121. Rogers EM . Diffusion of Innovations, 5th ed New York, NY: Simon & Shuster Inc; 2003.
  122. Bordage G . Conceptual frameworks to illuminate and magnify. Med Educ. 2009;43:312‐319.1933557210.1111/j.1365-2923.2009.03295.x
  123. Laksov KB , Dornan T , Teunissen PW . Making theory explicit—an analysis of how medical education research(ers) describe how they connect to theory. BMC Med Educ. 2017;17:18.2810385410.1186/s12909-016-0848-1PMC5248446
  124. Young M , Thomas A , Lubarsky S , et al. Drawing boundaries: the difficulty in defining clinical reasoning. Acad Med. 2018;93:990‐995.2936908610.1097/ACM.0000000000002142
  125. Shea JA , Arnold L , Mann KV . A RIME perspective on the quality and relevance of current and future medical education research. Acad Med. 2004;79:931‐938.1538334810.1097/00001888-200410000-00006
  126. Smolen P , Zhang Y , Byrne JH . The right time to learn: Mechanisms and optimization of spaced learning. Nat Rev Neurosci. 2016;17:77.2680662710.1038/nrn.2015.18PMC5126970
  127. Weidman J , Baker K . The cognitive science of learning: concepts and strategies for the educator and learner. Anest Analg. 2015;121:1586‐1599.10.1213/ANE.000000000000089026579660
  128. Weinstein Y , Madan CR , Sumeracki MA . Teaching the science of learning. Cogn Res Princ Implic. 2018;3:2.2939962110.1186/s41235-017-0087-yPMC5780548
  129. Antonoff MB , D'Cunha J . Retrieval practice as a means of primary learning: socrates had the right idea. Semin Thorac Cardiovasc Surg. 2011;23:89‐90.2204103410.1053/j.semtcvs.2011.06.002
  130. Keene AB , Shiloh AL , Dudaie R , Eisen LA , Savel RH . Online testing from Google Docs to enhance teaching of core topics in critical care: a pilot study. Med Teach. 2012;34:1075‐1077.2293114910.3109/0142159X.2012.716553
  131. Rapp EJ , Maximin S , Green DE . Practice corner: retrieval practice makes perfect. Radiographics. 2014;34:1869‐1870.2538428710.1148/rg.347140225
  132. Andersen SA . Virtual reality simulation training of mastoidectomy—studies on novice performance. Dan Med J. 2016;63:B5277.27477803
  133. Lin Y , Cheng A . The role of simulation in teaching pediatric resuscitation: current perspectives. Adv Med Educ Pract. 2015;6:239‐248.2587851710.2147/AMEP.S64178PMC4388005
  134. Schaverien MV . Development of expertise in surgical training. J Surg Educ. 2010;67:37‐43.2042108910.1016/j.jsurg.2009.11.002
  135. Sinitsky DM , Fernando B , Berlingieri P . Establishing a curriculum for the acquisition of laparoscopic psychomotor skills in the virtual reality environment. Am J Surg. 2012;204:367‐376.e1.2268810710.1016/j.amjsurg.2011.11.010
  136. Evans DJ , Zeun P , Stanier RA . Motivating student learning using a formative assessment journey. J Anat. 2014;224:296‐303.2411193010.1111/joa.12117PMC3931541
  137. Katz LM , Finch A , McKinnish T , Gilliland K , Tolleson‐Rinehart S , Marks BL . Teaching procedural skills to medical students: a pilot procedural skills lab. Educ Health. 2017;30:79‐83.10.4103/1357-6283.21051628707642
  138. Brown D . An evidence‐based analysis of learning practices: the need for pharmacy students to employ more effective study strategies. Curr Pharm Teach Learn. 2017;9:163‐170.2923339810.1016/j.cptl.2016.11.003
  139. Cannon‐Bowers JA , Bowers C , Procci K . Optimizing learning in surgical simulations: guidelines from the science of learning and human performance. Surg Clin North Am. 2010;90:583.2049782810.1016/j.suc.2010.02.006
  140. Kerfoot BP , Armstrong EG , O'Sullivan PN . Impact of item clustering on interactive spaced education. Med Educ. 2008;42:1115‐1116.1914101310.1111/j.1365-2923.2008.03186.x
  141. Stahl SM , Davis RL , Kim DH , et al. Play it gain: the master psychopharmacology program as an example of interval learning in bite‐sized portions. CNS Spectr. 2010;15:491‐504.2070319610.1017/s1092852900000444
  142. Deng F , Gluckstein JA , Larsen DP . Student‐directed retrieval practice is a predictor of medical licensing examination performance. Perspect Med Educ. 2015;4:308‐313.2649844310.1007/s40037-015-0220-xPMC4673073
  143. Panzarasa P , Kujawski B , Hammond EJ , Roberts CM . Temporal patterns and dynamics of e‐learning usage in medical education. Educ Tech Res Dev. 2016;64:13‐35.