METHODS
We employed a scoping review methodology to examine the definitions and applications of spaced learning in HPE. To execute the review in a rigorous manner, we assembled a research team consisting of co‐investigators with in‐depth knowledge of HPE (MV, RAH, AT, BWCO and PS), methodological experience (AT and BWCO),14 and medical library expertise (CP).
We used the methodological framework developed by Arksey and O'Malley,14 which was later refined by Levac and colleagues.15 The framework consists of the following six steps: Step 1, identifying the research question; Step 2, identifying relevant articles; Step 3, selecting articles; Step 4, charting the data; Step 5 collating, summarising and reporting the results, and Step 6, consultation. Step 6, consultation, was not conducted as we aimed to study the HPE literature specifically without including additional stakeholders’ perspectives on this matter.
Identifying the research question
Given our goal of identifying key concepts, and applications of spaced learning, we generated a main research question that allows for a broad exploration of spaced learning. The overarching question guiding this scoping review was as follows: ‘How is spaced learning defined and applied in HPE?’ Accordingly, we sought to answer the following specific research questions: (RQ1A) Which concepts are used to define spaced learning and associated terms? (RQ1B) To what extent do these terms show conceptual overlap? (RQ2) Which theoretical frameworks are used to frame spaced learning? (RQ3) Which spacing formats are utilised in spaced learning research?
Identifying relevant studies
A university affiliated librarian (CP) was consulted when drafting the search query. An initial brainstorming session with the research team and librarian led to the inclusion of ‘spaced learning’ and possible associated terms, such as ‘spaced training’, ‘spaced education’, ‘distributed practice’, ‘test‐enhanced learning’, and ‘retrieval practice’. The final search was conducted on 28 February 2018 using five databases: PubMed, Web of Science, Embase, Education Resources Information Center (ERIC), PsycINFO (Data S1). MV conducted additional forward reference searching of included review articles to identify additional articles.
Selecting the studies
There was no restriction on year of publication; therefore, all articles published up until 28 February 2018 were screened for eligibility. To be included, articles had to: (a) focus on HPE (eg medicine, nursing, pharmacology), and (b) explicitly name ‘spaced learning’, or any associated term with a spaced study format. We excluded editorials, commentaries, conference abstracts and books, as well as non‐English articles.
Two researchers (MV and RAH) tested the inclusion criteria on a 10% subset of titles.16, 17 A single calibration exercise was sufficient for the team to reach full agreement after inclusion criteria were discussed and clarified. In the abstract screening stage, RAH and MV tested the inclusion criteria using a subset of papers (5%). After reaching full agreement, MV independently screened the remaining abstracts. Two additional calibration exercises were performed with RH independently screening 2.5% of abstracts (n = 34) halfway and again 2.5% (n = 34) at the end of the process to ensure that MV's interpretation of the inclusion criteria was consistent with the original calibration outcome. Disagreements were resolved by discussion. If the focus of the article was unclear based on the title and abstract, the full article was inspected.
Charting the data
The data charting form was developed by MV and RAH based on the units of analysis included in the research questions (eg definition, theoretical framework, timing of events and setting) using Microsoft® Excel 2010 (Microsoft Corp., Redmond, WA, USA). They independently extracted data from five full text articles to pilot the form. The usability of the charting form was discussed and minor modifications were made accordingly (ie extraction categories were added and others were removed). For instance, the ‘intervention design’ category from a previous version of the charting form was merged with the ‘timing of events’ category in the final version. The process was repeated with an additional five full text articles, followed by discussion, resulting in a final extraction form comprised of the following categories: title; author; publication year; location; terms used for spaced learning; definition by researchers; theoretical framework; population; research method; research design; report of evidence‐based spacing; timing of events; topic of learning; type of knowledge; setting; basic sciences/clinical, and learning phase.
Collating, summarising and reporting the results
Numerical analyses
We performed a numerical analysis to describe the study characteristics (ie year of publication, location, population, educational content, domain, subject), theoretical frameworks (RQ2A) and spacing formats (RQ3A) included in each paper.
Thematic analyses
The variety of spaced learning definitions and associated terms (RQ1A) were synthesised using a thematic analysis. Two researchers (MV, RAH) generated a list of open codes from words or phrases in the definitions. Discussion between the two researchers explored relationships between open codes across definitions, which we refer to as concepts. These concepts were then analysed to generate overarching core themes. Drawing from the previously identified core themes as predetermined categories, we used a deductive approach to search for conceptual overlap amongst terms and definitions (RQ1B). Cross‐checking of coding strategies and interpretation of data was performed by BWCO.
CC BY 4.0. "Conceptualising spaced learning in health professions education: A scoping review" by Versteeg M, Hendriks RA, Thomas A et al., Medical education (2020). https://doi.org/10.1111/medu.14025. Licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Peer-reviewed and open access; full text from PubMed Central (PMC7064953). Headings and layout adapted for reading; figures and tables are in the original.