
Our Research
We believe that ". . . researchers can make every study count by learning from both replication success and failure to improve the rigor, relevance, and reproducibility of intervention research" (Kim, 2019). For this reason, we are committed to making our findings and research data available to other researchers. Consistent with the principles of Open Science, we include open data, open materials, and preregistration info, with preregistration occurring BEFORE implementation. To learn more about how you might gain access to our data sets, just click on "Replication Data" link for each study listed below.
Time to Transfer: Long-Term Effects of a Sustained and Spiraled Content Literacy Intervention in the Elementary Grades
Paper Citation
Kim, J. S., Gilbert, J. B., Relyea, J. E., Rich, P., Scherer, E., Burkhauser, M. A., & Tvedt, J. N. (2024). Time to transfer: Long-term effects of a sustained and spiraled content literacy intervention in the elementary grades. Developmental Psychology. Advance online publication. https://doi.org/10.1037/dev0001710
Research Brief
Sample
2,879 students and 93 teachers
Timeline
2019-2022
Outcome of
Interest
Domain general reading comprehension and vocabulary, science content reading comprehension, vocabulary knowledge
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Effects of tier 1 content literacy intervention on early-grade English learners’ reading and writing: Exploring the mediating roles of domain-specific vocabulary and oral language proficiency
Paper Citation
Relyea, J. E., Kim, J. S., Rich, P., & Fitzgerald, J. (2024). Effects of tier 1 content literacy intervention on early-grade English learners’ reading and writing: Exploring the mediating roles of domain-specific vocabulary and oral language proficiency.Journal of Educational Psychology. Advance online publication. https://doi.org/10.1037/edu0000882
Research Brief
Sample
1,236 English learners and 4,161 English-proficient peers
Timeline
2019
Outcome of
Interest
Reading proficiency, basic literacy skills, argumentative writing in science and social studies
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Estimating causal effects on psychological networks using item response theory
Paper Citation
Gilbert, J. B., Domingue, B. W., & Kim, J. S. (2025). Estimating causal effects on psychological networks using item response theory. Psychological Methods. Advance online publication. https://dx.doi.org/10.1037/met0000764
Research Brief
Sample
2,118 2nd grade students
Timeline
2019-2020
Outcome of
Interest
Vocabulary
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Effectiveness of Structured Teacher Adaptations to an Online Content Literacy Intervention for Third Graders: A Randomized Controlled Trial During COVID-19
Paper Citation
Relyea, J. E., Gilbert, J.B. Burkhauser, M.A, Scherer, E. Mosher, D.M, Wei, Z. Tvedt, J.N. and Kim, J.S. (2024). Effectiveness of Structured Teacher Adaptations to an Online Content Literacy Intervention for Third Graders: A Randomized Controlled Trial During COVID-19. (EdWorkingPaper: 24-1001). Retrieved from Annenberg Institute at Brown University: https://doi.org/10.26300/ztcp-v322
Research Brief
Sample
1,914 third-grade students
Timeline
2021
Outcome of
Interest
background knowledge, science text comprehension, engagement with digital and print reading activities, quality of instruction
Intervention
Adaptive MORE
AEA RCT
Registration
Replication
Data
Published
Paper
A Longitudinal Randomized Trial of a Sustained Content Literacy Intervention from First to Second Grade: Transfer Effects on Students’ Reading Comprehension
Paper Citation
Kim, J. S., Burkhauser, M. A., Relyea, J. E., Gilbert, J. B., Scherer, E., Fitzgerald, J., Mosher, D., & McIntyre, J. (2023). A longitudinal randomized trial of a sustained content literacy intervention from first to second grade: Transfer effects on students’ reading comprehension. Journal of Educational Psychology, 115(1), 73–98. https://doi.org/10.1037/edu0000751
Research Brief
Sample
2,952 3rd grade students and 144 3rd grade teachers
Timeline
2019-2020
Outcome of
Interest
Domain general reading comprehension and vocabulary, science content reading comprehension, vocabulary knowledge
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Improving Elementary Grade Students’ Science and Social Studies Vocabulary Knowledge Depth, Reading Comprehension, and Argumentative Writing: A Conceptual Replication
Paper Citation
Kim, J. S., Relyea, J. E., Burkhauser, M. A., Scherer, E., & Rich, P. (2021). Improving elementary grade students’ science and social studies vocabulary knowledge depth, reading comprehension, and argumentative writing: A conceptual replication. Educational Psychology Review, 33(4), 1935-1964.
Research Brief
Sample
5,494 1st and 2nd grade students and 280 1st and 2nd grade teachers
Timeline
2019
Outcome of
Interest
vocabulary, reading comprehension, basic literacy skills, argumentative writing
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Improving reading comprehension, science domain knowledge, and reading engagement through a first grade content literacy intervention
Paper Citation
Kim, J. S., Burkhauser, M. A., Mesite, L. M., Asher, C. A., Relyea, J. E., Fitzgerald, J., & Elmore, J. (2021). Improving reading comprehension, science domain knowledge, and reading engagement through a first grade content literacy intervention. Journal of Educational Psychology, 113(1), 3–26. https://doi-org.ezp-prod1.hul.harvard.edu/10.1037/edu0000465
Research Brief
Sample
674 first-grade students from 38 classrooms at 10 Southeastern schools.
Timeline
2018
Outcome of
Interest
science knowledge, reading engagement, reading comprehension, basic literacy skills
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Building a Science of Teaching Reading and Vocabulary: Experimental Effects of Structured Supplements for a Read Aloud Lesson on Third Graders’ Domain-Specific Reading Comprehension
Paper Citation
Mosher, D. M., & Kim, J. S. (2024). Building a Science of Teaching Reading and Vocabulary: Experimental Effects of Structured Supplements for a Read Aloud Lesson on Third Graders’ Domain-Specific Reading Comprehension. Scientific Studies of Reading, 1–25. https://doi.org/10.1080/10888438.2024.2368145
Research Brief
Sample
80 third-grade teachers and their students
Timeline
2022
Outcome of
Interest
Reading proficiency
Intervention
Model of Reading Engagement
AEA RCT
Registration
Replication
Data
Published
Paper
Leveraging Item Parameter Drift to Assess Transfer Effects in Vocabulary Learning.
Paper Citation
Gilbert, J. B., Kim, J. S., & Miratrix, L. W. (2024). Leveraging item parameter drift to assess transfer effects in vocabulary learning. Applied Measurement in Education, 37(3).
Research Brief
Sample
29, 327 item level responses
Timeline
2018-2020
Outcome of
Interest
Vocabulary
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Improving second-grade reading comprehension through a sustained content literacy intervention: A mixed-methods study examining the mediating role of domain-specific vocabulary
Paper Citation
Mosher, D.M., Burkhauser, M.A., Kim, J.S. (2024). Improving second-grade reading comprehension through a sustained content literacy intervention: A mixed-methods study examining the mediating role of domain-specific vocabulary. Journal of Educational Psychology. 116(4), 550-568.
https://doi.org/10.1037/edu0000868.
Research Brief
Sample
2,156 1st and 2nd grade students
Timeline
2019-2020
Outcome of
Interest
science content comprehension, vocabulary knowledge
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Understanding Heterogeneous Patterns of Family Engagement With Educational Technology to Inform School-Family Communication in Linguistically Diverse Communities
Paper Citation
Asher, C. A., Scherer, E., Kim, J. S., & Tvedt, J. N. (2024). Understanding Heterogeneous Patterns of Family Engagement With Educational Technology to Inform School-Family Communication in Linguistically Diverse Communities. Educational Researcher, 0(0). https://doi.org/10.3102/0013189X241238651
Research Brief
Sample
3,602 students and 51 parents
Timeline
2019-2020
Outcome of
Interest
Take-up and usage of an educational literacy app, reading comprehension, basic literacy skills
Intervention
Use of an educational literacy app .Parents received text "pushes" to encourage use of the app.
AEA RCT
Registration
Replication
Data
Published
Paper
Combining Human and Automated Scoring Methods in Experimental Assessments of Writing: A Case Study Tutorial.
Paper Citation
Mozer, R., Miratrix, L., Relyea, J. E., & Kim, J. S. (2023). Combining Human and Automated Scoring Methods in Experimental Assessments of Writing: A Case Study Tutorial. Journal of Educational and Behavioral Statistics, 0(0).
https://doi.org/10.3102/10769986231207886
Research Brief
Sample
6642
Timeline
2017-2019
Outcome of
Interest
Argumentative writing
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions
Paper Citation
Gilbert, J. B., Kim, J. S., & Miratrix, L. W. (2023). Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions. Journal of Educational and Behavioral Statistics, 10769986231171710.
Research Brief
Sample
7,797 students
Timeline
2022
Outcome of
Interest
Science and social studies reading comprehension
Intervention
Use of the MORE curriculum (content literacy intervention)
AEA RCT
Registration
Replication
Data
Published
Paper
Using a Factorial Design to Maximize the Effectiveness of a Parental Text Messaging Intervention
Paper Citation
Asher, C.A., Scherer, E., Kim, J. S. (2022). Using a Factorial Design to Maximize the Effectiveness of a Parental Text Messaging Intervention. Journal of Research on Educational Effectiveness.
Research Brief
Sample
5,172 rising second and third grade students, from 4,993 families
Timeline
2019
Outcome of
Interest
reading comprehension, app engagement, parent engagement
Intervention
Family Texting
AEA RCT
Registration
Replication
Data
Published
Paper
Using a Sequential Multiple Assignment Randomized Trial (SMART) to Develop an Adaptive K-2 Literacy Intervention with Personalized Print Texts and App-Based Digital Activities
Paper Citation
Kim, J. S., Asher, C. A., Burkhauser, M., Mesite, L., & Leyva, D. (2019). Using a Sequential Multiple Assignment Randomized Trial (SMART) to Develop an Adaptive K–2 Literacy Intervention With Personalized Print Texts and App-Based Digital Activities. AERA Open. https://doi.org/10.1177/2332858419872701
Research Brief
Sample
273 kindergarten to second-grade students from 1 Southeast school.
Timeline
2018
Outcome of
Interest
Take-up and usage of an educational literacy app, reading comprehension, basic literacy skills
Intervention
Use of an educational literacy app .Parents received text "pushes" to encourage use of the app.
AEA RCT
Registration
Replication
Data
Published
Paper
Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children’s Literacy and Math Skills
Paper Citation
Kim, J., Gilbert, J., Yu, Q., & Gale, C. (2021). Measures matter: A meta-analysis of the effects of educational apps on preschool to grade 3 children’s literacy and math skills. AERA Open, 7 23328584211004183.
Research Brief
Sample
36 intervention studies
Timeline
2010-2019
Outcome of
Interest
Academic achievement
Intervention
Meta-Analysis of Pre-K through 3rd Grade Educational Software