top of page
longfellow.PNG

Our Research

We believe that ". . . researchers can make every study count by learning from both replication success and failure to improve the rigor, relevance, and reproducibility of intervention research" (Kim, 2019).  For this reason, we are committed to making our findings and research data available to other researchers. Consistent with the principles of Open Science, we include open data, open materials, and preregistration info, with preregistration occurring BEFORE implementation. To learn more about how you might gain access to our data sets, just click on "Replication Data" link for each study listed below. 

Time to Transfer: Long-Term Effects of a Sustained and Spiraled Content Literacy Intervention in the Elementary Grades

 
Paper Citation

Kim, J. S., Gilbert, J. B., Relyea, J. E., Rich, P., Scherer, E., Burkhauser, M. A., & Tvedt, J. N. (2024). Time to transfer: Long-term effects of a sustained and spiraled content literacy intervention in the elementary grades. Developmental Psychology. Advance online publication. https://doi.org/10.1037/dev0001710

 
Research Brief
Smart paper.jpg
Sample

2,879 students and 93 teachers

Timeline

2019-2022

Outcome of 
Interest

Domain general reading comprehension and vocabulary, science content reading comprehension, vocabulary knowledge

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Effects of tier 1 content literacy intervention on early-grade English learners’ reading and writing: Exploring the mediating roles of domain-specific vocabulary and oral language proficiency

 
Paper Citation

Relyea, J. E., Kim, J. S., Rich, P., & Fitzgerald, J. (2024). Effects of tier 1 content literacy intervention on early-grade English learners’ reading and writing: Exploring the mediating roles of domain-specific vocabulary and oral language proficiency.Journal of Educational Psychology. Advance online publication. https://doi.org/10.1037/edu0000882

 
Research Brief
Smart paper.jpg
Sample

1,236 English learners and 4,161 English-proficient peers

Timeline

2019

Outcome of 
Interest

Reading proficiency, basic literacy skills, argumentative writing in science and social studies

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Estimating causal effects on psychological networks using item response theory

 
Paper Citation

Gilbert, J. B., Domingue, B. W., & Kim, J. S. (2025). Estimating causal effects on psychological networks using item response theory. Psychological Methods. Advance online publication. https://dx.doi.org/10.1037/met0000764

 
Research Brief
Smart paper.jpg
Sample

2,118 2nd grade students

Timeline

2019-2020

Outcome of 
Interest

Vocabulary

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Effectiveness of Structured Teacher Adaptations to an Online Content Literacy Intervention for Third Graders: A Randomized Controlled Trial During COVID-19

 
Paper Citation

Relyea, J. E., Gilbert, J.B. Burkhauser, M.A, Scherer, E. Mosher, D.M, Wei, Z. Tvedt, J.N. and Kim, J.S. (2024). Effectiveness of Structured Teacher Adaptations to an Online Content Literacy Intervention for Third Graders: A Randomized Controlled Trial During COVID-19. (EdWorkingPaper: 24-1001). Retrieved from Annenberg Institute at Brown University: https://doi.org/10.26300/ztcp-v322

 
Research Brief
Smart paper.jpg
Sample

1,914 third-grade students

Timeline

2021

Outcome of 
Interest

background knowledge, science text comprehension, engagement with digital and print reading activities, quality of instruction

Intervention

Adaptive MORE

AEA RCT
Registration
Replication
Data
Published
Paper

A Longitudinal Randomized Trial of a Sustained Content Literacy Intervention from First to Second Grade: Transfer Effects on Students’ Reading Comprehension

 
Paper Citation

Kim, J. S., Burkhauser, M. A., Relyea, J. E., Gilbert, J. B., Scherer, E., Fitzgerald, J., Mosher, D., & McIntyre, J. (2023). A longitudinal randomized trial of a sustained content literacy intervention from first to second grade: Transfer effects on students’ reading comprehension. Journal of Educational Psychology, 115(1), 73–98. https://doi.org/10.1037/edu0000751

 
Research Brief
Smart paper.jpg
Sample

2,952 3rd grade students and 144 3rd grade teachers

Timeline

2019-2020

Outcome of 
Interest

Domain general reading comprehension and vocabulary, science content reading comprehension, vocabulary knowledge

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Improving Elementary Grade Students’ Science and Social Studies Vocabulary Knowledge Depth, Reading Comprehension, and Argumentative Writing: A Conceptual Replication

 
Paper Citation

Kim, J. S., Relyea, J. E., Burkhauser, M. A., Scherer, E., & Rich, P. (2021). Improving elementary grade students’ science and social studies vocabulary knowledge depth, reading comprehension, and argumentative writing: A conceptual replication. Educational Psychology Review, 33(4), 1935-1964.

 
Research Brief
Smart paper.jpg
Sample

5,494 1st and 2nd grade students and 280 1st and 2nd grade teachers

Timeline

2019

Outcome of 
Interest

vocabulary, reading comprehension, basic literacy skills, argumentative writing

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Improving reading comprehension, science domain knowledge, and reading engagement through a first grade content literacy intervention

 
Paper Citation

Kim, J. S., Burkhauser, M. A., Mesite, L. M., Asher, C. A., Relyea, J. E., Fitzgerald, J., & Elmore, J. (2021). Improving reading comprehension, science domain knowledge, and reading engagement through a first grade content literacy intervention. Journal of Educational Psychology, 113(1), 3–26. https://doi-org.ezp-prod1.hul.harvard.edu/10.1037/edu0000465

 
Research Brief
Smart paper.jpg
Sample

674 first-grade students from 38 classrooms at 10 Southeastern schools.

Timeline

2018

Outcome of 
Interest

science knowledge, reading engagement, reading comprehension, basic literacy skills

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Building a Science of Teaching Reading and Vocabulary: Experimental Effects of Structured Supplements for a Read Aloud Lesson on Third Graders’ Domain-Specific Reading Comprehension

 
Paper Citation

Mosher, D. M., & Kim, J. S. (2024). Building a Science of Teaching Reading and Vocabulary: Experimental Effects of Structured Supplements for a Read Aloud Lesson on Third Graders’ Domain-Specific Reading Comprehension. Scientific Studies of Reading, 1–25. https://doi.org/10.1080/10888438.2024.2368145

 
Research Brief
Smart paper.jpg
Sample

80 third-grade teachers and their students

Timeline

2022

Outcome of 
Interest

Reading proficiency

Intervention

Model of Reading Engagement

AEA RCT
Registration
Replication
Data
Published
Paper

Leveraging Item Parameter Drift to Assess Transfer Effects in Vocabulary Learning.

 
Paper Citation

Gilbert, J. B., Kim, J. S., & Miratrix, L. W. (2024). Leveraging item parameter drift to assess transfer effects in vocabulary learning. Applied Measurement in Education, 37(3).

 
Research Brief
Smart paper.jpg
Sample

29, 327 item level responses

Timeline

2018-2020

Outcome of 
Interest

Vocabulary

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Improving second-grade reading comprehension through a sustained content literacy intervention: A mixed-methods study examining the mediating role of domain-specific vocabulary

 
Paper Citation

Mosher, D.M., Burkhauser, M.A., Kim, J.S. (2024). Improving second-grade reading comprehension through a sustained content literacy intervention: A mixed-methods study examining the mediating role of domain-specific vocabulary. Journal of Educational Psychology. 116(4), 550-568.
https://doi.org/10.1037/edu0000868.

 
Research Brief
Smart paper.jpg
Sample

2,156 1st and 2nd grade students

Timeline

2019-2020

Outcome of 
Interest

science content comprehension, vocabulary knowledge

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Understanding Heterogeneous Patterns of Family Engagement With Educational Technology to Inform School-Family Communication in Linguistically Diverse Communities

 
Paper Citation

Asher, C. A., Scherer, E., Kim, J. S., & Tvedt, J. N. (2024). Understanding Heterogeneous Patterns of Family Engagement With Educational Technology to Inform School-Family Communication in Linguistically Diverse Communities. Educational Researcher, 0(0). https://doi.org/10.3102/0013189X241238651

 
Research Brief
Smart paper.jpg
Sample

3,602 students and 51 parents

Timeline

2019-2020

Outcome of 
Interest

Take-up and usage of an educational literacy app, reading comprehension, basic literacy skills

Intervention

Use of an educational literacy app .Parents received text "pushes" to encourage use of the app.

AEA RCT
Registration
Replication
Data
Published
Paper

Combining Human and Automated Scoring Methods in Experimental Assessments of Writing: A Case Study Tutorial.

 
Paper Citation

Mozer, R., Miratrix, L., Relyea, J. E., & Kim, J. S. (2023). Combining Human and Automated Scoring Methods in Experimental Assessments of Writing: A Case Study Tutorial. Journal of Educational and Behavioral Statistics, 0(0).
https://doi.org/10.3102/10769986231207886

 
Research Brief
Smart paper.jpg
Sample

6642

Timeline

2017-2019

Outcome of 
Interest

Argumentative writing

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions

 
Paper Citation

Gilbert, J. B., Kim, J. S., & Miratrix, L. W. (2023). Modeling Item-Level Heterogeneous Treatment Effects With the Explanatory Item Response Model: Leveraging Large-Scale Online Assessments to Pinpoint the Impact of Educational Interventions. Journal of Educational and Behavioral Statistics, 10769986231171710.

 
Research Brief
Smart paper.jpg
Sample

7,797 students

Timeline

2022

Outcome of 
Interest

Science and social studies reading comprehension

Intervention

Use of the MORE curriculum (content literacy intervention)

AEA RCT
Registration
Replication
Data
Published
Paper

Using a Factorial Design to Maximize the Effectiveness of a Parental Text Messaging Intervention

 
Paper Citation

Asher, C.A., Scherer, E., Kim, J. S. (2022). Using a Factorial Design to Maximize the Effectiveness of a Parental Text Messaging Intervention. Journal of Research on Educational Effectiveness.

 
Research Brief
Smart paper.jpg
Sample

5,172 rising second and third grade students, from 4,993 families

Timeline

2019

Outcome of 
Interest

reading comprehension, app engagement, parent engagement

Intervention

Family Texting

AEA RCT
Registration
Replication
Data
Published
Paper

Using a Sequential Multiple Assignment Randomized Trial (SMART) to Develop an Adaptive K-2 Literacy Intervention with Personalized Print Texts and App-Based Digital Activities

 
Paper Citation

Kim, J. S., Asher, C. A., Burkhauser, M., Mesite, L., & Leyva, D. (2019). Using a Sequential Multiple Assignment Randomized Trial (SMART) to Develop an Adaptive K–2 Literacy Intervention With Personalized Print Texts and App-Based Digital Activities. AERA Open. https://doi.org/10.1177/2332858419872701

 
Research Brief
Smart paper.jpg
Sample

273 kindergarten to second-grade students from 1 Southeast school.

Timeline

2018

Outcome of 
Interest

Take-up and usage of an educational literacy app, reading comprehension, basic literacy skills

Intervention

Use of an educational literacy app .Parents received text "pushes" to encourage use of the app.

AEA RCT
Registration
Replication
Data
Published
Paper

Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children’s Literacy and Math Skills

 
Paper Citation

Kim, J., Gilbert, J., Yu, Q., & Gale, C. (2021). Measures matter: A meta-analysis of the effects of educational apps on preschool to grade 3 children’s literacy and math skills. AERA Open, 7 23328584211004183.

 
Research Brief
Smart paper.jpg
Sample

36 intervention studies

Timeline

2010-2019

Outcome of 
Interest

Academic achievement

Intervention

Meta-Analysis of Pre-K through 3rd Grade Educational Software

AEA RCT
Registration
Replication
Data
Published
Paper
reads_lab_horiz_hgselogo_web.png

Copyright © 2024 The President and Fellows of Harvard College

READS Lab, Graduate School of Education, Cambridge, MA  02138

bottom of page