Online Learning and Student Achievement


Summary

Virtual education is touted as a promoter of both quality and access for students across the country. Several states require that students enroll in at least one online course before they graduate, and many states have recently passed legislation encouraging the use of online learning. Yet despite the burgeoning popularity of virtual schools, there remains a stark lack of evidence that these methods actually improve educational opportunity. Our project will fill this gap by exploring how access to the online sector affects students’ academic performance, as well as the effect of various instructional and contextual factors on student learning and teacher effectiveness in virtual schools.

What are the Research Objectives?

As one of the states that require at least one online course for high school graduation, Florida has emerged as a pioneer of online learning opportunity and a strong provider of virtual school data. For this reason we have chosen to administer this study in Florida schools. To date, the Florida Virtual School (FLVS) is the largest education provider in Florida’s online educational market and is responsible for 97% of online learning enrollments. Our research will examine teacher and student data from both FLVS and Florida face-to-face (FtF) schools and compare the outcomes of each in order to identify virtual school best practices.

This project explores how the introduction of virtual schooling options affects students’ course progression and academic achievement. In addition to quantifying achievement effects, we explore candidate mechanisms, particularly teacher effectiveness, that may explain effects, as well as factors that moderate virtual course effects. The results will help policymakers and school personnel understand how virtual classes affect achievement, which students are most likely to benefit, and avenues for virtual class improvement.

Data analysis will take place as an exploratory study with a focus on identifying potential educational mediating and moderating factors and opportunities for improvement. The study will employ such research tools as descriptive analyses, difference-in-difference analysis, multiple regression analysis, teacher value-added measures, and teacher and student surveys using both comprehensive selection and random sample data. With this analysis we hope to evaluate the extent to which virtual schools can and do provide additional meaningful choices for schoolchildren and their families.

Research Questions

  1. Which students are most likely to take virtual courses, and which types of courses are they most likely to take?
  2. Does access to virtual classes improve course progression and academic achievement for students who do not have access to these classes in their bricks-and-mortar schools?
  3. What is the impact on achievement of taking courses virtually versus FtF? How does this vary for different types of students?
  4. What are the characteristics of teachers in online courses and do teachers matter for student success in virtual classes to the same degree that they do in the traditional sector? Also, are certain teacher characteristics correlated with student performance in the virtual sector, and how do these associations compare with those in the FtF sector?
  5. How do teachers and students describe and assess their experiences in online and FtF classes? How are their responses correlated with student performance within and across sectors? Based on this information, what are productive avenues for further analysis of online course effectiveness?

Publications

Can Technology Help Promote Equality of Educational Opportunities?

Brian Jacob

Brian Jacob, Dan Berger, Cassandra Hart, Susanna Loeb. October 2016. "Can Technology Help Promote Equality of Educational Opportunities?" The Russell Sage Foundation Journal of the Social Sciences 2(5): 242-271.

Abstract

This chapter assesses the potential for several prominent technological innovations to promote equality of educational opportunities. We review the history of technological innovations in education and describe several prominent innovations, including intelligent tutoring, blended learning, and virtual schooling.

[Download the working paper]

How is the Study Funded?

This study is funded by the Walton Family Foundation and the United States Department of Education’s Institute of Education Sciences, grant award number R305A150163.

Who will Use the Research?

This study will be useful to several parties at work in the education sector, virtual or not. Our findings will advise policymakers and legislators on key issues of cyber learning and will supply a base of knowledge upon which further research may develop virtual educational interventions tailored to student needs and school capabilities. This research will also directly influence educational decisions on an individual school level, by helping counselors and teachers make decisions for the success of their students and by providing virtual schools with recommendations for best practices. Finally, our conclusions will be disseminated through publications, conferences, and media outlets, where we hope to inspire a broader policy discussion over online learning opportunities.

Who is on the Project Team?

Brian A. Jacob, University of Michigan

Susanna Loeb is the Barnett Family professor of education at Stanford University, faculty director of the center for Education Policy Analysis, and a co-director of policy analysis for California Education. Dr. Loeb specializes in the economics of education and the relationship between schools and federal, state, and local policies. Her research addresses teacher policy, looking specifically at how teachers’ preferences affect the distribution of teaching quality across schools, how pre-service coursework requirements affect the quality of teacher candidates, and how reforms affect teachers’ career decisions. She also studies school leadership and school finance—for example, looking at how the structure of state finance systems affects the level and distribution of resources across schools. Loeb’s past work on these topics has been published in such journals as American Education Research Journal, Journal of Policy Analysis and Management, Educational Evaluation and Policy Analysis, Education Finance and Policy, Educational Evaluation and Policy Analysis, and American Economic Review. Dr. Loeb is a member of the National Board for Education Sciences, a senior fellow at the Stanford Institute for Economic Policy Research, member of the Executive Board of the National Center for the Analysis of Longitudinal Data in Education Research, and a faculty research fellow at the National Bureau of Economic Research.

Cassandra Hart is an assistant professor at the School of Education at the University of California, Davis. Her work focuses on the evaluation of state and national education policies. Specifically her research interests center on school choice, school accountability, and virtual education. Her work on these topics has been accepted in journals including American Journal of Economics: Applied Economics, Educational Evaluation and Policy Analysis, and Economics of Education Review. Dr. Hart received her PhD from Northwestern University’s School of Education and Social Policy in 2011.

General Inquiries

For all general inquiries about the Education Policy Initiative, please use the contact form.

Street Address

Education Policy Initiative
Gerald R. Ford School of Public Policy
735 South State Street, Suite 5100
Ann Arbor, MI 48109

Get in Touch

Phone: 734-615-6978