Award Abstract # 1258448
Understanding the edX MOOC: How can Circuits and Electronics (6.002x) help us understand the MOOC learning experience?

NSF Org: DRL
Division of Research on Learning in Formal and Informal Settings (DRL)
Recipient: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Initial Amendment Date: September 24, 2012
Latest Amendment Date: September 24, 2012
Award Number: 1258448
Award Instrument: Standard Grant
Program Manager: Sarah-Kay McDonald
DRL
 Division of Research on Learning in Formal and Informal Settings (DRL)
EDU
 Directorate for STEM Education
Start Date: October 1, 2012
End Date: September 30, 2013 (Estimated)
Total Intended Award Amount: $200,000.00
Total Awarded Amount to Date: $200,000.00
Funds Obligated to Date: FY 2012 = $200,000.00
History of Investigator:
  • Lori Breslow (Principal Investigator)
    lrb@mit.edu
  • Daniel Hastings (Co-Principal Investigator)
Recipient Sponsored Research Office: Massachusetts Institute of Technology
77 MASSACHUSETTS AVE
CAMBRIDGE
MA  US  02139-4301
(617)253-1000
Sponsor Congressional District: 07
Primary Place of Performance: Massachusetts Institute of Technology
Cambridge
MA  US  02139-4301
Primary Place of Performance
Congressional District:
07
Unique Entity Identifier (UEI): E2NYLCDML6V1
Parent UEI: E2NYLCDML6V1
NSF Program(s): REAL
Primary Program Source: 04001213DB NSF Education & Human Resource
Program Reference Code(s): 7625, 7914, 9177, SMET
Program Element Code(s): 762500
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.076

ABSTRACT

This is a RAPID to study Massive Open Online Courses as to how and in what context learning best occurs. This is a collaboration between MIT and Harvard on their edX initiative. The course studied is the MIT Circuits course "Circuits and Electronics" first offered in the Spring of 2012 as a MOOC. Data was collected from the 154,763 students enrolled in the course and this award will fund analyses of that data and additional data on students that needs to be collected quickly before too much attrition takes place. Additionally, the learning outcomes and experiences of students in the classroom version of the course will be compared to the outcomes and experiences of students in the MOOC to best determine both the effectiveness of MOOCs and the contexts in which MOOCs work well.

MOOCs are a recent phenomenon and MOOCs have not been studied as to their effectiveness in a learning environment. This study will answer many such questions and provide guidance for improvement in MOOCs and in their deployment.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Breslow, L., Pritchard, D.E., DeBoer, J., Stump, G.S., Ho, A.D., & Seaton, D.T. "Studying learning in the worldwide classroom: Research into edX's first MOOC." Research and Practice in Assessment , v.8 , 2013 , p.13 2161-4210

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

Massive open online courses (MOOCs) have garnered a tremendous amount of publicity since first launched in 2011. MOOCs allow tens of thousands of students to take one course together with lectures, assignments, and exams all online. This project analyzed data from “Circuits and Electronics” (6.002x), the first MOOC developed by edX. The course started with almost 155,000 registrants and just over 7,100 received a certificate of completion.

Goals of the Project

This research was undertaken to analyze three kinds of data from 6.002x: (1) data logs that captured 230 million interactions students had with the course; (2) over 90,000 posts on a discussion forum; and (3) an end-of-course survey to which over 7,000 students responded. The objectives of the study were to explore the methodologies that could be used to analyze the huge amount of data 6.002x created, and to identify both factors in the students’ backgrounds and their use of instructional materials that contributed to their persistence and success in the course.

Findings

We were able to draw a fairly detailed picture of the 6.002x students. They came from 194 countries with the U.S., India, and the U.K the top three. Two-thirds who initially registered for 6.002x reported English as their first language. The percentage of students who completed 6.002x was under 5%; most students who registered left after the first week.

Although 6.002x students ranged from teenagers to in their seventies, most students who answered a question about age on the end-of-course survey were in their 20s or 30s. (This statistic and the statistics below are based on a smaller number of responses than the total for the survey as not every student received every question.) Not surprisingly, 88% of the students were male. 6.002x students were highly educated: 37% had a bachelor’s degree, 28% had a master’s or professional degree, and 27% completed high school. Over three-quarters of the respondents had a strong background in calculus. Just over half reported their reason for enrolling was for the “knowledge and skills gained from the course”; just over a quarter enrolled for the “personal challenge.”

After identifying basic characteristics of the students, our next step was to carry out more sophisticated analyses.  First, we looked for relationships between students’ background and their achievement in the course, defined as earning a certificate. Using this definition, we found no relationship between achievement and age, gender, reason for enrolling, or home background.  Rather, the strongest positive correlation for achievement was whether students reported they worked offline with another person—either another student in 6.002x (18%) or “someone who teaches or has expertise in the area” (3%). The second strongest predicator of achievement was a background in calculus.

When we explored the patterns between uses of course components and achievement and persistence both for all students and for certificate earners, the findings were particularly interesting but puzzling. Some resources were consistent in helping students persist and achieve in 6.002x, but others were not. For example, for all students, time spent with homework and on the discussion forum was consistently positive.  However, the correlation with time spent with the e-textbook was negatively predictive of scores for both populations.

When we looked at time spent on labs or on the problems embedded in the lecture videos, the correlation with achievement was reversed for the two populations. For all students, the hours on lab assignments were predictive of a higher score, but for certificate earners, the correlation was negative. We found homework and labs most useful for all users, ...

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page