MOOC Math Students Beat On-Campus Pass Rate - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

08:40 PM
Connect Directly

MOOC Math Students Beat On-Campus Pass Rate

Udacity-San Jose State MOOC partnership, paused over poor early results, turns a corner and will resume.

10 Cool Back-To-School Tech Tools
10 Cool Back-To-School Tech Tools
(click image for larger view and for slideshow)
San Jose State University's (SJSU's) partnership with Udacity seems to be paying off after all, based on preliminary results from the program's summer term.

Statistics that SJSU published Wednesday night are the results that excited Udacity CEO Sebastian Thrun into declaring he was on the verge of discovering a magic formula for effective online education. At the time of that interview with InformationWeek, the numbers were still coming in. SJSU said it considers these results preliminary -- but solid enough to talk about.

In the SJSU Plus program, Udacity uses its massive open online course (MOOC) platform to host courses taught by SJSU instructors and offered for credit to enrolled students for a $150 fee. The same courses are available for free to any user of the website, but not for credit.

Poor results in an early test of the program this spring prompted SJSU to hold off on offering more courses this fall, but the summer program results offer justification for resuming the program in 2014, as planned.

Pass rates for elementary statistics and college algebra courses both improved significantly from spring to summer, reaching 83% and 73%, respectively. They now exceed the average pass rate for on-campus courses in those subjects.

[ Online course style: How Udacity Creates A More Engaging MOOC. ]

The pass rate for an entry-level math course improved, but only to about 30%, compared with 45.5% for the on-campus equivalent. This is a remedial math course and SJSU's report emphasizes that, particularly in the spring, it was offered to students who had failed the course once before and otherwise would have been directed to go back to community college.

"A 30% pass rate does sound low, until you stop and think that most of these students would not otherwise have had access to the course at all," said SJSU provost and VP for academic affairs Ellen Junn in a statement.

The table below shows pass rates (students who scored a C or better).

Spring Pilot 2013Summer Pilot 2013SJSU On-Campus
(based on past 6 semesters)
Elementary Statistics50.5%83.0%76.3%
College Algebra25.4%72.6%64.7%
Entry Level Math23.8%29.8%45.5%
General Psychologynot offered67.3%83.0%
Intro to Programmingnot offered70.4%67.6%

Junn pointed to three areas of improvement that made a difference:

-- Better orientation, particularly for students not otherwise enrolled at SJSU.

-- More encouragement along the way, including online tools to help students track their progress and mentors checking in with students more frequently.

-- More communication, with student feedback incorporated into changes in the courses. "We're also sending less email and more messages when students are 'in class' online," according to Junn.

A few other things were different. Although the spring semester boasted an 83% retention rate, over the summer SJSU let it drop to 60%, reflecting a "decision to be more flexible when students signaled to instructors that they needed to drop the course," according to Junn.

Some of the improvement in pass scores could be interpreted as a result of more students who would have failed having a chance to drop the course before they got to that point.

The summer enrollment was also much larger, with 2,091 students enrolled in five classes, compared with just under 300 students in three classes in the spring.

When SJSU Plus classes resume, the university wants to do more to "better sync our courses with our students' busy schedules," said Junn. Students also have asked for greater flexibility in course pacing, allowing them to speed up or slow down outside the confines of a semester schedule, and SJSU is investigating how it might make that work.

"To all those people who declared our experiment a failure, you have to understand how innovation works," Thrun wrote in a blog post on the latest results. "Few ideas work on the first try. Iteration is key to innovation. We are seeing significant improvement in learning outcomes and student engagement. And we know from our data that there is much more to be done."

We welcome your comments on this topic on our social media channels, or [contact us directly] with questions about the site.
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
User Rank: Author
8/29/2013 | 10:02:53 PM
re: MOOC Math Students Beat On-Campus Pass Rate
I think we're going to see more kind of foundational course like these taught via cheaper, online options. Classrooms and team learning are indispensable for some subjects, but some subjects will be better done in online and self study mode.
David F. Carr
David F. Carr,
User Rank: Author
8/29/2013 | 6:56:19 PM
re: MOOC Math Students Beat On-Campus Pass Rate
What's your take? Does this prove anything about the effectiveness of MOOCs or MOOCs + tutoring?
Think Like a Chief Innovation Officer and Get Work Done
Joao-Pierre S. Ruth, Senior Writer,  10/13/2020
10 Trends Accelerating Edge Computing
Cynthia Harvey, Freelance Journalist, InformationWeek,  10/8/2020
Northwestern Mutual CIO: Riding Out the Pandemic
Jessica Davis, Senior Editor, Enterprise Apps,  10/7/2020
White Papers
Register for InformationWeek Newsletters
2020 State of DevOps Report
2020 State of DevOps Report
Download this report today to learn more about the key tools and technologies being utilized, and how organizations deal with the cultural and process changes that DevOps brings. The report also examines the barriers organizations face, as well as the rewards from DevOps including faster application delivery, higher quality products, and quicker recovery from errors in production.
Current Issue
[Special Report] Edge Computing: An IT Platform for the New Enterprise
Edge computing is poised to make a major splash within the next generation of corporate IT architectures. Here's what you need to know!
Flash Poll