An issue facing online education is students getting feedback on assignments and tests from instructors in a timely manner. The crowdsourcing system Caesar is providing a solution for some students at Massachusetts Institute of Technology (MIT).
“The students in our programming courses write a lot of code and it takes a long time for a small staff of human graders to read and grade,” said MIT professor Rob Miller, who developed Caesar through the MIT computer science and artificial intelligence lab, in an article for eCampusNews. “The old way, it might take a few weeks to get feedback about what they’d written, and in that time they’ve written more programs—often repeating the same mistakes over and over.”
Caesar prioritizes submitted assignments and sends them to teaching assistants, course alumni, and computer-science students for review. Multiple reviewers are sent the assignments and all are able to offer comments and advice on the work, generally within three days and well before students have finished their next assignment.
The system is being expanded to other MIT programming courses and could be adopted by edX, the massive open online course platform founded by MIT and Harvard University. Miller also believes Caesar will work for more than just computer programming classes.
“The essential idea of crowdsourced review—dividing student work into smaller pieces and distributing those pieces to a mixed crowd of reviewers who comment on and discuss them—is likely to be applicable to many kinds of courses, including liberal arts, business, and social sciences, not just technical [courses],” he said.