When someone doesn't follow the rules in an academic environment, there must be consequences to ensure fairness. But what happens when the evidence isn’t clear? Or when the evidence absolving them is overlooked? The integrity of the system is lost.
Academic institutions can easily fall into this situation when they choose the wrong online proctoring software. Relying solely on human proctors is impractical, imprecise, and does not offer the documentary evidence available in automated systems. Algorithmic proctoring solutions without human oversight, however, can produce inaccurate results, perpetuate systemic inequality, and leave students without recourse. And these are not the only factors universities and other academic institutions must consider; many remote proctoring solutions include features that students find profoundly intrusive or even discriminatory. Such products may catch violations during an online exam, but at what cost?
Robust and thoughtful invigilation is necessary to create strong relationships with students, ensure the integrity of test results, and preserve the reputations of academic institutions. By exploring how four students rate some of the most widely used remote proctoring solutions, you can better understand the need for a state-of-the-art online exam experience.
Since the mass migration to online education in 2020, students are increasingly speaking out about the damaging effects of many popular proctoring platforms. However, concerns about online invigilation have existed for years.
A 2017 study at the University of Minnesota found that 40% of students were comfortable or very comfortable with taking exams in a remote proctoring environment with a live human proctor, while 60% reported being somewhat or not at all comfortable. Only 30% reported being comfortable with the presence of the proctor, and a full 70% said they were somewhat or not at all comfortable. This discomfort could have a significant impact on test anxiety, which is compounded by the fact that prior to the exam, about half of students did not feel they had the expertise to set up, use, and/or navigate the proctoring software. Although most students ultimately felt that the test environment conducive to test-taking, 38% did not.
These results are concerning. And while it is reasonable to believe that the rapidly growing prevalence of remote proctoring has increased familiarity with using such technology, online exam experiences have not necessarily improved. In fact, the ramifications of poor experiences are more visible than ever, and the relatively simple concerns about software setup are replaced by disturbing testimonies and complex ethical questions.
In the spring of 2020, Areeb Been Khan was fresh out of law school. In preparation for the bar, he was required to take a mock exam using ExamSoft. ExamSoft uses facial recognition algorithms to verify the test-taker’s identity and prevent impersonation—a process that failed for Khan. Although the company claimed that the issue was “inadequate lighting”, the problems persisted regardless of lighting conditions, leading Khan to conclude that the issue wasn’t lighting at all; it was the color of his skin. “There are so many systematic barriers preventing people like me from obtaining these degrees—and this is just another example of that.”
Research suggests he’s right; people of color have experienced the effects of poor facial recognition for years. As Klint Findley wrote in Wired Magazine:
Facial-recognition software works by training algorithms with thousands, or preferably millions, of examples and then testing the results. Researchers say the problematic facial-recognition systems likely were given too few black faces and can only identify them under ideal lighting conditions.
These technological shortcomings aren’t just frustrating; they can directly impact test-takers’ future opportunities. Perhaps even more disturbing, they perpetuate historical inequalities and discriminatory practices against racialized groups. This has significant implications for both individuals and communities and can deeply erode trust in educational institutions.
For Jazi, a 19-year-old student at the University of Texas at San Antonio, the online exam experience was compromised for different reasons. When Jazi was sent back home to study due to Covid, she had to take care of her younger siblings. She also had to take online exams using Proctorio.
Students using Proctorio must take exams in quiet places; any noise may be flagged as a violation of the rules. But when you take care of kids while completing an exam, noises both on and off screen are difficult to avoid—like when Jazi’s youngest sibling banged doors in the middle of a test.
“I was ignoring him the entire time, just saying, ‘Please, God, don’t let them email me about the sound,’' she said in a recent New York Times article. “You constantly ask, ‘Why is this so hard?’ Because you know it doesn’t have to be that way. But it is.” The situation became so bad that she used all her savings to move back to campus the following semester. “I knew that if I had stayed home, there was no way I would pass.”
Even those in typical student living environments run into issues. For Nkiru Chigbogwu, the presence of roommates talking in another room or knocking on her door intensified the stress of test-taking. “All you can think about after the exam is like, was I flagged, will they think I was cheating?” she says. In the absence of real-time feedback, she has taken to emailing professors after exams to explain any potential trigger, just in case.
The environmental requirements of some online proctoring solutions can have an outsized effect on students with children or younger siblings, who are living with roommates or in large multi-generational households, or who do not have a private space to complete exams. In practice, this tends to affect groups that already face barriers to higher education: women, single parents, people of color, students with precarious housing, and low-income students.
Most remote proctoring software is notoriously bad at accurately identifying potential violations by students with certain disabilities or medical conditions. This is because the AI algorithms are not trained to discriminate between movements caused by physical and behavioral differences vs. those caused by attempts to cheat on exams.
Many students know this and seek out accommodation to protect themselves from inaccurate judgments. However, accommodation can make students feel vulnerable in new ways, as simply requesting accommodation may be seen as a way of trying to skirt the rules. They also have to cope with potential invasions of privacy.
This was the experience of Sabrina Navarro, a junior at California State University, Fullerton, who has a neurological condition that causes facial tics. Her tics weren’t different in a remote test environment, but their implications were; suddenly, they became a threat to her academic performance, as they may be flagged by proctoring software as abnormal movements. This is not unusual. In fact, many neurodivergent students find that the online exam experience exacerbates the very symptoms that may be perceived as test violations. Accommodations seemed like the only way to give herself a fair shot.
To apply for accommodations, students must submit medical records to prove their diagnosis. Revealing such personal information to an educational institution is invasive, and the accommodations themselves can amplify it. “Just the fact that professors might have access to seeing me ticcing, over and over again—it feels like an invasion of privacy with something that all my life, I’ve been pretty good at hiding.”
This leaves students in a difficult position: do you ask for accommodation and feel your privacy stripped away, or do you leave yourself vulnerable to false flagging? These are choices students should not have to make. They’re also choices not all students have. Those who don’t have an extensively documented history of disability or a clear diagnosis may not believe their application for accommodation will be successful.
The online exam experience matters for everyone involved. As more and more students go public with their stories, it is becoming evident that most remote proctoring solutions leave much to be desired.
Not only do the problems caused by inferior products threaten students’ academic success and professional opportunities, but they also damage relationships between students and institutions and can tarnish the reputations of even the finest schools. For some, they even invite cheating. As one student says, “I feel morally conflicted. I am at the point where I’m like, if I’m paying you thousands of dollars for an education and you’re not doing your job, then I don’t have to do mine either.”
Rosalyn’s innovative invigilation solution is designed to promote academic integrity without compromising student dignity or invading their privacy. To do this, we:
By building Rosalyn around these principles, our system supports fair, comfortable test-taking experiences that both students and institutions can trust.
Rosalyn.ai
Dublin, OH
