This is what high school teachers see when they open GoGuardian, a popular software application used to monitor student activity: The interface is familiar, like the gallery view of a large Zoom call. But instead of seeing teenaged faces in each frame, the teacher sees thumbnail images showing the screens of each student’s laptop. They watch as students’ cursors skim across the lines of a sonnet or the word “chlorofluorocarbon” appears, painstakingly typed into a search bar. If a student is enticed by a distraction—an online game, a stunt video—the teacher can see that too and can remind the student to stay on task via a private message sent through GoGuardian. If this student has veered away from the assignment a few too many times, the teacher can take remote control of the device and zap the tab themselves.

Student-monitoring software has come under renewed scrutiny over the course of the Covid-19 pandemic. When students in the US were forced to continue their schooling virtually, many brought home school-issued devices. Baked into these machines was software that can allow teachers to view and control students’ screens, use AI to scan text from student emails and cloud-based documents, and, in severe cases, send alerts of potential violent threats or mental health harms to educators and local law enforcement after school hours.

Now that the majority of American students are finally going back to school in-person, the surveillance software that proliferated during the pandemic will stay on their school-issued devices, where it will continue to watch them. According to a report published today from the Center for Democracy and Technology, 89 percent of teachers have said that their schools will continue using student-monitoring software, up 5 percentage points from last year. At the same time, the overturning of Roe v. Wade has led to new concerns about digital surveillance in states that have made abortion care illegal. Proposals targeting LGBTQ youth, such as the Texas governor’s calls to investigate the families of kids seeking gender-affirming care, raise additional worries about how data collected through school-issued devices might be weaponized in September.

The CDT report also reveals how monitoring software can shrink the distance between classrooms and carceral systems. Forty-four percent of teachers reported that at least one student at their school has been contacted by law enforcement as a result of behaviors flagged by the monitoring software. And 37 percent of teachers who say their school uses activity monitoring outside of regular hours report that such alerts are directed to “a third party focused on public safety” (e.g., local police department, immigration enforcement). “Schools have institutionalized and routinized law enforcement’s access to students’ information,” says Elizabeth Laird, the director of equity in civic technology at the CDT.

US senators Elizabeth Warren and Ed Markey have recently raised concerns about the software’s facilitation of contact with law enforcement, suggesting that the products may also be used to criminalize students who seek reproductive health resources on school-issued devices. The senators have sought responses from four major monitoring companies: GoGuardian, Gaggle, Securly, and Bark for Schools, which together reach thousands of school districts and millions of American students.

Widespread concerns about teen mental health and school violence lend a grim backdrop to the back-to-school season. After the mass shooting at an elementary school in Uvalde, Texas, Congress passed a law that directs $300 million for schools to strengthen security infrastructure. Monitoring companies speak to educators’ fears, often touting their products’ ability to zero in on would-be student attackers. Securly’s website offers educators “AI-powered insight into student activity for email, Google Drive, and Microsoft OneDrive files.” It invites them to “approach student safety from every angle, across every platform, and identify students who may be at risk of harming themselves or others.”

See Me After Class

Before the Roe decision brought more attention to the risks of digital surveillance, lawmakers and privacy advocates were already concerned about student-monitoring software. In March 2022, an investigation led by senators Warren and Markey found that the four aforementioned companies—which sell digital student-monitoring services to K-12 schools—raised “significant privacy and equity concerns.” The investigation pointed out that low-income students (who tend to be disproportionately Black and Hispanic) rely more heavily on school devices and are exposed to more surveillance than affluent students; it also uncovered that schools and companies were often not required to disclose the use and extent of their monitoring to students and parents. In some cases, districts can opt to have a company send alerts directly to law enforcement instead of a school contact.

Students are often unaware that their AI hall monitors are imperfect and can be misused. An investigation by The 74 Million found that Gaggle would send students warning emails for harmless content, like profanity in a fiction submission to the school literary magazine. One high school newspaper reported that the district used monitoring software to reveal a student’s sexuality and out the student to their parents. (Today’s CDT report revealed that 13 percent of students knew someone who had been outed as a result of student-monitoring software.) A Texas student newspaper’s editorial board argued that their school’s use of the software might prevent students from seeking mental health support.

Also disquieting are the accounts of monitoring software breaching students’ after-school lives. One associate principal I spoke to for this story says his district would receive “Questionable Content” email alerts from Gaggle about pornographic photos and profanities from students’ text messages. But the students weren’t texting on their school-issued Chromebooks. When administrators investigated, they learned that while teens were home, they would charge their phones by connecting them to their laptops via USB cables. The teens would then proceed to have what they believed to be private conversations via text, in some cases exchanging nude photos with significant others—all of which the Gaggle software running on the Chromebook could detect. Now the school advises students not to plug their personal devices into their school-issued laptops.

This pervasive surveillance has always been disconcerting to privacy advocates, but the criminalization of reproductive health care in some states makes those problems more acute. It’s not difficult to envision a student who lives in a state where ending a pregnancy is illegal using a search engine to find out-of-state abortion clinics, or chatting online with a friend about an unplanned pregnancy. From there, teachers and administrators could take it upon themselves to inform the student’s parent or local law enforcement.