AI in Schools: Students Raise Concerns Over Surveillance, Access, and Deepfakes
A growing number of students are voicing concerns about the increasing use of artificial intelligence in education, extending beyond the widely discussed issue of AI-assisted cheating.from blocked research materials to heightened surveillance and the threat of AI-generated misinformation, students are finding themselves navigating a complex landscape where the technology intended to aid learning can also present critically important obstacles.
Blocked Access to Facts
Christianna Thomas, a senior at Heights High School in Texas, experienced firsthand how AI policies can hinder learning. While her school’s International Baccalaureate program utilizes AI to detect plagiarism,the same technology also restricts access to information. When researching the education system in Communist Cuba during the Cold War, Thomas found her school’s web filter repeatedly blocked her access, even on her personal laptop while on campus.
schools often employ AI-powered web filters to protect students from inappropriate content.Though, students report that these filters can inadvertently block access to valuable resources. The Trevor Project,a crisis intervention and suicide prevention organization,can be flagged due to its chat feature. JSTOR, a database of scholarly articles, faces restrictions as of some sexually explicit content. Even the Internet Archive, a vital resource for free access to information, is sometimes blocked.
Did You Know? A 2024 study by the Center for Democracy & Technology found that many school content filters lack transparency and due process,making it arduous for students and educators to challenge incorrect blocking decisions.
Surveillance and Privacy Concerns
The use of AI extends beyond web filtering to include student surveillance. Schools are increasingly relying on AI to scan online activity and assess risk, sometimes leading to what some studies describe as “heavy-handed” monitoring [1]. This surveillance can extend beyond school hours, with many edtech companies reporting they monitor students both at and outside of school.
Concerns are growing about the potential for this surveillance to infringe on students’ civil rights, particularly in light of increased federal scrutiny of immigrant communities, political activism, and LGBTQ+ rights. The use of AI-powered invigilation tools, which can increase interactions with law enforcement, is a particular worry. A 13-year-old in Tennessee was strip-searched after an arrest stemming from a joke in a private chat flagged by the monitoring service Gaggle, according to legal documents.
| Incident | location | AI Tool Involved | Outcome |
|---|---|---|---|
| Joke in private chat flagged | Tennessee | Gaggle | Strip search, arrest |
| Student journalism lawsuit | Kansas | Gaggle | Constitutional rights violation claim |
| Information request denied | Grapevine-Colleyville ISD, TX | Unknown | lawsuit filed by knight First Amendment Institute |
Student Activism and Advocacy
Students are actively pushing back against these trends. Christianna Thomas works with Students Engaged in Advancing Texas, a nonprofit that trains students in advocacy. The organization is lobbying for Texas House Bill 1773, which would create nonvoting student trustee positions on school boards. They are also advancing a “Student Bill of Rights” guaranteeing freedom of expression, well-being support, and student agency in education decisions.
Deeksha Vaidyanathan, former leader of the California chapter of Encode, a student-led AI advocacy organization, successfully collaborated with her school district to develop and implement a extensive AI policy. This policy, the first of its kind within a 100-mile radius, provides a framework for ethical AI use in the classroom and addresses the harm caused by deepfakes.
Pro Tip: When advocating for change, focus on specific, actionable policy proposals rather than broad complaints. research existing models and tailor them to yoru local context.
The Threat of Deepfakes and Misinformation
A particularly alarming trend is the rise of AI-generated deepfakes, particularly non-consensual sexually explicit images targeting young girls. These “nudify” apps can create convincing fakes from a single photo, causing significant trauma. Surveys indicate this is a widespread problem [2]. States are lagging in providing guidance to schools on how to address this issue.
Suchir Paruchuri, leader of the Texas chapter of Encode, emphasizes the importance of “AI safety”-ensuring AI is used in a way that protects rights, respects dignity, and avoids harm. He advocates for limiting access to student data and incorporating student voices into decision-making processes.
What steps can schools take to balance the benefits of AI with the need to protect student privacy and well-being? How can students be empowered to participate in shaping AI policies that affect their education?
Looking Ahead: The Evolving Landscape of AI in Education
The integration of AI in education is still in its early stages, and the challenges and opportunities will continue to evolve. Key trends to watch include the development of more elegant AI-powered learning tools, the increasing use of AI for personalized learning, and the ongoing debate over data privacy and algorithmic bias. The need for clear ethical guidelines,robust data security measures,and meaningful student involvement will become increasingly critical as AI becomes more pervasive in the educational landscape.
frequently Asked Questions about AI in Schools
- What is AI being used for in schools? AI is used for plagiarism detection,web filtering,student surveillance,and personalized learning.
- Are schools required to disclose how they use AI? Disclosure requirements vary by state and district,and transparency is often lacking.
- What are deepfakes and why are they a concern? Deepfakes are AI-generated images or videos that can be used to create convincing but false content, often with malicious intent.
- What can students do if they feel their privacy is being violated? Students can contact their school administration, advocate for policy changes, or seek legal assistance.
- How can schools address the ethical concerns surrounding AI? Schools should develop clear AI policies,provide training for educators,and involve students in the decision-making process.
This is a pivotal moment in education.as AI continues to reshape the learning environment, it’s crucial that students’ voices are heard and their rights are protected. We encourage you to share this article with your network, join the conversation in the comments below, and subscribe to our newsletter for more insightful coverage of this important topic.
