The possibility of strike back, massively trolling all the school if students team and decide to search for controversial statements all the time, everybody at the same time, or search "What to do if a teacher try to abuse sexually of me" just for fun, is fabulous. Matherial of legend.
If the alarm is triggered at a higher level, the school direction will gasp and remove the program in a hurry for fear of being signaled as a conflictive place with low score. If not the disruption and massive lose of time and calling to annoyed parents would taint or nuke the stupid data collecting bussiness.
Obviously being watched all the time will cause distress and strange behaviour in students, something that psychologists will understand perfectly with just an innocent sad look.
This. Kids are smart and the amount of ways to troll these 'ai' and 'smart systems' are endless. Hell, make a script that just searches endlessly controversial topics, and boom all that data is worthless. For every company trying to spy on these kids, theres a student who understands how these systems work and we all know how creative and open-minded younger people are.
If the alarm is triggered at a higher level, the school direction will gasp and remove the program in a hurry for fear of being signaled as a conflictive place with low score. If not the disruption and massive lose of time and calling to annoyed parents would taint or nuke the stupid data collecting bussiness.
Obviously being watched all the time will cause distress and strange behaviour in students, something that psychologists will understand perfectly with just an innocent sad look.