Comment on Person Hides Prompt Injection in Legal Filing Telling AI to Side With Them
ninjabard@lemmy.world 16 hours ago
“Spader Jr.’s 14-page decision excoriates the plaintiff for doing this, and said the manipulation attempt was the problem, not the possible use of AI in law.”
The attempt only exists because of the threat of using AI in legal applications. If you didn’t use AI, then there is no issue. If you use AI and these prompts activate, the onus is on you for using it in the first place.
N0t_5ure@lemmy.world 16 hours ago
That was my thought as well. The court should not be using AI to decide cases, and if they aren’t then this prompt injection shouldn’t be of concern. If they are, then there is an inherent vulnerability risking a miscarriage of justice that needs to be addressed. There was a story a while back about a teach that did this with an essay assignment to their students to catch cheaters, and most students failed it because they were copying and pasting the assignment into ChatGPT. The response was “ha ha, clever teacher.” Why is it different here?
Hackworth@piefed.ca 15 hours ago
In that story about the teacher, 32/35 students fell for it. The crazy thing to me wasn’t that the entire college class was using AI. It was that 0-3 of them actually proof read the AI’s answer before submitting it.
N0t_5ure@lemmy.world 15 hours ago
We’re literally creating a generation of morons, speeding towards Idiocracy as if we were riding a bullet train.
Emi@ani.social 15 hours ago
Tbh idiocracy is kinda a utopia. The president assigned the smartest person to solve a problem and then changes his mind when presented with evidence.
Grimy@lemmy.world 13 hours ago
Not that I disagree with your point, but it would be closer to a student adding prompt injections to his work to change his grade. It only works if the person scoring is using AI, which they shouldn’t be doing, but it’s still cheating.
wyldrstallyns@lemmy.dbzer0.com 9 hours ago
Closer still would be something simpler: the student hands in an essay with that white text footer, aiming for the possible grading algorithm. ☝🏼
Grimy@lemmy.world 7 hours ago
Thats what I meant, that was my example.
If it wasn’t cheating, then what makes the grade unfair? What about a case where the person notices it working and just silently accumulates fake grades. It’s definitely a form of cheating imo.