I’ve said from the beginning that the biggest risk with AI isn’t that it writes bad code. It’s that people are starting to trust it to make decisions it has no business making.
New research drives that point home.
Researchers have uncovered a new attack called HalluSquatting, and it exploits one of AI’s most well-known weaknesses: it would rather make something up than admit it doesn’t know the answer.
That behavior, which we’ve all come to know as hallucination, is no longer just an annoyance. It can now be turned into a weapon.
Here’s how it works. [Read more…]