Experience Tumblr like never before
New anti-AI tool from the team developing Glaze that looks to poison prompts and ruin data sets entirely.
The tool can go so far as to trick AI into generating things it didn't ask for. 50 "poisoned" images of dogs into a data set yield typical errors companies have been working to get rid of: weird proportions, extra limbs, etc. When they added 300 samples, it was drastic enough to make a data set that was trained to generate "dogs" into "cats" making the tool basically useless.
It's not out yet, but they're adding it to Glaze and they intend on making it open source.
Welcome to the age of the AI arms race.