Google has expanded its vulnerability rewards program (VRP) to incorporate assault eventualities particular to generative AI.
In an announcement shared with TechCrunch forward of publication, Google mentioned: “We imagine increasing the VRP will incentivize analysis round AI security and safety and convey potential points to mild that can finally make AI safer for everybody,”
Google’s vulnerability rewards program (or bug bounty) pays moral hackers for locating and responsibly disclosing safety flaws.
Provided that generative AI brings to mild new safety points, such because the potential for unfair bias or mannequin manipulation, Google mentioned it sought to rethink how bugs it receives must be categorized and reported.
The tech large says it’s doing this through the use of findings from its newly fashioned AI Red Team, a gaggle of hackers that simulate a wide range of adversaries, starting from nation-states and government-backed teams to hacktivists and malicious insiders to seek out safety weaknesses in know-how. The workforce lately performed an train to find out the most important threats to the know-how behind generative AI merchandise like ChatGPT and Google Bard.
The workforce discovered that giant language fashions (or LLMs) are weak to immediate injection assaults, for instance, whereby a hacker crafts adversarial prompts that may affect the conduct of the mannequin. An attacker may use one of these assault to generate textual content that’s dangerous or offensive or to leak delicate info. In addition they warned of one other sort of assault referred to as training-data extraction, which permits hackers to reconstruct verbatim coaching examples to extract personally identifiable info or passwords from the information.
Each of some of these assaults are lined within the scope of Google’s expanded VRP, together with mannequin manipulation and mannequin theft assaults, however Google says it won’t provide rewards to researchers who uncover bugs associated to copyright points or information extraction that reconstructs non-sensitive or public info.
The financial rewards will differ on the severity of the vulnerability found. Researchers can presently earn $31,337 in the event that they discover command injection assaults and deserialization bugs in extremely delicate functions, equivalent to Google Search or Google Play. If the failings have an effect on apps which have a decrease precedence, the utmost reward is $5,000.
Google says that it paid out greater than $12 million in rewards to safety researchers in 2022.
