As generative AI systems and voice cloning apps grow, organizations are seeing a rise in fraudulent calls. Organizations need to be vigilant and plan to deal with these threats.
The growth of deepfakes in the past few years is a threat to not only organizations, but also the U.S. general election in November.
Information security vendor Pindrop saw a sharp rise in deepfakes in the first few months of this year compared with the previous year. Deepfakes of Vice President Kamala Harris, former President Donald Trump, President Joe Biden and state-level candidates have circulated in the run-up to the November U.S. general election.
"Last year, we were seeing about one deepfake every single month," said Vijay Balasubramaniyan, co-founder and CEO at Pindrop, on the Targeting AI podcast. "Starting this year ... we started seeing a deepfake every single day across every single customer."
Starting this year ... we started seeing a deepfake every single day across every single customer.
Vijay BalasubramaniyanCEO and co-founder, Pindrop
A big reason for the stark increase is the growth of generative AI systems and voice cloning apps. While about 120 voice cloning apps were on the market last year, users -- both legitimate and illegitimate -- can choose among more than 350 voice cloning apps this year.
Moreover, Balasubramaniyan said, fraudsters are using generative AI technology to scale their attacks.
For example, generative AI systems can create deepfakes in many different languages -- a series of large language models from Meta can translate some 4,000 languages. Fraudsters can use these systems to create deepfakes that can respond to questions depending on which words are spoken.
"They have managed to scale their attacks in massive ways, and in ways that we have not seen before generative AI. We're seeing that now," Balasubramaniyan said.
Meanwhile, many people can't distinguish between a deepfake voice and an authentic one.
The massive progression of deepfake technology means organizations must remain aware and vigilant, said Harman Kaur, vice president of AI at Tanium, on the podcast. Tanium is a cybersecurity and management vendor based in Kirkland, Wash.
"You have to have a plan to respond," Kaur said. "Do you have the tools to understand what type of threat has been invited into your network, and do you have the tools to fix it?"
Esther Ajao is a TechTarget Editorial news writer and podcast host covering artificial intelligence software and systems. Shaun Sutner is senior news director for TechTarget Editorial's information management team, driving coverage of artificial intelligence, analytics and data management technologies. Together, they host the Targeting AI podcast series.
