July 11, 2019 |

If AI could feel, it would fear cyber attacks from people

New report from EU research group says attacks against AI systems are already occurring, difficult to identify, and potentially far more common than currently understood

Helsinki, Finland – July 11, 2019: Artificial intelligence (AI) is rapidly finding applications in nearly every walk of life. Self-driving cars, social media networks, cyber security companies, and everything in between uses it. But a new report published by the SHERPA consortium – an EU project studying the impact of AI on ethics and human rights that F-Secure joined in 2018 – finds that while human attackers have access to machine learning techniques, they currently focus most of their efforts on manipulating existing AI systems for malicious purposes instead of creating new attacks that would use machine learning.

The study’s primary focus is on how malicious actors can abuse AI, machine learning, and smart information systems. The researchers identify a variety of potentially malicious uses for AI that are well within reach of today’s attackers, including the creation of sophisticated disinformation and social engineering campaigns.

And while the research found no definitive proof that malicious actors are currently using AI to power cyber attacks, they highlight that adversaries are already attacking and manipulating existing AI systems used by search engines, social media companies, recommendation websites, and more.

F-Secure’s Andy Patel, a researcher with the company’s Artificial Intelligence Center of Excellence, thinks many people would find this surprising. Popular portrayals of AI insinuate it will turn against us and start attacking people on its own. But the current reality is that humans are attacking AI systems on a regular basis.

“Some humans incorrectly equate machine intelligence with human intelligence, and I think that’s why they associate the threat of AI with killer robots and out of control computers,” explains Patel. “But human attacks against AI actually happen all the time. Sybil attacks designed to poison the AI systems people use every day, like recommendation systems, are a common occurrence. There’s even companies selling services to support this behavior. So ironically, today’s AI systems have more to fear from humans than the other way around.”

Sybil attacks involve a single entity creating and controlling multiple fake accounts in order to manipulate the data that AI uses to make decisions. A popular example of this attack is manipulating search engine rankings or recommendation systems to promote or demote certain pieces of content. However, these attacks can also be used to socially engineer individuals in targeted attack scenarios.

“These types of attacks are already extremely difficult for online service providers to detect and it’s likely that this behavior is far more widespread than anyone fully understands,” says Patel, who’s done extensive research on suspicious activity on Twitter.

But perhaps AI’s most useful application for attackers in the future will be helping them create fake content. The report notes that AI has advanced to a point where it can fabricate extremely realistic written, audio, and visual content. Some AI models have even been withheld from the public to prevent them from being abused by attackers.

“At the moment, our ability to create convincing fake content is far more sophisticated and advanced than our ability to detect it. And AI is helping us get better at fabricating audio, video, and images, which will only make disinformation and fake content more sophisticated and harder to detect,” says Patel. “And there’s many different applications for convincing, fake content, so I expect it may end up becoming problematic.”

The study was produced by F-Secure and its partners in SHERPA – an EU-funded project founded in 2018 by 11 organizations from 6 different countries. Additional findings and topics covered in the study include:

  • Adversaries will continue to learn how to compromise AI systems as the technology spreads
  • The number of ways attackers can manipulate the output of AI makes such attacks difficult to detect and harden against
  • Powers competing to develop better types of AI for offensive/defensive purposes may end up precipitating an “AI arms race”
  • Securing AI systems against attacks may cause ethical issues (for example, increased monitoring of activity may infringe on user privacy)
  • AI tools and models developed by advanced, well-resourced threat actors will eventually proliferate and become adopted by lower-skilled adversaries

 

SHERPA Project Coordinator Professor Bernd Stahl from De Montfort University Leicester says F-Secure’s role in SHERPA as the sole partner from the cyber security industry is helping the project account for how malicious actors can use AI to undermine trust in society.

“Our project’s aim is to understand ethical and human rights consequences of AI and big data analytics to help develop ways of addressing these. This work has to be based on a sound understanding of technical capabilities as well as vulnerabilities, a crucial area of expertise which F-Secure contributes to the consortium,” says Stahl. “We can’t have meaningful conversations about human rights, privacy, or ethics in AI without considering cyber security. And as a trustworthy source of security knowledge, F-Secure’s contributions are a central part of the project.”

The full-length study is currently available here. More information on artificial intelligence and cyber security is available on F-Secure’s Blog, or F-Secure’s News from the Labs research blog.

 

About F-Secure

Nobody has better visibility into real-life cyber attacks than F-Secure. We’re closing the gap between detection and response, utilizing the unmatched threat intelligence of hundreds of our industry’s best technical consultants, millions of devices running our award-winning software, and ceaseless innovations in artificial intelligence. Top banks, airlines, and enterprises trust our commitment to beating the world’s most potent threats. Together with our network of the top channel partners and over 200 service providers, we’re on a mission to make sure everyone has the enterprise-grade cyber security we all need. Founded in 1988, F-Secure is listed on the NASDAQ OMX Helsinki Ltd.

f-secure.com | twitter.com/fsecure | linkedin.com/f-secure

 

F-Secure media relations

Adam Pilkey
+358 40 637 8859

Latest Press Releases

November 5, 2019

F-Secure garners “superior technical skills” recognition in recent industry evaluation report

Helsinki, Finland – November 4, 2019: Independent research firm Forrester has named F-Secure Consulting as a “Strong Performer” in their recent report, The Forrester Wave™: European Cybersecurity Consulting Providers, Q4 2019*. The evaluation is the first to assess F-Secure’s newly-formed consultancy unit. In it, Forrester recognized F-Secure Consulting for demonstrating “superior technical skills”. Forrester’s evaluation […]

October 16, 2019

Expanded F-Secure, Zyxel co-operation accelerates the delivery of connected home security through service providers

Secure Wi-Fi gateways coming to homes in Europe and North America through Zyxel’s customers and partners.

October 16, 2019

MITRE ATT&CK evaluation confirms F-Secure’s industry-leading capabilities in detecting advanced attacks

The results establish F-Secure’s EDR technologies as a rock-solid foundation for building comprehensive detection and response capabilities, going beyond MITRE’s framework.

September 27, 2019

F-Secure joins ETIS to help Europe’s telecom providers secure smart homes

F-Secure’s experience working with operators is a critical asset to help telecommunications sector tackle connected home security challenges.

%d bloggers like this: