Generative Artificial Intelligence (GenAI) and Large Language Models (LLMs)
are marvels of technology; celebrated for their prowess in natural language
processing and multimodal content generation, they promise a transformative
future. But as with all powerful tools, they come with their shadows. Picture
living in a world where deepfakes are indistinguishable from reality, where
synthetic identities orchestrate malicious campaigns, and where targeted
misinformation or scams are crafted with unparalleled precision. Welcome to the
darker side of GenAI applications.
This article is not just a journey through the meanders of potential misuse
of GenAI and LLMs, but also a call to recognize the urgency of the challenges
ahead. As we navigate the seas of misinformation campaigns, malicious content
generation, and the eerie creation of sophisticated malware, we'll uncover the
societal implications that ripple through the GenAI revolution we are
witnessing. From AI-powered botnets on social media platforms to the unnerving
potential of AI to generate fabricated identities, or alibis made of synthetic
realities, the stakes have never been higher.
The lines between the virtual and the real worlds are blurring, and the
consequences of potential GenAI's nefarious applications impact us all. This
article serves both as a synthesis of rigorous research presented on the risks
of GenAI and misuse of LLMs and as a thought-provoking vision of the different
types of harmful GenAI applications we might encounter in the near future, and
some ways we can prepare for them.

这篇论文讨论了生成型人工智能（GenAI）和大型语言模型（LLMs）的潜在滥用风险和社会影响，并提出了应对挑战和准备的思考。

应用生成人工智能和大型语言模型的险恶行为

GenAI Against Humanity: Nefarious Applications of Generative Artificial  Intelligence and Large Language Models

Persuasion is a key aspect of what it means to be human, and is central to
business, politics, and other endeavors. Advancements in artificial
intelligence (AI) have produced AI systems that are capable of persuading
humans to buy products, watch videos, click on search results, and more. Even
systems that are not explicitly designed to persuade may do so in practice. In
the future, increasingly anthropomorphic AI systems may form ongoing
relationships with users, increasing their persuasive power. This paper
investigates the uncertain future of persuasive AI systems. We examine ways
that AI could qualitatively alter our relationship to and views regarding
persuasion by shifting the balance of persuasive power, allowing personalized
persuasion to be deployed at scale, powering misinformation campaigns, and
changing the way humans can shape their own discourse. We consider ways
AI-driven persuasion could differ from human-driven persuasion. We warn that
ubiquitous highlypersuasive AI systems could alter our information environment
so significantly so as to contribute to a loss of human control of our own
future. In response, we examine several potential responses to AI-driven
persuasion: prohibition, identification of AI agents, truthful AI, and legal
remedies. We conclude that none of these solutions will be airtight, and that
individuals and governments will need to take active steps to guard against the
most pernicious effects of persuasive AI.

研究人工智能（AI）系统的说服力，探讨其未来发展可能造成的影响，如信息泛滥，个性化说服等，并寻找禁止、真实自然语言生成、鉴别 AI 代理和法律补救等解决方案。