Synthetic Media
What is Synthetic Media?
Synthetic MediaAny audio, image, video, or text content produced or substantially modified by generative AI rather than captured directly from the physical world.
Synthetic media is the umbrella category that includes deepfakes, AI-generated voices, text-to-image art, AI-written news articles, and AI-generated avatars. Not all synthetic media is malicious — creative, accessibility, and localization uses are widespread — but the same tools enable disinformation, fraud, harassment, and identity attacks. Standards bodies promote provenance and transparency: C2PA Content Credentials, JPEG Trust, IPTC photo metadata, and watermarking schemes such as Google SynthID. The EU AI Act and several national laws require clear disclosure when users interact with synthetic media. Security teams treat synthetic media as both a threat vector (deepfakes, fraud) and an asset class (AI-generated marketing, support, training data) that needs provenance, labelling, and governance.
● Examples
- 01
A C2PA-signed news image labelled as containing AI-generated elements.
- 02
A localized product video where the spokesperson's voice is regenerated in eight languages by a voice-cloning model.
● Frequently asked questions
What is Synthetic Media?
Any audio, image, video, or text content produced or substantially modified by generative AI rather than captured directly from the physical world. It belongs to the AI & ML Security category of cybersecurity.
What does Synthetic Media mean?
Any audio, image, video, or text content produced or substantially modified by generative AI rather than captured directly from the physical world.
How does Synthetic Media work?
Synthetic media is the umbrella category that includes deepfakes, AI-generated voices, text-to-image art, AI-written news articles, and AI-generated avatars. Not all synthetic media is malicious — creative, accessibility, and localization uses are widespread — but the same tools enable disinformation, fraud, harassment, and identity attacks. Standards bodies promote provenance and transparency: C2PA Content Credentials, JPEG Trust, IPTC photo metadata, and watermarking schemes such as Google SynthID. The EU AI Act and several national laws require clear disclosure when users interact with synthetic media. Security teams treat synthetic media as both a threat vector (deepfakes, fraud) and an asset class (AI-generated marketing, support, training data) that needs provenance, labelling, and governance.
How do you defend against Synthetic Media?
Defences for Synthetic Media typically combine technical controls and operational practices, as detailed in the full definition above.
What are other names for Synthetic Media?
Common alternative names include: AI-generated media, Generative media.
● Related terms
- ai-security№ 297
Deepfake
Synthetic audio, image, or video media generated by AI to convincingly depict a real person saying or doing something they did not.
- ai-security№ 035
AI Watermarking
Techniques that embed a detectable signal into AI-generated content so its provenance, model of origin, or training-set membership can be verified later.
- ai-security№ 026
AI Content Detection
Tools and techniques that estimate whether a piece of text, image, audio, or video was produced by an AI model rather than a human.
- ai-security№ 027
AI Governance
The policies, processes, roles, and controls organisations and regulators use to ensure AI systems are developed, deployed, and operated responsibly and lawfully.
- ai-security№ 034
AI Supply Chain Risk
The set of threats arising from the third-party datasets, base models, libraries, plug-ins, and infrastructure that organisations combine to build and deploy AI systems.
- ai-security№ 033
AI Safety
The discipline that aims to prevent AI systems from causing unintended harm to users, operators, and society — covering technical, operational, and societal dimensions.
● See also
- № 729Nightshade Attack