Generative AI: A Creative New World

Free

A comprehensive examination of the generative AI industry, offering a historical perspective and in-depth analysis of the industry ecosystem. By Sonya Huang, Pat Grady and GPT-3, September 19, 2022.

FreeFree tier

Type

Open Source

Company

Sequoia Capital

Visit Website GitHub (40 stars)

About Generative AI: A Creative New World

This article from Sequoia Capital, co-authored by Sonya Huang, Pat Grady, and GPT-3, provides a comprehensive overview of the generative AI industry. It traces the evolution from small models (pre-2015) to the race to scale with transformer architectures (2015–present), explaining how large language models enable machines to write, code, draw, and create with credible, sometimes superhuman results. The piece analyzes the economic potential of generative AI—projecting trillions of dollars in value—by making knowledge and creative workers at least 10% more efficient. It also identifies industries ripe for reinvention, from social media and gaming to law and sales, and discusses the trade-offs between full automation and human-machine collaboration.

Key Features

Large language models enable machines to write, code, draw, and create with credible results

Transformers architecture (Attention is All You Need) as key enabler

Shift from 'Analytical AI' to 'Generative AI'

Potential to lower marginal cost of creation toward zero

Human-machine iterative creative cycle for best outcomes

Three historical waves: small models (pre-2015), scaling (2015–2022), and current rapid advancement

Pros & Cons

Pros

Machines can generate creative work with superhuman quality in some cases
Faster and cheaper creation across wide range of markets
Potential to increase worker efficiency by at least 10%
Unlocks trillions of dollars in economic value
Enables a tight iterative creative cycle between human and machine

Cons

Certain functions may be completely replaced by generative AI, potentially displacing human workers
Requires massive compute and data resources, raising accessibility and environmental concerns
Not yet capable of general-purpose creative tasks; still domain-specific

Best For

Social media content creationGaming design and developmentAdvertising copy and visualsArchitecture and designCoding and software developmentGraphic design and illustrationProduct designLegal document drafting

FAQ

What is Generative AI?

Generative AI is a category of artificial intelligence where machines generate something new (text, code, images, etc.) using large language models, as opposed to analyzing existing data (Analytical AI).

Why are generative models becoming so powerful now?

Better models (especially transformer architectures like in 'Attention is All You Need'), more data, and more compute have led to human-level and superhuman results in creative tasks since 2015.

What industries could be transformed by Generative AI?

The article identifies social media, gaming, advertising, architecture, coding, graphic design, product design, law, marketing, and sales as industries up for reinvention.

Will Generative AI replace human workers?

Certain functions may be completely replaced, but many will thrive from a tight iterative creative cycle between human and machine, making workers more efficient and capable.