Idea
Generative recommendation system boosting ad revenue and scaling real-time advertising for hundreds of millions of users.
Research Paper
Core Innovation
This paper presents GR4AD, which innovates with UA-SID tokenization to capture complex ad semantics, LazyAR decoder to reduce inference cost, and value-aware supervised learning combined with ranking-guided reinforcement learning for business-aligned optimization. It also introduces dynamic beam serving to adapt compute during online inference, enabling scalable, effective generative recommendation in production.
Why It Matters
Advertising platforms face challenges in scaling real-time recommendation with high efficiency and business value alignment. GR4AD improves ad revenue by optimizing generation and serving under fixed compute budgets, enabling continual online updates and dynamic inference scaling. This transforms large-scale ad delivery workflows by balancing performance and cost at massive scale.
Market Size (TAM)
$20–50B TAM for digital advertising recommendation systems; $5–10B SAM from large-scale online platforms and ad tech companies. Driven by growth in programmatic advertising and demand for real-time personalized ads.
Potential Customers & Pain Points
- Online advertising platforms – Need scalable efficient real-time recommendation
- Ad tech companies – Require higher ad revenue and better business value alignment
- Large-scale content platforms – Demand high-throughput serving for millions of users
Business Model
Licensing or SaaS model offering the generative recommendation platform to large-scale advertising platforms and ad tech companies, with pricing based on usage volume and performance improvements.
Competitive Landscape
- Google Ads recommendation systems
- Facebook Ads delivery
- Amazon Advertising
- Criteo
- The Trade Desk
Implementation Challenges
- Integration complexity with existing ad tech stacks
- Maintaining low latency under high load
- Ensuring continual model updates without service disruption
- Balancing compute cost with recommendation quality
Validation Strategy
- Conduct large-scale A/B tests on partner advertising platforms
- Measure ad revenue uplift and inference cost reduction
- Demonstrate scalability to hundreds of millions of users
- Collect feedback on integration and operational stability
Research Paper Overview
Generative Recommendation for Large-Scale Advertising
Summary
GR4AD is a production-oriented generative recommendation system designed for large-scale advertising. It introduces innovations in tokenization, decoding, optimization, and serving to improve ad revenue and efficiency. Deployed at Kuaishou, it supports over 400 million users with real-time, high-throughput serving and shows significant revenue gains in large-scale A/B tests.