
Featured Episode
Just released: the newest Signal & Noise conversation. Full episode library below.
November 18, 2026
In the third and final installment of our live coverage from TMRE 2026 in Denver, Signal & Noise correspondent Lucas Longacre sits down on the show floor with Tracy Adams, Senior Director of Research and Insights at the Advertising Research Foundation (ARF), and Keith Smith, Managing Director of the Marketing Science Institute (MSI), to cut through the hype around AI-generated respondents.
Fresh off their TMRE session, “Decision-Ready or Not? How to Validate Synthetic Data,” Tracy and Keith walk through the joint ARF/MSI validation framework and explain why the level of validation should scale with the risk of the decision. Synthetic data can shine in early exploration and concept generation, needs more rigor when you’re narrowing 20 concepts down to four, and demands multiple avenues of validation before it informs a product launch, segmentation or forecast.
They also get candid about where synthetic falls short. Synthetic samples don’t just average toward the middle; they often return nothing but the middle, flattening the tails, outliers and niche segments marketers most need to find. Tracy shares ARF survey findings showing AI confidence is sky-high while only about a third of marketers take the time to validate outputs, and Keith asks a provocative question: if human survey responses are already degraded by AI use, what’s the right ground truth?
Plus: why AI’s sycophancy is a research risk, the “pendulum” of AI hype and backlash, why most organizations hand employees a chatbot with no framework, advice for junior researchers on building critical thinking by pushing back on AI, and how research roles are collapsing and expanding at the same time.
A must-watch for researchers, insights leaders, marketers and anyone evaluating synthetic data vendors.
CHAPTERS
-
00:00 Intros: Tracy Adams (ARF) & Keith Smith (MSI)
-
01:58 Why TMRE: AI and the synthetic data wave
-
04:00 “Decision-Ready or Not?” and defining synthetic data
-
06:00 The Wild West: black-box vendors and “magic beans”
-
07:50 ARF survey: high AI confidence, low validation
-
10:00 Three decision contexts: exploration, prioritization, final decisions
-
12:35 What synthetic data is NOT good for
-
15:00 Rethinking ground truth when human responses are degraded
-
16:30 Can Reddit and Discord data improve synthetic?
-
18:10 When does using AI become just how we work?19:40 The AI pendulum: hype, backlash and the middle
-
21:30 The long road to ROI and the “here’s a chat account” problem
-
24:00 Advice for junior researchers: push back and think critically
-
29:15 Critical thinking is a life skill
-
30:00 Are research roles collapsing or expanding?
-
37:40 Where to follow the ARF and MSI
GUESTS
Tracy Adams, Senior Director of Research and Insights, ARF: https://thearf.org
Keith Smith, Managing Director, Marketing Science Institute: https://msi.org
The ARF/MSI synthetic data validation framework is available on both organizations’ websites.

All Episodes
Browse every conversation across media, data, tech, and AI.
The complete archive. Newest episodes appear first.

Let's Chat.
Questions, partnerships, sponsorships, or guest ideas?
We’d love to hear from you.












































