top of page
mic2.jpg

Podcast

Unfiltered insight from the people building the future

A no-BS podcast where the founders, innovators & executive operators across advertising, tech & AI share what’s really happening.

Subscribe on: 

Thank you to our sponsors!

Join the Signal 

Weekly no-BS insight on marketing, tech, and AI, delivered to your inbox.

BOOST.png

Featured Episode

Just released: the newest Signal & Noise conversation. Full episode library below.

Decision-Ready 3 Sq.png

November 18, 2026

In the third and final installment of our live coverage from TMRE 2026 in Denver, Signal & Noise correspondent Lucas Longacre sits down on the show floor with Tracy Adams, Senior Director of Research and Insights at the Advertising Research Foundation (ARF), and Keith Smith, Managing Director of the Marketing Science Institute (MSI), to cut through the hype around AI-generated respondents.

 

Fresh off their TMRE session, “Decision-Ready or Not? How to Validate Synthetic Data,” Tracy and Keith walk through the joint ARF/MSI validation framework and explain why the level of validation should scale with the risk of the decision. Synthetic data can shine in early exploration and concept generation, needs more rigor when you’re narrowing 20 concepts down to four, and demands multiple avenues of validation before it informs a product launch, segmentation or forecast.

 

They also get candid about where synthetic falls short. Synthetic samples don’t just average toward the middle; they often return nothing but the middle, flattening the tails, outliers and niche segments marketers most need to find. Tracy shares ARF survey findings showing AI confidence is sky-high while only about a third of marketers take the time to validate outputs, and Keith asks a provocative question: if human survey responses are already degraded by AI use, what’s the right ground truth?

 

Plus: why AI’s sycophancy is a research risk, the “pendulum” of AI hype and backlash, why most organizations hand employees a chatbot with no framework, advice for junior researchers on building critical thinking by pushing back on AI, and how research roles are collapsing and expanding at the same time.

 

A must-watch for researchers, insights leaders, marketers and anyone evaluating synthetic data vendors.

 

CHAPTERS

  • 00:00 Intros: Tracy Adams (ARF) & Keith Smith (MSI)

  • 01:58 Why TMRE: AI and the synthetic data wave

  • 04:00 “Decision-Ready or Not?” and defining synthetic data

  • 06:00 The Wild West: black-box vendors and “magic beans”

  • 07:50 ARF survey: high AI confidence, low validation

  • 10:00 Three decision contexts: exploration, prioritization, final decisions

  • 12:35 What synthetic data is NOT good for

  • 15:00 Rethinking ground truth when human responses are degraded

  • 16:30 Can Reddit and Discord data improve synthetic?

  • 18:10 When does using AI become just how we work?19:40 The AI pendulum: hype, backlash and the middle

  • 21:30 The long road to ROI and the “here’s a chat account” problem

  • 24:00 Advice for junior researchers: push back and think critically

  • 29:15 Critical thinking is a life skill

  • 30:00 Are research roles collapsing or expanding?

  • 37:40 Where to follow the ARF and MSI

 

GUESTS

Tracy Adams, Senior Director of Research and Insights, ARF: https://thearf.org

Keith Smith, Managing Director, Marketing Science Institute: https://msi.org

The ARF/MSI synthetic data validation framework is available on both organizations’ websites.

Green Sound Backdrop.png

All Episodes

Browse every conversation across media, data, tech, and AI.

The complete archive. Newest episodes appear first.

Cloudy Blue Sky

Let's Chat.

Questions, partnerships, sponsorships, or guest ideas? 

​

We’d love to hear from you.

bottom of page