Signal and Noise

The Research Industry's Self-Inflicted Wound | Signal & Noise Ep 36

54 min · 3. juni 2026
episode The Research Industry's Self-Inflicted Wound | Signal & Noise Ep 36 cover

Description

In this episode, Brian and Andrew sit down with Dan Entrup, co-founder of AggKnowledge, to talk about one of the most overlooked drivers of the data quality crisis: the respondent experience nobody is actually fixing. Dan tracked every research outreach he received over 15 months and turned it into a SampleCon presentation. The numbers were brutal. 137 times asked his age. 57 dental requests sent to someone who has never been a dentist. An inbox so flooded with irrelevant surveys that even a motivated expert panelist nearly quit. His point is sharp: bad targeting is not just inefficient, it is actively killing the panels we depend on. The conversation gets into what AggKnowledge is building to solve it upstream, why free-text profiling and stale data are quietly sabotaging research operations at scale, and why identity verification and workplace verification are not the same thing. There is also a candid take on the M&A and funding landscape, who is well-positioned, where the yellow flags are, and why human knowledge only gets more valuable as AI takes over everything else. Key Takeaways: * Why bad targeting is a fraud accelerant, not just a waste of budget * What 15 months of tracking his own respondent experience revealed about how broken outreach really is * Why the gap between identity verification and workplace verification is where embellishment hides * How upstream profiling data can reduce fraud before a screener is ever sent * Why companies beating on revenue are still seeing their stock drop, and what that signals for the research industry M&A If you loved the episode, have comments, or want to appear on the show, connect with us down below! Connect with us: * LinkedIn [https://www.linkedin.com/company/roirocket/] * YouTube [https://www.youtube.com/channel/UCnmhaTMIktkMgdhVz3Bpbnw] * ROI Rocket [https://www.roirocket.com/] Connect with Dan Entrup: * LinkedIn [https://www.linkedin.com/in/danielentrup/] * Agg [https://www.aggknowledge.ai/]Knowledge [https://www.aggknowledge.ai/] * It's Pronounced Data [https://itspronounceddata.beehiiv.com/] (Newsletter)

Comments

0

Be the first to comment

Sign up now and become a member of the Signal and Noise community!

Get Started

1 month for 9 kr.

Then 99 kr. / month · Cancel anytime.

  • Podcasts kun på Podimo
  • 20 lydbogstimer pr. måned
  • Gratis podcasts

All episodes

38 episodes

episode Digital Twins, Synthetic Data, and Fairgen’s Transparency | Signal & Noise Ep 38 artwork

Digital Twins, Synthetic Data, and Fairgen’s Transparency | Signal & Noise Ep 38

Brian sits down with Samuel Cohen, CEO of Fairgen, for a no-fluff conversation about what is actually happening in synthetic data and who is positioned to win as the space matures. Samuel cuts through the vendor noise fast: most companies claiming to train models on millions of survey responses are not doing that. What is under the hood is usually far simpler, and the lack of transparency is quietly eroding trust in the whole category. Fairgen's answer is to model at the individual level and be open about how it works. The conversation also covers how collapsing time to insight is changing research workflows, where digital twins fit alongside real respondents in the next few years, and Samuel's unfiltered take on which players are well-positioned and which ones need to rethink their model now. Key Takeaways: * Why the data behind the model matters far more than which LLM is powering it * What most synthetic vendors are actually doing versus what they claim * Who wins as synthetic data matures and who is in trouble * What are the best use cases for Digital Twins & Synthetic Data If you loved the episode, have comments, or want to appear on the show, connect with us down below! Connect with us: * LinkedIn [https://www.linkedin.com/company/roirocket/] * YouTube [https://www.youtube.com/channel/UCnmhaTMIktkMgdhVz3Bpbnw] * ROI Rocket [https://www.roirocket.com/] Connect with the CEO of Fairgen, Samuel Cohen: * LinkedIn [https://www.linkedin.com/in/samuelcohenfairgen/] * Fairgen [https://www.fairgen.ai/]

Yesterday28 min
episode Questions the Industry Desperately Needs to Answer | Signal & Noise Ep 37 artwork

Questions the Industry Desperately Needs to Answer | Signal & Noise Ep 37

Andrew is in Italy on his honeymoon, a guest backed out, and Brian decided to go solo for the first time in 10 years of podcasting. No co-host, no guardrails, no agenda. Just 30 years of experience and a list of questions he has been sitting on for a while. None of them has clean answers. Thats kind of the point. Brian works through six questions the market research industry is not asking loudly enough: whether stacking fraud tools without coordination is quietly introducing a new category of data quality bias, who actually owns the definition of quality when nobody agrees, whether synthetic data is a legitimate solution or a convenient way to avoid the harder problem, where the next generation of researchers is coming from and whether the industry even knows what skills it needs to fill that pipeline, why market research is one of the only professions that shapes billion-dollar decisions without any required accreditation, and whether the M&A wave is actually good for research quality or just good for returns. These are not gotcha questions. Brian is not here to throw anyone under the bus. But he is willing to say some things out loud that tend to get avoided in favor of AI hype cycles and vendor showcases, and this episode is the result of that. Key Takeaways: * Why stacking uncoordinated fraud tools may be creating invisible bias, not solving fraud * Why the quality definition problem may eventually be settled by procurement departments instead of researchers * The legitimate use cases for synthetic data and the less legitimate reasons adoption is accelerating * Why the researcher talent shortage is really two problems bundled into one * Why market research informs billion-dollar decisions with zero required accreditation * Why consolidation looks like efficiency at first, and what history tells us happens next If you loved the episode, have comments, or want to appear on the show, connect with us down below! Connect with us: * LinkedIn [https://www.linkedin.com/company/roirocket/] * YouTube [https://www.youtube.com/channel/UCnmhaTMIktkMgdhVz3Bpbnw] * ROI Rocket [https://www.roirocket.com/]

9. juni 202626 min
episode The Research Industry's Self-Inflicted Wound | Signal & Noise Ep 36 artwork

The Research Industry's Self-Inflicted Wound | Signal & Noise Ep 36

In this episode, Brian and Andrew sit down with Dan Entrup, co-founder of AggKnowledge, to talk about one of the most overlooked drivers of the data quality crisis: the respondent experience nobody is actually fixing. Dan tracked every research outreach he received over 15 months and turned it into a SampleCon presentation. The numbers were brutal. 137 times asked his age. 57 dental requests sent to someone who has never been a dentist. An inbox so flooded with irrelevant surveys that even a motivated expert panelist nearly quit. His point is sharp: bad targeting is not just inefficient, it is actively killing the panels we depend on. The conversation gets into what AggKnowledge is building to solve it upstream, why free-text profiling and stale data are quietly sabotaging research operations at scale, and why identity verification and workplace verification are not the same thing. There is also a candid take on the M&A and funding landscape, who is well-positioned, where the yellow flags are, and why human knowledge only gets more valuable as AI takes over everything else. Key Takeaways: * Why bad targeting is a fraud accelerant, not just a waste of budget * What 15 months of tracking his own respondent experience revealed about how broken outreach really is * Why the gap between identity verification and workplace verification is where embellishment hides * How upstream profiling data can reduce fraud before a screener is ever sent * Why companies beating on revenue are still seeing their stock drop, and what that signals for the research industry M&A If you loved the episode, have comments, or want to appear on the show, connect with us down below! Connect with us: * LinkedIn [https://www.linkedin.com/company/roirocket/] * YouTube [https://www.youtube.com/channel/UCnmhaTMIktkMgdhVz3Bpbnw] * ROI Rocket [https://www.roirocket.com/] Connect with Dan Entrup: * LinkedIn [https://www.linkedin.com/in/danielentrup/] * Agg [https://www.aggknowledge.ai/]Knowledge [https://www.aggknowledge.ai/] * It's Pronounced Data [https://itspronounceddata.beehiiv.com/] (Newsletter)

3. juni 202654 min
episode What the Trends Actually Mean for How Research Gets Done | Signal & Noise Ep 35 artwork

What the Trends Actually Mean for How Research Gets Done | Signal & Noise Ep 35

This episode is the bonus round to Brian and Andrew's four forces webinar. They ran out of time on the live session, so they saved the best part for here: where all four trends are actually pointing and what it means for how research gets done. Andrew lays out the clearest version of the webinar's thesis: capital, AI, and the data quality crisis are not three separate things. They are converging forces pushing the industry toward methodologies that are more transparent, more respondent-friendly, and more operationally feasible than what came before. From there, the conversation gets specific on async qual, AI-led conversational interviewing, and agentic research. Andrew makes a sharp argument that the next step change in automated research will not come from software companies selling AI tools. It will come from agencies building proprietary workflows trained on their own data and methodological history. The agencies that do that work now will have a moat that an off-the-shelf product cannot replicate. The episode closes with Brian's take on four things the disruption narrative tends to get wrong, including why qual is not dying and why the trust crisis will not be solved by more technology. Key Takeaways: * Why the four trends are a single converging story, not four things happening in parallel * What AI-led async qual does better than scheduled IDIs and why it matters for panel health * Why agentic research workflows will be built by agencies from the inside, not sold to them as products * Why qual is not dying and why AI quant cannibalises quant budgets, not qual budgets * Why the trust crisis is a culture problem, not a technology problem If you loved the episode, have comments, or want to appear on the show, connect with us down below! Connect with us: * LinkedIn [https://www.linkedin.com/company/roirocket/] * YouTube [https://www.youtube.com/channel/UCnmhaTMIktkMgdhVz3Bpbnw] * ROI Rocket [https://www.roirocket.com/]

26. maj 202637 min
episode Four Forces Reshaping Market Research in 2026 | Signal & Noise Ep 34 artwork

Four Forces Reshaping Market Research in 2026 | Signal & Noise Ep 34

In this special episode, Brian and Andrew bring their live webinar to the podcast feed. Drawing from recent conferences, client conversations, and industry reports, they break down four forces reshaping how research gets done: Capital Influx, the Data Quality Crisis, AI Disruption, and Methodology Reframe. Brian's core argument is that these are not four separate trends. They are one larger story with feedback loops accelerating each other, and the industry does not get to choose whether the shift happens, only whether it leads or follows. The episode also features a live Q&A, including a sharp exchange on whether there are research categories where AI should not be used yet, and a direct answer to how you sell quality to a client who thinks $12 CEOs are fine. Key Takeaways: * Why OpenAI and Anthropic’s launch of deployment consulting firms is a competitive threat the insights industry needs to take seriously * What the latest GDQ benchmarks reveal, including a 59.6 percent post-survey removal rate in B2B * Why the biggest fraud risk is not bots but humans using AI to fake qualifications and game incentives * Why synthetic data still needs proof, and why every credible synthetic platform still anchors to a verified human sample * Why the qual and quant divide has not just blurred, it has effectively disappeared If you loved the episode, have comments, or want to appear on the show, connect with us down below! Connect with us: * LinkedIn [https://www.linkedin.com/company/roirocket/] * YouTube [https://www.youtube.com/channel/UCnmhaTMIktkMgdhVz3Bpbnw] * ROI Rocket [https://www.roirocket.com/]

19. maj 202654 min