EP34: Don't Freak Out About Quantitative Results

When you're in the early stages of building a business, you need to move quickly. But when you're testing growth channels, there is a difference between moving quickly and freaking out.   In this episode of the InDemand podcast, host Asia Orangio, founder of DemandMaven, uncovers the pitfalls that teams can fall into when reacting to quantitative results.   She covers the mistakes that founders make when reacting to experiments and how to set yourself up for success when running tests and reacting to the results.   TL;DL 0:22 - Don't freak out about bad numbers. Early technical founders have a tendency to overreact to test data from marketing and growth campaigns. But in growth you're working with humans, not code, and you can't always trust immediate results. 4:35 - A one to two week experiment with low spend on a growth channel likely won't show you a clear result. If you react to it you might be missing a big opportunity. 8:00 - A company Asia worked with was testing out a video demo option. After one week and getting two requests for the video the team was resigned to the fact that it wasn't working, but after waiting it turned out that having the video was actually increasing the number of prospects entering the pipeline. 12:45 - You always have to remember that quantitative outputs can tell you 'what', but can't tell you 'why'. Before you react, you have to pause and dig deeper to understand what is driving the numbers. 20:07 - When you're running a test, the sample size matters. You need a large enough volume of results to be able to trust the results. There is a natural variance in the results you get and if you end an experiment early you might just be seeing variance. 

Om Podcasten

Growing a SaaS? Yeah, that's hard. Growing a SaaS without a clue what you're doing from a marketing and growth perspective? Pretty much impossible — especially if you want to break the $1M and $10M ARR marks. Kim Talarczyk sits down with Asia Orangio to extract and unpack all the strategic insights she holds in her brain from working with hundreds of SaaS companies and interviewing thousands of their customers. Together, they break down how to diagnose and troubleshoot growth challenges across every part of a B2B SaaS business. About your hosts: Asia Orangio is the CEO & Founder of DemandMaven. Asia helps founders of PLG SaaS companies troubleshoot their growth across GTM, acquisition, activation, retention, and expansion and get unstuck. In early 2018, Asia founded DemandMaven — a consulting firm dedicated to helping bootstrapped and funded SaaS companies build revenue-generating growth engines. Previously, Asia served in a number of marketing roles, but most notably as head of marketing at Hull where she helped the team 10.5x in growth, and #FlipMyFunnel / Terminus as demand generation manager. Asia also served on the board of Moz before its successful acquisition in 2021. Kim Talarczyk is the Client Services and Operations Manager at DemandMaven, where she ensures all client engagements are executed to the highest standard. With a strong background in client-facing roles and professional service firms, Kim has played a key role in scaling operations and delivering exceptional experiences for both B2C and B2B brands.