Some might imagine that most companies today glide through product questions. They just pull on an array of key metrics that make the correct decision obvious. After all, it is easier than ever to collect product data!
But time and time again, companies report that they are not making data-informed decisions. What gives? Unfortunately, this is a classic example of the titular concept from Barry Schwartz's book "The Paradox of Choice." At its core, Schwartz argues that eliminating choice improves the customer experience. The same principle applies to the world of product metrics. Companies are collecting more data than ever. Instead of finding clarity, teams are increasingly overwhelmed by their data. In today's world, where data is pouring from every corner, it is fundamental to figure out how to cut through the noise and focus on what matters.
Contents:
As a product manager, designer, or founder, it’s essential to understand how your product is performing. Without metrics, you are basically operating off instinct. If you are pre-product, then I appreciate you doing your homework and reading, but obviously, you have no product metrics to operate with. If you have a live product with real customers, then ignoring customer/product data is squandering a golden opportunity.
The right set of product metrics gives your team x-ray vision. Complex questions can be dissected and solved with the right tools -- product metrics.
Product metrics provide instant insights into the status of your product. Rather than battling with purely subjective opinions, your team can land on the right answer faster with data-driven, or at least data-informed, discussions.
First, it is important to note that you cannot effectively track everything. If everything is important, then nothing is important. It is acceptable and necessary to draw a line in the sand -- "We are only tracking these things."
Second, with so many metrics to choose from, it can be overwhelming to decide which ones to focus on. Here are some guiding questions to pick the right metrics.
There is not a one-size fits all solution to metrics. Your company type and business model have everything to do with which metrics you should prioritize.
It's important to consider two sub-questions here:
If you are an early-stage founder that is trying to understand the high-level status of your product, then it is likely overkill to focus on the click rate of various in-app buttons and the time spent on specific features. It might be more valuable to understand your conversion funnel and identify drop-off points.
If you are a junior analyst on a product team, then you might be focused on the nitty-gritty of product performance metrics. Knowing that only 5% of users are trying the team's new feature is a great indication that more should be done to highlight the feature via in-app messaging or in-app guides.
If you are part of a team where the CEO, CPO, or CRO is laser-focused on a specific metric, your efforts might be best spent dissecting the leading indicators for that metric. For example, if there is a recent focus on user intent, it is critical to ensure your key performance indicators reflect the outcomes of leveraging user intent.
There are many product metrics frameworks to choose from. One popular framework is the Pirate Metrics Framework. What do metrics have to do with pirates? You might be disappointed to learn that the name comes from the acronym "AARRR" of its five pillars -- Acquisition, Activation, Retention, Referral, and Revenue.
This framework is focused on customer-oriented metrics. Each piece inspects a different aspect of the user journey, moving from the first sign of interest in your product to winning business from your customer. These categories provide a nice introduction to types of product metrics.
To simplify a bit, we'll consolidate the above into three buckets:
Let's dive into actually useful product metrics based on the categories above.
Active users are most commonly measured by day or month. Daily active users (DAUs) and monthly active users (MAUs) are the number of users that use your product during the specified time period.
Active user count gives you a bird's-eye view of your product.
Useful for a higher-level pulse check, active user counts do not produce targeted conclusions since they are often influenced by various other factors (e.g., customer retention, marketing spending, product/feature launches).
CTR measures the percentage of people that click on a call-to-action button, whether in-app or in a marketing email. A higher CTR indicates that the messaging is resonating with the target audience.
Conversion rate measures how many people completed a target flow. For example, the percentage of users that visited your product who actually created an account.
The percent of customers that used the feature during the time period. Feature adoption rate can help your team pinpoint which features need more love and which are succeeding. Sometimes in-app messaging is all it takes to improve feature usage -- your users simply do not know the feature exists or how they should use it. In other cases, core functionality might be missing.
Usage frequency can be measured on two extremes, as well as everything in between.
You usually want users to engage with your product, so you want to see higher usage frequency. If users interact with a feature often, they are likely getting value from it.
In rare cases, making certain processes more efficient can actually decrease usage frequency while increasing customer satisfaction. For example, users want to complete their taxes in TurboTax as quickly as possible.
Time-to-value measures how long it takes a user to reach one of your product's "aha" moments. For Slack, this is measured as the time it takes a workspace to reach 2000 messages. Decreasing TtV is a surefire way to improve the new user experience and convert new customers. If your TtV is high, consider the following:
Of all the metrics, the =error/bug rate is the most technical. The most common ways to measure bug rate are:
Understanding how often bugs occur relative to usage can reveal paint points in the customer journey and improve customer loyalty.
Net promoter score reflects how likely users are to recommend your product to others. A higher NPS indicates that your users are satisfied with your product and are more likely to refer others.
Churn and retention are two sides of the same coin. Churn rate is the percentage of users that stop using your product during a given time period. Retention rate is the percentage of users that continue to use your product after a given time period. High churn and low retention are indicators that you should help new users understand your product's value and get them to an aha moment more quickly. Session playback tools can be helpful for digging deeper, e.g., to uncover customer behavior patterns.
A subset of conversion rate, referral rate measures the percentage of users who refer others to your product. A higher rate indicates that users are highly engaged and satisfied.
Viral coefficient measures how many new users each existing user brings in. A higher viral coefficient implies that your product spreads effectively through word-of-mouth and referrals.
This metric measures the cost of acquiring a new customer. The lower the CPA, the more cost-effective your marketing efforts are.
Customer lifetime value measures the revenue you can earn from your average customer over their lifetime. A higher average customer lifetime value means that your customers are deriving more value from your product and generating more revenue for your business.
MRR is the amount of revenue your product generates every month. MRR goes hand in hand with product growth. While it can be great to see MRR increase, you have to consider the costs that are factored in, like marketing campaigns.
Customer acquisition cost is the cost of acquiring a new customer. Low customer acquisition costs mean your customer acquisition efforts are more cost-effective and profitable. Product-led growth (PLG) is a major lever companies are turning to acquire customers at a much lower cost.
Product metrics are essential for measuring the success of your product and user experiences. By understanding the metrics that matter most for your product or use case, you can make informed, data-driven decisions about improving your product. With the right product management metrics in place, you and your team can prioritize more confidently.