Prioritize Experiments Like a Product Manager: Scoreboard Method

Who This Helps

You're a Product Manager drowning in ideas. Everyone wants their pet feature shipped. But you need to pick the one experiment that actually moves the needle. This is for you.

Mini Case

Meet Maya. She's a PM at a fitness app. Her team tracks 20 metrics. Every week, they argue about what to build next. Maya's North Star is "weekly active sessions per user." She uses the Metrics & Dashboards Basics course to build a weekly scoreboard. She picks 3 supporting metrics: session duration, onboarding completion rate, and 7-day retention. She sets targets: 12% increase in session duration, 85% onboarding completion, 40% retention. Now, instead of debating, she looks at the scoreboard. The onboarding completion rate is at 72%—below target. That's her highest-impact move. She runs an experiment: simplify the sign-up flow. Result? Onboarding jumps to 83% in 2 weeks. North Star metric climbs 8%.

Do This Now (5 Steps)

1. Define your North Star metric. Pick one number that captures the core value your product delivers. Keep it simple.

1. List 3 supporting metrics. These are leading indicators that feed your North Star. For example, sign-up rate, feature adoption, or churn.

1. Set realistic targets. Use past data or industry benchmarks. Don't guess. A target like "increase retention by 10% in 30 days" is concrete.

1. Build a weekly scoreboard. Use a simple spreadsheet or dashboard. Update it every Monday. No more than 5 metrics total.

1. Pick the experiment with the biggest gap. Look at which metric is farthest from its target. That's your priority. Run one experiment at a time.

Avoid These Traps

• Tracking too many metrics. Stick to 5 or fewer. More noise, less signal.
• Setting vague targets. "Improve engagement" is not a target. Use numbers like "12% increase in daily active users."
• Running multiple experiments at once. You won't know what worked. Test one change per week.
• Ignoring the scoreboard. If you don't look at it weekly, it's useless. Make it a habit.
• Chasing vanity metrics. Total users don't matter if retention is low. Focus on behavior, not size.
• Changing targets too often. Give experiments time to work. Wait at least 2 weeks before adjusting.
• Forgetting guardrails. Set alerts for critical metrics. If churn spikes, pause everything and fix it.
• Overcomplicating the dashboard. A cluttered dashboard leads to confusion. Keep it clean with clear sections.

Your Win by Friday

By Friday, you'll have a clear North Star metric, 3 supporting metrics with targets, and a weekly scoreboard. You'll know exactly which experiment to run next. No more guesswork. Just calm, data-driven decisions. And maybe a little more time for coffee.