Who This Helps
This is for product managers who have a list of experiment ideas but no clear way to pick the winner. You want to stop wasting sprints on low-impact tests. The Product Metrics Basics program gives you the framework to decide fast.
Mini Case
Priya, a PM at a SaaS company, had 12 experiment ideas for her team. She used the activation definition from the program (one event + one time window) to filter them. Only 3 experiments could improve the activation rate within 7 days. She picked the one that could move the needle by 12%—and it did. Her team stopped debating and started shipping.
Do This Now (5 Steps)
- Write down your current activation event. Is it one clear action? If not, pick one. Use the Activation Definition mission from the program.
- Set a time window. Activation must happen within a specific number of days. For Priya, it was 7 days.
- List your experiment ideas. Write each one on a sticky note. No judgment yet.
- Score each idea. Ask: "Does this experiment directly improve my activation event within the time window?" Score 1 for yes, 0 for no.
- Pick the highest score. That's your next experiment. Run it this week.
Avoid These Traps
- Trap: Picking experiments that make you feel busy. If it doesn't touch activation, it's a distraction.
- Trap: Using multiple activation events. One event, one window. Keep it simple.
- Trap: Forgetting guardrails. The program's Metrics Charter mission helps you set North Star and guardrails so you don't optimize the wrong thing.
- Trap: Waiting for perfect data. Use what you have. Priya's team had messy tracking, but the Event Taxonomy mission cleaned it up in one afternoon.
- Trap: Overcomplicating the score. A simple yes/no is enough. You're not building a rocket.
- Trap: Ignoring segments. The Segment Snapshot mission shows you where activation breaks for different user groups. Don't skip it.
- Trap: Running too many experiments at once. Focus on one. Finish it. Learn from it.
- Trap: Not defining success upfront. Before you run the experiment, write down what "win" looks like. Use the program's retention reading to check later.
Your Win by Friday
By Friday, you will have one experiment picked and ready to run. Your team will know exactly why that experiment matters. You'll have a simple scorecard (1 or 0) for any future idea. And you'll feel the relief of not guessing anymore. That's a good week.