Tagged metrics.

The reply-rate trap: why we don't promote A/B winners by reply rate

Every other outbound tool ships an A/B winner-picker that promotes the variant with the higher reply rate. The trap: reply rate collapses positive replies, negative replies, and unsubscribes into one number. The 'winning' variant is often the one with more 'stop emailing me'. Here's what we built instead.