Recurring Decisions
The field guide catalogs the sensors. This page inverts it: every recurring decision a product company faces, with the loops that inform it stacked from fastest proxy to slowest truth. The cheap signal on top is usually the most gameable; the honest one at the bottom is the one you wait for.
Build
Can we make the thing?Is this change correct — and safe to merge?
The deepest ladder in the catalog: from feedback before you finish typing to the bug report that arrives weeks later. Every rung you add on the left saves a more expensive lesson on the right.
- 300msIDE inline feedbackhighpush
- 500msSyntax / parserhighpush
- 2sType systemhighpush
- 3sHot reload / REPLmedpush
- 30sLint / static analysismedpush
- 1minRuntime schema validationhighpush
- 1min◆ Pair / mob programmingmedpush
- 1minSecrets detectionhighpush
- 2minUnit testshighpush
- 5minAI code reviewmedpush
- 10minCoverage / mutation testingmedpush
- 10minIntegration testshighpush
- 10minVisual regression testingmedpush
- 30minE2E testsmedpush
- 30minSAST / code security scanmedpush
- 1hrError monitoringhighpush
- 12hr◆ Code reviewmedpush
- 1wk◆ Bug reportsmedpush
Is production healthy right now?
The always-on loops. Everything here is push and minutes-scale — if any of these are pull, you find out about outages from customers.
- 5minSynthetic monitoring / uptime checksmedpush
- 15minAlerts / on-call pageshighpush
- 1hrRuntime security detectionmedpush
- 1hrAPM / distributed tracinghighpull
- 1hrMemory / resource utilizationmedpush
- 1hrError monitoringhighpush
Can we keep shipping safely?
Not "is this deploy good" but "is our shipping process trustworthy": blast-radius control on the fast end, error budgets and failure rates as the trend.
- 30minCanary / progressive rollouthighpush
- 1d◆ Chaos engineering / game dayshighpull
- 1wkSLO / error budget burnhighpush
- 1moChange failure ratemedpull
Could an adversary get in — and would we know?
The full security ladder: the flaw caught at the whiteboard, the leak caught at commit, the inherited CVE, the drifting cloud config, the live attack — down to the commissioned pen test and the unbounded bounty crowd. Vulnerability age is the loop that watches whether any of it actually gets fixed.
- 1minSecrets detectionhighpush
- 30minSAST / code security scanmedpush
- 1hrRuntime security detectionmedpush
- 1d◆ Threat modelingmedpull
- 1dSCA / dependency vulnerabilitiesmedpush
- 1dCloud misconfiguration / CSPMhighpush
- 1wkDAST / automated web scanningmedpush
- 2wk◆ Bug bounty / VDPhighpush
- 2wk◆ AI red-teaming / adversarial evalshighpull
- 1moOpen vulnerability age / patch SLAhighpull
- 3mo◆ Pen test / red teamhighpull
What broke — and what do we learn from it?
The failure-learning ladder, including the loop that runs before the failure exists: pre-mortems are post-mortems with better timing.
- 1d◆ Pre-mortemslowpull
- 1wk◆ Incident post-mortemshighpull
- 1moMean time to restoremedpull
Is it fast enough for real users?
Lab numbers in minutes, field truth in weeks. The lab loops are proxies — the 28-day field window is the number that ranks you and retains users.
- 3minBundle size / asset weighthighpush
- 10minLighthouse / synthetic performancehighpush
- 30minBenchmark testsmedpush
- 1hrModel latency / time-to-first-tokenhighpull
- 1wk◆ Load / stress testingmedpull
- 1moCore Web Vitals (field / RUM)highpull
- 1moCapacity / scaling signalsmedpush
Is our delivery machine healthy?
Flow, not effort: how long work waits, how much is in flight, how often it ships, whether plans mean anything. The standup is the human sensor; the rest are the instruments.
- 1d◆ Daily standupmedpush
- 1dWIPhighpull
- 1dBuild & CI durationmedpull
- 2d◆ App store review gatemedpush
- 3dWork item agemedpull
- 2wkTask cycle timemedpull
- 2wkThroughputmedpull
- 1moPR cycle timemedpull
- 1moDeployment frequencymedpull
- 1moLead time for changesmedpull
- 1moSprint predictability (say:do ratio)lowpull
- 1moFlow efficiencymedpull
Where should we invest in the codebase?
Three rungs of the same ladder: static metrics lie fast, hotspots tell the truth in months, the tech-debt trend settles it in years. Refactor where churn meets complexity, not where the linter complains.
- 10minCode complexity & coupling metricsmedpush
- 1moHotspot analysis (churn × complexity)highpull
- 1moDependency freshness (libyear)highpull
- 1yr◆ Tech debt accumulationlowpull
Can we even build this?
Feasibility answered by building the smallest dangerous version, and by auditioning the technology before you marry it.
- 1d◆ Feasibility spike / throwaway prototypehighpull
- 1wk◆ Technology / model evaluationmedpull
- 1wk◆ Design / RFC reviewmedpull
Can downstream consumers trust the data?
Data breaks silently — the dashboard renders either way. These loops exist to make staleness and shape-drift loud.
- 15minData quality testshighpush
- 1hrPipeline freshness / data SLAshighpush
- 1dData anomaly detectionmedpush
Is the AI feature actually good?
Quality no human can read at production scale: golden sets gate the change, judges watch the drift, users vote one thumb at a time, and the upstream model shifts under all of it.
- 30minEval suite / golden-set regressionmedpush
- 1hrToken / cost per requesthighpull
- 1hrLLM-as-judge scoringmedpull
- 1dThumbs up/down on AI outputlowpull
- 1wkModel & output driftmedpull
- 2wk◆ AI red-teaming / adversarial evalshighpull
Value
Is it worth making?Should we build this at all?
The cheapest place to be wrong. Everything here runs before serious build cost: fake doors, interviews, and pricing research are how you lose a week instead of a quarter.
- 1wkFake door / prototype testsmedpull
- 1wk◆ Weekly discovery interviewshighpull
- 1wk◆ Feature request board / upvotesmedpull
- 2wk◆ Kano surveymedpull
- 2wk◆ Opportunity scoring (importance vs satisfaction)medpull
- 2wk◆ Willingness-to-pay researchmedpull
Can people actually use it?
From your own team's complaints to strangers' rage clicks. Dogfooding is fast but biased; five usability sessions find most of what matters; the field signals confirm at scale.
- 10minAccessibility checksmedpush
- 1d◆ Dogfoodingmedpush
- 1dFirst-click / findabilityhighpull
- 1dClicks / interaction costmedpull
- 1d◆ Task ease (SEQ / SUS)medpull
- 1dSession recordings / rage clicksmedpull
- 1wk◆ Beta / early-access programhighpull
- 1wk◆ Usability testshighpull
- 1wk◆ Task success ratehighpull
- 1wk◆ Time on taskmedpull
- 1wkFunnel / drop-off analysishighpull
Did the thing we shipped actually work?
Stakeholder nods in the demo, causal proof in the experiment, and the only number that settles it: do people reach the value moment and come back?
- 1wkFeature adoption / activationmedpull
- 1wkFunnel / drop-off analysishighpull
- 2wk◆ Sprint review / stakeholder demomedpush
- 2wkA/B experimentshighpull
Do we have product-market fit — and are we keeping it?
The slowest, highest-stakes question in the value track. Sentiment loops lead, retention curves decide, and churn interviews explain the verdict after it's in.
- 1dAI synthesis of qualitative streamsmedpull
- 1wk◆ Public reviews (G2 / app stores / Reddit)medpull
- 1wk◆ Churn interviews / exit surveyshighpull
- 2wkSean Ellis PMF surveymedpull
- 1moNPS / CSATlowpull
- 1moStickiness (DAU/MAU)medpull
- 1moTrial / freemium conversionhighpull
- 3moRetention curveshighpull
- 6moExpansion / referral revenuehighpull
Are we priced right?
Assembled entirely from loops that live elsewhere — pricing is the decision most companies inform by accident. Willingness-to-pay asks before you commit; discounting reveals the truth during every deal; churn and lost deals deliver the verdict after.
- 1wk◆ Churn interviews / exit surveyshighpull
- 2wk◆ Willingness-to-pay researchmedpull
- 1moTrial / freemium conversionhighpull
- 1mo◆ Win/loss analysishighpull
- 3moPricing realization / discount ratehighpull
- 1yr◆ Pricing powermedpull
Is support scaling with the product?
Two different questions hiding in one queue: are we handling tickets well (speed, one-touch resolution, CSAT) and why do tickets exist at all (contact rate — the product-quality number wearing a support costume).
- 4hrTime to first responsemedpull
- 1dResolution timemedpull
- 1wkTicket CSATlowpull
- 1wk◆ Support ticketsmedpush
- 2wkFirst contact resolutionmedpull
- 1moContact rate / tickets per customermedpull
Reach
Can we get it to people?Which channel deserves the next dollar?
The attribution ladder in full: last-click flatters, multi-touch negotiates, self-reported surprises, lift tests prove, and MMM allocates. Fast numbers spend the budget; slow numbers tell you whether they should have.
- 1dCPM / auction pressuremedpull
- 1dLast-click attributionlowpull
- 1wk◆ Self-reported attributionmedpull
- 1wkMulti-touch / data-driven attributionmedpull
- 1wk◆ Influencer / sponsorship performancelowpull
- 1wk◆ Events / webinar performancemedpull
- 1moROAS / channel CACmedpull
- 1moIncrementality / lift testshighpull
- 3mo◆ Partnership pipelinemedpull
- 3moBlended CACmedpull
- 6moMarketing mix modelinglowpull
Does this message land with this audience?
Creative feedback at every speed: the algorithm answers in hours, the click in days, the reply in weeks. All of it is the same question — did the words earn the attention?
- 4hrOpen ratelowpull
- 4hrClick-through ratemedpull
- 6hrViews / impressionslowpull
- 6hr◆ Comments / audience conversationmedpull
- 6hr◆ Comments & DMsmedpull
- 12hrCompletion / loop ratehighpull
- 1dHook rate / swipe-awaysmedpull
- 1dAudience retention / watch timehighpull
- 1dPaid ads CTR / CPAmedpull
- 1dEngagement ratemedpull
- 3dLanding conversion rate (CVR)medpull
- 3dContent engagementlowpull
- 3d◆ Cold outreach reply ratesmedpush
- 1wkQuality / relevance scoremedpull
- 2wkFrequency / creative fatiguemedpull
Can we still reach the inbox?
Deliverability is a licence, not a metric — revoked quietly and restored slowly. Unsubscribes are the leading edge of losing it.
- 10minBounce ratehighpull
- 15minDelivered / inbox placementhighpull
- 1hrSpam / reject rate & sender reputationmedpull
- 1dUnsubscribe / list churnhighpull
Are we compounding an audience or renting one?
Rented attention stops when the spend stops. These loops measure the owned kind: followers, saves, community, unprompted recall — the assets that survive a budget cut.
- 1dShares & saveshighpull
- 1dFollows-per-viewmedpull
- 1d◆ Community activity & sentimentmedpull
- 2wk◆ PR / press coveragelowpull
- 1moFollower / subscriber growthmedpull
- 1moReferral / K-factormedpull
- 1yr◆ Brand awareness / recalllowpull
Can buyers find us when they go looking?
The slowest channel to build and the cheapest to keep: keyword bets confirmed months later by rankings and traffic, decay quietly clawing it back, and answer engines rewriting the rules mid-game.
- 1d◆ Keyword research (difficulty vs. potential)medpull
- 1wkTechnical SEO / indexationhighpull
- 1moKeyword rankings / SERP positionmedpull
- 1moOrganic traffic & CTRhighpull
- 1moAI search visibility (AEO / GEO)lowpull
- 1moApp store ratings & ASOmedpull
- 3moDomain authority / backlink profilemedpull
- 6moContent decay / refresh signalmedpull
Is demand converting into revenue?
Pipeline is the leading number, cycle length the friction gauge, and win/loss the only loop that tells you why the machine wins or jams.
- 1mo◆ Meetings booked / pipelinemedpull
- 1mo◆ Win/loss analysishighpull
- 3moPipeline stage conversionmedpull
- 3moSales cycle lengthmedpull
Team
Can we sustain the people doing it?Is the hiring machine working?
A ladder with a famously slow truth: response rates answer in days, offers in weeks — but whether the interview signal was right takes two quarters to know.
- 3d◆ Sourcing response ratemedpull
- 1wk◆ Interview signallowpull
- 1wkOnboarding ramp / time-to-first-commitmedpull
- 1mo◆ Offer acceptance ratemedpull
- 1mo◆ Time-to-hiremedpull
- 6mo◆ Quality of hire / ramp timemedpull
- 6mo◆ Compensation benchmarkingmedpull
Is the team healthy and sustainable?
Morale measured at every cadence — the weekly 1:1, the sprint retro, the quarterly survey — with attrition as the lagging number nothing here should let you reach.
- 1wk◆ 1:1 sentimentmedpull
- 1wkPulse surveysmedpull
- 1wkMeeting load / focus timemedpull
- 1wkOn-call load / pages per personhighpull
- 2wk◆ Team retrospectivesmedpull
- 1mo◆ Developer experience surveymedpull
- 3moeNPS / engagement surveyslowpull
- 3moBus factor / knowledge concentrationmedpull
- 1yr◆ Attrition / regretted departureshighpush
Are people growing here?
Nothing in the twice-a-year review should be news if the faster loops are working — its real job is calibration, not discovery.
- 3mo◆ Performance reviews / 360 feedbackmedpull
- 6mo◆ Growth / promotion readinessmedpull
Are we working on the right things?
The strategy apex. Every other decision on this page optimises inside a frame; this is the loop that questions the frame.
- 2wk◆ Opportunity scoring (importance vs satisfaction)medpull
- 3mo◆ OKR check-ins / goal scoringmedpull
Risk & Moat
Are we allowed to keep winning?Do the unit economics actually work?
Whether the machine makes money per unit: margin as the ceiling, CAC payback as the honest operating metric, LTV as the forecast dressed as a measurement.
- 1wkAI / inference spendhighpush
- 3moGross marginhighpull
- 3moBlended CACmedpull
- 3moCAC payback periodmedpull
- 3moPricing realization / discount ratehighpull
- 1yrLTVlowpull
- 1yrLTV:CAC ratiolowpull
How long can we keep playing?
The cash ladder: cost alerts in days, the 13-week forecast weekly, the close monthly, runway as the scoreboard, and the capital market's opinion when you finally have to ask for more.
- 1dCloud spend / burn alertshighpush
- 1wk◆ 13-week cash flow forecasthighpull
- 1mo◆ Budget vs actuals (monthly close)highpull
- 1moCash collection / DSOhighpull
- 1mo◆ Investor / fundraising feedbacklowpull
- 3moRunway / burn multiplehighpull
Is revenue healthy — not just growing?
Growth is the number everyone watches; retention and concentration are the numbers that decide whether it means anything.
- 3moMRR / ARR growthhighpull
- 3moRevenue churn / GRRhighpull
- 3moRevenue concentrationhighpull
- 3mo◆ Revenue forecast accuracymedpull
- 6moExpansion / referral revenuehighpull
What could kill us from outside?
The existential pull loops: platforms, vendors, regulators, fraudsters and competitors all move on their own schedule, and none of them will page you.
- 1dFraud / abuse / chargeback ratemedpush
- 1mo◆ Platform / API dependency changeslowpull
- 1mo◆ Competitor launcheslowpull
- 3mo◆ Vendor / provider concentrationlowpull
- 3mo◆ Compliance audits (SOC2 / ISO)highpull
- 6mo◆ Regulatory & legal signalsmedpull
- 1yrChurn by tenure / lock-in strengthmedpull
- 1yr◆ Pricing powermedpull
A loop can serve more than one decision; a decision is only as good as its slowest trusted loop. Dataset v0.18.2 — 199 loops, every one of them reachable from a decision on this page.