What a 10k, 100k and 1M URL site actually needs from infrastructure — and where the cliffs are. Scoped as a standalone workstream or folded into a full ctos build.
from $2,750 as a standalone workstream · included in the CTOs Build tier
Programmatic sites do not fail gradually; they hit specific cliffs at predictable scales. We run this as a fixed-scope workstream: 4 defined deliverables, one named approver, and a written handover at the end. It attaches to an existing ctos engagement or stands alone if that is the only piece you are missing.
Database sizing and index strategy per URL tier
Object caching and CDN policy for high-cardinality URL sets
Background worker capacity planning for generation and refresh
The three scale cliffs and the warning signs before each
We look at what ctos already hold — systems, exports, APIs — and score each axis for demand and defensibility.
The data contract is written and the first template is designed against real rows, not placeholders.
3,750–8,750 URLs published with schema, internal links, sitemap entries and IndexNow.
Indexation and impression data decides what widens and what gets cut. Templates, gates and runbook transfer to you.
Usually around 40k–80k URLs, when meta-query patterns stop being viable and lookup tables become mandatory.
We'll audit the data source, size the first batch, set the performance budget and tell you honestly if programmatic is the wrong tool for your category.