Blog/Blog

Fast, Resilient Reads at Scale: Replica Cache Now Available in Public Preview

|
3 min
Authors
Kris Beevers
Fast, Resilient Reads at Scale: Replica Cache Now Available in Public Preview
Be the first to hear news and subscribe here.
Key links
Share

Today we’re entering public preview with Replica Cache — a read-only API that serves NetBox data from an operationally independent cache, delivering sub-50ms P95 query latency with zero load on the primary database. Available now for NetBox Cloud customers on the Premium tier.

Replica cache is built for teams running NetBox at scale — AI datacenter operators, hyperscalers, large telco automation teams, and anyone whose Ansible inventories, Terraform plans, monitoring integrations, or compliance checks read tens of thousands of devices, hundreds of thousands of interfaces, or millions of IP addresses from NetBox every day.

At that scale, reads become the bottleneck.

Three things matter here:

  • Fast reads at any scale. You need low latency for queries of any size — single lookups, filtered lists, large paginated scans. Replica Cache delivers the most dramatic improvements for the query patterns that cause the most pain today, but all read workloads benefit.
  • Operational resilience. Caching must be operationally independent, so it continues serving data even when the primary database is degraded or in a maintenance window. That way, your monitoring, compliance, and automation workflows keep running.
  • Zero primary database load. The whole goal of a caching layer is to ensure zero reads ever touch PostgreSQL. High-frequency polling, bulk data pulls, dashboard queries — none of it should compete with writes or the interactive UI.

The read problem at scale

The NetBox REST API is designed for interactive use and moderate-scale automation, and it’s excellent at both. But when your automation fleet is polling thousands of objects every few minutes, or paginating through massive inventories for CI/CD pipelines, the math gets hard. Complex queries generate expensive database joins. Read-heavy automation competes with the UI and write operations for shared database resources. During maintenance windows or periods of high load, read latency degrades — and when the database is under real pressure, automation stalls entirely.

For the teams operating the largest NetBox deployments, this isn’t theoretical. It’s the difference between automation that runs reliably and automation that pages you at 2 AM because a slow query cascaded into a timeout.

How it works — a separate read path

Replica Cache, now available in public preview, is a read-only API that serves NetBox data from an operationally independent cache, delivering lightning-fast query latency without putting load on the primary database.

Replica Cache captures changes from the NetBox database in near-real-time by watching changes, replicates them into a purpose-built caching layer, and serves a fast REST API against that local replica. Your automation reads from the cache. The primary database handles writes and interactive use. The two workloads never compete.

Replica Cache supports server-side filtering, field selection, cursor-based pagination, and aggregation. Data freshness is typically under 10 seconds, and a metadata endpoint lets your automation verify recency programmatically.

It’s not a drop-in replacement for the NetBox API — it’s a purpose-built complement, optimized for the read patterns that matter most to automation. Full API documentation is available in the Replica Cache docs.

The platform performance story

Replica Cache joins TurboBulk as the second premium-tier performance capability on the NetBox Labs platform. They solve different problems and are complementary.

TurboBulk provides fast bulk reads and writes with exact consistency — bulk imports, upserts, deletes, and full dataset exports — operating directly against the primary database. Replica Cache offloads reads to an independent cache — eventually consistent, but zero primary database load and resilient to outages.

For teams operating at scale, the combination is powerful: TurboBulk for bulk writes and consistent dataset exports, Replica Cache for high-frequency automation reads and resilience. The primary database is freed up for interactive use and standard API operations.

How to try it out

For existing Premium customers

Contact your Customer Success Manager to scope your first read workflow. We recommend starting with a single high-volume read pattern as a low-risk pilot.

Not on Premium yet?

Request a demo and we’ll walk you through Replica Cache and other powerful Premium tier capabilities.