improvement(db): cut hot-path connector count and rate-limit lock costs by waleedlatif1 · Pull Request #8944 · simstudioai/sim

waleedlatif1 · 2026-10-12T21:24:00Z

Summary

DbTokenBucket.consumeTokensAtomically now locks, refills, decides and spends every dimension in one CTE statement. Before, the bucket rows stayed locked across a separate UPDATE round trip per dimension plus the commit, and each waiter on a hot provider key queued behind that whole hold (waits ran 1.1–1.7 s with about 280 ms per holder). Now the lock is held for one statement plus the commit.
The token arithmetic is the same float8 math consumeTokens does in JS, with refills on whole intervals. Refill and cooldowns are judged once every lock is held, as before. The statement advances the caller's clock by the lock wait it measures (clock_timestamp() sampled before the first row can reach the lock and again after a count over every locked row), so an uncontended admission decides at exactly the caller clock, so a contended waiter still refills the time it waited, and every stored instant stays on the application clock. The JS reader cross-checks the statement's own decision and spent count. On a mismatch, a vanished bucket, an abort, or a deadline passed after the statement, it throws inside the transaction so the spend rolls back.
Once a connector has finished a pass (lastSyncAt set, which unfinished slices never advance), a content-pass slice that leaves the next pass unfinished no longer runs the full live document count. It keeps the count from that finished pass, which is the pass lastSyncAt still names. Until the first pass finishes, every slice is still counted, so a first sync shows progress. Finished passes count exactly as before, so the mass-deletion guard floor and the incremental listedCount are unchanged.

Type of Change

Performance improvement

Testing

provider-admission.integration.ts against real Postgres and Redis (bun run test:integration provider-admission): 20/20 pass. That includes the 40-way concurrent reversed-order admission, cooldown, cancel/expiry and partial-bucket cases, plus new cases: fractional refill on the atomic path; a waiter held behind another connection's row lock across a refill interval, which sees the refill and a wait measured from lock acquisition; and a spend rolled back when the deadline passes or the caller aborts while the statement runs. 23/23 pass. Each new case goes red with its guard removed (lock-wait clock, post-statement deadline check, post-statement abort check). Breaking the whole-interval refill anchoring turns the fractional case and 3 existing atomic cases red.
lib/core/rate-limiter/** and sync-engine.test.ts: 221 pass. The new unfinished-slice count cases go red when the skip is reverted, and the first-pass later-slice case goes red without the lastSyncAt gate.
Biome on the changed files. Type-check and check:audits are left to CI.

Checklist

Code follows project style guidelines
Self-reviewed my changes
Tests added/updated and passing (new tests pass the test-audit authoring gate)
No new warnings introduced
I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

…the database bucket Lock, refill, decide and spend every dimension in a single CTE so a hot bucket row stays locked for one statement plus the commit instead of a round trip per dimension. The clock is read before the statement, matching the Redis backend, so a contended admission never sees more tokens.

…ync slices An unfinished content pass keeps the count its last finished pass recorded, the pass lastSyncAt still names. Connectors with no recorded count are still counted so a first pass shows progress.

vercel · 2026-10-12T21:24:08Z

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment

Project	Deployment	Actions	Updated
docs	Skipped		Oct 12, 2026 10:44pm UTC

cubic-dev-ai

All reported issues were addressed across 6 files

_{Heads up: you’ve reached your flex budget. Increase your flex budget or wait for usage to reset.

Turn on auto-fix | Re-trigger cubic}

greptile-apps · 2026-10-12T21:30:38Z

Confidence Score: 5/5

[High impact] The PR appears safe to merge; no new actionable issue was found.

Summary

The PR reduces database work in provider admission and connector syncs.

PostgreSQL admits provider calls with one bucket-locking statement.
Unfinished connector slices keep the last finished pass's document count.

The previous threads are unnumbered. The rollback cases are present, and Greptile already conceded the clock concern. Neither is reposted.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart TD
  A[Connector slice finishes] --> B{Content pass unfinished?}
  B -->|No| C[Count live documents]
  B -->|Yes| D{Previous successful pass and saved count?}
  D -->|No| C
  D -->|Yes| E[Keep saved count]
  C --> F[Check run ownership and save completion]
  E --> F

_{Reviews (4) · Last reviewed commit: "fix(connectors): keep counting every sli..." · Reviewed by Greptile}

…s are held Advance the caller's clock by the lock wait measured inside the statement, so a contended admission refills the time it spent waiting as it did before the single-statement change. Cover the spend rollback when the deadline passes or the caller aborts while the statement runs.

waleedlatif1 · 2026-10-12T21:44:09Z

@greptile

waleedlatif1 · 2026-10-12T21:44:10Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-12T21:44:17Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 6 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{Heads up: you’ve reached your flex budget. Increase your flex budget or wait for usage to reset.

Turn on auto-fix | Re-trigger cubic}

Sample clock_timestamp() before the first row can reach the lock and again after the last is held, so an uncontended admission decides at exactly the caller's clock and planning or execution time never shifts a refill.

waleedlatif1 · 2026-10-12T21:54:01Z

@greptile

waleedlatif1 · 2026-10-12T21:54:02Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-12T21:54:08Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 6 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{Heads up: you’ve reached your flex budget. Increase your flex budget or wait for usage to reset.

Turn on auto-fix | Re-trigger cubic}

…pass finishes A first pass's own unfinished slices wrote a count, so later slices of that pass saw it and stopped counting. Skip only once lastSyncAt shows a finished pass, which unfinished slices never advance.

waleedlatif1 · 2026-10-12T22:44:41Z

@greptile

waleedlatif1 · 2026-10-12T22:44:43Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-10-12T22:44:53Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 6 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{Heads up: you’ve reached your flex budget. Increase your flex budget or wait for usage to reset.

Turn on auto-fix | Re-trigger cubic}

waleedlatif1 added 2 commits October 12, 2026 14:23

improvement(connectors): skip the live document count on unfinished s…

4542b2a

…ync slices An unfinished content pass keeps the count its last finished pass recorded, the pass lastSyncAt still names. Connectors with no recorded count are still counted so a first pass shows progress.

cubic-dev-ai Bot reviewed Oct 12, 2026

View reviewed changes

Comment thread apps/sim/lib/core/rate-limiter/storage/db-token-bucket.ts Outdated

greptile-apps Bot reviewed Oct 12, 2026

View reviewed changes

Comment thread apps/sim/lib/core/rate-limiter/storage/db-token-bucket.ts Outdated

vercel Bot temporarily deployed to Preview October 12, 2026 21:43 Inactive

cubic-dev-ai Bot reviewed Oct 12, 2026

View reviewed changes

greptile-apps Bot reviewed Oct 12, 2026

View reviewed changes

Comment thread apps/sim/lib/core/rate-limiter/storage/db-token-bucket.ts

vercel Bot temporarily deployed to Preview October 12, 2026 21:54 Inactive

cubic-dev-ai Bot reviewed Oct 12, 2026

View reviewed changes

vercel Bot temporarily deployed to Preview October 12, 2026 22:44 Inactive

cubic-dev-ai Bot reviewed Oct 12, 2026

View reviewed changes

waleedlatif1 merged commit 90ed227 into staging Oct 12, 2026
48 of 49 checks passed

waleedlatif1 deleted the perf/hot-path-db-reads branch October 13, 2026 01:59

TheodoreSpeaks mentioned this pull request Oct 13, 2026

v0.9.20: project membership enforcement, db and perf improvements, realtime and auth hardening, CI and test fixes #8963

Merged

waleedlatif1 mentioned this pull request Oct 13, 2026

improvement(knowledge): finish Confluence passes past unreadable attachments, rank unauthenticated keyword search in one statement #8975

Merged

3 of 4 tasks

Conversation

waleedlatif1 commented Oct 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Type of Change

Testing

Checklist

Uh oh!

vercel Bot commented Oct 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

greptile-apps Bot commented Oct 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Confidence Score: 5/5

Summary

Diagram

Uh oh!

Uh oh!

waleedlatif1 commented Oct 12, 2026

Uh oh!

waleedlatif1 commented Oct 12, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 12, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

waleedlatif1 commented Oct 12, 2026

Uh oh!

waleedlatif1 commented Oct 12, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 12, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

waleedlatif1 commented Oct 12, 2026

Uh oh!

waleedlatif1 commented Oct 12, 2026

Uh oh!

cubic-dev-ai Bot commented Oct 12, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

This branch was previously deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

waleedlatif1 commented Oct 12, 2026 •

edited

Loading

vercel Bot commented Oct 12, 2026 •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

greptile-apps Bot commented Oct 12, 2026 •

edited

Loading