feat(backend): add Bull Board metrics history by brendan-kellam · Pull Request #1604 · sourcebot-dev/sourcebot · GitHub

Summary

upgrade Bull Board packages from 6.11.2 to 9.0.0
enable one week of native BullMQ metrics and record long-retention metrics in Redis
expose history and latency charts in the read-only Bull Board and stop the recorder cleanly

Validation

yarn workspace @sourcebot/backend build
yarn workspace @sourcebot/backend test --run

Note

Medium Risk
Major dependency upgrade (Bull Board 6→9, Express 5 for bull-board only) plus new Redis-backed metrics writers; shutdown order changed but scoped to observability and lifecycle.

Overview
Upgrades Bull Board from 6.11.2 to 9.0.0 and adds @bull-board/metrics so the read-only /admin/queues UI can show queue history and latency charts backed by Redis.

The API wires a RedisMetricsHistoryProvider and MetricsRecorder (shared Redis connection, latency errors logged per queue), starts recording at boot, and stops the recorder / disconnects the history provider on shutdown. Graceful shutdown now disposes the API before stopping workers and closing Redis.

BullMQ workers retain one week of native metrics (MetricsTime.ONE_WEEK / 10,080 data points), with a unit test asserting that worker option.

Reviewed by Cursor Bugbot for commit 375c1da. Bugbot is set up for automated code reviews on this repo. Configure here.

Summary by CodeRabbit

New Features
- Added queue performance metrics to the monitoring dashboard, including latency tracking and historical data.
- Metrics history is retained for up to one week for easier trend analysis.
- Improved metrics handling during application startup and shutdown.
Bug Fixes
- Improved reliability when collecting and displaying queue metrics.

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info ⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: e99c9319-532a-4774-b734-e9eb105c9453

📥 Commits

Reviewing files that changed from the base of the PR and between a135f1a and f28ab2b.

📒 Files selected for processing (1)

packages/backend/src/api.ts

Walkthrough

The backend upgrades Bull Board, adds Redis-backed metrics history, configures BullMQ worker metric retention for one week, and updates API startup and shutdown ordering.

Changes

Metrics integration

Layer / File(s)	Summary
Worker metrics retention packages/backend/src/jobManager.ts, packages/backend/src/jobManager.test.ts	Workers retain one week of native BullMQ metrics. Tests verify the maxDataPoints configuration.
Bull Board metrics lifecycle packages/backend/package.json, packages/backend/src/api.ts, packages/backend/src/index.ts	Bull Board uses Redis-backed metrics history. The API starts and stops metrics recording and disposes metrics resources before Redis shutdown.

Estimated code review effort: 3 (Moderate) | ~20 minutes

Sequence Diagram(s)

sequenceDiagram
  participant Server
  participant Api
  participant BullBoard
  participant RedisMetricsHistory
  participant BullMQMetricsRecorder
  Server->>Api: initialize API server
  Api->>BullBoard: register queue adapters and history provider
  Api->>RedisMetricsHistory: configure Redis-backed history
  Api->>BullMQMetricsRecorder: start recording
  Server->>Api: dispose API
  Api->>BullMQMetricsRecorder: stop recording
  Api->>RedisMetricsHistory: disconnect history provider

🚥 Pre-merge checks | ✅ 5 ✅ Passed checks (5 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title clearly and concisely describes the primary change: adding Bull Board metrics history to the backend.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches 📝 Generate docstrings

Create stacked PR
Commit on current branch

🧪 Generate unit tests (beta)

Create PR with unit tests
Commit unit tests in branch brendan/bull-board-metrics

Warning

Review ran into problems

🔥 Problems

Git: Failed to clone repository. Please run the @coderabbitai full review command to re-trigger a full review. If the issue persists, set path_filters to include or exclude specific files.

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Caution

CodeRabbit couldn't update its existing comment. The review summary may be out of date.

Error details

No server is currently available to service your request. Sorry about that. Please try resubmitting your request and contact us if the problem persists.

License Audit

⚠️ Status: PASS

Metric	Count
Total packages	2171
Resolved (non-standard)	8
Unresolved	0
Strong copyleft	0
Weak copyleft	28

Weak Copyleft Packages (informational)

Package	Version	License
@img/sharp-libvips-darwin-arm64	1.3.2	LGPL-3.0-or-later
@img/sharp-libvips-darwin-x64	1.3.2	LGPL-3.0-or-later
@img/sharp-libvips-linux-arm	1.3.2	LGPL-3.0-or-later
@img/sharp-libvips-linux-arm64	1.3.2	LGPL-3.0-or-later
@img/sharp-libvips-linux-ppc64	1.3.2	LGPL-3.0-or-later
@img/sharp-libvips-linux-riscv64	1.3.2	LGPL-3.0-or-later
@img/sharp-libvips-linux-s390x	1.3.2	LGPL-3.0-or-later
@img/sharp-libvips-linux-x64	1.3.2	LGPL-3.0-or-later
@img/sharp-libvips-linuxmusl-arm64	1.3.2	LGPL-3.0-or-later
@img/sharp-libvips-linuxmusl-x64	1.3.2	LGPL-3.0-or-later
@img/sharp-wasm32	0.35.3	Apache-2.0 AND LGPL-3.0-or-later AND MIT
@img/sharp-win32-arm64	0.35.3	Apache-2.0 AND LGPL-3.0-or-later
@img/sharp-win32-ia32	0.35.3	Apache-2.0 AND LGPL-3.0-or-later
@img/sharp-win32-x64	0.35.3	Apache-2.0 AND LGPL-3.0-or-later
axe-core	4.10.3	MPL-2.0
dompurify	3.4.13	(MPL-2.0 OR Apache-2.0)
lightningcss	1.32.0	MPL-2.0
lightningcss-android-arm64	1.32.0	MPL-2.0
lightningcss-darwin-arm64	1.32.0	MPL-2.0
lightningcss-darwin-x64	1.32.0	MPL-2.0
lightningcss-freebsd-x64	1.32.0	MPL-2.0
lightningcss-linux-arm-gnueabihf	1.32.0	MPL-2.0
lightningcss-linux-arm64-gnu	1.32.0	MPL-2.0
lightningcss-linux-arm64-musl	1.32.0	MPL-2.0
lightningcss-linux-x64-gnu	1.32.0	MPL-2.0
lightningcss-linux-x64-musl	1.32.0	MPL-2.0
lightningcss-win32-arm64-msvc	1.32.0	MPL-2.0
lightningcss-win32-x64-msvc	1.32.0	MPL-2.0

Resolved Packages (8)

Package	Version	Original	Resolved	Source
codemirror-lang-elixir	4.0.0	UNKNOWN	Apache-2.0	GitHub repo (livebook-dev/codemirror-lang-elixir, GitHub license API: Apache-2.0), confirmed by Apache-2.0 LICENSE file in the published npm tarball; npmjs.com page blocked automated fetch (HTTP 403) and the registry manifest has no license field
khroma	2.1.0	UNKNOWN	MIT	GitHub repo (fabiospampinato/khroma, GitHub license API: MIT), confirmed by MIT "license" file in the published npm tarball; npmjs.com page blocked automated fetch (HTTP 403) and the registry manifest has no license field
lezer-elixir	1.1.2	UNKNOWN	Apache-2.0	GitHub repo (livebook-dev/lezer-elixir, GitHub license API: Apache-2.0), confirmed by Apache-2.0 LICENSE file in the published npm tarball; npmjs.com page blocked automated fetch (HTTP 403) and the registry manifest has no license field
map-stream	0.1.0	UNKNOWN	MIT	GitHub repo (dominictarr/map-stream, GitHub license API: MIT), confirmed by MIT LICENCE file in the published npm tarball; npmjs.com page blocked automated fetch (HTTP 403) and the registry manifest has no license field
memorystream	0.3.1	UNKNOWN	MIT	extracted from object: legacy "licenses": [{"type":"MIT","url":"..."}] field in the npm registry manifest; confirmed by MIT LICENSE file in the published npm tarball
pause-stream	0.0.11	["MIT", "Apache2"]	MIT OR Apache-2.0	extracted from array license field ["MIT","Apache2"] in the npm registry manifest; LICENSE file in the published npm tarball states "Dual Licensed MIT and Apache 2" and contains both full texts, so "Apache2" normalizes to Apache-2.0
posthog-js	1.369.0	SEE LICENSE IN LICENSE	Apache-2.0	LICENSE file referenced by "SEE LICENSE IN LICENSE" in the published npm tarball: Apache License 2.0 grant (Copyright 2020 PostHog / Hiberly, Inc.). A trailing MIT notice applies only to specific expo/expo-derived files, so the package license is Apache-2.0
valid-url	1.0.9	UNKNOWN	MIT	MIT LICENSE file in the published npm tarball (verbatim MIT text, Copyright (c) 2013 Odysseas Tsatalos and oDesk Corporation); GitHub repo ogt/valid-url reports NOASSERTION (no metadata) and npmjs.com page blocked automated fetch (HTTP 403)

Cursor Bugbot has reviewed your changes using high effort and found 1 potential issue.

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit f28ab2b. Configure here.

Bull Board loses read-only mode

High Severity

BullMQAdapter instances are created without readOnlyMode: true, so /admin/queues becomes a writable Bull Board. The prior board blocked retries, cleans, pauses, and other mutations; this endpoint still has no auth middleware, so anyone who can reach the worker API can alter job queues. That conflicts with the PR’s “read-only Bull Board” intent.

Additional Locations (1)

packages/backend/src/api.ts#L60-L62

Reviewed by Cursor Bugbot for commit f28ab2b. Configure here.

feat(backend): add Bull Board metrics history

375c1da

This comment has been minimized.

Sign in to view

docs: add Bull Board metrics changelog entry

a135f1a

feedback

f28ab2b

brendan-kellam merged commit 41d90a4 into main Aug 17, 2026
11 of 12 checks passed

brendan-kellam deleted the brendan/bull-board-metrics branch August 17, 2026 21:05

github-actions Bot mentioned this pull request Aug 17, 2026

Sourcebot Roadmap 🚀 #459

Open

cursor Bot reviewed Aug 17, 2026

View reviewed changes

coderabbitai Bot mentioned this pull request Aug 19, 2026

chore: update bull-board to 9.3.1 #1610

Merged

                       bullBoardAdapter.setBasePath('/admin/queues');
+                      const queueAdapters = jobManager
+                          .getQueues()
+                          .map(queue => new BullMQAdapter(queue));

feat(backend): add Bull Board metrics history by brendan-kellam · Pull Request #1604 · sourcebot-dev/sourcebot · GitHub

Uh oh!

feat(backend): add Bull Board metrics history - #1604

feat(backend): add Bull Board metrics history#1604
brendan-kellam merged 3 commits into
mainfrom
brendan/bull-board-metrics

brendan-kellam commented Aug 17, 2026 •
edited by coderabbitai Bot
Loading

Uh oh!

Uh oh!

This comment has been minimized.

coderabbitai Bot commented Aug 17, 2026 •
edited
Loading

Uh oh!

Uh oh!

coderabbitai Bot commented Aug 17, 2026

Uh oh!

github-actions Bot commented Aug 17, 2026 •
edited
Loading

Uh oh!

Uh oh!

Uh oh!

cursor Bot left a comment

Uh oh!

cursor Bot Aug 17, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

feat(backend): add Bull Board metrics history by brendan-kellam · Pull Request #1604 · sourcebot-dev/sourcebot · GitHub

Uh oh!

feat(backend): add Bull Board metrics history - #1604

feat(backend): add Bull Board metrics history#1604brendan-kellam merged 3 commits intomainsourcebot-dev/sourcebot:mainfrom brendan/bull-board-metricssourcebot-dev/sourcebot:brendan/bull-board-metricsCopy head branch name to clipboard

Conversation

brendan-kellam commented Aug 17, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Validation

Summary by CodeRabbit

Uh oh!

This comment has been minimized.

coderabbitai Bot commented Aug 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Review failed

Walkthrough

Changes

Sequence Diagram(s)

Review ran into problems

Uh oh!

coderabbitai Bot commented Aug 17, 2026

Uh oh!

github-actions Bot commented Aug 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

License Audit

Weak Copyleft Packages (informational)

Uh oh!

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

cursor Bot Aug 17, 2026

Choose a reason for hiding this comment

Bull Board loses read-only mode

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

feat(backend): add Bull Board metrics history#1604
brendan-kellam merged 3 commits into
mainfrom
brendan/bull-board-metrics

brendan-kellam commented Aug 17, 2026 •
edited by coderabbitai Bot
Loading

coderabbitai Bot commented Aug 17, 2026 •
edited
Loading

github-actions Bot commented Aug 17, 2026 •
edited
Loading