Benchkit is a shell-first benchmarking framework for the CX Framework. It supports build and run workflows for multiple applications and systems, result collection, profiler data handling, estimation workflows, and result portal integration.
Repository migration details are documented in docs/repository-history.md.
- Run benchmarks across multiple codes and systems with a shared workflow.
- Support both cross-build and native execution environments.
- Keep site-specific configuration separate from benchmark logic.
- Collect result data, profiler outputs, and estimation inputs in a consistent format.
- Integrate with the CX result portal and related estimation workflows.
- Provide a practical base for performance analysis, estimation, and feedback.
Core specifications:
Estimation specifications:
- Estimation: common rules for accepting, running, storing, and presenting estimation functions. Detailed estimation data, package, input, and re-estimation specifications are linked from this document.
- Result storage design: storage-design memo for result and estimate artifacts.
Operational specifications:
The detailed developer-oriented reference has moved to docs:
This includes:
- project structure
- result portal architecture
- CI pipeline structure
- configuration files
- CI execution control
- system-specific execution environments
- runtime requirements
- result_server requires Python 3.12 or later.
This project is licensed under the BSD 3-Clause License. See LICENSE.