Commit history

1. Commits on Jul 17, 2026

   • docs(benchmark): point setup at cecli-cats, note benchmark_classic deprecation

     cattishly-rgb

     committed
     6c05c14View commit details

     Copy full SHA for 6c05c14

     View code at this pointBrowse repository at this point
2. Commits on Apr 25, 2026

   • Pre-commit updates

     

     Your Name

     committed
     0fc4746View commit details

     Copy full SHA for 0fc4746

     View code at this pointBrowse repository at this point
3. Commits on Mar 27, 2026

   • Make conversation classes instantiable, add common interface to access conversation system per coder class as a nother step towards sub-agent functionality

     

     Your Name

     committed
     e35c9ccView commit details

     Copy full SHA for e35c9cc

     View code at this pointBrowse repository at this point
4. Commits on Mar 17, 2026

   • Update benchmark suite to be able to more easily run comparison batches

     

     Your Name

     committed
     80cb9faView commit details

     Copy full SHA for 80cb9fa

     View code at this pointBrowse repository at this point
5. Commits on Mar 4, 2026

   • Add ability to express all reflections for fairer model benchmarking

     

     Your Name

     committed
     31ae310View commit details

     Copy full SHA for 31ae310

     View code at this pointBrowse repository at this point
6. Commits on Mar 1, 2026

   • Update benchmark suite to include test case pass percentages, aggregation, and compressing a group of tests

     

     Your Name

     committed
     dcf25f3View commit details

     Copy full SHA for dcf25f3

     View code at this pointBrowse repository at this point
7. Commits on Feb 22, 2026

   • Benchmark Harness Updates

     

     Your Name

     committed
     c994722View commit details

     Copy full SHA for c994722

     View code at this pointBrowse repository at this point
8. Commits on Feb 18, 2026

   • Update benchmark file to prevent context leakage

     

     Your Name

     committed
     42fa0c7View commit details

     Copy full SHA for 42fa0c7

     View code at this pointBrowse repository at this point
9. Commits on Feb 11, 2026

   • Benchmark and website updates

     

     Your Name

     committed
     0de366eView commit details

     Copy full SHA for 0de366e

     View code at this pointBrowse repository at this point
10. Commits on Feb 8, 2026

    • Update benchmark script and README

      dwash96

      committed
      f829a33View commit details

      Copy full SHA for f829a33

      View code at this pointBrowse repository at this point
11. Commits on Jan 3, 2026

    • Update env variable prefix part 2 to "CECLI_" and not "CECLI"

      dwash96

      committed
      7a4c1fbView commit details

      Copy full SHA for 7a4c1fb

      View code at this pointBrowse repository at this point
12. Commits on Jan 2, 2026

    • Rename aider to cecli on a file system level (pacakge deployment will come later)

      dwash96

      committed
      10a50e2View commit details

      Copy full SHA for 10a50e2

      View code at this pointBrowse repository at this point
13. Commits on Dec 31, 2025

    • refactor: migrate test_benchmark from unittest to pytest

      Show description for 0e1075f
      johbo

      committed
      0e1075fView commit details

      Copy full SHA for 0e1075f

      View code at this pointBrowse repository at this point
14. Commits on Dec 28, 2025

    • Update prompts.py import to be underneath prompt folder

      dwash96

      committed
      99c9c1eView commit details

      Copy full SHA for 99c9c1e

      View code at this pointBrowse repository at this point
15. Commits on Dec 24, 2025

    • Fix spelling

      dwash96

      committed
      90783f6View commit details

      Copy full SHA for 90783f6

      View code at this pointBrowse repository at this point

    • Formatting

      dwash96

      committed
      b4f02f4View commit details

      Copy full SHA for b4f02f4

      View code at this pointBrowse repository at this point
16. Commits on Dec 23, 2025

    • yada

      ErichBSchulz

      committed
      fde8469View commit details

      Copy full SHA for fde8469

      View code at this pointBrowse repository at this point

    • yada

      ErichBSchulz

      committed
      65bdb1dView commit details

      Copy full SHA for 65bdb1d

      View code at this pointBrowse repository at this point

    • fix: Update benchmark README with minor formatting changes

      Show description for 663cba4
      ErichBSchulz

      committed
      663cba4View commit details

      Copy full SHA for 663cba4

      View code at this pointBrowse repository at this point

    • refactor: Update benchmark README with Cecli Cats details

      Show description for 9c2359e
      ErichBSchulz

      committed
      9c2359eView commit details

      Copy full SHA for 9c2359e

      View code at this pointBrowse repository at this point

    • fix: Format benchmark.py to conform to linter

      Show description for 29e3c5d
      ErichBSchulz

      committed
      29e3c5dView commit details

      Copy full SHA for 29e3c5d

      View code at this pointBrowse repository at this point

    • refactor: Copy new exercises when continuing benchmark runs

      Show description for 8150fef
      ErichBSchulz

      committed
      8150fefView commit details

      Copy full SHA for 8150fef

      View code at this pointBrowse repository at this point

    • change to gem

      ErichBSchulz

      committed
      54442feView commit details

      Copy full SHA for 54442fe

      View code at this pointBrowse repository at this point

    • fix: Improve readability of language filtering in benchmark

      Show description for b568600
      ErichBSchulz

      committed
      b568600View commit details

      Copy full SHA for b568600

      View code at this pointBrowse repository at this point

    • refactor: Simplify benchmark result directory structure

      Show description for fa13a81
      ErichBSchulz

      committed
      fa13a81View commit details

      Copy full SHA for fa13a81

      View code at this pointBrowse repository at this point

    • fix: Exit when prior unnamed runs exist

      Show description for 28dfc22
      ErichBSchulz

      committed
      28dfc22View commit details

      Copy full SHA for 28dfc22

      View code at this pointBrowse repository at this point

    • fix: Add debug logging for directory resolution and result loading

      Show description for c79c7bf
      ErichBSchulz

      committed
      c79c7bfView commit details

      Copy full SHA for c79c7bf

      View code at this pointBrowse repository at this point

    • fix: Add helpful error message with paths to resolve_dirname

      Show description for 86a2b20
      ErichBSchulz

      committed
      86a2b20View commit details

      Copy full SHA for 86a2b20

      View code at this pointBrowse repository at this point

    • fix: Handle None results_dir in benchmark script

      Show description for e7e56f0
      ErichBSchulz

      committed
      e7e56f0View commit details

      Copy full SHA for e7e56f0

      View code at this pointBrowse repository at this point

    • feat: Update benchmark script for async Coder

      Show description for 8390a20
      ErichBSchulz

      committed
      8390a20View commit details

      Copy full SHA for 8390a20

      View code at this pointBrowse repository at this point

    • chore: Update benchmark debug plan for async/await

      Show description for c7f89c9
      ErichBSchulz

      committed
      c7f89c9View commit details

      Copy full SHA for c7f89c9

      View code at this pointBrowse repository at this point

    • docs: Add debug plan for benchmark script

      Show description for 2190623
      ErichBSchulz

      committed
      2190623View commit details

      Copy full SHA for 2190623

      View code at this pointBrowse repository at this point

    • chore: Fix linter warnings in benchmark.py

      Show description for c29a88e
      ErichBSchulz

      committed
      c29a88eView commit details

      Copy full SHA for c29a88e

      View code at this pointBrowse repository at this point

    • refactor: Support new dir structure and dry run

      Show description for ea4df0f
      ErichBSchulz

      committed
      ea4df0fView commit details

      Copy full SHA for ea4df0f

      View code at this pointBrowse repository at this point

    • fix: Add debug logging for metadata parsing

      ErichBSchulz

      committed
      c9b13bbView commit details

      Copy full SHA for c9b13bb

      View code at this pointBrowse repository at this point