Search results

how to test local llm launched by llam.cpp?

Status: Open.

#149 In LiveCodeBench/LiveCodeBench;

· zzsczz opened on Aug 2, 2026

EvalScope integration: one-command evaluation support for Live-Code-Bench

Status: Open.

#148 In LiveCodeBench/LiveCodeBench;

· Yunnglin opened on Jul 24, 2026

#1 is a real lead, but ranks 2-6 are one statistical tier — consider significance tiers / CIs

Status: Open.

#147 In LiveCodeBench/LiveCodeBench;

· ipezygj opened on Jul 19, 2026

Clarification on LiveCodeBench v6 dataset size (454 vs 175 tasks)

Status: Open.

#145 In LiveCodeBench/LiveCodeBench;

· Curry30Messi opened on Mar 25, 2026

How to specify LMStyle for Qwen3-30B-A3B-Thinking-2507

Status: Open.

#143 In LiveCodeBench/LiveCodeBench;

· Curry30Messi opened on Feb 26, 2026

When will Version 7 be released?

Status: Open.

#139 In LiveCodeBench/LiveCodeBench;

· archersama opened on Dec 23, 2025

Evaluation Support for Custom Output Files

Status: Open.

#138 In LiveCodeBench/LiveCodeBench;

· Facico opened on Dec 22, 2025

Using livecodebench(release_v6) with the datasets lib causes an error! "ValueError: BuilderConfig JsonConfigdoesn't have a 'version_tag' key."

Status: Open.

#134 In LiveCodeBench/LiveCodeBench;

· Keithwwa opened on Nov 25, 2025

Heavy precision problem

Status: Open.

#133 In LiveCodeBench/LiveCodeBench;

· NileZhou opened on Nov 5, 2025

Errors of running time

Status: Open.

#132 In LiveCodeBench/LiveCodeBench;

· HelloWorldLTY opened on Nov 2, 2025

ValueError: Couldn't find cache for livecodebench/code_generation_lite for config 'default-version_tag=release_latest' Available configs in the cache: ['release_latest-version_tag=release_v5']

Status: Open.

#131 In LiveCodeBench/LiveCodeBench;

· fkggggg opened on Oct 30, 2025

Has the --not_fast option been deprecated?

Status: Open.

#130 In LiveCodeBench/LiveCodeBench;

· dog-qiuqiu opened on Oct 23, 2025