FazBrowse GitHub Viewer | Trending | | Home

Tools: [Download Repo ZIP] [Original HTTPS Page]

History for llama_cpp/server - timwu/llama-cpp-python · GitHub

Commits

History for

Commits on Jan 8, 2025

fix: streaming resource lock (#1879)

gjpower
and
abetlen
authored
e8f14ce

Commits on Dec 9, 2024

fix: add missing await statements for async exit_stack handling (#1858)
gjpower
authored
afedfc8

Commits on Dec 6, 2024

fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context (#1798)

gjpower
and
abetlen
authored
9bd0c95
fix: added missing exit_stack.close() to /v1/chat/completions (#1796)
Ian321
authored
073b7e4

Commits on Sep 20, 2024

feat: Add option to configure n_ubatch
abetlen
committed
6c44a3f

Commits on Aug 29, 2024

feat: Add server chat_format minicpm-v-2.6 for MiniCPMv26ChatHandler
abetlen
committed
97d527e

Commits on Jul 17, 2024

fix(server): Use split_mode from model settings (#1594)

grider-withourai
and
abetlen
authored
66d5cdd

Commits on Jul 9, 2024

fix(misc): Format
abetlen
committed
c1ae815

Commits on Jul 2, 2024

Commits on Jun 13, 2024

feat: Add `.close()` method to `Llama` class to explicitly free model from memory (#1513)

jkawamoto
and
abetlen
authored
320a5d7

Commits on Jun 4, 2024

feat: adding `rpc_servers` parameter to `Llama` class (#1477)

chraac
and
abetlen
authored
d634efc

Commits on May 29, 2024

fix: fix string value kv_overrides. Closes #1487
abetlen
committed
df45a4b

Commits on May 14, 2024

feat: add MinTokensLogitProcessor and min_tokens argument to server (#1333)
twaka
authored
5212fb0

Commits on May 5, 2024

feat(server): Add support for setting root_path. Closes #1420
abetlen
committed
0318702

Commits on May 3, 2024

Commits on May 2, 2024

feat: Add llama-3-vision-alpha chat format
abetlen
committed
31b1d95

Commits on Apr 30, 2024

Commits on Apr 26, 2024

fix: pydantic deprecation warning
abetlen
committed
fcfea66

Commits on Apr 23, 2024

feat(server): Provide ability to dynamically allocate all threads if desired using `-1` (#1364)
sean-bailey
authored
53ebcc8

Commits on Apr 17, 2024

feat: add `disable_ping_events` flag (#1257)
khimaros
authored
b73c73c
feat: Use all available CPUs for batch processing (#1345)

ddh0
authored and
abetlen
committed
c96b2da

Commits on Apr 10, 2024

feat: Add support for yaml based configs
abetlen
committed
060bfa6

Commits on Apr 1, 2024

feat: add support for KV cache quantization options (#1307)

Limour-dev
and
abetlen
authored
f165048

Commits on Mar 31, 2024

feat: Add logprobs support to chat completions (#1311)

windspirit95
and
abetlen
authored
aa9f1ae

Commits on Mar 23, 2024

fix(server): minor type fixes
abetlen
committed
d11ccc3

Commits on Mar 19, 2024

docs: Add chat examples to openapi ui
abetlen
committed
f7decc9

Commits on Mar 9, 2024

feat: Add endpoints for tokenize, detokenize and count tokens (#1136)

felipelo
and
abetlen
authored
c139f8b

Commits on Feb 28, 2024

misc: Format
abetlen
committed
727d60c
feat: Update llama.cpp
abetlen
committed
0d37ce5

Commits on Feb 26, 2024

feat(server): Add support for pulling models from Huggingface Hub (#1222)
abetlen
authored
4d574bd

Back | FazBrowse Home | New Git URL