FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

[pull] main from abetlen:main by pull[bot] · Pull Request #31 · stungkit/llama-cpp-python · GitHub

[pull] main from abetlen:main - #31

Open
pull[bot] wants to merge 1041 commits into
stungkit:mainfrom
abetlen:main
Open

[pull] main from abetlen:main#31
pull[bot] wants to merge 1041 commits into
stungkit:mainfrom
abetlen:main

Conversation

pull Bot commented Nov 2, 2023
edited
Loading

Copy link
Copy Markdown

See Commits and Changes for more details.


Created by pull[bot] (v2.0.0-alpha.4)

Can you help keep this open source service alive? 💖 Please sponsor : )

pull Bot added the ⤵️ pull label Nov 2, 2023
pull Bot added the merge-conflict Resolve conflicts manually label Nov 4, 2023
abetlen force-pushed the main branch 5 times, most recently from 4408d7a to cc0fe43 Compare November 14, 2023 20:30
abetlen force-pushed the main branch 2 times, most recently from 5a7ad37 to dc20e8c Compare July 2, 2024 05:39
abetlen and others added 30 commits June 10, 2026 21:49
* feat: update llama.cpp to 6eab47181

* feat: add Pyodide wheel support

* docs: fix Pyodide changelog entry

* feat: enable mtmd for emscripten
…ready cached (#2306)

Co-authored-by: Ankur Kaul <akaul36@gatech.edu>
* feat: update llama.cpp to fdbd6abee

* feat: update llama.cpp to b3fed31b9
* feat: update llama.cpp to 78d2f5246

* fix: align llama.cpp binding comments

* fix: align llama.cpp binding docstrings (#2328)

* fix: align llama.cpp binding docstrings

* fix: use None in Python binding docstrings

* fix: format binding docstring
* feat: update llama.cpp to 13f2b28b0

* feat: update llama.cpp to e3546c794
* feat: update llama.cpp to d2a818231

* feat: update llama.cpp to 11924d4c1

* fix: close contexts before models

* feat: update llama.cpp to fc3f10b38

* feat: update llama.cpp to 42e98813e

* feat: update llama.cpp to 936918514
* fix(server): show falsey defaults in CLI help

* test(server): remove CLI regression test

---------

Co-authored-by: haijie11 <haijie11@noreply.gitcode.com>
Co-authored-by: abetlen <abetlen@gmail.com>
) (#2343)

* fix(llama): release a vision chat handler's mtmd context on close (#2342)

`Llama.close()` tore down the model and its context but left the chat
handler's `_exit_stack` untouched, so the mtmd/clip context it built from
that model was never freed.

Handlers routinely outlive the `Llama` that initialized them -- callers
construct one handler and reuse it across loads -- and
`_init_mtmd_context()` returns early while `mtmd_ctx` is set. After the
first `close()` the handler therefore kept a context bound to an
already-freed model and handed it back on the next load, where it
surfaces as a null `mtmd_ctx` on the C++ side.

Register the handler's exit stack on the Llama's `_stack`. It unwinds
LIFO, so the mtmd context is released ahead of the model teardown
registered earlier in `__init__`, and `mtmd_free` resets `mtmd_ctx` to
`None` so the next load re-initializes cleanly. Duck-typed on
`_exit_stack`, which both `Llava15ChatHandler` and `MTMDChatHandler`
(and every subclass) expose.

* fix: bind multimodal context cleanup to model

---------

Co-authored-by: Anai Guo <antai12232931@anaiguo.com>
Co-authored-by: abetlen <abetlen@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

⤵️ pull merge-conflict Resolve conflicts manually

Projects

None yet

Development

Successfully merging this pull request may close these issues.


Back | FazBrowse Home | New Git URL