FazBrowse GitHub Viewer
|
Trending
|
URL:
|
Home
Tools:
[Download Repo ZIP]
[Original HTTPS Page]
gh-153569: hide tokenizer state behind token and source operations by pablogsal · Pull Request #156654 · python/cpython · GitHub
python
cpython
Repository navigation
Code
Issues
5k+
(5k+)
Pull requests
2.4k
(2.4k)
Actions
Projects
Security and quality
Insights
gh-153569: hide tokenizer state behind token and source operations
- #156654
#156654
Merged
pablogsal
merged 4 commits into
python:main
python/cpython:main
from
pablogsal:gh-153569-tokenizer-source-ftstring-clean
pablogsal/cpython:gh-153569-tokenizer-source-ftstring-clean
Copy head branch name to clipboard
Sep 12, 2026
Conversation
Commits
4
(4)
Checks
Files changed
Merged
gh-153569: hide tokenizer state behind token and source operations
#156654
pablogsal
merged 4 commits into
python:main
python/cpython:main
from
pablogsal:gh-153569-tokenizer-source-ftstring-clean
pablogsal/cpython:gh-153569-tokenizer-source-ftstring-clean
Copy head branch name to clipboard
Commits
Commits on Sep 8, 2026
gh-153569: hide tokenizer state behind token and source operations
pablogsal
committed
5caac0f
View commit details
Copy full SHA for 5caac0f
Browse repository at this point
gh-153569: keep persistent scanner positions as source offsets
pablogsal
committed
97b6803
View commit details
Copy full SHA for 97b6803
Browse repository at this point
gh-153569: include token types and owned metadata in tokenizer results
pablogsal
committed
1d56ef5
View commit details
Copy full SHA for 1d56ef5
Browse repository at this point
gh-153569: keep character scanning inline with source offsets
pablogsal
committed
aef6c9e
View commit details
Copy full SHA for aef6c9e
Browse repository at this point
Back
|
FazBrowse Home
|
New Git URL