FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

feat: Add Lance optional dependencies by haoxu0 · Pull Request #6958 · feast-dev/feast · GitHub

Repository navigation

Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension .lock  (1) .md  (1) .py  (1) .toml  (1) .txt  (3) All 5 file types selected
Only manifest files
Viewed files
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Unified
Split
Hide whitespace
Diff view
Unified
Split
Hide whitespace
25 changes: 24 additions & 1 deletion docs/reference/data-sources/table-formats.md
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,29 @@ Feast supports modern table formats to enable data lakehouse architectures with

## Supported Table Formats

### Lance

[Lance](https://lancedb.github.io/lance/) is an Arrow-native table format with
versioned datasets and vector indexing. Install Feast's native Lance reader and
namespace client with:

```bash
pip install 'feast[lance]'
```

Use `LanceFormat` to select a namespace and optionally pin reads to a dataset
version or tag:

```python
from feast.table_format import LanceFormat

lance_format = LanceFormat(
catalog="my_catalog",
namespace="features",
tag="candidate",
)
```

### Apache Iceberg

[Apache Iceberg](https://iceberg.apache.org/) is an open table format designed for huge analytic datasets. It provides:
Expand Down Expand Up @@ -354,4 +377,4 @@ Future support planned for:
- [Apache Iceberg Documentation](https://iceberg.apache.org/docs/latest/)
- [Delta Lake Documentation](https://docs.delta.io/latest/index.html)
- [Apache Hudi Documentation](https://hudi.apache.org/docs/overview)
- [Python API Reference - TableFormat](https://rtd.feast.dev/en/master/#feast.table_format)
- [Python API Reference - TableFormat](https://rtd.feast.dev/en/master/#feast.table_format)
4 changes: 3 additions & 1 deletion pixi.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

6 changes: 5 additions & 1 deletion pyproject.toml
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Original file line number Diff line number Diff line change
Expand Up @@ -116,6 +116,10 @@ openlineage = ["openlineage-python>=1.40.0"]
opentelemetry = ["prometheus_client", "psutil"]
spark = ["pyspark>=4.0.0"]
iceberg = ["pyiceberg>=0.7.0"]
lance = [
"pylance>=12.0.0",
"lance-namespace>=0.11.1",
]
trino = ["trino>=0.305.0,<0.400.0", "regex"]
postgres = ["psycopg[binary,pool]>=3.2.5"]
# psycopg[c] install requires a system with a C compiler, python dev headers, & postgresql client dev headers
Expand Down Expand Up @@ -178,7 +182,7 @@ test = [
]

ci = [
"feast[test, aws, azure, cassandra, clickhouse, couchbase, delta, docling, duckdb, elasticsearch, faiss, gcp, ge, glide, go, grpcio, hazelcast, hbase, ibis, iceberg, image, k8s, mcp, mcp-server, milvus, mlflow, mongodb, mssql, mysql, openlineage, opentelemetry, oracle, scylladb, spark, trino, postgres, pytorch, qdrant, rag, ray, redis, singlestore, snowflake, sqlite_vec]",
"feast[test, aws, azure, cassandra, clickhouse, couchbase, delta, docling, duckdb, elasticsearch, faiss, gcp, ge, glide, go, grpcio, hazelcast, hbase, ibis, iceberg, image, k8s, lance, mcp, mcp-server, milvus, mlflow, mongodb, mssql, mysql, openlineage, opentelemetry, oracle, scylladb, spark, trino, postgres, pytorch, qdrant, rag, ray, redis, singlestore, snowflake, sqlite_vec]",
"build",
"virtualenv>=20.26,<21",
"dbt-artifacts-parser",
Expand Down
87 changes: 85 additions & 2 deletions sdk/python/requirements/py3.10-ci-requirements.txt
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Original file line number Diff line number Diff line change
Expand Up @@ -3304,6 +3304,16 @@ kubernetes==36.0.3 \
# feast (pyproject.toml)
# codeflare-sdk
# kube-authkit
lance-namespace==0.11.1 \
--hash=sha256:07643fce9a42ad4d58cc8bf91e3f592bc7f4cbd8d0ad5233223506debf67551c \
--hash=sha256:f67cfbbe0647b7cb42f23b673e7edf8a75b7d8a047265a916492f8d247ee1bc2
# via
# feast (pyproject.toml)
# pylance
lance-namespace-urllib3-client==0.11.1 \
--hash=sha256:145a9e9424d7597487249b5b95ee274423bf2910e1a9160b6a07b676b61ea46a \
--hash=sha256:36537f529294da6d884ba0fe783704483f0a75463497c7705fd083a4d0257990
# via lance-namespace
lark==1.3.1 \
--hash=sha256:b426a7a6d6d53189d318f2b6236ab5d6429eaf09259f1ca33eb716eed10d2905 \
--hash=sha256:c629b661023a014c37da873b4ff58a817398d12635d3bbb2c5a03be7fe5d1e12
Expand Down Expand Up @@ -4528,6 +4538,7 @@ numpy==2.2.6 ; python_full_version < '3.11' \
# opencv-python-headless
# pandas
# pandas-gbq
# pylance
# qdrant-client
# safetensors
# scikit-image
Expand Down Expand Up @@ -4632,6 +4643,7 @@ numpy==2.4.6 ; python_full_version == '3.11.*' \
# opencv-python-headless
# pandas
# pandas-gbq
# pylance
# qdrant-client
# ray
# safetensors
Expand Down Expand Up @@ -4731,6 +4743,7 @@ numpy==2.5.3 ; python_full_version >= '3.12' \
# opencv-python-headless
# pandas
# pandas-gbq
# pylance
# qdrant-client
# ray
# safetensors
Expand Down Expand Up @@ -5654,6 +5667,7 @@ pyarrow==23.0.1 \
# milvus-lite
# mlflow
# pandas-gbq
# pylance
# ray
# snowflake-connector-python
pyarrow-hotfix==0.7 \
Expand Down Expand Up @@ -5774,6 +5788,7 @@ pydantic[email]==2.13.5 \
# fastapi-mcp
# fastmcp-slim
# great-expectations
# lance-namespace-urllib3-client
# mcp
# mlflow-skinny
# mlflow-tracing
Expand Down Expand Up @@ -5977,6 +5992,14 @@ pyjwt[crypto]==2.15.1 \
# msal
# singlestoredb
# snowflake-connector-python
pylance==13.0.0 \
--hash=sha256:22a37a0af446964e79cfd6046f9ea2735fcb42f8020eab63947b2bdca04989c2 \
--hash=sha256:22e47adcc2c7300ff876fb398ee9c625973932163ec055adae14871f8a09d7b0 \
--hash=sha256:2c94649a35161c6100ed822ac022756bfefb840b7e01cf491505c5245186f7b4 \
--hash=sha256:38cbe8d204785e697909e8faca91adb3b00a2f6a865c425987cb232d0865c010 \
--hash=sha256:8a340dcf750171dd6386db0b6ed303bb22594e1c1b266b7fe149ea1684bf4a9a \
--hash=sha256:a54496c4e6c01a8c3d49479fce98474c95a265515091d173aa9e16df271d837d
# via feast (pyproject.toml)
pylatexenc==2.11 \
--hash=sha256:305a072a99ce736246049c9da05841b9d718c0f7ea8888f5f596cf15cb621053 \
--hash=sha256:e78e7391d6c104f1ed150e21cfaa58016cdb50aa54406a2eecb793649ffdfdd0
Expand Down Expand Up @@ -6566,6 +6589,7 @@ python-dateutil==2.9.0 \
# ibis-framework
# jupyter-client
# kubernetes
# lance-namespace-urllib3-client
# matplotlib
# moto
# openlineage-python
Expand Down Expand Up @@ -8404,14 +8428,47 @@ toolz==1.1.0 \
# ibis-framework
# partd
torch==2.14.1 ; sys_platform == 'darwin' \
--hash=sha256:100df7e44af5c973606cfef571a14b36b0acfd165d6bbc7aabe3edac95c9ccbd \
--hash=sha256:17b32fd68abe9429d936c643579e24465e7174a06c168bbfcc01395a881bc8af \
--hash=sha256:192745b92c9ac392298e73de950cd02d8a7886117923073d890625622d343ede \
--hash=sha256:24b279ee181df14dc353f3e3f0e3f088d88a38175989dadb5645c0194830d4de \
--hash=sha256:2547c9f32f8fd9c8fced83119269d85519b123d4e8c87eba71660fe3a6996336 \
--hash=sha256:2948f065d848178a0402791baf87493b7ebf067dae48a8e04c498d6668e94895 \
--hash=sha256:2af649994b36dffc627175c3f306d9e513a309b58d4619ac7107577613336454 \
--hash=sha256:2f8162c6b265eaf2b0bdd6bef20e96cece430f308e1477a32d0aef51e472124c \
--hash=sha256:331fa474e26e428e2e6af1143b2fdab19cee492d7d21897b8899ce1c14755662 \
--hash=sha256:35103e180214793207f95d7e12e100ecba3ace6f5fb37e1fcefbb07e096ed180 \
--hash=sha256:36a03a3f87ec875ca39c8e29eccbaf0fc704605f78a3f7f179f157048c3c395e \
--hash=sha256:3e4d7679866c4cd68258ccda7c51bcda150797eda095813f26fe63c07934cc21 \
--hash=sha256:4b323c71a5ac184485c87d694842157b1eb217c425ad69761dafd379d1590521 \
--hash=sha256:4ce2a6ae7d302bba56ef7c5c92d9f752728896cfe2626a7f3e5293f879e36650 \
--hash=sha256:4eec5a4fadd7a18f9c75b97fdb374fbb579ce4b1604bf66eeb14dc2201d54def \
--hash=sha256:5a6363570c753812540a05eb82380e329469cbe668643e88111414c12627711f \
--hash=sha256:5c0d1ef51127c9c65ec6394226b82ef1a5f3cd0ab8ffb10f48cc5c08aa72a5cf \
--hash=sha256:5e38154c8896d426a5df58bf2276b603e82184dfae4f54d77dbb212f36e34f37 \
--hash=sha256:6b06a7f6275c5fdecaf1dbf5546f0820b024a97785575bb99e3d9930d83cd86b \
--hash=sha256:6fe25964e53113a8a1f5640be1103a982a426c07f8907fba48fcca1be1112202 \
--hash=sha256:729992e6b581de722989012547b7767ef8ac019bd060e34805f06a52ff9a120e \
--hash=sha256:783a3dec10d272e40ed3f1a05ec228400300d3229b8f7521a9327645fae88646 \
--hash=sha256:7b0670b545f1b732a3219966e6704b27398a32a764bc7cce065e40b142dcf8a1 \
--hash=sha256:7d2c35e915793f3ae82e8ee4041a960140bcd0bd35f3ec6eb06e1f1f37a89dba \
--hash=sha256:82762c7527079f1e17a771684362ed51400e3bc72942df30217e40f27c6816d7 \
--hash=sha256:88634fad89f7b953acd011bad0d5c131d269aa71a7de6e0ef2344e3a2c95fabc \
--hash=sha256:930d724490955b822c0b005499128279e54876a318b51fdb9b9da35e0230cc0f \
--hash=sha256:94edee897fbd15a73f91aa38e22e2d2b7b60ac3acf6e8afc6b8dad89229c810c \
--hash=sha256:9cf3082d25560efb1eef921871595227c0cf305abb7761ca45b6b988ef6cdd45 \
--hash=sha256:e3ac0a862f1e81a23bd2b9ff979c189a2154e731c06d4c530bfbf2642ff01ddf
--hash=sha256:a46884e8b38cbdf5af8d4fdd39223a5fa97491419c3417c93f9b3e28749fa356 \
--hash=sha256:a7a580e3d92467516c9247a22bc805ae4f79c7b1b9a2052f92849f34e89720f5 \
--hash=sha256:a93db7947d53caab62c2436205a60ddf9c3150c2e09eb9b24610c1c3f4cbaf99 \
--hash=sha256:b869fe9358c90dd82d02db89aef89729df93a89a48b7c3e21a7719abf55586b3 \
--hash=sha256:bda7043ec45539b1b61538af468e19854b72ac6be8d6fde2f51dfd0c91721568 \
--hash=sha256:c52adc3bd526ff7fc5bdcc58fc4a76e6214d09951b646ffe5256ebd7ba60cef1 \
--hash=sha256:cccd0a609fe3f83ab2ff651b627d5bd68c7fb33ee77a994b31c18b7c9a6f9a52 \
--hash=sha256:d14b0c8a66345b7ba43adfa86fc20d89087a0a92e440004755d49d2468ddc6e0 \
--hash=sha256:e3ac0a862f1e81a23bd2b9ff979c189a2154e731c06d4c530bfbf2642ff01ddf \
--hash=sha256:e799161f94d97485857ec82424e40a83d7648ab02c03e3d6e71c7838a4d7b89e \
--hash=sha256:f56cd23a3bf003bfbed3da0645ba09b3ccc66c0a2f2ac726a9b98f34e0e4926f \
--hash=sha256:f67ee1fe9c9f7c6ad3785d150bc3cecda442a5880a6d40816e13fee475d97dd8
# via
# feast (pyproject.toml)
# accelerate
Expand Down Expand Up @@ -8465,14 +8522,38 @@ torch==2.14.1+cpu ; sys_platform != 'darwin' \
# timm
# torchvision
torchvision==0.29.1 ; sys_platform == 'darwin' \
--hash=sha256:0be6a8048d16964d0c56b819c2beaa72c8f8985700add134d8ae02062fddd5d5 \
--hash=sha256:0ca9fcc7c35ca00682e33a278fbc596233552e56417e2548861bcdd023660b51 \
--hash=sha256:148aa2e7606117827b9117744c739a38aaba91a519f44c3971a1c6f118508243 \
--hash=sha256:192a46d1ccb8118810cef0c3852d90f4ba5160bfcb09c674062d3753b9b97719 \
--hash=sha256:25687959fab99dc2489c5f5ab2624101066428a9d344f9f0b45c90c019b25037 \
--hash=sha256:25fee78bd73f3a70fd8402959c6eea0fd164c05727c08bf4f59c73350653d7cc \
--hash=sha256:265b7c27a54bd17fad35494e478ddcf9028187898a8b1c73df515b8be83bc44f \
--hash=sha256:3058f855e65089330ec987b8cac1ccf5e7a26cd475f8cab20597b5577ddc8767 \
--hash=sha256:361f943872f7763807912cc51d621f0172e8d481792f8c6f3fe1f63838a29e0c \
--hash=sha256:3b6eb9d2f8fe9b93d9d37637749df361efeed133d96ddd503184a1b5b12bb27f \
--hash=sha256:48d50755767f08230ada71213decd6502ec59ebc9c9f67098bc2f81036f24b74 \
--hash=sha256:502a45b518f801e4b2689e63c4d2085995e257c54002bc5a0e602093db95405d \
--hash=sha256:52662534ce7451661d94312f11a0922e89998c7d409803046de7046ba6fd1c08 \
--hash=sha256:53bb0c2dd29e5f4f74dc6796e642c13996222f64b3ac0c2fce6d8abd351998e5 \
--hash=sha256:5df6b59fccec8046df9b1ef197d6b5cd8523d1a2e0b981df69fbfd908ccbc464 \
--hash=sha256:7b27accfa545169ad070efb8a6679b25d63acc8513bbc0c05937c3ce94c13ea5 \
--hash=sha256:7e22a746a259d93d00392e0a71df389d3d4466bcd2458d95be3d65bb018efaa5 \
--hash=sha256:81631181cff6389b76195c770dca6292321bffc6fd7954bb72dd690c39c7e375 \
--hash=sha256:84690a857d4ded320a5c5264499a266bb9beb1b706125980d7a4a6f4e07b6b42 \
--hash=sha256:880c1c789fd9cdc31cdb4dbe906b8c74bd8b9b70509cc9fffe6b996ad0a0f656 \
--hash=sha256:8b26ff2c61cd1da60d74cf704cae6007bc38902a60d4a7068fe327db1cb45c62 \
--hash=sha256:9029fbac8d86dc562a79ef33824c50152674ac2f017c001419be4e1e06256b53 \
--hash=sha256:94590cee2298a7b6cc6512159781b577a322d0813baf1add3cf02db744138b31 \
--hash=sha256:9ef8de9b4a47b00dbe0a6a35bba22907f86f091adef57a76f1581502dbfc59f8 \
--hash=sha256:aa6ee9cb6995f10af9e78ba5bceded3aa824b64610f4bafb650e66f8722f841a \
--hash=sha256:b0b3de76f2ee5678b7950ba9971cf72d9c5887cd7993db61788552f371686fed \
--hash=sha256:c33cbd596afa13c24de752ead437eb5da48285efd6dc2a06543948821bfde57a
--hash=sha256:c33cbd596afa13c24de752ead437eb5da48285efd6dc2a06543948821bfde57a \
--hash=sha256:dc630e9aa09a8ee4497e088dfabd60dbfb3b839fa35768a4f3d07e5ebd59a632 \
--hash=sha256:e100257aa2cd8840088d321c338f02657faf43d802d470dd8dcb7ff4003553d2 \
--hash=sha256:ef220d4b21878c58947851beb7337382897159105f012f0c9c07bf7e84174d7e \
--hash=sha256:ef94bfa4f1e870e376d65ca4bac6ca979fdd5da4ce34295621342b6b1736ba43 \
--hash=sha256:f1ef752411a031d74f78488c2ec93619f0d75a6c762409b7a541959054578f2c
# via
# feast (pyproject.toml)
# docling-ibm-models
Expand Down Expand Up @@ -8757,6 +8838,7 @@ typing-extensions==4.16.0 \
# jupyter-client
# jupyterlab
# jwcrypto
# lance-namespace-urllib3-client
# mcp
# minio
# mistune
Expand Down Expand Up @@ -8834,6 +8916,7 @@ urllib3==2.8.0 \
# great-expectations
# kube-authkit
# kubernetes
# lance-namespace-urllib3-client
# minio
# qdrant-client
# requests
Expand Down
Loading
Loading

Back | FazBrowse Home | New Git URL