Repository navigation
|
there are run vortex with datafusion in rust exmaples in the document. But I didn't see a python example. |
Replies: 1 comment
|
These benchmarks (which are really out of date) just invoke a rust binary. The way to use Vortex and DataFusion together right now through python is by building your own datafusion-python bindings that also include Depending on your usecase, maybe duckdb makes for a better experience? It does have Vortex as a core extension, so it should be pretty seamless. |
These benchmarks (which are really out of date) just invoke a rust binary.
The way to use Vortex and DataFusion together right now through python is by building your own datafusion-python bindings that also include
vortex-datafusionand set up the Vortex file format so it can work with a similar experience as any of the other built-in file formats.Depending on your usecase, maybe duckdb makes for a better experience? It does have Vortex as a core extension, so it should be pretty seamless.