Recent Releases of fugue
fugue - 0.9.2.dev2
Fixed a couple of compatibility issues.
- Python
Published by goodwanghan 11 months ago
fugue - Support `dict[str,Any]` as transformer input and output
- Python
Published by goodwanghan over 1 year ago
fugue - 0.9.0
0.9.0
- 482 Move Fugue SQL dependencies into extra
[sql]and functions to become soft dependencies - 504 Create Fugue pytest fixtures and plugins
- 541 Change table temp view names to uppercase
- 540 Fix Ray 2.10+ compatibility issues
- 539 Fix compatibility issues with Dask 2024.4+
- 534 Remove ibis version cap
- 505 Deprecate
as_ibisin FugueWorkflow - 387 Improve test coverage on 3.10, add tests for 3.11
- 269 Spark and Dask Take 1 row without sorting optimization
- Python
Published by goodwanghan almost 2 years ago
fugue - Fix some compatibility issues
Fix some compatibility issues
- Python
Published by goodwanghan about 2 years ago
fugue - 0.8.7
- 488 Migrate from fs to fsspec
- 521 Add
as_dictsto Fugue API - 516 Use
_collect_as_arrowfor Sparkas_arrow` - 520 Add Python 3.10 to Windows Tests
- 506 Adopt pandas
ExtensionDType - 504 Create Fugue pytest fixtures
- 503 Deprecate python 3.7 support
- 501 Simplify zip/comap, remove join from the implementation
- 500 Implement all partitioning strategies for Dask
- 495 Resolve segfault on Duckdb 0.8.1
- 494 Remove the version cap of Dask
- Python
Published by goodwanghan over 2 years ago
fugue - Dask partitioning improvement, zip improvement
- Python
Published by goodwanghan over 2 years ago
fugue - 0.8.6
- 497 Make LocalExecutionEngine respect partition numbers
- 493 Spark Pandas UDF partitioning improvement
- 492 Made AnyDataFrame recognized by Creator, Processor and Ouputter
- 490 Fixed pa.Table as transformer output bug
- 489 Added version cap to Ibis
- 485 Made Fugue compatible with Ray 2.5.0
- 486 Added py.typed to Fugue
- Python
Published by goodwanghan over 2 years ago
fugue - Make LocalExecutionEngine respect partition numbers
- Python
Published by goodwanghan over 2 years ago
fugue - 0.8.5
- 481 Moved Fugue SQL dependencies into functions as soft dependencies
- 478 Removed cloudpickle from the hard dependency of Spark backend
- 477 Removed tests folder from Fugue package
- 476 Fix compatibility issues for Pandas 2+ and Spark < 3.4
- Python
Published by goodwanghan over 2 years ago
fugue - A couple of perf fixes + refactoring FuncParam
- Python
Published by goodwanghan almost 3 years ago
fugue - 0.8.1
- 423 Add seaborn as a domain level extension for visualization
- 422 Add pandas_df.plot as the first namespace extension
- 421 Add the namespace concept to Fugue extensions
- 420 Add is_distributed to engines
- 419 Log transpiled SQL query upon error
- Python
Published by goodwanghan about 3 years ago
fugue - 0.8.0
- 384 Expanding Fugue API
- 410 Unify Fugue SQL dialect (syntax only)
- 409 Support arbitrary column names in Fugue
- 404 Ray/Dask engines guess optimal default partitions
- 403 Deprecate registerrawdf_type
- 392 Aggregations on Spark dataframes fail intermittently
- 398 Rework API Docs and Favicon
- 393 ExecutionEngine as_context
- 385 Remove DataFrame metadata
- 381 Change SparkExecutionEngine to use pandas udf by default
- 380 Refactor ExecutionEngine (Separate out MapEngine)
- 378 Refactor DataFrame show
- 377 Create bag
- 372 Infer execution engine from input
- 340 Migrate to plugin mode
- 369 Remove execution from FugueWorkflow context manager, remove engine from FugueWorkflow
- 373 Fixed Spark engine rename slowness when there are a lot of columns
- Python
Published by goodwanghan about 3 years ago
fugue - Fugue SQL enhancement (dialect, column names)
- Python
Published by goodwanghan about 3 years ago
fugue - Refactor FugueWorkflow, fix EntryPoint issues
- Python
Published by goodwanghan over 3 years ago
fugue - Remove 3.6 support, deeper integration with Ibis
- Python
Published by goodwanghan over 3 years ago
fugue - Add path support for transform and out_transform
- Python
Published by goodwanghan over 3 years ago
fugue - 0.7.0
- 326: Added tests for Python 3.6 - 3.10 for Linux and 3.7 - 3.9 for Windows. Updated devenv and CICD to Python 3.8.
- 321: Moved out Fugue SQL to https://github.com/fugue-project/fugue-sql-antlr, removed version cap of
antlr4-python3-runtime - 323: Removed version cap of DuckDB
- 334: Replaced RLock with SerializableRLock
- 337: Fixed index warning in fugue_dask
- 339: Migrated execution engine parsing to triad conditional_dispatcher
- 341: Added Dask Client to DaskExecutionEngine, and fixed bugs of Dask and Duckdb
- Python
Published by goodwanghan over 3 years ago
fugue - Remove DuckDB cap, replace RLock with SerializableRLock
- Python
Published by goodwanghan over 3 years ago
fugue - 0.6.6
- Create a hybrid engine of DuckDB and Dask
- Save Spark-like partitioned parquet files for all engines
- Enable DaskExecutionEngine to transform dataframes with nested columns
- A smarter way to determine default npartitions in Dask
- Support even partitioning on Dask
- Add handling of nested ArrayType on Spark
- Change to plugin approach to avoid explicit import
- Fixed Click version issue
- Added version caps for antlr4-python3-runtime and duckdb as they both released new versions with breaking changes.
- Python
Published by goodwanghan almost 4 years ago
fugue - 0.6.5
- Make Fugue exceptions short and useful
- Ibis integration (experimental)
- Get rid of simple assignment (not used at all)
- Improve DuckDB engine to use a real DuckDB ExecutionEngine
- YIELD LOCAL DATAFRAME
- Python
Published by goodwanghan about 4 years ago
fugue - Fix Dask recompute, add as_local, persist to transform
- Python
Published by goodwanghan about 4 years ago
fugue - 0.6.4
- Add an option to transform to turn off native dataframe output
- Add callback parameter to
transformandout_transform - Support DuckDB
- Create fsqlignorecase for convenience, make this an option in notebook setup
- Make Fugue SQL error more informative about case issue
- Enable pandas default SQL engine (QPD) to take lower case SQL
- Python
Published by goodwanghan over 4 years ago
fugue - 0.6.3
- Change pickle to cloudpickle for Flask RPC Server
- Add license to package
- Python
Published by goodwanghan over 4 years ago
fugue - 0.6.0
- Added Select, Aggregate, Filter, Assign interfaces
- Made compatible with Windows OS, added github actions to test on windows
- Let SparkExecutionEngine accept empty pandas dataframes
- Move to codecov
- Let Fugue SQL take input dataframes with name such as a.b
- Python
Published by goodwanghan over 4 years ago
fugue - 0.5.6
- Dask repartitioning improvement
- Separate Dask IO to use its own APIs
- Improved Dask print function by adding back head
- Made
assert_or_throwlazy - Improved notebook setup handling for jupyter lab
- Python
Published by goodwanghan almost 5 years ago
fugue - 0.5.4
- Added built in avro support
- Fixed dask print bug
- Python
Published by goodwanghan almost 5 years ago
fugue - 0.5.2
- Added Codacy and Slack channel badges, fixed pylint
- Created transform and out_transform functions
- Added partition syntax sugar
- Fixed FugueSQL
CONNECTbug
- Python
Published by goodwanghan almost 5 years ago
fugue - 0.5.1
- Fugueless 1 2 3 4 5
- Notebook experience and extension 1 2
- NativeExecutionEngine: switched to use QPD for SQL
- Spark pandas udf: migrate to applyInPandas and mapInPandas
- SparkExecutionEngine take bug
- Fugue SQL: PRINT ROWS n -> PRINT n ROWS|ROW
- Refactor yield
- Fixed Jinja templating issue
- Change parsepresort_exp from a private function to public
- Failure to delete execution temp directory is annoying was changed to info
- Python
Published by goodwanghan about 5 years ago