Projects

Updated 9 months ago

@uwdata/mosaic-core • Rank 22.2 • Science 65%

An extensible framework for linking databases and interactive views.

data duckdb interaction scalability visualization

Updated 9 months ago

https://github.com/moj-analytical-services/splink • Rank 24.9 • Science 49%

Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

data-matching data-science deduplicate-data deduplication duckdb em-algorithm entity-resolution fuzzy-matching record-linkage spark uk-gov-data-science

Updated 9 months ago

https://github.com/lancedb/lance • Rank 28.1 • Science 36%

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

apache-arrow computer-vision data-analysis data-analytics data-centric data-format data-science dataops deep-learning duckdb embeddings llms machine-learning mlops python rust

Updated 9 months ago

duckdbserver.jl • Rank 1.4 • Science 44%

Lightweight Julia wrapper around the DuckDB extension, httpserver (extension developed by @quackscience)

data-science duckdb duckdb-community duckdb-extension julia

Updated 9 months ago

https://github.com/ploomber/jupysql • Rank 22.2 • Science 10%

Better SQL in Jupyter. 📊

bigquery clickhouse data-engineering data-science duckdb hive jupyter mysql polars postgres presto python redshift snowflake spark-sql sql sqlite trino tsql

Updated 9 months ago

https://github.com/apecloud/myduckserver • Science 13%

Unified MySQL, Postgres & FlightSQL Server, Powered by DuckDB.

analytics arrow business-analytics business-intelligence columnar-storage data-engineering data-science database duckdb htap mariadb mysql olap pandas parquet polars postgres replication sql zero-etl