Data

Tools

Indexes

Applications

Experiments

Open Source Science

duckdb

DuckDB is an analytical in-process SQL database management system

https://github.com/duckdb/duckdb

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ✓
    Committers with academic emails
    24 of 528 committers (4.5%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (16.9%) to scientific vocabulary

Keywords

analytics database embedded-database olap sql

Keywords from Contributors

distributed embedded mpp lakehouse dbms cloud-native clickhouse self-hosted alignment flexible
Last synced: 6 months ago · JSON representation

Repository

DuckDB is an analytical in-process SQL database management system

Basic Info
  • Host: GitHub
  • Owner: duckdb
  • License: mit
  • Language: C++
  • Default Branch: main
  • Homepage: http://www.duckdb.org
  • Size: 351 MB
Statistics
  • Stars: 32,448
  • Watchers: 233
  • Forks: 2,545
  • Open Issues: 520
  • Releases: 51
Topics
analytics database embedded-database olap sql
Created over 7 years ago · Last pushed 6 months ago
Metadata Files
Readme Contributing License Code of conduct Citation

README.md

DuckDB logo


Github Actions Badge discord Latest Release

DuckDB

DuckDB is a high-performance analytical database system. It is designed to be fast, reliable, portable, and easy to use. DuckDB provides a rich SQL dialect with support far beyond basic SQL. DuckDB supports arbitrary and nested correlated subqueries, window functions, collations, complex types (arrays, structs, maps), and several extensions designed to make SQL easier to use.

DuckDB is available as a standalone CLI application and has clients for Python, R, Java, Wasm, etc., with deep integrations with packages such as pandas and dplyr.

For more information on using DuckDB, please refer to the DuckDB documentation.

Installation

If you want to install DuckDB, please see our installation page for instructions.

Data Import

For CSV files and Parquet files, data import is as simple as referencing the file in the FROM clause:

sql SELECT * FROM 'myfile.csv'; SELECT * FROM 'myfile.parquet';

Refer to our Data Import section for more information.

SQL Reference

The documentation contains a SQL introduction and reference.

Development

For development, DuckDB requires CMake, Python 3 and a C++11 compliant compiler. In the root directory, run make to compile the sources. For development, use make debug to build a non-optimized debug version. You should run make unit and make allunit to verify that your version works properly after making changes. To test performance, you can run BUILD_BENCHMARK=1 BUILD_TPCH=1 make and then perform several standard benchmarks from the root directory by executing ./build/release/benchmark/benchmark_runner. The details of benchmarks are in our Benchmark Guide.

Please also refer to our Build Guide and Contribution Guide.

Support

See the Support Options page.

Owner

  • Name: DuckDB
  • Login: duckdb
  • Kind: organization
  • Location: Amsterdam, The Netherlands

Committers

Last synced: 9 months ago

All Time
  • Total Commits: 43,278
  • Total Committers: 528
  • Avg Commits per committer: 81.966
  • Development Distribution Score (DDS): 0.723
Past Year
  • Commits: 9,979
  • Committers: 194
  • Avg Commits per committer: 51.438
  • Development Distribution Score (DDS): 0.763
Top Committers
Name Email Commits
Mark Raasveldt m****t@g****m 11,995
Tishj t****b@l****l 5,079
Pedro Holanda p****a@g****m 3,946
Laurens Kuiper l****r@c****l 2,743
Hannes Mühleisen h****s@m****g 1,987
Sam Ansmink s****k@h****m 1,859
Tom Ebergen t****m@e****m 1,523
Carlo Piovesan p****o@g****m 1,437
taniabogatsch 4****h 1,359
Richard Wesley h****h@e****m 1,270
Elliana May me@m****e 781
Max Gabrielsson m****x@g****m 754
Tiago Kepe t****e@g****m 650
Maia m****a@d****m 626
Richard Wesley 1****h 393
Kirill Müller k****r@m****g 351
Nick Gerrets n****s@g****m 335
Zuleykha Pavlichenkova z****a@g****m 305
Hannes Mühleisen h****s@d****m 237
Denis Hirn d****n@u****e 227
Gabor Szarnyas s****g@g****m 167
Stefan Binder b****n@o****m 165
Diego Gomes Tome d****t@g****m 163
stephaniewang q****9@c****u 147
lokax m****4@g****m 136
AzimAfroozeh a****3@g****m 105
Christiaan Herrewijn c****n@d****m 90
Lars Verdoes l****s@M****l 88
Josh Wills j****s@g****m 83
Koki Ueha j****e@g****m 81
and 498 more...
Committer Domains (Top 20 + Academic)
qq.com: 12 motherduck.com: 12 cwi.nl: 5 fb.com: 3 duckdblabs.com: 3 163.com: 3 modeanalytics.com: 2 appian.com: 2 uef.fi: 2 alibaba-inc.com: 2 tigereye.com: 2 bytedance.com: 2 me.com: 2 proton.me: 2 clear-code.com: 2 github.com: 2 arista.com: 2 uni-tuebingen.de: 2 gmx.com: 2 sundeck.io: 2 uw.edu: 1 student.uni-tuebingen.de: 1 dhcp-141.eduroam.cwi.nl: 1 anu.edu.au: 1 stat.math.ethz.ch: 1 espol.edu.ec: 1 tu-ilmenau.de: 1 student.tuwien.ac.at: 1 cornell.edu: 1 dhcp-233.eduroam.cwi.nl: 1 dhcp-52.eduroam.cwi.nl: 1 student.vu.nl: 1 umich.edu: 1 inf.ethz.ch: 1 rwth-aachen.de: 1 mail.sustech.edu.cn: 1 zju.edu.cn: 1 molgen.mpg.de: 1 tum.de: 1 cebitec.uni-bielefeld.de: 1 dhcp-248.eduroam.cwi.nl: 1 re-guest-195-169-72-100.wireless.uva.nl: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 3,291
  • Total pull requests: 7,795
  • Average time to close issues: 3 months
  • Average time to close pull requests: 7 days
  • Total issue authors: 1,685
  • Total pull request authors: 427
  • Average comments per issue: 3.08
  • Average comments per pull request: 1.13
  • Merged pull requests: 5,849
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 1,277
  • Pull requests: 3,959
  • Average time to close issues: 11 days
  • Average time to close pull requests: 4 days
  • Issue authors: 753
  • Pull request authors: 237
  • Average comments per issue: 1.39
  • Average comments per pull request: 0.97
  • Merged pull requests: 2,793
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • soerenwolfers (105)
  • pkoppstein (47)
  • SteveLeungYL (42)
  • Mytherin (41)
  • Tishj (33)
  • manticore-projects (32)
  • lukaseder (30)
  • suyZhong (28)
  • hawkfish (27)
  • rpbouman (27)
  • NickCrews (26)
  • l1t1 (26)
  • fuboat (24)
  • rustyconover (22)
  • Giorgi (19)
Pull Request Authors
  • Mytherin (1,537)
  • carlopi (862)
  • Tishj (669)
  • lnkuiper (457)
  • pdet (456)
  • hawkfish (416)
  • taniabogatsch (355)
  • Tmonster (249)
  • samansmink (209)
  • Maxxen (203)
  • szarnyasg (181)
  • hannes (174)
  • hmeriann (111)
  • maiadegraaf (92)
  • Mause (83)
Top Labels
Issue Labels
needs triage (1,087) reproduced (1,061) stale (593) under review (437) needs more info (81) Needs Documentation (62) needs reproducible example (58) expected behavior (53) bug (39) PR submitted (32) Silver Foundation Member (30) feature (24) Gold Foundation Member (17) JDBC (15) R (13) Python (11) good first issue (9) enhancement (8) duplicate (7) Index (7) Ready For Review (7) API (6) Ready To Merge (6) Julia (5) ODBC (5) Arrow (5) Changes Requested (4) Optimizer (4) Execution (3) Extension (3)
Pull Request Labels
Ready For Review (1,088) Ready To Merge (907) Changes Requested (231) Needs Documentation (215) CI Failure (96) stale (55) feature (35) Draft (29) needs triage (20) reproduced (16) Merge Conflict (12) bug-fix (9) Index (6) needs maintainer approval (6) under review (5) Friendly SQL (5) Test (3) ODBC (2) Next Release (2) JDBC (2) incorrect results (2) Needs functions.json entry (2) expected behavior (2) Storage (1) Optimizer (1) PR submitted (1) build (1) enhancement (1) experimental (1) needs more info (1)

Packages

  • Total packages: 8
  • Total downloads:
    • nuget 1,171 total
    • pypi 7,110,467 last-month
    • julia 461 total
  • Total docker downloads: 25,236,648
  • Total dependent packages: 309
    (may contain duplicates)
  • Total dependent repositories: 3,753
    (may contain duplicates)
  • Total versions: 1,424
  • Total maintainers: 4
  • Total advisories: 1
pypi.org: duckdb

DuckDB in-process database

  • Versions: 1,266
  • Dependent Packages: 300
  • Dependent Repositories: 3,752
  • Downloads: 7,110,467 Last month
  • Docker Downloads: 25,236,648
Rankings
Dependent packages count: 0.1%
Stargazers count: 0.2%
Dependent repos count: 0.2%
Downloads: 0.2%
Average: 0.6%
Forks count: 1.3%
Docker downloads count: 1.5%
Maintainers (3)
hfmuehleisen Mytherin duckdb_admin
Advisories (1)
Last synced: about 1 year ago
proxy.golang.org: github.com/duckdb/duckdb
  • Versions: 52
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Stargazers count: 0.6%
Forks count: 0.6%
Average: 4.4%
Dependent packages count: 7.0%
Dependent repos count: 9.3%
Last synced: 6 months ago
proxy.golang.org: github.com/DuckDB/duckdb
  • Versions: 52
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 5.3%
Average: 5.5%
Dependent repos count: 5.7%
Last synced: 6 months ago
juliahub.com: DuckDB

DuckDB is an analytical in-process SQL database management system

  • Versions: 30
  • Dependent Packages: 3
  • Dependent Repositories: 0
  • Downloads: 461 Total
Rankings
Stargazers count: 0.0%
Forks count: 0.0%
Average: 8.2%
Dependent repos count: 9.9%
Dependent packages count: 23.0%
Last synced: 6 months ago
conda-forge.org: python-duckdb

DuckDB is an embedded database designed to execute analytical SQL queries fast while embedded in another process. It is designed to be easy to install and easy to use.

  • Versions: 21
  • Dependent Packages: 6
  • Dependent Repositories: 1
Rankings
Stargazers count: 3.1%
Forks count: 5.6%
Dependent packages count: 9.0%
Average: 10.5%
Dependent repos count: 24.4%
Last synced: 6 months ago
nuget.org: duckdb.nativebinaries

Pre‑compiled DuckDB shared libraries for Linux, Windows and macOS packaged as a NuGet dependency.

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1,171 Total
Rankings
Dependent repos count: 6.7%
Dependent packages count: 18.0%
Average: 27.2%
Downloads: 56.8%
Maintainers (1)
halgari
Last synced: 6 months ago
anaconda.org: duckdb

DuckDB is an embedded database designed to execute analytical SQL queries fast while embedded in another process. It is designed to be easy to install and easy to use.

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 45.7%
Average: 48.0%
Dependent repos count: 50.3%
Last synced: 6 months ago
anaconda.org: python-duckdb

DuckDB is an embedded database designed to execute analytical SQL queries fast while embedded in another process. It is designed to be easy to install and easy to use.

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 45.8%
Average: 48.0%
Dependent repos count: 50.3%
Last synced: 6 months ago

Dependencies

.github/actions/build_extensions/action.yml actions
  • lukka/run-vcpkg v11 composite
.github/actions/swap_space/action.yml actions
.github/workflows/CodeQuality.yml actions
  • actions/checkout v3 composite
  • hendrikmuhs/ccache-action main composite
.github/workflows/DraftMe.yml actions
  • actions/upload-artifact v3 composite
.github/workflows/DraftMeNot.yml actions
.github/workflows/DraftPR.yml actions
  • actions/github-script v6 composite
.github/workflows/ExtendedTests.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • hendrikmuhs/ccache-action main composite
.github/workflows/ExtraTests.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • hendrikmuhs/ccache-action main composite
.github/workflows/InternalIssuesCreateMirror.yml actions
.github/workflows/InternalIssuesUpdateMirror.yml actions
.github/workflows/IssuesCloseStale.yml actions
  • actions/stale v8 composite
.github/workflows/Julia.yml actions
  • actions/checkout v3 composite
  • hendrikmuhs/ccache-action main composite
  • julia-actions/setup-julia v1 composite
.github/workflows/LinuxRelease.yml actions
  • ./.github/actions/build_extensions * composite
  • ./.github/actions/manylinux_2014_setup * composite
  • ./.github/actions/ubuntu_18_setup * composite
  • KyleMayes/install-llvm-action v1 composite
  • actions/checkout v3 composite
  • actions/download-artifact v3 composite
  • actions/setup-python v4 composite
  • actions/upload-artifact v3 composite
  • hendrikmuhs/ccache-action main composite
.github/workflows/Main.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • hendrikmuhs/ccache-action main composite
.github/workflows/NightlyTests.yml actions
  • ./.github/actions/manylinux_2014_setup * composite
  • ./.github/actions/ubuntu_18_setup * composite
  • KyleMayes/install-llvm-action v1 composite
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • actions/upload-artifact v3 composite
  • hendrikmuhs/ccache-action main composite
  • mymindstorm/setup-emsdk v12 composite
.github/workflows/OSX.yml actions
  • ./.github/actions/build_extensions * composite
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • actions/upload-artifact v3 composite
  • hendrikmuhs/ccache-action main composite
.github/workflows/Regression.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • hendrikmuhs/ccache-action main composite
.github/workflows/Swift.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
.github/workflows/SwiftRelease.yml actions
  • actions/checkout v3 composite
.github/workflows/Windows.yml actions
  • ./.github/actions/build_extensions * composite
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • actions/upload-artifact v3 composite
  • hendrikmuhs/ccache-action main composite
  • ilammy/msvc-dev-cmd v1 composite
  • msys2/setup-msys2 v2 composite
.github/workflows/_extension_client_tests.yml actions
  • actions/checkout v2 composite
  • actions/setup-python v2 composite
.github/workflows/cifuzz.yml actions
  • actions/upload-artifact v1 composite
  • google/oss-fuzz/infra/cifuzz/actions/build_fuzzers master composite
  • google/oss-fuzz/infra/cifuzz/actions/run_fuzzers master composite
.github/workflows/NeedsDocumentation.yml actions
.github/workflows/PRNeedsMaintainerApproval.yml actions
.github/workflows/CheckIssueForCodeFormatting.yml actions
  • actions/checkout v4 composite
  • actions/setup-python v4 composite
.github/workflows/coverity.yml actions
  • actions/checkout v4 composite
.github/workflows/InvokeCI.yml actions
.github/workflows/StagedUpload.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
.github/workflows/Android.yml actions
  • ./.github/actions/ubuntu_18_setup * composite
  • actions/checkout v3 composite
  • actions/upload-artifact v3 composite
.github/workflows/DockerTests.yml actions
  • actions/checkout v4 composite
.github/workflows/OnTag.yml actions
.github/workflows/BundleStaticLibs.yml actions
  • ./.github/actions/build_extensions * composite
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
  • actions/upload-artifact v4 composite
  • hendrikmuhs/ccache-action main composite
  • r-lib/actions/setup-r v2 composite
.github/workflows/CrossVersion.yml actions
  • actions/checkout v4 composite
  • actions/download-artifact v4 composite
  • actions/setup-python v5 composite
  • actions/upload-artifact v4 composite
  • hendrikmuhs/ccache-action main composite
.github/workflows/NotifyExternalRepositories.yml actions
extension/delta/vcpkg.json vcpkg
  • openssl *
.github/workflows/Extensions.yml actions
  • actions/checkout v4 composite
  • actions/checkout v3 composite
  • actions/download-artifact v4 composite
  • actions/setup-python v5 composite
  • actions/upload-artifact v4 composite
  • hendrikmuhs/ccache-action main composite
.github/workflows/MirrorDiscussions.yml actions
.github/workflows/_extension_distribution.yml actions