Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of dx

dx - v1.4.0

What's Changed

  • Bump duckdb-engine from 0.6.8 to 0.7.0 by @dependabot in https://github.com/noteable-io/dx/pull/188
  • Bump exceptiongroup from 1.1.0 to 1.1.1 by @dependabot in https://github.com/noteable-io/dx/pull/202
  • Bump pydantic from 1.10.6 to 1.10.7 by @dependabot in https://github.com/noteable-io/dx/pull/203
  • Bump polars from 0.16.14 to 0.16.17 by @dependabot in https://github.com/noteable-io/dx/pull/209
  • Bump faker from 18.3.0 to 18.3.2 by @dependabot in https://github.com/noteable-io/dx/pull/210
  • Bump ipython from 8.11.0 to 8.12.0 by @dependabot in https://github.com/noteable-io/dx/pull/212
  • Bump polars from 0.16.17 to 0.17.7 by @dependabot in https://github.com/noteable-io/dx/pull/227
  • Bump faker from 18.3.2 to 18.4.0 by @dependabot in https://github.com/noteable-io/dx/pull/218
  • Bump black from 23.1.0 to 23.3.0 by @dependabot in https://github.com/noteable-io/dx/pull/215
  • Bump github/super-linter from 4 to 5 by @dependabot in https://github.com/noteable-io/dx/pull/222
  • Bump dependabot/fetch-metadata from 1.3.6 to 1.4.0 by @dependabot in https://github.com/noteable-io/dx/pull/224
  • Bump mkdocstrings from 0.20.0 to 0.21.2 by @dependabot in https://github.com/noteable-io/dx/pull/217
  • Bump mkdocstrings-python from 0.8.3 to 0.9.0 by @dependabot in https://github.com/noteable-io/dx/pull/213
  • Summary Charts by @emeeks in https://github.com/noteable-io/dx/pull/226
  • use Field aliases for summary_types by @shouples in https://github.com/noteable-io/dx/pull/234
  • programmatic DEX updates by @shouples in https://github.com/noteable-io/dx/pull/235

New Contributors

  • @emeeks made their first contribution in https://github.com/noteable-io/dx/pull/226

Full Changelog: https://github.com/noteable-io/dx/compare/v1.3.0...v1.4.0

- Python
Published by shouples about 3 years ago

dx - v1.3.0

What's Changed

  • clean up dependencies by @shouples in https://github.com/noteable-io/dx/pull/23
  • don't interfere with other loggers by @shouples in https://github.com/noteable-io/dx/pull/24
  • disable stringify index values by @shouples in https://github.com/noteable-io/dx/pull/27
  • update display formatter registration to use display IDs by @shouples in https://github.com/noteable-io/dx/pull/28
  • convert filters to pandas/sql query syntax by @shouples in https://github.com/noteable-io/dx/pull/31
  • accept cell_id in comm msg data by @shouples in https://github.com/noteable-io/dx/pull/32
  • fix for nonunique index checking JSON serialization by @shouples in https://github.com/noteable-io/dx/pull/35
  • remove copy/paste snippet after filtering by @shouples in https://github.com/noteable-io/dx/pull/33
  • run workflow on push to main by @shouples in https://github.com/noteable-io/dx/pull/37
  • don't look up display ID if one isn't passed by @shouples in https://github.com/noteable-io/dx/pull/38
  • fix column cleaning and general cleanup by @shouples in https://github.com/noteable-io/dx/pull/39
  • only update dataframe_info with truncated dimensions by @shouples in https://github.com/noteable-io/dx/pull/40
  • remove ndarray from renderable types until more testing can be done by @shouples in https://github.com/noteable-io/dx/pull/42
  • handle conversions from np.nan and pd.NA to None in display formatter payloads by @shouples in https://github.com/noteable-io/dx/pull/43
  • OSS updates and some extra cleanup by @shouples in https://github.com/noteable-io/dx/pull/34
  • Bump JRubics/poetry-publish from 1.12 to 1.13 by @dependabot in https://github.com/noteable-io/dx/pull/44
  • Bump mkdocs-material from 8.5.2 to 8.5.3 by @dependabot in https://github.com/noteable-io/dx/pull/45
  • update for docs by @shouples in https://github.com/noteable-io/dx/pull/46
  • Bump faker from 14.2.0 to 14.2.1 by @dependabot in https://github.com/noteable-io/dx/pull/50
  • performance updates by @shouples in https://github.com/noteable-io/dx/pull/48
  • Bump mkdocs-jupyter from 0.21.0 to 0.22.0 by @dependabot in https://github.com/noteable-io/dx/pull/53
  • use duckdb instead of sqlite by @shouples in https://github.com/noteable-io/dx/pull/52
  • Bump faker from 14.2.1 to 15.0.0 by @dependabot in https://github.com/noteable-io/dx/pull/54
  • Bump mkdocs from 1.3.1 to 1.4.0 by @dependabot in https://github.com/noteable-io/dx/pull/55
  • fix for index not being set during resample by @shouples in https://github.com/noteable-io/dx/pull/56
  • Bump pytest-cov from 3.0.0 to 4.0.0 by @dependabot in https://github.com/noteable-io/dx/pull/58
  • Fixes #51 - handle groupby pd.Series objects with .name & .index.names conflict by @shouples in https://github.com/noteable-io/dx/pull/57
  • Bump dependabot/fetch-metadata from 1.3.3 to 1.3.4 by @dependabot in https://github.com/noteable-io/dx/pull/60
  • Bump mkdocs-material from 8.5.3 to 8.5.6 by @dependabot in https://github.com/noteable-io/dx/pull/61
  • Bump pytest-mock from 3.8.2 to 3.9.0 by @dependabot in https://github.com/noteable-io/dx/pull/59
  • Bump pytest-mock from 3.9.0 to 3.10.0 by @dependabot in https://github.com/noteable-io/dx/pull/64
  • Bump black from 22.8.0 to 22.10.0 by @dependabot in https://github.com/noteable-io/dx/pull/65
  • Dataframe renaming comms listener by @MSeal in https://github.com/noteable-io/dx/pull/49
  • Bump faker from 15.0.0 to 15.1.0 by @dependabot in https://github.com/noteable-io/dx/pull/68
  • Fixes #67 - deconflict index/column names by @shouples in https://github.com/noteable-io/dx/pull/69
  • Closes #47 - updated datatype handling - Decimal, datetime.date, datetime.time by @shouples in https://github.com/noteable-io/dx/pull/70
  • remove sqlalchemy + poetry update by @shouples in https://github.com/noteable-io/dx/pull/71
  • Bump mkdocs from 1.4.0 to 1.4.1 by @dependabot in https://github.com/noteable-io/dx/pull/72
  • Bump pandas from 1.5.0 to 1.5.1 by @dependabot in https://github.com/noteable-io/dx/pull/74
  • Bump mkdocs-material from 8.5.6 to 8.5.7 by @dependabot in https://github.com/noteable-io/dx/pull/75
  • add variable assignment comm by @shouples in https://github.com/noteable-io/dx/pull/66
  • Bump geopandas from 0.11.1 to 0.12.0 by @dependabot in https://github.com/noteable-io/dx/pull/76
  • Bump pytest-benchmark from 3.4.1 to 4.0.0 by @dependabot in https://github.com/noteable-io/dx/pull/77
  • Bump pytest from 7.1.3 to 7.2.0 by @dependabot in https://github.com/noteable-io/dx/pull/78
  • downgrade pydantic dep requirement from ^1.9.1 to ^1.9 by @shouples in https://github.com/noteable-io/dx/pull/79
  • change column sampling method from random to outer by @shouples in https://github.com/noteable-io/dx/pull/80
  • add variable name to metadata by @shouples in https://github.com/noteable-io/dx/pull/84
  • Bump geopandas from 0.12.0 to 0.12.1 by @dependabot in https://github.com/noteable-io/dx/pull/85
  • Bump mkdocs from 1.4.1 to 1.4.2 by @dependabot in https://github.com/noteable-io/dx/pull/88
  • Bump faker from 15.1.1 to 15.1.3 by @dependabot in https://github.com/noteable-io/dx/pull/89
  • Bump ipython from 8.5.0 to 8.6.0 by @dependabot in https://github.com/noteable-io/dx/pull/86
  • Bump dependabot/fetch-metadata from 1.3.4 to 1.3.5 by @dependabot in https://github.com/noteable-io/dx/pull/91
  • update is_default_index logic by @shouples in https://github.com/noteable-io/dx/pull/92
  • remove index=default_index_used so schema fields & data columns match by @shouples in https://github.com/noteable-io/dx/pull/93
  • Bump mkdocs-material from 8.5.7 to 8.5.8 by @dependabot in https://github.com/noteable-io/dx/pull/95
  • Bump faker from 15.1.3 to 15.3.1 by @dependabot in https://github.com/noteable-io/dx/pull/96
  • Bump mkdocs-material from 8.5.8 to 8.5.9 by @dependabot in https://github.com/noteable-io/dx/pull/97
  • Bump nox-poetry from 1.0.1 to 1.0.2 by @dependabot in https://github.com/noteable-io/dx/pull/98
  • Bump mkdocstrings-python from 0.7.1 to 0.8.0 by @dependabot in https://github.com/noteable-io/dx/pull/99
  • Bump mkdocs-material from 8.5.9 to 8.5.10 by @dependabot in https://github.com/noteable-io/dx/pull/100
  • Bump duckdb from 0.5.1 to 0.6.0 by @dependabot in https://github.com/noteable-io/dx/pull/101
  • cast origsizebytes/truncatedsizebytes as int instead of np.int64 by @shouples in https://github.com/noteable-io/dx/pull/103
  • Bump faker from 15.3.1 to 15.3.2 by @dependabot in https://github.com/noteable-io/dx/pull/102
  • Bump JRubics/poetry-publish from 1.13 to 1.14 by @dependabot in https://github.com/noteable-io/dx/pull/104
  • Bump JRubics/poetry-publish from 1.14 to 1.15 by @dependabot in https://github.com/noteable-io/dx/pull/105
  • Bump mkdocstrings-python from 0.8.0 to 0.8.2 by @dependabot in https://github.com/noteable-io/dx/pull/106
  • Bump structlog from 22.1.0 to 22.2.0 by @dependabot in https://github.com/noteable-io/dx/pull/107
  • Bump nox from 2022.8.7 to 2022.11.21 by @dependabot in https://github.com/noteable-io/dx/pull/108
  • Bump faker from 15.3.2 to 15.3.3 by @dependabot in https://github.com/noteable-io/dx/pull/109
  • Bump duckdb-engine from 0.6.4 to 0.6.5 by @dependabot in https://github.com/noteable-io/dx/pull/110
  • Bump pandas from 1.5.1 to 1.5.2 by @dependabot in https://github.com/noteable-io/dx/pull/111
  • Bump structlog from 22.2.0 to 22.3.0 by @dependabot in https://github.com/noteable-io/dx/pull/112
  • Bump ipython from 8.6.0 to 8.7.0 by @dependabot in https://github.com/noteable-io/dx/pull/113
  • Bump jupyter-core from 4.11.1 to 4.11.2 by @dependabot in https://github.com/noteable-io/dx/pull/114
  • add exceptiongroup to dependencies by @shouples in https://github.com/noteable-io/dx/pull/115
  • Bump mkdocs-material from 8.5.10 to 8.5.11 by @dependabot in https://github.com/noteable-io/dx/pull/116
  • DEX metadata modeling and tons of documentation by @shouples in https://github.com/noteable-io/dx/pull/90
  • Bump faker from 15.3.3 to 15.3.4 by @dependabot in https://github.com/noteable-io/dx/pull/117
  • Add site_url by @willingc in https://github.com/noteable-io/dx/pull/119
  • Add options to snippets in mkdocs config file by @willingc in https://github.com/noteable-io/dx/pull/120
  • add ALLOW_NOTEABLE_ATTRS setting by @shouples in https://github.com/noteable-io/dx/pull/122
  • add handler for datetime.timezone-aware datetime values by @shouples in https://github.com/noteable-io/dx/pull/123
  • Bump duckdb from 0.6.0 to 0.6.1 by @dependabot in https://github.com/noteable-io/dx/pull/125
  • Use mkdocs-material preferred ci and use pip for docs not poetry by @willingc in https://github.com/noteable-io/dx/pull/126
  • Bump certifi from 2022.9.24 to 2022.12.7 by @dependabot in https://github.com/noteable-io/dx/pull/128
  • remove explicit duckdb dependency by @shouples in https://github.com/noteable-io/dx/pull/129
  • Bump black from 22.10.0 to 22.12.0 by @dependabot in https://github.com/noteable-io/dx/pull/130
  • Bump isort from 5.10.1 to 5.11.1 by @dependabot in https://github.com/noteable-io/dx/pull/132
  • Bump geopandas from 0.12.1 to 0.12.2 by @dependabot in https://github.com/noteable-io/dx/pull/131
  • Update CONTRIBUTING.md by @mattupstate in https://github.com/noteable-io/dx/pull/133
  • fixes for bugs associating display IDs across cells by @shouples in https://github.com/noteable-io/dx/pull/135
  • Bump isort from 5.11.1 to 5.11.2 by @dependabot in https://github.com/noteable-io/dx/pull/136
  • fix for subset handling -> display ID updates by @shouples in https://github.com/noteable-io/dx/pull/137
  • handle duplicate columns by @shouples in https://github.com/noteable-io/dx/pull/138
  • Bump isort from 5.11.2 to 5.11.3 by @dependabot in https://github.com/noteable-io/dx/pull/141
  • Bump duckdb-engine from 0.6.5 to 0.6.6 by @dependabot in https://github.com/noteable-io/dx/pull/142
  • add dedicated uuid4 generator/handler functions by @shouples in https://github.com/noteable-io/dx/pull/146
  • Allow the renaming comm to rename things other that dataframes by @jlrobins in https://github.com/noteable-io/dx/pull/140
  • Bump exceptiongroup from 1.0.4 to 1.1.0 by @dependabot in https://github.com/noteable-io/dx/pull/149
  • Bump Gr1N/setup-poetry from 7 to 8 by @dependabot in https://github.com/noteable-io/dx/pull/150
  • Bump pydantic from 1.10.2 to 1.10.3 by @dependabot in https://github.com/noteable-io/dx/pull/151
  • Bump isort from 5.11.3 to 5.11.4 by @dependabot in https://github.com/noteable-io/dx/pull/147
  • Bump pydantic from 1.10.3 to 1.10.4 by @dependabot in https://github.com/noteable-io/dx/pull/152
  • Use new poetry group notation by @mattupstate in https://github.com/noteable-io/dx/pull/154
  • Bump ipython from 8.7.0 to 8.8.0 by @dependabot in https://github.com/noteable-io/dx/pull/153
  • Cleanup lint warnings in CI by @willingc in https://github.com/noteable-io/dx/pull/127
  • Fix git command by @mattupstate in https://github.com/noteable-io/dx/pull/134
  • add extra sampling options by @shouples in https://github.com/noteable-io/dx/pull/156
  • Bump duckdb-engine from 0.6.6 to 0.6.8 by @dependabot in https://github.com/noteable-io/dx/pull/157
  • modeling and metadata updates by @shouples in https://github.com/noteable-io/dx/pull/139
  • fix programmatic chart/dashboard functions by @shouples in https://github.com/noteable-io/dx/pull/159
  • Bump JRubics/poetry-publish from 1.15 to 1.16 by @dependabot in https://github.com/noteable-io/dx/pull/158
  • Bump pytest from 7.2.0 to 7.2.1 by @dependabot in https://github.com/noteable-io/dx/pull/160
  • Bump pandas from 1.5.2 to 1.5.3 by @dependabot in https://github.com/noteable-io/dx/pull/161
  • Bump dependabot/fetch-metadata from 1.3.5 to 1.3.6 by @dependabot in https://github.com/noteable-io/dx/pull/162
  • Bump flake8-docstrings from 1.6.0 to 1.7.0 by @dependabot in https://github.com/noteable-io/dx/pull/163
  • Bump isort from 5.11.4 to 5.12.0 by @dependabot in https://github.com/noteable-io/dx/pull/165
  • Bump ipython from 8.8.0 to 8.9.0 by @dependabot in https://github.com/noteable-io/dx/pull/166
  • remove comm registration on import by @shouples in https://github.com/noteable-io/dx/pull/148
  • remove rename comm and associated settings/tests by @shouples in https://github.com/noteable-io/dx/pull/167
  • ensure applied_filters items are dictionaries by @shouples in https://github.com/noteable-io/dx/pull/168
  • add character limits on object columns with settings.MAX_STRING_LENGTH by @shouples in https://github.com/noteable-io/dx/pull/169
  • update DEX dashboard-related docs by @shouples in https://github.com/noteable-io/dx/pull/170
  • add mkdocs-glightbox for images by @shouples in https://github.com/noteable-io/dx/pull/144
  • adjust MAX_STRING_LENGTH by @shouples in https://github.com/noteable-io/dx/pull/184
  • Bump mkdocstrings from 0.19.0 to 0.20.0 by @dependabot in https://github.com/noteable-io/dx/pull/172
  • Bump markdown-it-py from 2.1.0 to 2.2.0 by @dependabot in https://github.com/noteable-io/dx/pull/179
  • Bump mkdocstrings-python from 0.8.2 to 0.8.3 by @dependabot in https://github.com/noteable-io/dx/pull/173
  • Bump pydantic from 1.10.4 to 1.10.6 by @dependabot in https://github.com/noteable-io/dx/pull/182
  • provide user_variable_name in display metadata by @shouples in https://github.com/noteable-io/dx/pull/187
  • add custom renderable converters by @shouples in https://github.com/noteable-io/dx/pull/183
  • don't enable simple display mode on import by @shouples in https://github.com/noteable-io/dx/pull/185
  • Bump faker from 15.3.4 to 18.3.0 by @dependabot in https://github.com/noteable-io/dx/pull/198
  • Bump polars from 0.16.13 to 0.16.14 by @dependabot in https://github.com/noteable-io/dx/pull/200
  • Bump pytest from 7.2.1 to 7.2.2 by @dependabot in https://github.com/noteable-io/dx/pull/190
  • Bump black from 22.12.0 to 23.1.0 by @dependabot in https://github.com/noteable-io/dx/pull/189
  • Bump ipython from 8.9.0 to 8.11.0 by @dependabot in https://github.com/noteable-io/dx/pull/180
  • Update Poetry to 1.4.1 by @mattupstate in https://github.com/noteable-io/dx/pull/181
  • Bump dask from 2023.3.1 to 2023.3.2 by @dependabot in https://github.com/noteable-io/dx/pull/204
  • don't return private variables that match current dataframe by @shouples in https://github.com/noteable-io/dx/pull/207
  • fix for non-pandas dataframe rendering by @shouples in https://github.com/noteable-io/dx/pull/208
  • update publish.yaml for PyPI by @shouples in https://github.com/noteable-io/dx/pull/199

New Contributors

  • @dependabot made their first contribution in https://github.com/noteable-io/dx/pull/44
  • @MSeal made their first contribution in https://github.com/noteable-io/dx/pull/49
  • @willingc made their first contribution in https://github.com/noteable-io/dx/pull/119
  • @mattupstate made their first contribution in https://github.com/noteable-io/dx/pull/133
  • @jlrobins made their first contribution in https://github.com/noteable-io/dx/pull/140

Full Changelog: https://github.com/noteable-io/dx/compare/v1.2.0...v1.3.0

- Python
Published by shouples about 3 years ago

dx - v1.2.0

What's Changed

1.2.0

2022-08-21

Added

  • pd.Series as a default renderable type (to go with the existing pd.DataFrame and np.ndarray types)
  • Support for the following data types inside pd.DataFrame columns:
    • type and np.dtype
    • shapely.geometry objects
    • pd.Timedelta and datetime.timedelta
    • pd.Period
    • pd.Interval
    • complex numbers
    • ipaddress.IPv4Address and .IPv6Address
  • Extra dataset generation functions for development/testing under dx.utils.datatypes
    • dx.quick_random_dataframe(n_rows, n_columns) to get a pd.DataFrame of 0.0-1.0 floats (convenience wrapper for pd.DataFrame(np.random.rand(n_rows, n_columns)))
    • dx.random_dataframe() with different boolean values to enable based on available datatypes (dx.DX_DATATYPES)
  • settings_context context manager to allow temporarily changing a setting (or multiple)
  • Logging via structlog (default level: logging.WARNING)

Changed

  • Default sampling method changed from outer to random

Fixed

  • Displaying a dataframe with an out-of-order index (like with .sample()) no longer resets the index before sending data to the frontend.
  • Index/column flattening and string-formatting is behind settings and is handled more explicitly
  • dx should no longer interfere with other media type / mime bundles (e.g. matplotlib) formatted by the existing IPython display formatted
  • 1.1.3 updates by @shouples in https://github.com/noteable-io/dx/pull/19
  • fix github workflow for publishing to pypi by @shouples in https://github.com/noteable-io/dx/pull/15
  • display ID registration prep, formatter registration fixes, index updates, dtype handlers, expanded data generators by @shouples in https://github.com/noteable-io/dx/pull/16

Full Changelog: https://github.com/noteable-io/dx/compare/v1.1.2...v1.2.0

- Python
Published by shouples almost 4 years ago

dx - 1.1.2

What's Changed

  • 1.1.2 dtype hotfix & github workflows by @shouples in https://github.com/noteable-io/dx/pull/14

Fixed

  • outer sampling method no longer alters column dtypes by adding ... placeholder row/column

Full Changelog: https://github.com/noteable-io/dx/compare/v1.1.1...v1.1.2

- Python
Published by shouples almost 4 years ago

dx - v1.1.1

What's Changed

Fixes

  • settings.SAMPLING_METHOD assignment will no longer resolve as True during dataframe truncating

Adds

  • support for pd.NA values
  • pre-render dataframe stats sent in the metadata to the frontend

Full Changelog: https://github.com/noteable-io/dx/compare/v1.1.0...v1.1.1

- Python
Published by shouples almost 4 years ago

dx - v1.1.0

What's Changed

Added

  • Direct support for application/vnd.dataresource+json media type display formatting
  • reverting all settings to pandas defaults with dx.reset() or switching to the DISPAY_MODE setting to default
  • pydantic dependency for BaseSettings use
    • pandas-inspired dx.set_option(setting_name, setting_value)
    • dx.set_display_mode() convenience function for globally switching between simple (simpleTable/DEX), enhanced (GRID), and default (vanilla pandas)
  • Auto-truncating rows and columns of pd.DataFrame objects based on DISPLAY_MAX_ROWS, DISPLAY_MAX_COLUMNS, and MAX_RENDER_SIZE_BYTES (1MB default) size limits before rendering (for simple & enhanced display modes), with blueprintjs flavored warnings
    • SAMPLING_MODE setting to better control how truncating happens ("first", "last", "outer", "inner", and "random" options)
    • RANDOM_SEED setting for random sampling

Fixed

  • Support for non-string column and index values (possibly temporary) to allow build_table_schema to work with pd.MultiIndex values image

Full Changelog: https://github.com/noteable-io/dx/compare/v1.0.4...v1.1.0

- Python
Published by shouples almost 4 years ago

dx - v1.0.4

What's Changed

  • update readme; add screenshots by @shouples in https://github.com/noteable-io/dx/pull/7
  • add testing by @shouples in https://github.com/noteable-io/dx/pull/4
  • lower minimum ipython version from 8.2.0 to 7.31.1 by @shouples in https://github.com/noteable-io/dx/pull/9

Full Changelog: https://github.com/noteable-io/dx/compare/v1.0.3...v1.0.4

- Python
Published by shouples about 4 years ago

dx - v1.0.3

First release! The notes below cover changes from v1.0.0 to v1.0.3, but future release notes will be version-specific.

Fixed

  • dx.register() (dx.enable(), deprecated) and dx.deregister() (dx.disable(), deprecated) will now update the default display formatting for pandas DataFrame objects as intended
  • Updated minimum python version to 3.8 (down from 3.9.6 in 1.0.0)

Added

  • Custom IPython formatter for Noteable environments
  • Additional data type support for display() / dx():
    • any tabular structure (lists of dicts, dict of {column: [values]}, etc) that can be loaded into a pandas DataFrame
    • .csv and .json file paths

Full Changelog: https://github.com/noteable-io/dx/commits/v1.0.3 PyPI: https://pypi.org/project/dx/1.0.3/

- Python
Published by shouples about 4 years ago