Recent Releases of lightning-ir

lightning-ir - v0.0.5

What's Changed

  • Update action to manually deploy docs by @fschlatt in https://github.com/webis-de/lightning-ir/pull/28
  • Remove work in progress sbert integration by @fschlatt in https://github.com/webis-de/lightning-ir/pull/30
  • Fix documentation for custom datasets by @fschlatt in https://github.com/webis-de/lightning-ir/pull/31
  • Update docs class template by @fschlatt in https://github.com/webis-de/lightning-ir/pull/32
  • Minor documentation improvements by @fschlatt in https://github.com/webis-de/lightning-ir/pull/35
  • add scores for NanoBEIR dataset by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/33
  • Add prepare data method to download data in single process and prevent data corruption by @fschlatt in https://github.com/webis-de/lightning-ir/pull/36
  • Fix preparing data by sampling the first element from each ir dataset by @fschlatt in https://github.com/webis-de/lightning-ir/pull/37
  • Fix col model document expansion by @fschlatt in https://github.com/webis-de/lightning-ir/pull/38
  • Batch similarity functions for dense and sparse retriever to avoid OOM for large indexes by @fschlatt in https://github.com/webis-de/lightning-ir/pull/39
  • Version bump in CITATION.cff by @fschlatt in https://github.com/webis-de/lightning-ir/pull/40
  • Fix preparing docs store for to avoid corrupted data by @fschlatt in https://github.com/webis-de/lightning-ir/pull/41
  • Correctly use batching for sparse and dense PyTorch indexer to avoid memory issues by @fschlatt in https://github.com/webis-de/lightning-ir/pull/42
  • Speed up batching by using empty instead of zeros by @fschlatt in https://github.com/webis-de/lightning-ir/pull/43
  • Restructure model-zoo tables and improve documentation clarity by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/44
  • Add callbacks for indexing and searching in model-zoo by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/45
  • Improve printing results for searching and re-ranking by @fschlatt in https://github.com/webis-de/lightning-ir/pull/46
  • Increase precision for sparse and dense searcher by @fschlatt in https://github.com/webis-de/lightning-ir/pull/47
  • Do not print results for validation in training by @fschlatt in https://github.com/webis-de/lightning-ir/pull/48
  • Free memory in searching + Fix skip dataset logging by @fschlatt in https://github.com/webis-de/lightning-ir/pull/49
  • Add index and save directory configurations for callbacks by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/50
  • Fix logging for validation by @fschlatt in https://github.com/webis-de/lightning-ir/pull/51
  • Fix getting dataset for single dataloader by @fschlatt in https://github.com/webis-de/lightning-ir/pull/52
  • Fix class references in quickstart guide for models and configurations by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/53
  • Fix class references in documentation by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/54
  • Fix emptying cache when loading new index by @fschlatt in https://github.com/webis-de/lightning-ir/pull/55
  • Minor dataset improvements by @fschlatt in https://github.com/webis-de/lightning-ir/pull/56
  • Add convenience function to parse sparse CSR tensor by @fschlatt in https://github.com/webis-de/lightning-ir/pull/57
  • Add the option to specify an index name by @fschlatt in https://github.com/webis-de/lightning-ir/pull/58
  • Minor indexing and retrieval improvements by @fschlatt in https://github.com/webis-de/lightning-ir/pull/59
  • Add ModernColBERT support and update tokenizer warnings by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/60
  • Fix CI + Minor pretty printing fix by @fschlatt in https://github.com/webis-de/lightning-ir/pull/61
  • Fix CI by @fschlatt in https://github.com/webis-de/lightning-ir/pull/62
  • Add option to pass model kwargs when loading model using module by @fschlatt in https://github.com/webis-de/lightning-ir/pull/63
  • Fix pretty printing for skipped inference datasets by @fschlatt in https://github.com/webis-de/lightning-ir/pull/64
  • Improve passing model kwargs and fix quotes in saving run files by @fschlatt in https://github.com/webis-de/lightning-ir/pull/65
  • Add monoelectra rank-distillm data by @fschlatt in https://github.com/webis-de/lightning-ir/pull/66
  • Remove flash + Make model registration public by @fschlatt in https://github.com/webis-de/lightning-ir/pull/67
  • Update seismic test index by @fschlatt in https://github.com/webis-de/lightning-ir/pull/68
  • Entirely remove indexes from test data by @fschlatt in https://github.com/webis-de/lightning-ir/pull/69
  • Return none for dataset len if no length can be inferred by @fschlatt in https://github.com/webis-de/lightning-ir/pull/71
  • Fix doc dataset length and update docstrings by @fschlatt in https://github.com/webis-de/lightning-ir/pull/72
  • Support different tokenizers for adding marker tokens by @fschlatt in https://github.com/webis-de/lightning-ir/pull/73
  • Force query and doc ids to str by @fschlatt in https://github.com/webis-de/lightning-ir/pull/74
  • Make cross-encoder abstract by @fschlatt in https://github.com/webis-de/lightning-ir/pull/76
  • Fix tests by @fschlatt in https://github.com/webis-de/lightning-ir/pull/77
  • Fix flake8 issues in documentation strings by @fschlatt in https://github.com/webis-de/lightning-ir/pull/78
  • Remove colbert-ai from test dependencies by @fschlatt in https://github.com/webis-de/lightning-ir/pull/79
  • Make sure datasets>=3.0.0 by @fschlatt in https://github.com/webis-de/lightning-ir/pull/80
  • Refactor documentation to Google-style format by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/81
  • Improve readability and documentation of loss functions by @fschlatt in https://github.com/webis-de/lightning-ir/pull/83
  • Refactor documentation by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/82
  • Fix mono models for transformers version bump by @fschlatt in https://github.com/webis-de/lightning-ir/pull/84
  • Add Coil to Lightning IR by @samiki-hub in https://github.com/webis-de/lightning-ir/pull/16
  • Fix coil without gpu by @fschlatt in https://github.com/webis-de/lightning-ir/pull/89
  • Update COIL embedding docstrings by @fschlatt in https://github.com/webis-de/lightning-ir/pull/90
  • Add docstrings for retrieve modules by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/88
  • Add MVR to lightning-IR by @lisalehna in https://github.com/webis-de/lightning-ir/pull/75
  • Improve documentation by @fschlatt in https://github.com/webis-de/lightning-ir/pull/92
  • Version bump by @fschlatt in https://github.com/webis-de/lightning-ir/pull/93

New Contributors

  • @samiki-hub made their first contribution in https://github.com/webis-de/lightning-ir/pull/16
  • @lisalehna made their first contribution in https://github.com/webis-de/lightning-ir/pull/75

Full Changelog: https://github.com/webis-de/lightning-ir/compare/v0.0.4...v0.0.5

- Python
Published by fschlatt 10 months ago

lightning-ir - v0.0.4

What's Changed

  • Fix Testing with New Dataset Loading by @fschlatt in https://github.com/webis-de/lightning-ir/pull/20
  • Fix MLM Decoder Weigth Tieing When Tieing Query-Document Projection by @fschlatt in https://github.com/webis-de/lightning-ir/pull/21
  • Improve auto factory for models with multiple architectures by @fschlatt in https://github.com/webis-de/lightning-ir/pull/22
  • Make BiEncoderModel an abstract base class and require abstract encode method + Split bi-encoder into single-vector and multi-vector by @RaykKretzschmar in https://github.com/webis-de/lightning-ir/pull/23
  • Update Seismic Indexer and Searcher by @fschlatt in https://github.com/webis-de/lightning-ir/pull/24
  • Minor documentation improvements by @fschlatt in https://github.com/webis-de/lightning-ir/pull/25
  • Minor linting fixes and bug fixes by @fschlatt in https://github.com/webis-de/lightning-ir/pull/26
  • Minor action fixes and version bump by @fschlatt in https://github.com/webis-de/lightning-ir/pull/27

New Contributors

  • @fschlatt made their first contribution in https://github.com/webis-de/lightning-ir/pull/20
  • @RaykKretzschmar made their first contribution in https://github.com/webis-de/lightning-ir/pull/23

Full Changelog: https://github.com/webis-de/lightning-ir/compare/v0.0.3...v0.0.4

- Python
Published by fschlatt about 1 year ago

lightning-ir - 0.0.3

What's Changed

  • docs: update README.md by @eltociear in https://github.com/webis-de/lightning-ir/pull/3
  • Configure Dependabot updates by @janheinrichmerker in https://github.com/webis-de/lightning-ir/pull/8
  • Bump actions/setup-python from 4 to 5 by @dependabot in https://github.com/webis-de/lightning-ir/pull/10
  • Update pytest-cov requirement from ==5.*,>=5.0 to >=5,<7 by @dependabot in https://github.com/webis-de/lightning-ir/pull/9

New Contributors

  • @eltociear made their first contribution in https://github.com/webis-de/lightning-ir/pull/3
  • @janheinrichmerker made their first contribution in https://github.com/webis-de/lightning-ir/pull/8
  • @dependabot made their first contribution in https://github.com/webis-de/lightning-ir/pull/10

Full Changelog: https://github.com/webis-de/lightning-ir/compare/v0.0.2...v0.0.3

- Python
Published by fschlatt about 1 year ago

lightning-ir - 0.0.2

Minor updates and tweaks

- Python
Published by fschlatt over 1 year ago

lightning-ir - Initial Release

Initial Lightning IR release

- Python
Published by fschlatt over 1 year ago