Recent Releases of paper-qa

paper-qa - v5.29.0

What's Changed

  • Preventing Greek name from crashing by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1048
  • Better invalid name logs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1049
  • Fix paperqa/configs link in README.md by @chrisranderson in https://github.com/Future-House/paper-qa/pull/1051
  • Fixing all broken links, pymarkdown by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1052
  • chore(deps): lock file maintenance by @renovate[bot] in https://github.com/Future-House/paper-qa/pull/1053
  • chore(deps): chore(deps): update actions/checkout action to v5 @renovate[bot] in https://github.com/Future-House/paper-qa/pull/1058
  • chore(deps): chore(deps): update actions/download-artifact action to v5 by @renovate[bot] in https://github.com/Future-House/paper-qa/pull/1059
  • Moved mypy to use local hook to unsilence it on missing dependencies by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1055
  • Removed dead patch from test_add_clinical_trials_to_docs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1056
  • Restored UnpaywallProvider by updating expected response by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1057
  • Refreshed test_crossref_journalquality_fields_filtering cassette by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1060
  • Updating journal_quality.csv from script by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1061
  • Better lookup failure message in Settings.from_name by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1064
  • Lower bibtex logging to debug by @mskarlin in https://github.com/Future-House/paper-qa/pull/1067
  • Fixed SearchIndex default index_directory being a default_factory by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1070
  • skip bibtex call to crossref by @mskarlin in https://github.com/Future-House/paper-qa/pull/1072
  • Adding EmptyDocsError failover to gen_answer by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1073
  • Removed a duplicate computation of body's filehash by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1074

Note @jamesbraza did a clean rebase of a few commits to beyond this release, so this CHANGELOG entry was manually constructed.

New Contributors

  • @chrisranderson made their first contribution in https://github.com/Future-House/paper-qa/pull/1051

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.28.0...v5.29.0

- Python
Published by jamesbraza 9 months ago

paper-qa - v5.28.0

What's Changed

  • Added PyPDF package to mypy_path by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1036
  • Removed trailing whitespace from summary_json_system_prompt by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1037
  • Allow users to skip citation stripping from evidence by @mskarlin in https://github.com/Future-House/paper-qa/pull/1035
  • Re-raising original exception in clinical_trials tools by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1038
  • Fixed test_agent_types after Gemini 1.5 deprecation by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1043
  • Renamed a few more answer to session by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1042
  • Move context str generation into configurable function by @mskarlin in https://github.com/Future-House/paper-qa/pull/1039
  • chore(deps): lock file maintenance by @renovate[bot] in https://github.com/Future-House/paper-qa/pull/1045

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.27.0...v5.28.0

- Python
Published by jamesbraza 10 months ago

paper-qa - v5.27.0

What's Changed

  • Expose answer evidence score cutoff as config by @mskarlin in https://github.com/Future-House/paper-qa/pull/1031
  • Support grouping contexts by question in the final context by @mskarlin in https://github.com/Future-House/paper-qa/pull/1032
  • Journal quality fixes by @mskarlin in https://github.com/Future-House/paper-qa/pull/1034
  • Avoiding citation prompt hallucinating doi.org URLs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1033

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.26.0...v5.27.0

- Python
Published by mskarlin 10 months ago

paper-qa - v5.26.0

What's Changed

  • Fixed aiohttp.ClientOSError crashing us by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1016
  • S2 also retrying 403's by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1017
  • Fixed _s2_get_with_retrying multiple values issue by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1018
  • chore(deps): lock file maintenance by @renovate[bot] in https://github.com/Future-House/paper-qa/pull/1020
  • Removed JSONType for Pydantic's equivalent JsonValue by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1022
  • Removed extra test test_can_read_normal_pdf_reader by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1019
  • uv workspace layout, broke out PyMuPDF by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1021
  • Created PyPDF reader package by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1023
  • Fixed Docs.aadd giving bad docname after upgrade by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1025
  • Removed dead code repopulate_doc_id_from_doi from DocDetails by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1024
  • Made DeprecationWarning on moved Settings more precise by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1027
  • Open sourced test of encode_id by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1030

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.25.0...v5.26.0

- Python
Published by jamesbraza 10 months ago

paper-qa - v5.25.0

What's Changed

  • Sorting Doc.fields_to_overwrite_from_metadata serialization by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1010
  • Ensuring manifest deserialization works for non-primitive fields by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1011
  • Removing leading/trailing newlines from Context creation prompt by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1013
  • Adding variable timeouts for clients by @mskarlin in https://github.com/Future-House/paper-qa/pull/1015

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.24.0...v5.25.0

- Python
Published by mskarlin 11 months ago

paper-qa - v5.24.0

What's Changed

  • Exposing environment on-reset hook for Docs preparation by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1003
  • Removed reset_log_levels fixture by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1004
  • Lowering OpenAI base client log verbosity during CI by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1007
  • Added convenience method DocDetails.make_filename by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1006
  • Fixed Context not always requiring a call-arg type ignore by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1009
  • Fixed DocDetails.pages having leading/trailing whitespace by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1008

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.23.0...v5.24.0

- Python
Published by jamesbraza 11 months ago

paper-qa - v5.23.0

What's Changed

  • Rolling out markdownlint-cli to lint Markdown by @jamesbraza in https://github.com/Future-House/paper-qa/pull/979
  • Modernized CI by @jamesbraza in https://github.com/Future-House/paper-qa/pull/982
  • Allow extras to be kept in user output by @mskarlin in https://github.com/Future-House/paper-qa/pull/983
  • Assertions that chunked Text.name have correct page ranges by @jamesbraza in https://github.com/Future-House/paper-qa/pull/985
  • Refactor to expose PDF parsing settings by @jamesbraza in https://github.com/Future-House/paper-qa/pull/984
  • Removed dead Docs.index_path and generalized aadd types by @jamesbraza in https://github.com/Future-House/paper-qa/pull/987
  • Fixing missing bibtex_source, and created BibTeXSource enum by @jamesbraza in https://github.com/Future-House/paper-qa/pull/989
  • Implemented Text.__eq__ by @jamesbraza in https://github.com/Future-House/paper-qa/pull/988
  • Change contexts to use ids rather than text by @mskarlin in https://github.com/Future-House/paper-qa/pull/990
  • Fixing crash on possessive query by @jamesbraza in https://github.com/Future-House/paper-qa/pull/992
  • Moved debug config to use Claude 3 Haiku by @jamesbraza in https://github.com/Future-House/paper-qa/pull/991
  • Centralized codespell config and refreshed tooling/lock file versions by @jamesbraza in https://github.com/Future-House/paper-qa/pull/996
  • Documenting why we drop embeddings by @jamesbraza in https://github.com/Future-House/paper-qa/pull/995
  • Began deprecation cycle of exclude_text_filter by @jamesbraza in https://github.com/Future-House/paper-qa/pull/994
  • Supporting bytes in stored documents by @jamesbraza in https://github.com/Future-House/paper-qa/pull/997
  • Specifying default= in AnswerSettings.answer_length by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1000
  • Denying empty text going to citation_prompt by @jamesbraza in https://github.com/Future-House/paper-qa/pull/998
  • Supporting more kwargs in ParsingSettings.parse_pdf by @jamesbraza in https://github.com/Future-House/paper-qa/pull/999
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/1001
  • Removed extraneous mention of 'relevance scores' from QA prompt template by @jamesbraza in https://github.com/Future-House/paper-qa/pull/1002

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.22.0...v5.23.0

- Python
Published by whitead 11 months ago

paper-qa - v5.22.0

What's Changed

  • Exposing IndexSettings.files_filter for programmatic use by @jamesbraza in https://github.com/Future-House/paper-qa/pull/960
  • Fixing flaky test_ensure_robust_to_timeouts by lowering timeout by 10X by @jamesbraza in https://github.com/Future-House/paper-qa/pull/963
  • Fixing code chunking working with binary files by @jamesbraza in https://github.com/Future-House/paper-qa/pull/961
  • Restoring typeguard functionality by @jamesbraza in https://github.com/Future-House/paper-qa/pull/962
  • Removing dead print_callback and empty_callback by @jamesbraza in https://github.com/Future-House/paper-qa/pull/964
  • Fixed chunk_code_text's UnboundLocalError crash on empty code file by @jamesbraza in https://github.com/Future-House/paper-qa/pull/965
  • Added missing PyPI classifiers by @jamesbraza in https://github.com/Future-House/paper-qa/pull/967
  • chore(deps): update astral-sh/setup-uv action to v6 by @renovate in https://github.com/Future-House/paper-qa/pull/968
  • chore(deps): update all non-major dependencies by @renovate in https://github.com/Future-House/paper-qa/pull/969
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/970
  • add client response errors to our catching stack by @mskarlin in https://github.com/Future-House/paper-qa/pull/972
  • Making use of new Environment.get_id by @jamesbraza in https://github.com/Future-House/paper-qa/pull/973
  • Fix pdf parsing bug by @markenki in https://github.com/Future-House/paper-qa/pull/938
  • Fixed README typo from answer.k to answer.evidence_k by @jamesbraza in https://github.com/Future-House/paper-qa/pull/974
  • Fixed flaky test test_chain_completion via resolving Cannot add callback by @jamesbraza in https://github.com/Future-House/paper-qa/pull/975
  • Allow for non-mutated user specified doc-ids by @mskarlin in https://github.com/Future-House/paper-qa/pull/977
  • Remove threaded pdf parsing by @mskarlin in https://github.com/Future-House/paper-qa/pull/978
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/980

New Contributors

  • @markenki made their first contribution in https://github.com/Future-House/paper-qa/pull/938

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.21.0...v5.22.0

- Python
Published by whitead 11 months ago

paper-qa - v5.21.0

What's Changed

  • Pulling in Pydantic 2.11, latest tooling, doctests by @jamesbraza in https://github.com/Future-House/paper-qa/pull/920
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/914
  • Removed LFRQA prompts by @jamesbraza in https://github.com/Future-House/paper-qa/pull/923
  • Integrating typos tool by @jamesbraza in https://github.com/Future-House/paper-qa/pull/922
  • Resolved a few deprecation warnings by @jamesbraza in https://github.com/Future-House/paper-qa/pull/926
  • Fixed README typo on basename by @jamesbraza in https://github.com/Future-House/paper-qa/pull/927
  • Began deprecation of non-async methods in Docs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/925
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/930
  • Gave instructions to correct citation on answer by @maykcaldas in https://github.com/Future-House/paper-qa/pull/929
  • Pulled in latest fhaviary for tool schemae changes by @jamesbraza in https://github.com/Future-House/paper-qa/pull/933
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/934
  • Updated repo badges by @maykcaldas in https://github.com/Future-House/paper-qa/pull/935
  • Removed Gemini special case in Settings.adjust_tools_for_agent_llm by @jamesbraza in https://github.com/Future-House/paper-qa/pull/936
  • Expanded test_chain_completion to check IDs and text by @jamesbraza in https://github.com/Future-House/paper-qa/pull/944
  • Pulled in latest litellm and fhlmi by @jamesbraza in https://github.com/Future-House/paper-qa/pull/945
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/943
  • Moved Renovate config validation to CI by @jamesbraza in https://github.com/Future-House/paper-qa/pull/931
  • Supporting Python 3.13 by @jamesbraza in https://github.com/Future-House/paper-qa/pull/946
  • Add ipykernel as dev dependency by @tobiasdiez in https://github.com/Future-House/paper-qa/pull/947
  • Usable "getting started" docs in README, both interpreter and Jupyter by @jamesbraza in https://github.com/Future-House/paper-qa/pull/953
  • Add error handling for index file loading in SearchIndex by @tobiasdiez in https://github.com/Future-House/paper-qa/pull/948

New Contributors

  • @tobiasdiez made their first contribution in https://github.com/Future-House/paper-qa/pull/947

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.20.0...v5.21.0

- Python
Published by whitead about 1 year ago

paper-qa - v5.20.0

What's Changed

  • Pulled in latest tantivy for Document.from_dict typing fix by @jamesbraza in https://github.com/Future-House/paper-qa/pull/916
  • Catch retry errors, i.e. when a metadata service fails by @mskarlin in https://github.com/Future-House/paper-qa/pull/918

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.19.0...v5.20.0

- Python
Published by mskarlin about 1 year ago

paper-qa - v5.19.0

What's Changed

  • Only show the top contexts to the agent for the specific question by @mskarlin in https://github.com/Future-House/paper-qa/pull/912

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.18.0...v5.19.0

- Python
Published by mskarlin about 1 year ago

paper-qa - v5.18.0

What's Changed

  • Added tutorial showing how to configure paperqa Settings by @maykcaldas in https://github.com/Future-House/paper-qa/pull/893
  • Add reasoning from LLMResult to PQASession by @maykcaldas in https://github.com/Future-House/paper-qa/pull/896
  • Added embeddings to claude and gemine examples in the readme by @maykcaldas in https://github.com/Future-House/paper-qa/pull/895
  • Deferred PQA_HOME evaluation until Settings construction by @jamesbraza in https://github.com/Future-House/paper-qa/pull/894
  • Updated tooling versions and configs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/898
  • Added discussion to tutorial showing a dry setup for anthropic by @maykcaldas in https://github.com/Future-House/paper-qa/pull/901
  • Lfrqa tutorial adjustments by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/897
  • Mentioned dev extra in CONTRIBUTING.md by @jamesbraza in https://github.com/Future-House/paper-qa/pull/903
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/905
  • Implemented PaperQAEnvironment.from_task by @jamesbraza in https://github.com/Future-House/paper-qa/pull/907
  • Support for answer iterations in the gen_answer flow by @mskarlin in https://github.com/Future-House/paper-qa/pull/911

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.17.0...v5.18.0

- Python
Published by mskarlin about 1 year ago

paper-qa - v5.17.0

New parsing support for claude3.7 model's summary JSONs.

What's Changed

  • Support to parse nested quotes in JSONs during the summary step by @mskarlin in https://github.com/Future-House/paper-qa/pull/892

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.16.1...v5.17.0

- Python
Published by mskarlin over 1 year ago

paper-qa - v5.16.1

Minor release with bugfixes

What's Changed

  • Little fix in import at LFRQA tutorial by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/887
  • Fixed problematic date parsing by @whitead in https://github.com/Future-House/paper-qa/pull/888

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.16.0...v5.16.1

- Python
Published by whitead over 1 year ago

paper-qa - v5.16.0

What's Changed

  • Add openreview helper to fetch papers from conferences by @eamag in https://github.com/Future-House/paper-qa/pull/879
  • Update clinical trials setting to use proper tool name by @mskarlin in https://github.com/Future-House/paper-qa/pull/886

New Contributors

  • @eamag made their first contribution in https://github.com/Future-House/paper-qa/pull/879

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.15.0...v5.16.0

- Python
Published by mskarlin over 1 year ago

paper-qa - v5.15.0

What's Changed

  • Using API key and VCR constants defined in lmi by @jamesbraza in https://github.com/Future-House/paper-qa/pull/880
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/882
  • Supporting .md in indexing by @jamesbraza in https://github.com/Future-House/paper-qa/pull/881
  • Many minor updates to README by @jamesbraza in https://github.com/Future-House/paper-qa/pull/883

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.14.0...v5.15.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.14.0

What's Changed

  • Propagates llmclient changes to pqa by @maykcaldas in https://github.com/Future-House/paper-qa/pull/839

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.13.0...v5.14.0

- Python
Published by maykcaldas over 1 year ago

paper-qa - v5.13.0

What's Changed

  • Specific rag-qa-arena changes by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/853
  • Pin fh-llm-client by @maykcaldas in https://github.com/Future-House/paper-qa/pull/864
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/865
  • Corrected paper title in tutorial by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/867
  • Changes to llmparsejson() to handle issues when LLM does not respond as per instructions by @foreverallama in https://github.com/Future-House/paper-qa/pull/843
  • Correctly escape backlashes by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/870
  • Migrated LitQA and LFRQA to aviary by @maykcaldas in https://github.com/Future-House/paper-qa/pull/872
  • Fix aviary typing by @maykcaldas in https://github.com/Future-House/paper-qa/pull/874
  • Add support and instructions for gemini by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/871
  • chore(deps): update all non-major dependencies by @renovate in https://github.com/Future-House/paper-qa/pull/876
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/877
  • Fixed flaky test_answer_rename via flaky decoration by @jamesbraza in https://github.com/Future-House/paper-qa/pull/875
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/878

New Contributors

  • @foreverallama made their first contribution in https://github.com/Future-House/paper-qa/pull/843

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.12.0...v5.13.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.12.0

What's Changed

  • Allow agent_query to Use an Existing Search Index Without Rebuilding by @psl-schaefer in https://github.com/Future-House/paper-qa/pull/847
  • Support parallel indexing by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/849
  • Added the getmanifestkwargs function to get more than doi and title… by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/848
  • Parallel handle lockbusy by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/855
  • Move doc details line by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/856
  • added escape_backlashes function with test by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/858

New Contributors

  • @psl-schaefer made their first contribution in https://github.com/Future-House/paper-qa/pull/847

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.11.1...v5.12.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.11.1

What's Changed

  • Pulled in latest fh-llm-client to resolve TODO on callbacks cast by @jamesbraza in https://github.com/Future-House/paper-qa/pull/827
  • Automate fetching the current year by @harryvu-futurehouse in https://github.com/Future-House/paper-qa/pull/828
  • Fixed typo in pip install instructions by @maykcaldas in https://github.com/Future-House/paper-qa/pull/834
  • Fixing flaky test test_resuming_crashed_index_build by retrying by @jamesbraza in https://github.com/Future-House/paper-qa/pull/837
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/840
  • Fixed pagination issue in search.py and added corresponding test by @JoaquinPolonuer in https://github.com/Future-House/paper-qa/pull/846
  • Fixed mutable default issue in is_hydration_needed by @jamesbraza in https://github.com/Future-House/paper-qa/pull/836
  • Latest tooling and deps by @jamesbraza in https://github.com/Future-House/paper-qa/pull/842

New Contributors

  • @JoaquinPolonuer made their first contribution in https://github.com/Future-House/paper-qa/pull/846

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.11.0...v5.11.1

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.11.0

What's Changed

  • Fixed type problems from llmclient by @maykcaldas in https://github.com/Future-House/paper-qa/pull/770
  • Clinical trials docs and bugfixes by @mskarlin in https://github.com/Future-House/paper-qa/pull/819
  • Fixing flaky test test_cli_can_build_and_search_index by retrying by @jamesbraza in https://github.com/Future-House/paper-qa/pull/816
  • Allowing more general types in Settings by @jamesbraza in https://github.com/Future-House/paper-qa/pull/818
  • Documenting citation style by @jamesbraza in https://github.com/Future-House/paper-qa/pull/817
  • Updated badges in README by @maykcaldas in https://github.com/Future-House/paper-qa/pull/821
  • Pulling in latest ldp for bulk_evaluate_consensus by @jamesbraza in https://github.com/Future-House/paper-qa/pull/826
  • Updated CITATION.cff to include more info by @jamesbraza in https://github.com/Future-House/paper-qa/pull/824
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/825

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.10.2...v5.11.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.10.2

What's Changed

  • Ensure fields are lists before combining in DocDetails class by @harryvu-futurehouse in https://github.com/Future-House/paper-qa/pull/801
  • Pulling in latest fh-llm-client for CommonLLMNames by @jamesbraza in https://github.com/Future-House/paper-qa/pull/810
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/811
  • Fixing gather_evidence and complete response messages by @jamesbraza in https://github.com/Future-House/paper-qa/pull/812

New Contributors

  • @harryvu-futurehouse made their first contribution in https://github.com/Future-House/paper-qa/pull/801

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.10.1...v5.10.2

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.10.1

What's Changed

  • Fixing tool failures crashing runners in failover answer by @jamesbraza in https://github.com/Future-House/paper-qa/pull/808
  • Fixing evidence counted in gather_evidence's response message by @jamesbraza in https://github.com/Future-House/paper-qa/pull/809

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.10.0...v5.10.1

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.10.0

What's Changed

  • Expose more contexts as output from gather_evidence tool by @mskarlin in https://github.com/Future-House/paper-qa/pull/793
  • Settings lookup table and improved Settings descriptions by @jamesbraza in https://github.com/Future-House/paper-qa/pull/795
  • Fixing incorrect seeding argument due to Pydantic extra="ignore" by @jamesbraza in https://github.com/Future-House/paper-qa/pull/797
  • Loosened input types to allow more MultipleChoiceQuestion by @jamesbraza in https://github.com/Future-House/paper-qa/pull/798
  • Added aviary-paper-data as LitQA v2 test split by @jamesbraza in https://github.com/Future-House/paper-qa/pull/800
  • Added LitQAv2TaskSplit.get_index convenience by @jamesbraza in https://github.com/Future-House/paper-qa/pull/802
  • Refactor to remove QueryRequest entity by @jamesbraza in https://github.com/Future-House/paper-qa/pull/799
  • Latest tooling by @jamesbraza in https://github.com/Future-House/paper-qa/pull/804
  • chore(deps): update astral-sh/setup-uv action to v5 by @renovate in https://github.com/Future-House/paper-qa/pull/806
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/807

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.9.2...v5.10.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.9.2

Note to self: run unit tests (and not just mypy) in downstream repos before cutting the release.

What's Changed

  • Fixing not using set_llm_session_ids from fh-llm-client by @jamesbraza in https://github.com/Future-House/paper-qa/pull/792

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.9.1...v5.9.2

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.9.1

What's Changed

  • Pinning min version of fh-llm-client by @jamesbraza in https://github.com/Future-House/paper-qa/pull/790
  • Fixed Record import from Qdrant not being in TYPE_CHECKING block by @jamesbraza in https://github.com/Future-House/paper-qa/pull/791

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.9.0...v5.9.1

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.9.0

What's Changed

  • feat: Qdrant support by @Anush008 in https://github.com/Future-House/paper-qa/pull/730
  • Made it possible to get answers from litqa evaluations by @whitead in https://github.com/Future-House/paper-qa/pull/760
  • Added answer an ideal to gradeable environments by @whitead in https://github.com/Future-House/paper-qa/pull/762
  • Pinned lower bound on aiohttp for aiohttp.ClientConnectionResetError by @jamesbraza in https://github.com/Future-House/paper-qa/pull/763
  • Added llmclient dependency by @maykcaldas in https://github.com/Future-House/paper-qa/pull/757
  • Propagating citation count in flaky test_pdf_reader_match_doc_details by @jamesbraza in https://github.com/Future-House/paper-qa/pull/766
  • Renovate lockFileMaintenance respecting schedule, 2-week stability period, no openai pinning by @jamesbraza in https://github.com/Future-House/paper-qa/pull/767
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/765
  • Added test split's source DOIs and question IDs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/771
  • Consolidated LDP imports into ldp_shims module by @jamesbraza in https://github.com/Future-House/paper-qa/pull/772
  • Missing None failovers in LDP shims by @jamesbraza in https://github.com/Future-House/paper-qa/pull/774
  • Dropping refurb in favor of its ruff port by @jamesbraza in https://github.com/Future-House/paper-qa/pull/773
  • Converting add_texts_and_embeddings to async by @ThomasRochefortB in https://github.com/Future-House/paper-qa/pull/778
  • Add clinical trials search tool by @mskarlin in https://github.com/Future-House/paper-qa/pull/777
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/769
  • Replace raise_for_status return None with Mock() in clinical trials test by @mskarlin in https://github.com/Future-House/paper-qa/pull/785
  • Docs around embeddings and agentic usage by @jamesbraza in https://github.com/Future-House/paper-qa/pull/780
  • Moved to MultipleChoiceQuestion/MultipleChoiceEvaluation from aviary by @jamesbraza in https://github.com/Future-House/paper-qa/pull/768
  • Feat/qdrant docs reconstruct by @ThomasRochefortB in https://github.com/Future-House/paper-qa/pull/776
  • Removed dead test cassettes by @jamesbraza in https://github.com/Future-House/paper-qa/pull/788

New Contributors

  • @Anush008 made their first contribution in https://github.com/Future-House/paper-qa/pull/730
  • @ThomasRochefortB made their first contribution in https://github.com/Future-House/paper-qa/pull/778

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.8.0...v5.9.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.6.1

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.6.0...v5.6.1

- Python
Published by sidnarayanan over 1 year ago

paper-qa - v5.8.0

What's Changed

  • Update all non-major dependencies by @renovate in https://github.com/Future-House/paper-qa/pull/745
  • Created dev extra for convenience by @jamesbraza in https://github.com/Future-House/paper-qa/pull/750
  • Update all non-major dependencies by @renovate in https://github.com/Future-House/paper-qa/pull/754
  • Populated LICENSE by @jamesbraza in https://github.com/Future-House/paper-qa/pull/756
  • Add partitioning func capabilities to allow doc-types-based embedding ranking by @mskarlin in https://github.com/Future-House/paper-qa/pull/752
  • Exposed seeding of LitQA2 read and shuffling by @jamesbraza in https://github.com/Future-House/paper-qa/pull/758

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.7.0...v5.8.0

- Python
Published by mskarlin over 1 year ago

paper-qa - v5.7.0

What's Changed

  • Moved README to use session over answer by @jamesbraza in https://github.com/Future-House/paper-qa/pull/741
  • Moved Docs.aadd to support str | os.PathLike by @jamesbraza in https://github.com/Future-House/paper-qa/pull/742
  • Cleared up 'Adding Documents Manually' docs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/740
  • Support env states with custom status functions by @mskarlin in https://github.com/Future-House/paper-qa/pull/743
  • Update astral-sh/setup-uv action to v4 by @renovate in https://github.com/Future-House/paper-qa/pull/746
  • Moved JSON summary prompt to mention score is an integer by @jamesbraza in https://github.com/Future-House/paper-qa/pull/748

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.6.0...v5.7.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.5.1

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.5.0...v5.5.1

- Python
Published by sidnarayanan over 1 year ago

paper-qa - v5.6.0

Highlights

This release is mainly a bunch of bug fixes:

  • Pulling in breaks in upstream dependencies (e.g. Pydantic 2.10, aviary 0.10.1)
  • Makes GradablePaperQAEnvironment's evaluations robust to an empty answer or multiple answers

Due to the introduction of Complete.NO_ANSWER_PHRASE in https://github.com/Future-House/paper-qa/pull/726 it was requested we consider this a minor version bump, as it will impact system performance.

What's Changed

  • Fixed settings session into EnvironmentState, and suppressing PyMuPDF derived DeprecationWarning by @jamesbraza in https://github.com/Future-House/paper-qa/pull/713
  • Adding assertion gather_evidence doesn't populate session.answer by @jamesbraza in https://github.com/Future-House/paper-qa/pull/716
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/715
  • Fixes gather_with_concurrency typing by @maykcaldas in https://github.com/Future-House/paper-qa/pull/714
  • Latest tooling dependencies by @jamesbraza in https://github.com/Future-House/paper-qa/pull/719
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/718
  • Fixed EVAL_PROMPT_TEMPLATE to handle empty string or multiple match answers by @jamesbraza in https://github.com/Future-House/paper-qa/pull/724
  • Address missing GenerateAnswer in trajectories, no answers after Complete tools, and better history by @mskarlin in https://github.com/Future-House/paper-qa/pull/726
  • Pulling in latest aviary for concurrency rename by @jamesbraza in https://github.com/Future-House/paper-qa/pull/728
  • Pulling in latest aviary for dependencies fix, and retrying flaky test_propagate_options more by @jamesbraza in https://github.com/Future-House/paper-qa/pull/729
  • Pulling in latest ldp for Callback.before_rollout by @jamesbraza in https://github.com/Future-House/paper-qa/pull/734
  • Documenting why we don't handle evaluation failures in GradablePaperQAEnvironment.step by @jamesbraza in https://github.com/Future-House/paper-qa/pull/738
  • Created LitQAEvaluation.calculate_accuracy_precision utility by @jamesbraza in https://github.com/Future-House/paper-qa/pull/733
  • Refreshed test cassettes, fixed flaky test test_search, and fixed test type ignores by @jamesbraza in https://github.com/Future-House/paper-qa/pull/739
  • Unpins pydantic >2.10.2 requirement, removes TYPE_CHECKING by @nadolskit in https://github.com/Future-House/paper-qa/pull/725
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/737
  • Alternative maybe is text by @loesinghaus in https://github.com/Future-House/paper-qa/pull/717

New Contributors

  • @maykcaldas made their first contribution in https://github.com/Future-House/paper-qa/pull/714
  • @loesinghaus made their first contribution in https://github.com/Future-House/paper-qa/pull/717

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.5.0...v5.6.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.5.0

Highlights

In all of v5 before this release, we defined the presence of 1+ answer generations not containing the substring "cannot answer" as the agent loop's end. However, this (suboptimally) leads to the agent loop terminating early on partial answers like "Based on the sources provided, it appears no one has done x." We realized this, and have resolved this issue by:

  • No longer coupling our done condition with the substring "cannot answer" being not present in 1+ generated answers
  • No longer implicitly depending on clients mentioning this "cannot answer" sentinel in the input qa prompt

We also fixed several (bad) bugs:

  • We support parallel tool calling (2+ ToolCalls in one action: ToolRequestMessage). However, our tools (notably gather_evidence) are not actually concurrent-safe. Our tool schemae instructed not to call certain tools in parallel, nonetheless we observed agents specifying gather_evidence to be called in parallel. So now we force our tools to be non-concurrently executed to work around this race condition
  • When using LitQAEvaluation and the same GradablePaperQAEnvironment 2+ times, we repeatedly added the "unsure" option to the target multiple choice question, degrading performance over time
  • When using PaperQAEnvironment 2+ times, each reset was not properly wiping the Docs object
  • The reward distribution of LitQAEvaluation was mixing up "unsure" reward of 0.1 with the "incorrect" reward of -1.0, not properly incentivizing learning

There are a bunch of other minor features, cleanups, and bugfixes here too, see the full list below.

What's Changed

  • Deprecation cycle for AgentSettings.should_pre_search by @jamesbraza in https://github.com/Future-House/paper-qa/pull/679
  • Moved agent prompts to prompts.py by @jamesbraza in https://github.com/Future-House/paper-qa/pull/681
  • Refactor to remove skip_system from LLMModel.run_prompt by @jamesbraza in https://github.com/Future-House/paper-qa/pull/680
  • Resolving evidence_detailed_citations and Answer deprecations by @jamesbraza in https://github.com/Future-House/paper-qa/pull/682
  • Fixed agent prompt names and contents after #681 mess up by @jamesbraza in https://github.com/Future-House/paper-qa/pull/683
  • Removed tool_names validation for gen_answer being present by @jamesbraza in https://github.com/Future-House/paper-qa/pull/685
  • Fixing test_evaluation logic bugs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/686
  • Removed GenerateAnswer.FAILED_TO_ANSWER as its unnecessary by @jamesbraza in https://github.com/Future-House/paper-qa/pull/691
  • Allowing serialized Settings in get_settings by @jamesbraza in https://github.com/Future-House/paper-qa/pull/688
  • Fixed LDP runner's TRUNCATED not calling gen_answer, and documented AgentStatus by @jamesbraza in https://github.com/Future-House/paper-qa/pull/690
  • Removed gen_answer's dead argument question by @jamesbraza in https://github.com/Future-House/paper-qa/pull/689
  • Making sure we copy distractors by @sidnarayanan in https://github.com/Future-House/paper-qa/pull/694
  • Created complete tool to allow unsure answers by @jamesbraza in https://github.com/Future-House/paper-qa/pull/684
  • Added missing test_from_question cassette by @jamesbraza in https://github.com/Future-House/paper-qa/pull/696
  • Moved fake agent to LLM propose complete tool by @jamesbraza in https://github.com/Future-House/paper-qa/pull/695
  • Default to ordered tool calls, w env variable control by @mskarlin in https://github.com/Future-House/paper-qa/pull/697
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/699
  • Refactored TestGradablePaperQAEnvironment for DRY code by @jamesbraza in https://github.com/Future-House/paper-qa/pull/702
  • Fixing PaperQAEnvironment.reset respecting mmr_lambda and text_hashes by @jamesbraza in https://github.com/Future-House/paper-qa/pull/703
  • Removed "cannot answer" literals and added reset tool by @jamesbraza in https://github.com/Future-House/paper-qa/pull/698
  • Update all non-major dependencies by @renovate in https://github.com/Future-House/paper-qa/pull/705
  • Fixing LitQAEvaluation bugs: incorrect reward indices, not using LLM's native knowledge by @jamesbraza in https://github.com/Future-House/paper-qa/pull/708
  • Adding filters to paper-qa Docs by @whitead in https://github.com/Future-House/paper-qa/pull/707
  • Fixed mutably defaulted NumpyVectorStore.texts by @jamesbraza in https://github.com/Future-House/paper-qa/pull/711

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.4.0...v5.5.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - Hotfix to included `ordered=True` in tool exec calls

Prevents parallel tool calls from clobbering the env. state.

- Python
Published by mskarlin over 1 year ago

paper-qa - v5.3.3

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.3.2...v5.3.3

- Python
Published by sidnarayanan over 1 year ago

paper-qa - v5.4.0

What's Changed

  • Renamed to PQASession type by @whitead in https://github.com/Future-House/paper-qa/pull/653
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/657
  • Ability to zero-shot gen_answer by @jamesbraza in https://github.com/Future-House/paper-qa/pull/658
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/659
  • Moving to uv dependency groups by @jamesbraza in https://github.com/Future-House/paper-qa/pull/660
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/664
  • Convert citation to formatted_citation usage where necessary by @mskarlin in https://github.com/Future-House/paper-qa/pull/666
  • Catch edge case where externalIds field is None by @mskarlin in https://github.com/Future-House/paper-qa/pull/668
  • Made o1 temperature issue a warning, instead of valueerror by @whitead in https://github.com/Future-House/paper-qa/pull/669
  • Added train and eval splits' questions and DOIs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/662
  • fake agent allowing timeouts or exceptions, by @jamesbraza in https://github.com/Future-House/paper-qa/pull/672
  • Optional AnswerSetting.max_answer_attempts to allow a new unsure branch by @jamesbraza in https://github.com/Future-House/paper-qa/pull/673
  • Made it so you do not die on invalid tool by @whitead in https://github.com/Future-House/paper-qa/pull/670
  • Allowing latest pydantic-settings and regenerated cassettes by @jamesbraza in https://github.com/Future-House/paper-qa/pull/674
  • Empty tool calls leading to done condition by @jamesbraza in https://github.com/Future-House/paper-qa/pull/671
  • Changed it to be debug for source quality by @whitead in https://github.com/Future-House/paper-qa/pull/675

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.3.2...v5.4.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.3.2

What's Changed

  • Printing the text in a failed llm_parse_json by @jamesbraza in https://github.com/Future-House/paper-qa/pull/629
  • Change S2 client logic to use arxiv doi if it's defined by @mskarlin in https://github.com/Future-House/paper-qa/pull/632
  • Increased retry count for ClientConnectorDNSError errors by @jamesbraza in https://github.com/Future-House/paper-qa/pull/639
  • Make string similarity case insensitive by default by @mskarlin in https://github.com/Future-House/paper-qa/pull/640
  • Pulling in latest fhaviary, mypy, ruff by @jamesbraza in https://github.com/Future-House/paper-qa/pull/647
  • Add an after model validator ensuring temp=1 for o1 models by @dakoner in https://github.com/Future-House/paper-qa/pull/649
  • Fixing crash due to None author by @jamesbraza in https://github.com/Future-House/paper-qa/pull/650
  • Fixing flaky test test_minimal_fields_filtering by @jamesbraza in https://github.com/Future-House/paper-qa/pull/651
  • Fixing flaky tests test_code and test_minimal_fields_filtering by @jamesbraza in https://github.com/Future-House/paper-qa/pull/652
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/648

New Contributors

  • @dakoner made their first contribution in https://github.com/Future-House/paper-qa/pull/649

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.3.1...v5.3.2

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.3.1

What's Changed

  • Exposed LDPRolloutCallback and on_agent_action_callback for fake agent by @jamesbraza in https://github.com/Future-House/paper-qa/pull/612
  • Fixed NumpyVectorStore.__eq__'s NotImplemented case by @jamesbraza in https://github.com/Future-House/paper-qa/pull/613
  • Implemented __deepcopy__ on all Environments by @jamesbraza in https://github.com/Future-House/paper-qa/pull/614
  • Made embedding default by @whitead in https://github.com/Future-House/paper-qa/pull/615
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/617
  • Pulled in latest PyMuPDF for set_messages by @jamesbraza in https://github.com/Future-House/paper-qa/pull/618
  • Fixed crash due to DOI being a list by @jamesbraza in https://github.com/Future-House/paper-qa/pull/619
  • Added configuration to adjust how contexts are displayed by @whitead in https://github.com/Future-House/paper-qa/pull/620
  • Fixing CI by regenerating test_pdf_reader_match_doc_details cassette by @jamesbraza in https://github.com/Future-House/paper-qa/pull/625
  • Retrying flaky test test_propagate_options by @jamesbraza in https://github.com/Future-House/paper-qa/pull/626
  • Regression protection in embedding_model_factory by @jamesbraza in https://github.com/Future-House/paper-qa/pull/622
  • Added writer.wait_merging_threads call by @jamesbraza in https://github.com/Future-House/paper-qa/pull/628
  • Caching opened tantivy.Indexes in the package by @jamesbraza in https://github.com/Future-House/paper-qa/pull/627

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.3.0...v5.3.1

- Python
Published by whitead over 1 year ago

paper-qa - v5.3.0

What's Changed

  • Add callback support in settings and tools by @nadolskit in https://github.com/Future-House/paper-qa/pull/590
  • Moved validate_sources to include all sources not found by @jamesbraza in https://github.com/Future-House/paper-qa/pull/595
  • Cleaning up citations by @jamesbraza in https://github.com/Future-House/paper-qa/pull/598
  • Validating sources with case insensitive DOI matching by @jamesbraza in https://github.com/Future-House/paper-qa/pull/600
  • Added sentence transformers embedding model by @whitead in https://github.com/Future-House/paper-qa/pull/604
  • Cleaned and clarified deferred embeddings code by @jamesbraza in https://github.com/Future-House/paper-qa/pull/597
  • Fixed NumpyVectorStore.clear from not clearing text_hashes by @jamesbraza in https://github.com/Future-House/paper-qa/pull/608
  • Moved Pydantic model_config to top of each class by @jamesbraza in https://github.com/Future-House/paper-qa/pull/607
  • Testing we can use ~ as paper_directory by @jamesbraza in https://github.com/Future-House/paper-qa/pull/610
  • Increased testing of NumpyVectorStore and defer_embeddings by @jamesbraza in https://github.com/Future-House/paper-qa/pull/606
  • Expose env class to run_agent functions by @mskarlin in https://github.com/Future-House/paper-qa/pull/611

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.2.1...v5.3.0

- Python
Published by whitead over 1 year ago

paper-qa - v5.2.1

What's Changed

  • Fixing Settings propagation and always configuring LiteLLM retrying by @jamesbraza in https://github.com/Future-House/paper-qa/pull/575
  • Fixing the ability to resume index builds by @jamesbraza in https://github.com/Future-House/paper-qa/pull/577
  • Fixed GLOBAL_RATE_LIMITER_TIMEOUT env var typo by @jamesbraza in https://github.com/Future-House/paper-qa/pull/578
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/583
  • Unsilencing manifest read failure when no CSV header is present by @jamesbraza in https://github.com/Future-House/paper-qa/pull/587
  • Added typeguard to confirm type hints by @jamesbraza in https://github.com/Future-House/paper-qa/pull/585
  • Renovate once/month, removing stale LiteLLM disables by @jamesbraza in https://github.com/Future-House/paper-qa/pull/589
  • Fixed a few minor SearchIndex bugs and documented SearchIndex by @jamesbraza in https://github.com/Future-House/paper-qa/pull/588
  • Confirming LitQA sources are in a manifest/index by @jamesbraza in https://github.com/Future-House/paper-qa/pull/579
  • Limiting parsed page size to 1.28 million chars by @jamesbraza in https://github.com/Future-House/paper-qa/pull/592
  • Stripping DOI URL prefix for sources by @jamesbraza in https://github.com/Future-House/paper-qa/pull/593
  • Fix sequential client query clobbering by @mskarlin in https://github.com/Future-House/paper-qa/pull/594

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.2.0...v5.2.1

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.2.0: OpenAlex

Highlights

Added a new metadata provider OpenAlex for scholarly work, researchers, institutions, journals, and research topics.

  • Responses can include open access information and raw pdf locations.
  • Doesn't require authentication, but does prioritize requests with an email in the mailto URL parameter, exposed as an environment variable OPENALEX_MAILTO

Implemented an opt-in bypass around the litellm.Router for LLM completions (see https://github.com/Future-House/paper-qa/pull/563)

What's Changed

  • Fixed pickle-ability of LiteLLMModel by @jamesbraza in https://github.com/Future-House/paper-qa/pull/560
  • Refactoring LiteLLMModel before removing Router by @jamesbraza in https://github.com/Future-House/paper-qa/pull/561
  • Adds openalex client as a default client by @nadolskit in https://github.com/Future-House/paper-qa/pull/555
  • Moving to setup-uv and hynek/build-and-inspect-python-package in CI by @jamesbraza in https://github.com/Future-House/paper-qa/pull/564
  • Ability to bypass usage of litellm.Router by @jamesbraza in https://github.com/Future-House/paper-qa/pull/563
  • Propagating hynek/build-and-inspect-python-package's output location to pypa/gh-action-pypi-publish by @jamesbraza in https://github.com/Future-House/paper-qa/pull/565
  • Downloading Package artifact for pypa/gh-action-pypi-publish by @jamesbraza in https://github.com/Future-House/paper-qa/pull/566

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.1.1...v5.2.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.1.1

What's Changed

  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/545
  • Validating for broken index by @jamesbraza in https://github.com/Future-House/paper-qa/pull/544
  • Added example how to use ollama hosted models by @grg-ffb in https://github.com/Future-House/paper-qa/pull/536
  • Making parsing resistant to failed inference of citations by @whitead in https://github.com/Future-House/paper-qa/pull/551
  • Exposed log verbosity configuration function by @jamesbraza in https://github.com/Future-House/paper-qa/pull/552
  • Cleaned up log verbosity code by @jamesbraza in https://github.com/Future-House/paper-qa/pull/554

New Contributors

  • @grg-ffb made their first contribution in https://github.com/Future-House/paper-qa/pull/536

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.1.0...v5.1.1

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.1.0: rate limits, refactored settings

Highlights

In-housed rate limits management

  • Centers on a moving window algorithm with either a Redis or in-memory state
  • Supports dynamically defined rates for different models or providers.
  • New bundled configurations for different OpenAI rate limit tiers
  • Accomplished using new third party dependencies coredis and limits

Refactored Settings to allow for increased flexibility

  • Indexing
    • Indexes can use relative paths, enabling sharing across machines
    • Paper search now no longer rebuilds the index every invocation
    • Index parameter now are grouped in IndexSettings
      • This release begins a deprecation cycle for the original hyperparameters
    • Index builds now have a rich.Progress bar
  • Parsing
    • Chunking and embedding can now be deferred to inference time
  • Agents
    • Agents now have a max_timesteps parameter to upper-bound trajectory length
    • Default agent is now a simple tool calling agent (ToolSelector), instead of a deterministic sequence of tool calls ("fake" agent)

Several bug fixes centered on retry-able errors:

  • Flaky Semantic Scholar and Crossref SSL errors and connection reset errors
  • LLM completions and text embeddings

What's Changed

  • Cleaning up #489's implementation by @jamesbraza in https://github.com/Future-House/paper-qa/pull/503
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/504
  • chore(deps): lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/506
  • chore(deps): update all non-major dependencies by @renovate in https://github.com/Future-House/paper-qa/pull/505
  • Filtering two more DeprecationWarnings by @jamesbraza in https://github.com/Future-House/paper-qa/pull/509
  • Refactor to create settings.agent.index grouping by @jamesbraza in https://github.com/Future-House/paper-qa/pull/510
  • Removed extra save_index calls, and added missing changed by @jamesbraza in https://github.com/Future-House/paper-qa/pull/513
  • Not rebuilding SearchIndex every paper_search by @jamesbraza in https://github.com/Future-House/paper-qa/pull/512
  • Updated citation to arxiv preprint by @whitead in https://github.com/Future-House/paper-qa/pull/514
  • Aviary agent max_timesteps and fixed test_gather_evidence_rejects_empty_docs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/515
  • Moved reset_log_levels to usefixtures by @jamesbraza in https://github.com/Future-House/paper-qa/pull/517
  • Decomposing Answer.could_not_answer by @jamesbraza in https://github.com/Future-House/paper-qa/pull/516
  • Fixing IndexSettings.use_absolute_paper_directory leading to relative index file paths by @jamesbraza in https://github.com/Future-House/paper-qa/pull/518
  • Moving run_ldp_agent to center on RolloutManager by @jamesbraza in https://github.com/Future-House/paper-qa/pull/519
  • Retrying on known Semantic Scholar flaky SSL error in get_s2_doc_details_from_doi by @jamesbraza in https://github.com/Future-House/paper-qa/pull/522
  • Converted PyMuPDF message to warning logs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/523
  • rich.Progress bar for monitoring index builds by @jamesbraza in https://github.com/Future-House/paper-qa/pull/521
  • Better descriptions and log messages by @jamesbraza in https://github.com/Future-House/paper-qa/pull/524
  • Made it possible to skip chunking by @whitead in https://github.com/Future-House/paper-qa/pull/526
  • Retrying on aiohttp.ClientConnectionResetError by @jamesbraza in https://github.com/Future-House/paper-qa/pull/529
  • Add rate limits for LLMs and Embedding Models by @mskarlin in https://github.com/Future-House/paper-qa/pull/520
  • Disallowing confusing None from IndexSettings.index_directory, and IndexSettings.get_named_index_directory by @jamesbraza in https://github.com/Future-House/paper-qa/pull/531
  • Add router_kwargs in separate control flow step by @mskarlin in https://github.com/Future-House/paper-qa/pull/532
  • Propagating AgentSettings.agent_type default for synchrony by @jamesbraza in https://github.com/Future-House/paper-qa/pull/533
  • Adding retrying of aembedding if it fails by @jamesbraza in https://github.com/Future-House/paper-qa/pull/535
  • Add limits+coredis to mypy by @mskarlin in https://github.com/Future-House/paper-qa/pull/537
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/534
  • Controlling for pymupdf version in test_pdf_reader_match_doc_details VCR by @jamesbraza in https://github.com/Future-House/paper-qa/pull/538
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/539
  • Fixed yet another api.semanticscholar.org:443 ssl:default error via retrying by @jamesbraza in https://github.com/Future-House/paper-qa/pull/540

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.10...v5.1.0

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.0.10

What's Changed

  • Discovered Renovate :automergeMinor and preventing openai version bumps by @jamesbraza in https://github.com/Future-House/paper-qa/pull/493
  • Fixing LitQATaskDataset deserialization from config by @jamesbraza in https://github.com/Future-House/paper-qa/pull/494
  • chore(deps): update all non-major dependencies by @renovate in https://github.com/Future-House/paper-qa/pull/498
  • Broken reader ut by @nadolskit in https://github.com/Future-House/paper-qa/pull/497
  • Fixing LitQATaskDatasetcompute_trajectory_metrics crash with bad status extraction by @jamesbraza in https://github.com/Future-House/paper-qa/pull/500
  • For autogenerated Router kwargs, specifying timeout of 60-sec by @jamesbraza in https://github.com/Future-House/paper-qa/pull/501

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.9...v5.0.10

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.0.9

What's Changed

  • Fixing tests/tests/cassettes issue by using absolute path by @jamesbraza in https://github.com/Future-House/paper-qa/pull/482
  • Retrying on known Crossref flaky SSL error in doi_to_bibtex by @jamesbraza in https://github.com/Future-House/paper-qa/pull/479
  • Cleaning up and testing get_directory_index by @jamesbraza in https://github.com/Future-House/paper-qa/pull/483
  • Modernizing Renovate config by @jamesbraza in https://github.com/Future-House/paper-qa/pull/487
  • Allowing parse_text to be given a str path by @jamesbraza in https://github.com/Future-House/paper-qa/pull/491
  • Refactor to expose agents.RichHandler by @jamesbraza in https://github.com/Future-House/paper-qa/pull/489

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.8...v5.0.9

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.0.8

What's Changed

  • Documenting and cleaning up manifest file logic by @jamesbraza in https://github.com/Future-House/paper-qa/pull/448
  • Latest dependencies for pylint 3.3 by @jamesbraza in https://github.com/Future-House/paper-qa/pull/463
  • Down-pinning openai 1.47 since it breaks CI by @jamesbraza in https://github.com/Future-House/paper-qa/pull/466
  • Lock file maintenance by @renovate in https://github.com/Future-House/paper-qa/pull/462
  • chore: add .gitattributes for cassettes file by @devstein in https://github.com/Future-House/paper-qa/pull/468
  • Documenting Python 3.11+ in README by @jamesbraza in https://github.com/Future-House/paper-qa/pull/467
  • Fixing flaky test_tool_failure by @jamesbraza in https://github.com/Future-House/paper-qa/pull/465
  • Documenting manifest CSV pathing a bit more by @jamesbraza in https://github.com/Future-House/paper-qa/pull/469
  • Handling S2 KeyError crash during indexing by @jamesbraza in https://github.com/Future-House/paper-qa/pull/472
  • Fixing pymupdf.mupdf.FzErrorFormat crash by recasting as an ImpossibleParsingError by @jamesbraza in https://github.com/Future-House/paper-qa/pull/474
  • Updating test_tool_failure cassette by @jamesbraza in https://github.com/Future-House/paper-qa/pull/476
  • Simplifying the indexing of action tokens by @jamesbraza in https://github.com/Future-House/paper-qa/pull/477
  • Truncating failing test_evaluation via max_rollout_steps by @jamesbraza in https://github.com/Future-House/paper-qa/pull/475

New Contributors

  • @devstein made their first contribution in https://github.com/Future-House/paper-qa/pull/468

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.7...v5.0.8

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.0.7

What's Changed

  • Fixing flaky test test_pdf_reader_match_doc_details by @jamesbraza in https://github.com/Future-House/paper-qa/pull/447
  • Retrying Crossref's aiohttp.ClientConnectorError by @jamesbraza in https://github.com/Future-House/paper-qa/pull/444
  • Handling AttributeError on structured citation prompt failure by @jamesbraza in https://github.com/Future-House/paper-qa/pull/445

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.6...v5.0.7

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.0.6

What's Changed

  • Avoiding div0 crash in LitQATaskDataset.compute_trajectory_metrics by @jamesbraza in https://github.com/Future-House/paper-qa/pull/439
  • Added some documentation and adjusted field names for ease of use in DocDetails by @whitead in https://github.com/Future-House/paper-qa/pull/440

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.5...v5.0.6

- Python
Published by whitead over 1 year ago

paper-qa - v5.0.5

What's Changed

  • build_index with defaults by @jamesbraza in https://github.com/Future-House/paper-qa/pull/430
  • Less common CROSSREF_XYZ warnings by @jamesbraza in https://github.com/Future-House/paper-qa/pull/431
  • DRY'd up default indexes default location by @jamesbraza in https://github.com/Future-House/paper-qa/pull/432
  • Including paper and evidence counts in metrics by @jamesbraza in https://github.com/Future-House/paper-qa/pull/435
  • Allowing case insensitive "fake" agent type by @jamesbraza in https://github.com/Future-House/paper-qa/pull/437
  • Many documentation improvements by @jamesbraza in https://github.com/Future-House/paper-qa/pull/438

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.4...v5.0.5

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.0.4

What's Changed

  • DocMetadataClient can now take instantiated providers and processors by @geemi725 in https://github.com/Future-House/paper-qa/pull/414
  • Promoting agent factories to Settings by @jamesbraza in https://github.com/Future-House/paper-qa/pull/407
  • Add stubdatadir fixture to retraction test by @geemi725 in https://github.com/Future-House/paper-qa/pull/420
  • pytest-recording docs in CONTRIBUTING.md by @jamesbraza in https://github.com/Future-House/paper-qa/pull/410
  • Fixing test_crossref_journalquality_fields_filtering incorrect cassette set up by @jamesbraza in https://github.com/Future-House/paper-qa/pull/423
  • Broken title search ut by @nadolskit in https://github.com/Future-House/paper-qa/pull/411
  • Update pre-commit-ci/lite-action action to v1.0.3 by @renovate in https://github.com/Future-House/paper-qa/pull/422
  • Pinning min pymupdf version by @jamesbraza in https://github.com/Future-House/paper-qa/pull/424
  • Preventing Environments from sharing one Docs by @jamesbraza in https://github.com/Future-House/paper-qa/pull/425
  • Dropped PyCryptodome and build dependencies by @jamesbraza in https://github.com/Future-House/paper-qa/pull/426

New Contributors

  • @nadolskit made their first contribution in https://github.com/Future-House/paper-qa/pull/411

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.3...v5.0.4

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.0.3

What's Changed

  • Adding Renovate config and newer dependencies by @jamesbraza in https://github.com/Future-House/paper-qa/pull/398
  • Fixing mutable BaseModel defaults and removing extra BaseModel by @jamesbraza in https://github.com/Future-House/paper-qa/pull/400
  • Passing mypy paperqa by @jamesbraza in https://github.com/Future-House/paper-qa/pull/405
  • Adding CONTRIBUTING.md by @jamesbraza in https://github.com/Future-House/paper-qa/pull/404
  • Creating LitQAv2TaskDataset for agent training/evaluation by @jamesbraza in https://github.com/Future-House/paper-qa/pull/401

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.2...v5.0.3

- Python
Published by jamesbraza over 1 year ago

paper-qa - v5.0.2

What's Changed

  • Changed email addresses to something less generic by @whitead in https://github.com/Future-House/paper-qa/pull/376
  • Fix examples in README by @taabishm2 in https://github.com/Future-House/paper-qa/pull/379
  • Validating LiteLLMModel.config structure by @jamesbraza in https://github.com/Future-House/paper-qa/pull/383
  • No google auth, better CI names by @jamesbraza in https://github.com/Future-House/paper-qa/pull/384
  • Fixing Pydantic validation in Python<3.12 by @jamesbraza in https://github.com/Future-House/paper-qa/pull/385
  • LitQA2 downloading and question creation functionality by @jamesbraza in https://github.com/Future-House/paper-qa/pull/386
  • Testing MemoryAgent and timeouts on ldp agents by @jamesbraza in https://github.com/Future-House/paper-qa/pull/375
  • Removed monkeypatch fixture since it's not a dependency by @jamesbraza in https://github.com/Future-House/paper-qa/pull/395
  • Fixing crash in chunk_text for empty file by @jamesbraza in https://github.com/Future-House/paper-qa/pull/389

New Contributors

  • @taabishm2 made their first contribution in https://github.com/Future-House/paper-qa/pull/379

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.1...v5.0.2

- Python
Published by whitead over 1 year ago

paper-qa - v5.0.1

What's Changed

  • Removed StrPath in favor of direct type hints by @jamesbraza in https://github.com/Future-House/paper-qa/pull/369
  • Added tool description update to test by @mskarlin in https://github.com/Future-House/paper-qa/pull/368
  • Added explanation of different with paper by @whitead in https://github.com/Future-House/paper-qa/pull/371
  • Updates to retraction status checker by @geemi725 in https://github.com/Future-House/paper-qa/pull/370
  • Retrying if ToolSelector fails to select a tool by @jamesbraza in https://github.com/Future-House/paper-qa/pull/373
  • Reset default settings to use high_quality and remove truncation by @mskarlin in https://github.com/Future-House/paper-qa/pull/374

Full Changelog: https://github.com/Future-House/paper-qa/compare/v5.0.0...v5.0.1

- Python
Published by whitead over 1 year ago

paper-qa - V5.0.0

New Features

  • Automatic population of metadata: PDF metadata is automatically retrieved from a variety of providers, including adding bibtex, citation counts, journal quality assessments, and noting retractions
  • full-text search: A major difference between our published work and this repo is ability to search over all of scientific literature. We've brought the OSS version closer by adding full-text keyword search via tantivy. Now you can index and search many papers before embdding, making it feasible to ingest many papers.
  • unified settings management: You can now save/load settings and that makes it easier for us to distribute settings reflecting various tasks with PaperQA2. Examples are writing wikipedia articles, identifying contradictions, and obtaining structured data
  • CLI: We've made a CLI that uses persistent parsings/indexes and makes it much easier to just ask questions of a folder of PDFs
  • Litellm: We've adopted litellm as the LLM wrapper of choice. This means we now support many LLM APIs directly with only the model string changing. It also means we have "routers" now that can do fallbacks, api rate limiting, and retries.

Improvements

  • More modern agent frameworks
  • Reduction in dependencies
  • Removed code duplicated by litellm
  • Many improvements on code style and best practices

Regressions/Deprecation

We've removed the following features to keep our library focused:

  • doc_match - we do not have enough data to support that this method actually helps for very large corpuses
  • LangchainVectorStore - We no longer support more complex vector stores via Langchain like FAISS. Instead, we only support Numpy vector stores. We never found the paradigm of very large vector stores to be better than keyword search -> vector search -> LLM reranking and thus removed the code

Detailed Changes:

  • typo by @oganm in https://github.com/Future-House/paper-qa/pull/303
  • Updated readme and models by @mskarlin in https://github.com/Future-House/paper-qa/pull/305
  • Add Client (external API) Module For Enhanced Metadata by @mskarlin in https://github.com/Future-House/paper-qa/pull/306
  • Agentic workflows, locally indexed search, and CLI by @mskarlin in https://github.com/Future-House/paper-qa/pull/309
  • Add new unpaywall provider by @mskarlin in https://github.com/Future-House/paper-qa/pull/310
  • Rollback search fields to list and dynamically compute md5 hash in tests by @mskarlin in https://github.com/Future-House/paper-qa/pull/311
  • Refactor to breakout config from rest of code by @whitead in https://github.com/Future-House/paper-qa/pull/289
  • Changed to rely on litellm for computing cost by @whitead in https://github.com/Future-House/paper-qa/pull/321
  • Fixing LLMModel.axyz_iter type hints by @jamesbraza in https://github.com/Future-House/paper-qa/pull/324
  • CLI Fixes by @whitead in https://github.com/Future-House/paper-qa/pull/322
  • blackened code to prevent IDE scrolling by @jamesbraza in https://github.com/Future-House/paper-qa/pull/330
  • Optimized import paths by @jamesbraza in https://github.com/Future-House/paper-qa/pull/331
  • Removed pytest-mock plugin by @jamesbraza in https://github.com/Future-House/paper-qa/pull/328
  • Adding pytest-xdist plugin by @jamesbraza in https://github.com/Future-House/paper-qa/pull/329
  • Passing mypy by @jamesbraza in https://github.com/Future-House/paper-qa/pull/332
  • Removing make_chain in favor of run_prompt by @jamesbraza in https://github.com/Future-House/paper-qa/pull/325
  • Readme updates by @mskarlin in https://github.com/Future-House/paper-qa/pull/323
  • Adding refurb tool, and lint CI by @jamesbraza in https://github.com/Future-House/paper-qa/pull/333
  • Fixing arg ordering after #325 by @jamesbraza in https://github.com/Future-House/paper-qa/pull/334
  • Fixing parse_text after #332 by @jamesbraza in https://github.com/Future-House/paper-qa/pull/335
  • Fixing union attr error by @jamesbraza in https://github.com/Future-House/paper-qa/pull/338
  • Check if a journal name starts with the by @geemi725 in https://github.com/Future-House/paper-qa/pull/320
  • Fixing two more tests by @jamesbraza in https://github.com/Future-House/paper-qa/pull/340
  • All Ruff ANN autofixes by @jamesbraza in https://github.com/Future-House/paper-qa/pull/341
  • Adding in .mailmap by @jamesbraza in https://github.com/Future-House/paper-qa/pull/342
  • Remove cassettes which aren't needed by @mskarlin in https://github.com/Future-House/paper-qa/pull/339
  • Add configs for contracrow + wikicrow by @mskarlin in https://github.com/Future-House/paper-qa/pull/336
  • Removed LangchainVectorStore, llms extra, and fixing up README by @jamesbraza in https://github.com/Future-House/paper-qa/pull/343
  • Dropping requests dependency by @jamesbraza in https://github.com/Future-House/paper-qa/pull/346
  • Removed html2text requirement by @jamesbraza in https://github.com/Future-House/paper-qa/pull/347
  • Requiring Python 3.11+ by @jamesbraza in https://github.com/Future-House/paper-qa/pull/348
  • Did one revision at README by @whitead in https://github.com/Future-House/paper-qa/pull/344
  • Renaming fitz to pymupdf by @mskarlin in https://github.com/Future-House/paper-qa/pull/350
  • Better control flow in litellm_get_search_query by @jamesbraza in https://github.com/Future-House/paper-qa/pull/351
  • Recurse into directories; catch empty documents by @sidnarayanan in https://github.com/Future-House/paper-qa/pull/352
  • Move configureclilogging such that it's not called twice by @mskarlin in https://github.com/Future-House/paper-qa/pull/353
  • Cleaning up dependencies by @jamesbraza in https://github.com/Future-House/paper-qa/pull/354
  • Fixed code in README by @whitead in https://github.com/Future-House/paper-qa/pull/355
  • Added citation and paper URL by @whitead in https://github.com/Future-House/paper-qa/pull/357
  • aviary and ldp for agents over langchain by @jamesbraza in https://github.com/Future-House/paper-qa/pull/358
  • Adds retraction status by @geemi725 in https://github.com/Future-House/paper-qa/pull/314
  • Adding pylint by @jamesbraza in https://github.com/Future-House/paper-qa/pull/349
  • Added account for cost info by @whitead in https://github.com/Future-House/paper-qa/pull/360

New Contributors

  • @oganm made their first contribution in https://github.com/Future-House/paper-qa/pull/303
  • @geemi725 made their first contribution in https://github.com/Future-House/paper-qa/pull/320
  • @sidnarayanan made their first contribution in https://github.com/Future-House/paper-qa/pull/352

Full Changelog: https://github.com/Future-House/paper-qa/compare/v4.9.0...vnew

- Python
Published by whitead over 1 year ago

paper-qa - v5.0.0-alpha.1

PRE-RELEASE

What's Changed

  • typo by @oganm in https://github.com/Future-House/paper-qa/pull/303
  • Updated readme and models by @mskarlin in https://github.com/Future-House/paper-qa/pull/305
  • Add Client (external API) Module For Enhanced Metadata by @mskarlin in https://github.com/Future-House/paper-qa/pull/306
  • Agentic workflows, locally indexed search, and CLI by @mskarlin in https://github.com/Future-House/paper-qa/pull/309

New Contributors

  • @oganm made their first contribution in https://github.com/Future-House/paper-qa/pull/303

Full Changelog: https://github.com/Future-House/paper-qa/compare/v4.9.0...v5.0.0-alpha.1

- Python
Published by whitead almost 2 years ago

paper-qa - v4.9.0

What's Changed

  • Latest ruff and codespell by @jamesbraza in https://github.com/whitead/paper-qa/pull/295
  • Documented Context.context and defaulted LLMResult.date by @jamesbraza in https://github.com/whitead/paper-qa/pull/296
  • Documenting PromptCollection.pre by @jamesbraza in https://github.com/whitead/paper-qa/pull/298
  • Fixing pre missing a space by @jamesbraza in https://github.com/whitead/paper-qa/pull/297
  • Enhanced mypy and Ruff 0.5 by @jamesbraza in https://github.com/whitead/paper-qa/pull/300
  • Moved to setuptools_scm for versioning from git tag by @jamesbraza in https://github.com/whitead/paper-qa/pull/301

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.8.1...v4.9.0

- Python
Published by jamesbraza almost 2 years ago

paper-qa - v4.8.1

What's Changed

  • Fixed sonnet json formatting issue by @whitead in https://github.com/whitead/paper-qa/pull/293

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.8.0...v4.8.1

- Python
Published by whitead almost 2 years ago

paper-qa - v4.8.0

What's Changed

  • Support Anyscale OpenAI models by @mskarlin in https://github.com/whitead/paper-qa/pull/285
  • Decompose is_openai_model into separate call for Anyscale by @mskarlin in https://github.com/whitead/paper-qa/pull/287
  • Removed slient 429 by @whitead in https://github.com/whitead/paper-qa/pull/290

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.7.0...v4.8.0

- Python
Published by whitead almost 2 years ago

paper-qa - v4.7.0

What's Changed

  • Simplify langhcain config by @whitead in https://github.com/whitead/paper-qa/pull/282

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.6.1...v4.7.0

- Python
Published by whitead almost 2 years ago

paper-qa - v4.6.1

What's Changed

  • Add VoyageAI embeddings by @mskarlin in https://github.com/whitead/paper-qa/pull/276
  • Support fine tuned Openai model selections by @mskarlin in https://github.com/whitead/paper-qa/pull/277
  • Fixed summary_json_system_prompt by @jamesbraza in https://github.com/whitead/paper-qa/pull/281
  • remove intro sentence in citation prompt by @rosepolle in https://github.com/whitead/paper-qa/pull/280

New Contributors

  • @rosepolle made their first contribution in https://github.com/whitead/paper-qa/pull/280

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.6.0...v4.6.1

- Python
Published by whitead almost 2 years ago

paper-qa - v4.6.0

What's Changed

  • Removed extra space from select_paper_prompt by @jamesbraza in https://github.com/whitead/paper-qa/pull/275
  • Configurability of SparseEmbeddingModel from embedding_model_factory by @jamesbraza in https://github.com/whitead/paper-qa/pull/274

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.5.2...v4.6.0

- Python
Published by whitead about 2 years ago

paper-qa - v4.5.2

What's Changed

  • Cleaning-up formatting on json mode by @whitead in https://github.com/whitead/paper-qa/pull/271
  • Fixed flaky add_texts test by @whitead in https://github.com/whitead/paper-qa/pull/272

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.5.1...v4.5.2

- Python
Published by whitead about 2 years ago

paper-qa - v4.5.1

What's Changed

  • dev extra and cleaned up CI by @jamesbraza in https://github.com/whitead/paper-qa/pull/263
  • CI pip caching by @jamesbraza in https://github.com/whitead/paper-qa/pull/266
  • More robust JSON parsing by @whitead in https://github.com/whitead/paper-qa/pull/270

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.5.0...v4.5.1

- Python
Published by whitead about 2 years ago

paper-qa - v4.5.0

What's Changed

  • Delaying of state mutation in Docs.aadd_texts by @jamesbraza in https://github.com/whitead/paper-qa/pull/264

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.4.1...v4.5.0

- Python
Published by whitead about 2 years ago

paper-qa - v4.4.1

What's Changed

  • Creating Answer.get_unique_docs_from_contexts helper method by @jamesbraza in https://github.com/whitead/paper-qa/pull/261
  • Added batching to embed documents by @whitead in https://github.com/whitead/paper-qa/pull/262

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.4.0...v4.4.1

- Python
Published by whitead about 2 years ago

paper-qa - v4.4.0

What's Changed

  • Documenting LLMResult by @jamesbraza in https://github.com/whitead/paper-qa/pull/255
  • Migrating from setup.py to pyproject.toml by @jamesbraza in https://github.com/whitead/paper-qa/pull/252
  • Adjust whitespace on detailed citations by @whitead in https://github.com/whitead/paper-qa/pull/257

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.3.0...v4.4.0

- Python
Published by whitead about 2 years ago

paper-qa - v4.3.0

What's Changed

  • Separate parsing and chunking in read_doc by @mskarlin in https://github.com/whitead/paper-qa/pull/254

New Contributors

  • @mskarlin made their first contribution in https://github.com/whitead/paper-qa/pull/254

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.2.1...v4.3.0

- Python
Published by whitead about 2 years ago

paper-qa - v4.2.1

What's Changed

  • Fixed bug for mixed encoding types from numpy by @whitead in https://github.com/whitead/paper-qa/pull/253

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.2.0...v4.2.1

- Python
Published by whitead about 2 years ago

paper-qa - v4.2.0

What's Changed

  • Upgrade of ruff, adding codespell, toml-sort by @jamesbraza in https://github.com/whitead/paper-qa/pull/251
  • Added convenience methods for building sparse/hybrid vector dbs by @whitead in https://github.com/whitead/paper-qa/pull/250

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.1.1...v4.2.0

- Python
Published by whitead about 2 years ago

paper-qa - v4.1.1

What's Changed

  • Fixed MMR alg on not correctly choosing most similar

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.1.0...v4.1.1

- Python
Published by whitead about 2 years ago

paper-qa - v4.1.0

What's Changed

  • delete the texts by @Dustyposa in https://github.com/whitead/paper-qa/pull/181
  • Making Doc hashable by @jamesbraza in https://github.com/whitead/paper-qa/pull/244
  • Latest black and prettier by @jamesbraza in https://github.com/whitead/paper-qa/pull/247
  • Add more vector embedding types by @whitead in https://github.com/whitead/paper-qa/pull/245
  • Allowing Doc subclasses to propagate to evidence by @jamesbraza in https://github.com/whitead/paper-qa/pull/246
  • Fixing crash when json.loads returns str by @jamesbraza in https://github.com/whitead/paper-qa/pull/248

New Contributors

  • @Dustyposa made their first contribution in https://github.com/whitead/paper-qa/pull/181

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0...v4.1.0

- Python
Published by whitead about 2 years ago

paper-qa - v4.0.0

What's Changed

  • Version 4 with better open source model support and no langchain by @whitead in https://github.com/whitead/paper-qa/pull/223
  • Prevent error loading pdf: Added pymupdf/fitz open to get page count by @ekcomputer in https://github.com/whitead/paper-qa/pull/225
  • Removed nest_asyncio by @whitead in https://github.com/whitead/paper-qa/pull/227
  • JSON Mode & Callbacks by @whitead in https://github.com/whitead/paper-qa/pull/229
  • Removed features that required python 3.11 by @whitead in https://github.com/whitead/paper-qa/pull/230
  • Added status info on used contexts by @whitead in https://github.com/whitead/paper-qa/pull/231
  • Improved json parsing by @whitead in https://github.com/whitead/paper-qa/pull/232
  • Fixed deserialized computed fields issue by @whitead in https://github.com/whitead/paper-qa/pull/233
  • Propogated extra props in JSON by @whitead in https://github.com/whitead/paper-qa/pull/235
  • Added py.typed metadata file by @jamesbraza in https://github.com/whitead/paper-qa/pull/238
  • mypy config update by @jamesbraza in https://github.com/whitead/paper-qa/pull/237
  • More verbose comment on Answer.token_counts by @jamesbraza in https://github.com/whitead/paper-qa/pull/240
  • Added anthropic LLMs by @whitead in https://github.com/whitead/paper-qa/pull/241
  • Adjusted anthropic import by @whitead in https://github.com/whitead/paper-qa/pull/242

New Contributors

  • @ekcomputer made their first contribution in https://github.com/whitead/paper-qa/pull/225
  • @jamesbraza made their first contribution in https://github.com/whitead/paper-qa/pull/238

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.13.4...v4.0.0

- Python
Published by whitead about 2 years ago

paper-qa - v4.0.0-pre.11

What's Changed

  • Adjusted anthropic import by @whitead in https://github.com/whitead/paper-qa/pull/242

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0-pre.10...v4.0.0-pre.11

- Python
Published by whitead about 2 years ago

paper-qa - v4.0.0-pre.10

What's Changed

  • More verbose comment on Answer.token_counts by @jamesbraza in https://github.com/whitead/paper-qa/pull/240
  • Added anthropic LLMs by @whitead in https://github.com/whitead/paper-qa/pull/241

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0-pre.9...v4.0.0-pre.10

- Python
Published by whitead about 2 years ago

paper-qa - v4.0.0-pre.9

What's Changed

  • Added py.typed metadata file by @jamesbraza in https://github.com/whitead/paper-qa/pull/238
  • mypy config update by @jamesbraza in https://github.com/whitead/paper-qa/pull/237

New Contributors

  • @jamesbraza made their first contribution in https://github.com/whitead/paper-qa/pull/238

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0-pre.8...v4.0.0-pre.9

- Python
Published by whitead over 2 years ago

paper-qa - v4.0.0-pre.8

What's Changed

  • Propogated extra props in JSON by @whitead in https://github.com/whitead/paper-qa/pull/235

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0-pre.7...v4.0.0-pre.8

- Python
Published by whitead over 2 years ago

paper-qa - v4.0.0-pre.7

What's Changed

  • Fixed deserialized computed fields issue by @whitead in https://github.com/whitead/paper-qa/pull/233

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0-pre.6...v4.0.0-pre.7

- Python
Published by whitead over 2 years ago

paper-qa - v4.0.0-pre.6

What's Changed

  • Improved json parsing by @whitead in https://github.com/whitead/paper-qa/pull/232

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0-pre.5...v4.0.0-pre.6

- Python
Published by whitead over 2 years ago

paper-qa - v4.0.0-pre.5

What's Changed

  • Added status info on used contexts by @whitead in https://github.com/whitead/paper-qa/pull/231

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0-pre.4...v4.0.0-pre.5

- Python
Published by whitead over 2 years ago

paper-qa - v4.0.0-pre.4

What's Changed

  • Removed features that required python 3.11 by @whitead in https://github.com/whitead/paper-qa/pull/230

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0-pre.3...v4.0.0-pre.4

- Python
Published by whitead over 2 years ago

paper-qa - v4.0.0-pre.3

What's Changed

  • JSON Mode & Callbacks by @whitead in https://github.com/whitead/paper-qa/pull/229

Full Changelog: https://github.com/whitead/paper-qa/compare/v4.0.0-pre.2...v4.0.0-pre.3

- Python
Published by whitead over 2 years ago

paper-qa - v4.0.0-pre.2

What's Changed

  • Removed nest_asyncio by @whitead in https://github.com/whitead/paper-qa/pull/227

Full Changelog: https://github.com/whitead/paper-qa/compare/4.0.0-pre.1...v4.0.0-pre.2

- Python
Published by whitead over 2 years ago

paper-qa - 4.0.0-pre.1

What's Changed

  • Version 4 with better open source model support and no langchain by @whitead in https://github.com/whitead/paper-qa/pull/223
  • Prevent error loading pdf: Added pymupdf/fitz open to get page count by @ekcomputer in https://github.com/whitead/paper-qa/pull/225

New Contributors

  • @ekcomputer made their first contribution in https://github.com/whitead/paper-qa/pull/225

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.13.4...4.0.0-pre.1

- Python
Published by whitead over 2 years ago

paper-qa - v3.13.4

What's Changed

  • More score parsing improvements by @whitead in https://github.com/whitead/paper-qa/pull/218

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.13.3...v3.13.4

- Python
Published by whitead over 2 years ago

paper-qa - v3.13.3

What's Changed

  • Fixed another score variant seen from LLMs by @whitead in https://github.com/whitead/paper-qa/pull/215

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.13.2...v3.13.3

- Python
Published by whitead over 2 years ago

paper-qa - v3.13.2

What's Changed

  • Fixed eating paranthetical statements by @whitead in https://github.com/whitead/paper-qa/pull/211

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.13.1...v3.13.2

- Python
Published by whitead over 2 years ago

paper-qa - v3.13.1

What's Changed

  • More robust check on citation finding for markdown @whitead in https://github.com/whitead/paper-qa/pull/210

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.13.0...v3.13.1

- Python
Published by whitead over 2 years ago

paper-qa - v3.13.0

What's Changed

  • Added markdown output with citations by @whitead in https://github.com/whitead/paper-qa/pull/209

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.12.0...v3.13.0

- Python
Published by whitead over 2 years ago

paper-qa - v3.12.0

What's Changed

  • Added option to strip indirect citations by @whitead in https://github.com/whitead/paper-qa/pull/203

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.11.2...v3.12.0

- Python
Published by whitead over 2 years ago

paper-qa - v3.11.2

  • Updated for compatibility with langchain v0.0.303

- Python
Published by whitead over 2 years ago

paper-qa - v3.11.1

  • Updated support for langchain 0.0.294 which broke backwards compatibility for embeddings types

- Python
Published by whitead over 2 years ago

paper-qa - v3.11.0

What's Changed

  • Adjusted formatting of pre chain by @whitead in https://github.com/whitead/paper-qa/pull/195

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.10.0...v3.11.0

- Python
Published by whitead over 2 years ago

paper-qa - v3.10.0

What's Changed

  • Added support for pydantic v2 by @whitead in https://github.com/whitead/paper-qa/pull/193

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.9.1...v3.10.0

- Python
Published by whitead over 2 years ago

paper-qa - v3.9.1

What's Changed

  • Fixed typing and formatting problems by @whitead in https://github.com/whitead/paper-qa/pull/191

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.9.0...v3.9.1

- Python
Published by whitead almost 3 years ago

paper-qa - v3.9.0

What's Changed

  • Made it possible to turn off llm rerank by @whitead in https://github.com/whitead/paper-qa/pull/190

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.8.0...v3.9.0

- Python
Published by whitead almost 3 years ago

paper-qa - v3.8.0

What's Changed

  • Added option to skip summaries and adjusted prompts by @whitead in https://github.com/whitead/paper-qa/pull/187

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.7.1...v3.8.0

- Python
Published by whitead almost 3 years ago

paper-qa - v3.7.1

  1. Added check for adoc_match with models that cannot understand prompt
  2. Pinned pydantic to 1

- Python
Published by whitead almost 3 years ago

paper-qa - v3.7.0

  1. Adjusted prompts to reduce "cannot answers"
  2. Reduced size of prompts

- Python
Published by whitead almost 3 years ago

paper-qa - V3.6.0

What's Changed

  • Update setup.py by @SamCox822 in https://github.com/whitead/paper-qa/pull/175
  • added ablations to paperQA to test performance effects by @odhran-o-d in https://github.com/whitead/paper-qa/pull/174
  • Fixed bug in accumulating contexts by @whitead

New Contributors

  • @SamCox822 made their first contribution in https://github.com/whitead/paper-qa/pull/175

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.5.0...V3.6.0

- Python
Published by whitead almost 3 years ago

paper-qa - v3.5.0

What's Changed

  • Made system prompt configurable by @whitead in https://github.com/whitead/paper-qa/pull/170

Full Changelog: https://github.com/whitead/paper-qa/compare/v3.4.1...v3.5.0

- Python
Published by whitead almost 3 years ago