graphannis - 3.8.1 - 2025-05-22

Release Notes

Fixed

Avoid loading the node annotation storage when listing the components for a corpus in the CorpusStorage. Before this change, querying for components via the webservice could block the corpus cache.
Better estimation for queries with regular expressions without prefix.

graphannis-cli 3.8.1

Download graphannis-cli 3.8.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.8.1

Download graphannis-webservice 3.8.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] 9 months ago

graphannis - 3.8.0 - 2025-05-14

Release Notes

Changed

Compile releases of the C-library on Ubuntu 22.04 instead of 20.04, which means the minimal GLIBC version is 2.35. This is necessary, since GitHub actions deprecated this Ubuntu version.

Added

New optional file option for the [logging] section in the webservice configuration. Can be used to additionally output all log messages to the given file.
Add number of root nodes to graph storage statistics. This changes the way most of the graph storages store their statistics. You can use old imported data files, but to make use of the new information you queries, you have to reimport your corpora.
Graph:ensure_loaded_parallel returns the actually loaded components that did exist.

Fixed

Less frequent corpus cache status updates in log. Before, every corpus access could trigger an entry into the log which is not desired under heavy load.
Improve query execution planning by assuming all annotations can be matched in regular expressions without a prefix.

graphannis-cli 3.8.0

Download graphannis-cli 3.8.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.8.0

Download graphannis-webservice 3.8.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] 9 months ago

graphannis - 3.7.1 - 2025-04-14

Release Notes

Fixed

Correctly map the mappings column for older resolver_vis_map.tab files that do have a visibility column.

graphannis-cli 3.7.1

Download graphannis-cli 3.7.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.7.1

Download graphannis-webservice 3.7.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] 10 months ago

graphannis - 3.7.0 - 2025-03-18

Release Notes

Fixed

Fix broken imports for existing corpora when they never have been added to the cache or have been evicted from it. (by https://github.com/matthias-stemmler)

Deprecated

Graph::load_from is replaced with the open and import methods.

Added

Allow to add updates to the annotation Graph without re-calculating the statistics with apply_update_keep_statistics. This is useful for scenarios were we assume the changes don't change the graph that much and we want to apply the updates as fast as possible.
Open an Graph from an external location with open or import the changes into the current graph.

graphannis-cli 3.7.0

Download graphannis-cli 3.7.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.7.0

Download graphannis-webservice 3.7.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] 11 months ago

graphannis - 3.6.0 - 2025-01-14

Release Notes

Added

UpdateEvent now implements PartialEq to make possible to compare changes.

Fixed

Deserializing a write-ahead log failed because it was located at the wrong sub-directory and the deserialization routine for the map had a bug.

graphannis-cli 3.6.0

Download graphannis-cli 3.6.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.6.0

Download graphannis-webservice 3.6.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] about 1 year ago

graphannis - 3.5.1 - 2024-09-25

Release Notes

Fixed

Fixed out of bounds error parsing legacy meta queries with multiple alternatives (https://github.com/korpling/graphANNIS/pull/308)

graphannis-cli 3.5.1

Download graphannis-cli 3.5.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.5.1

Download graphannis-webservice 3.5.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] over 1 year ago

graphannis - 3.4.0 - 2024-08-20

Release Notes

Added

Added support for coverage edges between span nodes an segmentation nodes when calculating the AQL model index.

Fixed

Do not use recursion to calculate the indirect coverage edges in the model index, since this could fail for deeply nested structures.

graphannis-cli 3.4.0

Download graphannis-cli 3.4.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.4.0

Download graphannis-webservice 3.4.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] over 1 year ago

graphannis - 3.3.3 - 2024-07-12

Release Notes

Fixed

Add bug fixes for relANNIS import discovered testing the Annatto relANNIS importer.
Fix FileTooLarge error when searching for token precedence where the statistics indicate that this search is impossible.

graphannis-cli 3.3.3

Download graphannis-cli 3.3.3

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.3.3

Download graphannis-webservice 3.3.3

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] over 1 year ago

graphannis - 3.3.2 - 2024-07-04

Release Notes

Fixed

Load existing components from the backup folder instead of the actual location if a backup folder exists.

graphannis-cli 3.3.2

Download graphannis-cli 3.3.2

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.3.2

Download graphannis-webservice 3.3.2

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] over 1 year ago

graphannis - 3.3.1 - 2024-06-04

Release Notes

Fixed

When optional nodes where located not at the end but somewhere in between the query, the output of the find query could include the wrong node ID.

graphannis-cli 3.3.1

Download graphannis-cli 3.3.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.3.1

Download graphannis-webservice 3.3.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] over 1 year ago

graphannis - 3.3.0 - 2024-05-27

Release Notes

Changed

Use a TOML file instead of a binary file format to store the global statistics. You might have to re-import existing corpora or use the re-optimize command on the command line if the global statistics are relevant for optimal speed in returning the token of a corpus.

Fixed

Do not reload graph storages when they are already loaded.
Do not attempt to unload a corpus that is about to be loaded in the next step. This could trigger problematic unload/load cycles.
Fixed issues with find_connected, find_connected_inverse and is_connected and excluded ranges (#257)
Updated lalrpop dependency to 0.20 to fix warnings reported in newer clippy versions.
Fixed compiler warnings in newer Rust versions about unused code.

Added

Added information about the corpus size to the global statistics and corpus configuration file. The used token/segmentation layer for the corpus size in the corpus configuration file corpus-config.toml can be configured manually. Or theentries are created automatically during import or when the re-optimize command is run on the command line. The corpus size is given as a combination of a unit and the actual quantitiy. The corpus size unit can be the number of basic token (no outgoing coverage). ``` [corpus_size] quantity = 44079

[corpussize.unit] name = "tokens" Or it can describe a specific segmentation layer. [corpussize] quantity = 305056

[corpussize.unit] name = "segmentation" value = "diplomatic" ``When the configuration is created automatically, the corpus view configuration is checked whether it is configured to use abasetext_segmentation` and uses this segmentation as the corpus size unit. If a corpus size is already configured, only the quantity will be updated but not the unit.

graphannis-cli 3.3.0

Download graphannis-cli 3.3.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.3.0

Download graphannis-webservice 3.3.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] over 1 year ago

graphannis - 3.2.2 - 2024-04-22

Release Notes

Fixed

Fix offset and limitation issue when multiple corpora are selected. After a refactoring, the updated offset was never actually applied when finding the results in the next corpus. This could lead to too many results on the first page and also to missing matches on the second and later pages.

graphannis-cli 3.2.2

Download graphannis-cli 3.2.2

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.2.2

Download graphannis-webservice 3.2.2

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] almost 2 years ago

graphannis - 3.2.1 - 2024-03-25

Release Notes

Fixed

Fix datasource-gap for zero context by ensuring that tokens are sorted in subgraph iterator. (by https://github.com/matthias-stemmler)

graphannis-cli 3.2.1

Download graphannis-cli 3.2.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.2.1

Download graphannis-webservice 3.2.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] almost 2 years ago

graphannis - 3.2.0 - 2024-03-13

Release Notes

Added

New disk-based graph storage implementation DiskPathV1_D15 that stores the outgoing paths from every node when maximum branch-out is 1 and the longest path has the length 15. This is an optimization especially useful for the PartOf component, since it avoids frequent disk access which would be needed for a adjecency based implementations to get all ancestors. Also PartOf components are not trees, but still have the property of at most 1 outgoing edge which can be used to optimize finding all ancestors. Important You cannot downgrade graphANNIS to an older version if you imported a disk-based corpus with the new version, since old graphANNIS versions won't be able to load the new graph storage implementation.
Add new global statistics that describe the combined graph. Until know, there were only statistics for each graph component and for the node annotation storage.
Improved handling of tok queries for corpora with tens of millions token, by using the newly added graph storage implementation and statistics and providing an optimized implementation for token search if we already know that all token are part of the default ordering component. This fixes #276.
Improve performance for regular expression search when using disk-based annotation storage and the regex has a prefix. This e.g. fixes getting the text for a document in ANNIS when the corpus is large.
Improve performance for regular expressions that can be replaced by an exact value search, even when the value is escaped. This can be useful e.g. in the subgraph extraction queries from ANNIS, where some characters are escaped with \x and which was previously not treated as constant value search.
Improve performance for getting all token of a document (e.g. for a subgraph query) when the PartOf graph storage implementation does not have the same cost of the inverse graph storage operations by allowing to use a nested loop join in this particular scenario.

Fixed

Do not add "annis:doc" labels to sub-corpora when importing relANNIS corpora. This will fix queries where you just search for documents, e.g. by annis:doc but also got the sub-corpora as result.
Re-enable adding the C-API shared library as release artifacts to GitHub.

graphannis-cli 3.2.0

Download graphannis-cli 3.2.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

graphannis-webservice 3.2.0

Download graphannis-webservice 3.2.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | Intel macOS | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | x64 Windows | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |

- Rust
Published by github-actions[bot] almost 2 years ago

graphannis - 3.1.1 - 2024-02-05

Release Notes

Fixed

Fix leaf filter for token searches and loading of necessary components (#280)

graphannis-cli 3.1.1

Download graphannis-cli 3.1.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

graphannis-webservice 3.1.1

Download graphannis-webservice 3.1.1

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

- Rust
Published by github-actions[bot] about 2 years ago

graphannis - 3.1.0 - 2024-01-10

Release Notes

Added

Allow to execute AQL directly on loaded AnnotationGraph objects by using the new aql::execute_query_on_graph and aql::parse functions. This is an alternative for using a CorpusStorage when only one corpus is handled.
New Graph::ensure_loaded_parallel function to load needed graph storages in parallel.
Added graphannis_core::graph::serialization::graphml::export_stable_order function that allows to export to GraphML, but with a guaranteed order of the elements.

Fixed

Do not attempt to unload corpora that are not loaded when trying to free memory.
Improve performance of loading a main memory corpus by using the standard HashMap for fields that are deserialized.

graphannis-cli 3.1.0

Download graphannis-cli 3.1.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

graphannis-webservice 3.1.0

Download graphannis-webservice 3.1.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

- Rust
Published by github-actions[bot] about 2 years ago

graphannis - 3.0.0 - 2023-11-28

Release Notes

Added

Add has_node_name function to AnnotationStorage that can be more efficient than get_node_id_name.

Changed

Changed API to use new types NodeAnnotationStorage and EdgeAnnotationStorage instead of AnnoStorageImpl<NodeID> or AnnoStorageImpl<NodeID>. (backward incompatible change in the Rust API)
get_node_id_from_name is now a function of the AnnotationStorage instead of the Graph. This allows for more specific and efficient implementations based on the type of annotation storage.
Improved performance of the Graph::apply_update function.
Use jemalloc memory allocator for webservice and CLI.

Removed

Remove all heap size estimation code. This also means that information about heap consumption of a single corpus has been removed, like the fields of the graphannis::corpusstorage::LoadStatus enum.
Remove EvictionStrategy::MaximumBytes for DiskMap.

Fixed

Polling when importing a web corpus through the webservice could fail because the background job list was not shared between the web server threads.

graphannis-cli 3.0.0

Download graphannis-cli 3.0.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-cli-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | graphannis-cli-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | graphannis-cli-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | graphannis-cli-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

graphannis-webservice 3.0.0

Download graphannis-webservice 3.0.0

| File | Platform | Checksum | |--------|----------|----------| | graphannis-webservice-aarch64-apple-darwin.tar.xz | macOS Apple Silicon | checksum | | graphannis-webservice-x86_64-apple-darwin.tar.xz | macOS Intel | checksum | | graphannis-webservice-x86_64-pc-windows-msvc.zip | Windows x64 | checksum | | graphannis-webservice-x86_64-unknown-linux-gnu.tar.xz | Linux x64 | checksum |

- Rust
Published by github-actions[bot] about 2 years ago

graphannis - 2.4.8

Fixed

Do not output document nodes in find query when using quirks mode and meta:: queries.

- Rust
Published by thomaskrause over 2 years ago

graphannis - 2.4.7

Fixed

When an optional node (for negation without existence) was not at the end of the query, find queries could give an empty output (#267).
Create default components for the graph type when importing GraphML files.

- Rust
Published by thomaskrause over 2 years ago

graphannis - 2.4.6

Changed

Compile release for macOS on version 11 (Big Sur). This is necessary, since GitHub actions deprecated the older macOS version.

- Rust
Published by thomaskrause over 2 years ago

graphannis - 2.4.5

Changed

Compile releases on Ubuntu 20.04 instead of 18.04, which means the minimal GLIBC version is 2.31. This is necessary, since GitHub actions deprecated this Ubuntu version.

Fixed

Update quick-xml to version 0.28 to avoid issues in future Rust versions
Update sstable to version 0.11 to avoid issues in future Rust versions
Update actix-web to version 4 to avoid issues in future Rust versions
Update config crate to version 0.13 to avoid issues in future Rust versions
Update diesel to version 2.0 due to issue in sqlite dependency

- Rust
Published by thomaskrause over 2 years ago

graphannis - 2.4.4

Fixed

Importing a corpus with a relative path directly under the current working directory would fail if the corpus has linked files.
Output of data items in GraphML for node/edge annotations could be unordered and cause test failures if comparing GraphML files.

- Rust
Published by thomaskrause almost 3 years ago

graphannis - 2.4.3

Fixed

Update smartstring crate to version 1 to avoid issues with newer Rust versions.

- Rust
Published by thomaskrause almost 3 years ago

graphannis - 2.4.2

Fixed

After re-using a deleted symbol ID (used in the annotation storage), the retrieved value was empty.

- Rust
Published by thomaskrause about 3 years ago

graphannis - 2.4.1

Fixed

When importing relANNIS corpora with sub-corpora, add the PartOf edge to the parent corpus node of the document or sub-corpora, but not automatically to the top-level corpus.

- Rust
Published by thomaskrause over 3 years ago

graphannis - 2.4.0

Added

Allow to configure how spans should be interpreted in the view when the token layer is representing a timeline with the timeline_strategy parameter in the view section of the corpus configuration. This allows the view to reconstruct an implicit relation between spans and their segmentation nodes (which is not possible to represent in the legacy relANNIS data model). New corpora should use explicit Coverage edges between spans and their segmentation nodes, but in order to maintain backward compatibility with relANNIS, we need to support these older corpus configuration values (virtual_tokenization_mapping and virtual_tokenization_from_namespace), which only affect the display of the corpora.

- Rust
Published by thomaskrause over 3 years ago

graphannis - 2.3.0

Fixed

Fixed wrong result order for non-token searches.
Estimation for negated regex was extremely off when the regex could possibly match all values. This caused problematic query plans including those with nested loop joins and long execution times.
Better estimation of result sizes for regular expressions with multiple prefixes.
Fix compilation issues in Rust projects that use the 2021 Rust edition. https://github.com/lalrpop/lalrpop/issues/650
Faster subgraph generation for subgraph queries with context. The previous implementation used an AQL query that got quite complex over time and was difficult to execute. The new implemenation directly implements the logic using iterators. It also sorts the nodes in the iterator by the order of the node in the text.

Added

Add edges to the special Ordering/annis/datasource-gap between the last and first token of context regions in subgraph when the returned context regions do not overlap. This allows sorting the context regions that belong to the same data source but are not connected by ordinary Ordering/annis/ edges.

- Rust
Published by thomaskrause over 3 years ago

graphannis - 2.2.2

Fixed

Use external sorting for match results to avoid out of memory errors for large results.

- Rust
Published by thomaskrause over 3 years ago

graphannis - 2.2.1

Fixed

For subgraph queries with segmentation, the left and right context was switched.

- Rust
Published by thomaskrause over 3 years ago

graphannis - 2.2.0

Added

Allow to configure the expected display order of (sub)-corpus meta annotations using the corpus_annotation_order field in the view configuration.

- Rust
Published by thomaskrause over 3 years ago

graphannis - 2.1.0

Added

Added anonymous_access_all_corpora to [auth] section of the web service configuration to allow read-only access to all corpora without any authentication. (#234)
Added documentation on how to change configure which group can access which corpora.
Document how to change the stack size of the CLI in case the import aborts with a stack related error. (#229)

Fixed

Near operator failed to work with segmentation constraint (#238)
Remove corpus storage lock file when exiting the application (#230)

- Rust
Published by thomaskrause over 3 years ago

graphannis - 2.0.6

Fixed

Fix subgraph generation when a segmentation was defined as context and the match includes a token that is not covered by a segmentation node (there are gaps in the segmentation). This is achieved by explicitly searching for all token between the first and last matched segment and produces a more complex query than before. Because token where missing from the graph, it could appear in ANNIS that there are gaps in the data and that the token order is incorrect.

- Rust
Published by thomaskrause over 3 years ago

graphannis - 2.0.5

Fixed

Fix timeout handling for queries with a lot of intermediate results, but less than 1000 matches. The timeout was only checked after each 1000th match. This caused troubles for queries with complex temporary results that where discarded. The query execution could take too long time and consume system resources in a multi-user system even when the timeout was configured. The fix is to push down the timeout check to the node search iterators.

- Rust
Published by thomaskrause almost 4 years ago

graphannis - 2.0.4

Fixed

Non-Existing operator did include invalid matches when searching for attributes without a value.

- Rust
Published by thomaskrause almost 4 years ago

graphannis - 2.0.3

Fixed

Fix import of resolver mappings and order configuration for older relANNIS versions.

- Rust
Published by thomaskrause almost 4 years ago

graphannis - 2.0.2

Fixed

Fix handling of corpora with special characters like umlauts or slashes when deleting corpora, getting the corpus configuration file, getting linked files (both the CorpusStorage API and the web service).
Expliclity escape / in node names so we can create hierarchical paths in node names. We already have this assumption at several places, but a corpus with slashes would create ambiguities. This also helps when creating linked files base on the node name. Also, escape all characters that are invalid file names on Windows, because the node name might be used as file name.

- Rust
Published by thomaskrause almost 4 years ago

graphannis - 2.0.1

Fixed

Web service API version prefix should still be /v1 and not /v2 because this API did not change and is still backward-compatible.

- Rust
Published by thomaskrause almost 4 years ago

graphannis - 2.0.0

While this is a new major release with breaking changes in the internal Rust and external C-API, graphANNIS 2.x can read all existing data directories. No data migration is needed, and you should be able to just run the updated binary file. Also, there are no changes in how AQL is interpreted.

Changed

Refactored the basic GraphStorage and AnnotationStorage APIs to handle errors. Previously, we used mostly main memory containers which had an API that could not fail. This was reflected in the GraphStorage and AnnotationStorage APIs, which directly returned the result or an iterator over the non-fallible results. With the addition of disk-based implementations, this API model was not possible to implement without using panics when repeated access to the disk failed. Some of the API that was changed was user visible when using the graphannis-core crate (and thus the C-API), so this release is not technically backwards-compatible. Adapting to the updated API should be restricted to handle the errors returned by the functions.
The changes to the error handling also affects the C-API. These following functions have now a ErrorList argument:
- annis_cs_list_node_annotations
- annis_cs_list_edge_annotations
- annis_cs_list_components_by_type
- annis_cs_unload
- annis_iter_nodeid_next
- annis_graph_annotations_for_node
- annis_graph_outgoing_edges
- annis_graph_annotations_for_edge
Renamed the Criterion-based benchmark CLI to bench_queries and synchronize its arguments to the current version of Criterion.

Fixed

More efficient node path extraction in count_extra function and when sorting the matches.
Avoid large memory consumption when importing GraphML files by resetting an internal buffer on each XML event.
Limit the number of disk maps for the GraphUpdate so there are less issues with large corpora where the maximum number of open files per process might be reached.
Performance improvements when importing large corpora in disk-based mode. This optimizes the DiskMap to use a C0 (normal in memory BTree), a C1 (on disk BTree) and a C2 map when serialized to disk. On compacting, the entries are only written to C1 in O(n*log(n)). Before, multiple on disk maps might need to be merged, which had a much worse complexity. The C1 file uses the transient-btree-index crate.
Trim mapping entries when importing relANNIS resolver files (#222).
Fixed schema errors in the Webservice OpenAPI file.

- Rust
Published by thomaskrause almost 4 years ago

graphannis - 1.5.0

Fixed

RelANNIS version 3.3 files with segmentation might also have a missing "span" column. In case the "span" column is null, always attempt to reconstruct the actual value from the corresponding node annotation instead of failing directly.

Changed

Avoid unnecessary compacting of disk tables when collecting graph updates during import. This speeds up both the GraphML and the relANNIS importer and can also reduce the used main memory during import.
Use release optimization of some of the performance sensitive crates even for debug builds. This allows faster builds and debugging of our own code, while balancing performance.

- Rust
Published by thomaskrause about 4 years ago

graphannis - 1.4.1

Fixed

Avoid unnecessary memory allocation when checking if a node has outgoing edges in adjacency lists. This improves search for tokens because the Coverage components are typically adjacency lists, and we need to make sure the token nodes don't have any outgoing edges.
Fixed miscalculation of whitespace string capacity which could lead to memory allocation failed error.

- Rust
Published by thomaskrause about 4 years ago

graphannis - 1.4.0

Added

Added clear() method to the WriteableGraphStorage trait.

Fixed

Limit the used main memory cache per DiskTable by only using a disk block cache for the C1 table. Since we use a lot of disk-based maps during import of relANNIS files, the previous behavior could add up to > 1GB easily, wich amongst other issues caused #205 to happen. With this change, during relANNIS import the main memory usage should be limited to be less than 4GB, which seams more reasonable than the previous 20+GB
Reduce memory footprint during import when corpus contains a lot of escaped strings (as in #205)
Avoid creating small fragmented main memory when importing corpora from relANNIS to help to fix #205

Changed

Improved overall import speed of relANNIS corpora and when applying graph updates

- Rust
Published by thomaskrause about 4 years ago

graphannis - 1.3.0

Added

The webservice endpoint /search/node-descriptions now returns wether a node in the query is optional or not.

- Rust
Published by thomaskrause over 4 years ago

graphannis - 1.2.2

Fixed

Queries with optional nodes with a smaller index than the last non-optional node could fail. If the execution nodes re-order the match result vector internally, the query node index is used to define the mapping. Unfortunately the largest index could be larger than the size of mappings, which used to be used to create the output vector. By allowing empty elements in the output vector and using the maximum value, we can still map the results properly.

- Rust
Published by thomaskrause over 4 years ago

graphannis - 1.2.1

Fixed

Don't allow optional operands for non-negated operators

- Rust
Published by thomaskrause over 4 years ago

graphannis - 1.2.0

Added

Added generic operator negation without existence assumption, if only one side of the negated operator is optional (#187).

- Rust
Published by thomaskrause over 4 years ago

graphannis - 1.1.0

Added

Added generic operator negation with existance assumption by adding ! before the binary operator (#186)

Changed

Compile releases on Ubuntu 18.04 instead of 16.04, which means the minimal GLIBC version is 2.27
Updated dependencies
Improved compile time by disabling some dependency features. This also removes some optional features from the command line parser (used in webservice and CLI binaries).
Don't use RIDGES corpus in search tests and fail search tests when corpus does not exist.

Fixed

Use the correct set-disk-based on command in the documentation for the CLI
Optimize node annotation storage and graph implementations when importing GraphML files

- Rust
Published by thomaskrause over 4 years ago

graphannis - 1.0.2

This release should not have any functional changes and only fixes issues in the GitHub Actions pipeline.

Fixed

Fix issue when deploying release artifacts on GitHub

- Rust
Published by thomaskrause over 4 years ago

graphannis - 1.0.1

Fixed

Assume that the annis::node_name annotation is unique when estimating match size. This should improve e.g. subgraph-queries, where the intermediate result sizes are now better estimated.

- Rust
Published by thomaskrause over 4 years ago

graphannis - 1.0.0

This is our first official stable release! :tada: Compared to 0.32.0, this only fixes a default value in the corpus configuration.

Changed

The default context sizes in the corpus configuration now include 0 (#181)

- Rust
Published by thomaskrause over 4 years ago

graphannis - 0.32.0

Added

C-API now implements exporting corpora

Changed

Renamed (public) function export_corpus_zip in CorpusStorage to export_to_zip to align with the other export function name.

- Rust
Published by thomaskrause over 4 years ago

graphannis - 0.31.2

Fixed

Synchronize REST API error output for bad AQL requests with the OpenAPI specification.

- Rust
Published by thomaskrause almost 5 years ago

graphannis - 0.31.1

Fixed

Fix compilation issues in interaction with lalrpop v0.19.5

- Rust
Published by thomaskrause almost 5 years ago

graphannis - 0.31.0

Changed

Using the new SmallVec-based MatchGroup type instead of Vec<Match>.
The FixedMaxMemory CacheStrategy now uses Megabytes instead of bytes.
The graphannis and core crates now use their own error type instead of the one provided by the anyhow crate.
Bundle commonly used search query parameters in SearchQuery struct.
Query execution methods now have an optional timeout after which an query is aborted.
Annotation keys and values in the AnnoKey and Annotation structs now use inlined strings from the smartstrings crate.

Removed

Replaced the update_statistics function in CorpusStorage with the more general reoptimize_implementation function. The new function is available via the re-optimize command in the CLI.

Added

The webservice configuration now allows to configure the size of the in-memory corpus cache.
There can be multiple --cmd arguments for the CLI, which are executed in the order they are given.

Fixed

Importing a relANNIS corpus could fail because the integer would wrap around from negative to a large value when calculating the tok-whitespace-after annotation value. This large value would then be used to allocate memory, which will fail.
Adding \$ to the escaped input sequence in the relANNIS import, fixing issues with some old SFB 632 corpora
Unbound near-by-operator (^*) was not limited to 50 in quirks mode
Workaround for duplicated document names when importing invalid relANNIS corpora
Corpus names with non-ASCII characters where not listed with their decoded name
Fix memory consumption of AQL parser in repeated calls (like the webservice).
Limit the memory which is reserved for an internal result vector to avoid out-of-memory errors when the estimation is wrong.

- Rust
Published by thomaskrause about 5 years ago

graphannis - 0.30.0

Changed

JWT secret configuration now supports RS256 in addition to HS256. This enables support of applications which use Keycloak as their identity provider, since they only provide public keys.
JWT tokens now should have the roles field instead of using the admin field. This enhances compatibility with Keycloak.
Pull requests are now checked with the Clippy static code analyis tool
Updated Actix Web dependency for webservice to version 3

Removed

The REST API does not act as an identity provider anymore and the /local-login endpoint has been removed

- Rust
Published by thomaskrause over 5 years ago

graphannis - 0.29.2

Fixed

Travis did add the webservice executables to the release
cargo release did not release all crates

Changed

Node IDs in matches don't have the salt:/ prefix anymore

Added

Add non-tokenized primary text segments as special labels "tok-whitespace-before" and "tok-whitespace-after" to the existing token when importing from relANNIS. This allows to re-construct the original relANNIS primary text by iterating over all token in order and be prepending or append these labels to the token values.
Add a REST based web-service replacing the legacy annis-service

- Rust
Published by thomaskrause over 5 years ago

graphannis - 0.28.0

Addded

Copy and link files from the ExtData folder when importing relANNIS.
Map resolver_vis_map.annis, example_queries.annis and corpus.properties from relANNIS files to a new unified corpus configuration stored as TOML file. This corpus configuration is also exported to GraphML.
Export and import ZIP files containing multiple corpora.

Removed

Removed Brotli support: use the ZIP file export instead

- Rust
Published by thomaskrause over 5 years ago

graphannis - 0.27.0

Changed

Backward incompatible: Return opaque anyhow Error type in all functions instead of our own enum. The new Error type also implements std::error::Error and is equivalent to using Box<dyn std:error::Error>.
Upgraded parser generator lalrpop to version 0.18.x

Added

Disk-based implementation of an adjacency list is used when a corpus is configured to be prefer disk over memory.
Ability to export and import GraphML files. This follows the Neo4j dialect of GraphML. It is also possible to compress the GraphML files with Brotli.

Fixed

The dense adjacency list implementation did not implement the source_nodes function properly

- Rust
Published by thomaskrause over 5 years ago

graphannis - 0.26.0

Removed

Removed the unintentionally public size_of_cached function of Graph from the API.

Changed

Backward incompatible: the AnnotationStorage and WriteableGraphStorage interfaces have been adjusted to return Result types for mutable functions. This change is necessary because on-disk annotation storage implementations might fail, and we want to handle it when modifying the annotation storage.
Improved main memory usage when importing relANNIS files. The implementation now uses temporary disk-based maps instead of memory-intensive maps. This change also affects the GraphUpdate class, which is now disk-based, too.

Added

Added disk-based annotation storage for nodes as an alternative to the memory-only variant. On the console, use use_disk <on|off> to set if newly imported corpora prefer disk-based annotation storage. disk_based parameters are also added to the various "import relANNIS" API functions.

Fixed

Reconstruct coverage edges with the correct component, if the actual edges are omitted in rank.annis, but the ones without a parent node are still present. #125

- Rust
Published by thomaskrause almost 6 years ago

graphannis - 0.25.1

Fixed

Inverted sort order did not reverse the corpus name list for multiple corpora
Workaround for docs.rs problems seem to have caused other problems and graphANNIS was not recognized as library

- Rust
Published by thomaskrause about 6 years ago

graphannis - 0.25.0

Changed

Backward incompatible: the several search functions (find, count, etc.) not take several corpus names as argument. This is especially important for find, where the implementation can be optimized to correctly skip over a given offset using the internal state. Such an optimization is impossible from outside when calling the API and not having access to the iterator.

Fixed

Don't assume inverse operator has the same cost when fan-out is too different. Subgraph queries could be very slow for corpora with large documents due to an estimation error from this assumption the @ operator.

- Rust
Published by thomaskrause about 6 years ago

graphannis - 0.24.0

Changed

The annotation storage is now a complete interface which provides all functions necessary to write and read annotations. To make this less dependent on the current implementation of the in-memory annotation storage, the annotation key symbol (an integer) has been removed. This annotation key symbol has been used in the Match class as well, which is now using an Arc<AnnoKey> instead. The AnnoKey contains the fully qualified name as String. Several functions of the annotation storage that used to have String parameters now take &str and resulting string values are now returned as Cow<str>. The latter change is also meant to enable more flexible implementations, that can choose to allocate new strings (e.g. from disk) or return references to existing memory locations.
The Graph uses a boxed instance of the general AnnotationStorage trait. Before, this was an Arc to the specific implementation, which made it possible to simply clone the node annotation storage. Now, references to it must be used, e.g. in the operators. This changes a lot of things in the BinaryOperator trait, like the signature of get_inverse_operator() and the filter functions that are used as conditions for the node search (these need an argument to the node annotation storage now)
Graph does not implement the AnnotationStorage<NodeID> trait anymore, but provides a getter to reference its field.
Data source nodes are now included when querying for a subgraph with context. This is needed for parallel text support in ANNIS 4.

- Rust
Published by thomaskrause over 6 years ago

graphannis - 0.23.1

Fixed

Deploying release artifacts by CI was broken due to invalid condition

- Rust
Published by thomaskrause over 6 years ago

graphannis - 0.23.0

Added

Subgraph queries can now define the context using ordering relation names (segmentation) instead of the default context in tokens. This changes the function signature of the subgraph(...) function.

Changed

For performance and stylistic reasons, the GraphStorage API has been changed to accept integer node IDs instead of references to integers.
Windows DLL in releases is now created by Travis CI instead of Appveyor

- Rust
Published by thomaskrause over 6 years ago

graphannis - 0.22.0

Fixed

Windows DLL generated by CI was empty

Changed

Updated several dependencies
Organize documentation topics in sub-folders. Previously, mdbook did not updated the images on these sites on the print.html. Since mdbook >0.3.1 this is fixed and we can use the better layout.

- Rust
Published by thomaskrause over 6 years ago

graphannis - 0.21.0

Changed

C API now has an argument to return error messages when creating a corpus storage

Added

C API now also allows to unload a corpus from the cache manually

Fixed

CorpusStorageManager: Escape the corpus name when writing it to its disk location to support e.g. corpora with slash in their name.
Quirks mode: sort matches by reversed document path (document first)
Node names/paths where double encoded both when importing them and when executing the "find" function
Quirks mode: use default collation of Rust for corpora imported from relANNIS 3.3

- Rust
Published by thomaskrause over 6 years ago

graphannis - 0.20.0

Deprecated

meta:: queries are now deprecated and can only be used in quirks mode

Fixed

Output annotations with the namespace "annis" in find function
Quirks mode: add additional identity joins in the order as the nodes are defined in the query
Encode ",", " " and ":" in the Salt ID output of the find(...) function
Sort longer vectors ("more specific") before shorter ones in find(...) output

- Rust
Published by thomaskrause almost 7 years ago

graphannis - 0.19.4

Changed

Optimize parallel nested loop join by performing less copy operations

Fixed

Quirks mode: meta-data nodes are not part of the match result anymore

- Rust
Published by thomaskrause almost 7 years ago

graphannis - 0.19.2

Fixed

Escape corpus and document paths with percent encoding when importing them from relANNIS
Use locale aware sorting of the results in quirks mode (which depends on the system graphANNIS is executed on)
CLI did not allow to turn quirks mode off once activated

- Rust
Published by thomaskrause almost 7 years ago

graphannis - 0.19.1

Added

DOI on Zenodo to cite the Software itself

- Rust
Published by thomaskrause almost 7 years ago

graphannis - 0.19.0

Added

Utility function node_names_from_match for getting the node identifiers from the matches
Tutorial for Python, Java and Rust on how to embedd graphANNIS in other programs
Citation File Format (https://citation-file-format.github.io/) meta-data

Changed

Renamed the "PartOfSubcorpus" component type to more general "PartOf"
relANNIS import now takes the sub-corpus structure into account
Quirks mode now also emulates the component search normalization behavior. Search nodes that where part of multiple dominance/pointing relation joins where duplicated and joined with the identity operator to work around the issue that nodes of different components could not be joined in relANNIS. This leads to additional output nodes in the find(...) query. See also the original JavaDoc for an explanation.
The error_chain crate is no longer used for error reporting, instead a custom Error representation is used

Fixed

"NULL" annotation namespaces where imported as "NULL" in relANNIS import
Result ordering for "find(...)" function was not correct if token helper components where not loaded

- Rust
Published by thomaskrause almost 7 years ago