pathling
Tools that make it easier to use FHIR® and clinical terminology within data analytics, built on Apache Spark.
Science Score: 49.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
✓DOI references
Found 2 DOI reference(s) in README -
○Academic publication links
-
✓Committers with academic emails
5 of 13 committers (38.5%) from academic institutions -
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (12.3%) to scientific vocabulary
Keywords
Keywords from Contributors
Repository
Tools that make it easier to use FHIR® and clinical terminology within data analytics, built on Apache Spark.
Basic Info
- Host: GitHub
- Owner: aehrc
- License: apache-2.0
- Language: Java
- Default Branch: main
- Homepage: https://pathling.csiro.au
- Size: 169 MB
Statistics
- Stars: 108
- Watchers: 12
- Forks: 15
- Open Issues: 74
- Releases: 39
Topics
Metadata Files
README.md
Pathling is a set of tools that make it easier to use FHIR® and clinical terminology within health data analytics. It is built on Apache Spark, and it implements the SQL on FHIR view specification and the Bulk Data Access implementation guide.
What can it do?
Query and transformation of FHIR data
FHIR R4 is the dominant standard for exchanging health data. It comes in both JSON or XML formats, and can contain over 140 different types of resources, such as Patient, Observation, Condition, Procedure, and many more.
Pathling is capable of reading all the different types of FHIR resources into a format suitable for data analysis tasks. This makes the following things possible:
- Creating SQL-friendly views from FHIR data
- Transforming data into other formats, such as CSV or Parquet
- Performing terminology queries against coded fields within the FHIR data
See Data in and out and Running queries for more information.
Terminology queries
Health data often contains codes from systems such as SNOMED CT, LOINC or ICD. These codes contain a great deal of information about diagnoses, procedures, observations and many other aspects of a patient's clinical record.
It is common to group these codes based upon their properties, relationships to other codes, or membership within a pre-defined set. Pathling can automate the task of calling out to a FHIR terminology server to ask questions about the codes within your data.
Examples of the types of questions that can be answered include:
- Is this SNOMED CT procedure code a type of endoscopy?
- Does this LOINC test result code have an analyte of bilirubin?
- Is this ICD-10 code within the pre-defined list of codes within my cohort definition?
See Terminology functions for more information.
What happened to the server and some of the query functionality?
As part of the version 8 release, we took the decision to significantly change the focus and scope of Pathling with the purpose of rebuilding it around the SQL on FHIR specification.
This will mean that the server implementation will be temporarily removed. It will also mean that the scope of FHIRPath functions will be temporarily reduced to the minimal FHIRPath subset defined within the SQL on FHIR Shareable View Definition specification (with the exception of the terminology functions).
We have released this functionality as version 8, and we have spawned three work streams to build upon this new foundation:
- Implementation of a new server focused upon the Bulk Data Access IG and the draft SQL on FHIR server API. This server will not include the aggregate or extract operations.
- Expansion of the scope of the FHIRPath implementation to achieve full or close to full coverage of the FHIRPath spec.
- Implementation of Parquet on FHIR as the new schema for lossless persistence of FHIR data for analytics.
We think that this is the best way to align Pathling to user needs, and also to make sure that the code base is sustainable going forwards.
If you are a current user of the server, aggregate or extract operations, please continue using the v7.x series. We are happy to continue maintaining and accepting contributions to this series as requested by users, but will be focusing our enhancement efforts on v8.
Artifact signing
Published Maven artifacts are signed with the following GPG key:
- Key ID:
ED48678D - Fingerprint:
F814 751C 64B5 F5E7 08A8 C73F C3C6 291F ED48 678D - User ID:
Pathling Developers <pathling@csiro.au>
The public key is available on keys.openpgp.org.
Licensing and attribution
Pathling is copyright 2018-2025, Commonwealth Scientific and Industrial Research Organisation (CSIRO) ABN 41 687 119 230. Licensed under the Apache License, version 2.0.
This means that you are free to use, modify and redistribute the software as you wish, even for commercial purposes.
If you use this software in your research, please consider citing our paper, Pathling: analytics on FHIR.
Pathling is experimental software, use it at your own risk! You can get a full description of the current set of known issues here.
Owner
- Name: The Australian e-Health Research Centre
- Login: aehrc
- Kind: organization
- Website: https://aehrc.com
- Twitter: ehealthresearch
- Repositories: 101
- Profile: https://github.com/aehrc
The Australian e-Health Research Centre (AEHRC) is CSIRO’s digital health research program.
GitHub Events
Total
- Create event: 250
- Release event: 4
- Issues event: 178
- Watch event: 17
- Delete event: 332
- Issue comment event: 434
- Member event: 1
- Push event: 470
- Pull request review event: 56
- Pull request review comment event: 39
- Pull request event: 564
- Fork event: 3
Last Year
- Create event: 250
- Release event: 4
- Issues event: 178
- Watch event: 17
- Delete event: 332
- Issue comment event: 434
- Member event: 1
- Push event: 470
- Pull request review event: 56
- Pull request review comment event: 39
- Pull request event: 564
- Fork event: 3
Committers
Last synced: 9 months ago
Top Committers
| Name | Commits | |
|---|---|---|
| John Grimes | J****s@c****u | 2,221 |
| Piotr Szul | p****l@c****u | 486 |
| dependabot[bot] | 4****] | 214 |
| dependabot-preview[bot] | 2****] | 68 |
| Sean Fong | y****g@g****m | 14 |
| Burgess, Mark (H&B, Black Mountain) | M****s@c****u | 13 |
| Lorenz Kapsner | l****r@u****e | 4 |
| Jens Kristian Villadsen | j****n@g****m | 4 |
| chgl | c****l | 3 |
| Alejandro Metke | a****e@c****u | 3 |
| Kai Kewley | k****y@g****m | 2 |
| dionmcm | d****e@g****m | 1 |
| Mark Burgess | m****s@c****u | 1 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: 6 months ago
All Time
- Total issues: 193
- Total pull requests: 1,385
- Average time to close issues: 11 months
- Average time to close pull requests: about 1 month
- Total issue authors: 15
- Total pull request authors: 6
- Average comments per issue: 0.77
- Average comments per pull request: 0.79
- Merged pull requests: 94
- Bot issues: 1
- Bot pull requests: 1,263
Past Year
- Issues: 132
- Pull requests: 526
- Average time to close issues: 3 months
- Average time to close pull requests: 12 days
- Issue authors: 7
- Pull request authors: 5
- Average comments per issue: 0.35
- Average comments per pull request: 0.7
- Merged pull requests: 71
- Bot issues: 0
- Bot pull requests: 439
Top Authors
Issue Authors
- johngrimes (122)
- piotrszul (51)
- chgl (5)
- lakime (2)
- liquid36 (2)
- MartinBernstorff (2)
- cyrilzakka (1)
- paulolaup (1)
- yehtunkhine (1)
- jkiddo (1)
- sentry-io[bot] (1)
- fhnaumann (1)
- bwalsh (1)
- brucosper (1)
- alejosv (1)
Pull Request Authors
- dependabot[bot] (1,263)
- piotrszul (82)
- johngrimes (35)
- jkiddo (3)
- chgl (1)
- fhnaumann (1)
Top Labels
Issue Labels
Pull Request Labels
Packages
- Total packages: 14
-
Total downloads:
- npm 26 last-month
- pypi 1,616 last-month
-
Total dependent packages: 22
(may contain duplicates) -
Total dependent repositories: 3
(may contain duplicates) - Total versions: 300
- Total maintainers: 1
pypi.org: pathling
Python API for Pathling
- Homepage: https://github.com/aehrc/pathling
- Documentation: https://pathling.readthedocs.io/
- License: Apache License, version 2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
Maintainers (1)
npmjs.org: pathling-client
Client library for the Pathling FHIR API.
- Homepage: https://github.com/aehrc/pathling/tree/master/lib/js#readme
- License: Apache-2.0
-
Latest release: 2.1.4
published 12 months ago
Rankings
Maintainers (1)
npmjs.org: pathling-import
A set of functions for performing bulk export from a FHIR server and importing to Pathling.
- Homepage: https://github.com/aehrc/pathling/tree/master/lib/import#readme
- License: Apache-2.0
-
Latest release: 2.2.6
published 12 months ago
Rankings
Maintainers (1)
repo1.maven.org: au.csiro.pathling:utilities
Utility functions used by different components of Pathling.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/utilities/
- License: Apache-2.0,Apache-2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
repo1.maven.org: au.csiro.pathling:terminology
Interact with a FHIR terminology server from Spark.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/terminology/
- License: Apache-2.0,Apache-2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
repo1.maven.org: au.csiro.pathling:encoders
Encoders for transforming FHIR data into Spark Datasets.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/encoders/
- License: Apache-2.0,Apache-2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
repo1.maven.org: au.csiro.pathling:library-api
An API that exposes Pathling functionality to language libraries.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/library-api/
- License: Apache-2.0,Apache-2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
repo1.maven.org: au.csiro.pathling:fhir-server
A server that exposes Pathling functionality through a FHIR API.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/fhir-server/
- License: Apache-2.0,Apache-2.0
-
Latest release: 7.2.0
published 12 months ago
Rankings
repo1.maven.org: au.csiro.pathling:pathling
A set of tools that make it easier to use FHIR® within data analytics, built on Apache Spark.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/pathling/
- License: Apache License, Version 2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
repo1.maven.org: au.csiro.pathling:python
A library for using Pathling with Python.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/python/
- License: Apache-2.0,Apache-2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
repo1.maven.org: au.csiro.pathling:r
A library for using Pathling with R.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/r/
- License: Apache-2.0,Apache-2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
repo1.maven.org: au.csiro.pathling:site
A website that contains documentation for Pathling.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/site/
- License: Apache-2.0,Apache-2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
repo1.maven.org: au.csiro.pathling:fhirpath
A library that can translate FHIRPath expressions into Spark queries.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/fhirpath/
- License: Apache-2.0,Apache-2.0
-
Latest release: 8.0.1
published 6 months ago
Rankings
repo1.maven.org: au.csiro.pathling:library-runtime
A Spark package that bundles the Pathling Library API and its runtime dependencies for use in applications and clusters.
- Homepage: https://pathling.csiro.au
- Documentation: https://appdoc.app/artifact/au.csiro.pathling/library-runtime/
- License: Apache License, Version 2.0
-
Latest release: 8.0.1
published 6 months ago