pathogenseq

Pathogen whole genome sequence (WGS) data analysis pipeline

https://github.com/xiaoli-dong/pathogenseq

Science Score: 57.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 10 DOI reference(s) in README
  • Academic publication links
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (10.8%) to scientific vocabulary

Keywords

amr assembly capsular-typing emm-typing illumina mlst nanopore ngs pathogen plasmid serotyping taxonomy virulome
Last synced: 6 months ago · JSON representation ·

Repository

Pathogen whole genome sequence (WGS) data analysis pipeline

Basic Info
  • Host: GitHub
  • Owner: xiaoli-dong
  • License: mit
  • Language: Nextflow
  • Default Branch: main
  • Homepage:
  • Size: 3.62 MB
Statistics
  • Stars: 2
  • Watchers: 1
  • Forks: 1
  • Open Issues: 2
  • Releases: 8
Topics
amr assembly capsular-typing emm-typing illumina mlst nanopore ngs pathogen plasmid serotyping taxonomy virulome
Created over 2 years ago · Last pushed 10 months ago
Metadata Files
Readme Changelog Contributing License Code of conduct Citation

README.md

Pathogenseq

Pathogenseq is a pathogen whole genome sequence (WGS) data analysis pipeline, which inclues sequence quality checking, quality control, taxonomy assignment, assembly, assembly quality assessment, assembled contig annotation, mlst, antimicrobial resistance, virulome, plasmid, and taxonomy prediciton. Built with Nextflow,it enables portable and scalable execution across a range of computing environments. The use of Docker and Singularity containers ensures easy installation and highly reproducible results.

Pipeline summary

By default, the pipeline supports both short and long reads:

  • Sequence quality check and quality control
    • Short reads
    • Short Illumina reads quality checks (FastQC)
    • Short read quality control (BBDuk | fastp)
    • Short read statistics (seqkit stats)
    • Taxonomic assignment and contamination check (Kraken2)
    • Long reads
    • Nanopore long read quality checks (NanoPlot)
    • Nanopore long read adapter trimming (Porechop)
    • Nanopore long read quality and length filter (chopper)
    • Nanopore long read statistics (seqkit stats)
  • Assembly
    • Short read assembly with user choice of the assemblers (Spades | Skesa | Unicycler | megahit | shovill
    • Long read assembly is following the steps below:
    • Nanopore long read de novo assembly (Flye)
    • Circular Flye contigs are rotated to start in the center of the contig (in-house perl script)
    • Long read polishing and consensus generating (Medaka)
    • Short-read polishing while short reads are available:
  • Assembly quality check
    • Rapid assessment of genome assembly completeness and contamination using machine learning approach (CheckM2)
    • Rapid taxonomic identification of microbial pathogens from assemblies and also the assement of the sample relatedness (gambit)
    • Assembly depth prediciton and reproting using (Minimap2, samtools and in-house sripts)
  • Genome annotation
    • Gene prediction and annotation (Bakta)
    • Identify acquired antimicrobial resistance genes in the assembled contigs (AMRFinderPlus)
    • Scan contig files against traditional PubMLST typing schemes (mlst)
    • Typing and reconstruction of plasmid sequences from assembled contigs (MOB-suite)
    • Virulome detection (abricate with VFDB)
  • Tools for special organism
    • Mycobacterium tuberculosis lineage and drug resistance prediciton based on quality controlled illumina and nanopore reads using (TB-Profiler)
    • Streptococcus pneumoniae capsular typeing based on quality controlled illumina reads using (PneumoCaT)
    • Streptococcus pyogenes emm-typing based on assembled contigs using (emmtyper)
    • Streptococcus agalactiae, Group B Streptococcus, serotyping based on assembled contigs using (GBS-SBG)
  • Summarize and generate the analysis report, software version control reports

Pipeline reference databases

Quick Start

If you are new to Nextflow and nf-core, please refer to this page on how to set-up Nextflow. Make sure to test your setup with -profile test before running the workflow on actual data.

Check workflow options

You can clone or download the pathogenseq from github to local computer or you can directly run the pipeline from github. To check the pipeline command line options:

```{r df-drop-ok, class.source="bg-success"}

running directly from github without downloading or cloning

nextflow run xiaoli-dong/pathogenseq -r revision_number(e.g:8657a20) --help

```

Prepare required samplesheet input

The pathogenseq pipeline requires user to provide a csv format samplesheet, which contains the sequenence information for each sample, as input. See below for what the samplesheet looks like:

samplesheet.csv

sample,fastq_1,fastq_2,long_fastq,basecaller_mode sample1,shortreads_1.fastq.gz,shortreads_2.fastq.gz,longreads.fastq.gz,r1041_e82_400bps_hac_v4.2.0 sample2,shortreads.fastq,NA,longreads.fastq.gz,r1041_e82_400bps_sup_v4.2.0 sample3,NA,NA,longreads.fastq.gz,NA sample4,shortreads_1.fastq.gz,shortreads_2.fastq.gz,NA The csv format samplesheet has five required columns: * The first row of the csv file is the header describing the columns * Each row represents a unique sample to be processed, the first colum is the unique sample id * When the information for a particular column is missing, please fill the column with "NA" * The "fastq1" and "fastq2" columns are reserved for supplying the short sequence files * "basecallermode" is for user to provide the Nanopore basecalling model, for example: r1041e82400bpshacv4.2.0. The availble models for medakaconsensus from medaka (v1.8.0) are listed at bewlow:

medaka model, (default: r1041e82400bpssupv4.2.0). Choices: r103fastg507 r103hacg507 r103minhighg345 r103minhighg360 r103promhighg360 r103supg507 r1041e82260bpsfastg632 r1041e82260bpshacg632 r1041e82260bpshacv4.0.0 r1041e82260bpshacv4.1.0 r1041e82260bpssupg632 r1041e82260bpssupv4.0.0 r1041e82260bpssupv4.1.0 r1041e82400bpsfastg615 r1041e82400bpsfastg632 r1041e82400bpshacg615 r1041e82400bpshacg632 r1041e82400bpshacv4.0.0 r1041e82400bpshacv4.1.0 r1041e82400bpshacv4.2.0 r1041e82400bpssupg615 r1041e82400bpssupv4.0.0 r1041e82400bpssupv4.1.0 r1041e82400bpssupv4.2.0 r104e81fastg5015 r104e81hacg5015 r104e81supg5015 r104e81supg610 r10minhighg303 r10minhighg340 r941e81fastg514 r941e81hacg514 r941e81supg514 r941minfastg303 r941minfastg507 r941minhacg507 r941minhighg303 r941minhighg330 r941minhighg340rle r941minhighg344 r941minhighg351 r941minhighg360 r941minsupg507 r941promfastg303 r941promfastg507 r941promhacg507 r941promhighg303 r941promhighg330 r941promhighg344 r941promhighg360 r941promhighg4011 r941promsupg507 r941supplant_g610

Run the pipeline:

```

Runing the pipeline from remote github

nextflow run xiaoli-dong/pathogenseq \ -r sevencharactergithubrevisionnumber (e.g: 8657a20) --input samplesheet.csv \ -profile \ --outdir results \ --platform

run the pipeline with a local clone

nextflow run yourpathto/pathogenseq/main.nf \ --input samplesheet.csv \ -profile \ --outdir results \ --platform

an example command to launch the pipeline from local computer and run it with singularity configraton profile.

nextflow run yourpathto/pathogenseq/main.nf \ -profile singularity \ --input samplesheet.csv \ --outdir results_singularity \ --platform

an example commnad to launch the pipeline from a local clone and run it with conda configraton profile.

nextflow run yourpathto/pathogenseq/main.nf \ -profile conda \ --input samplesheet.csv \ --outdir results_conda \ --platform ```

  • Notes: Please provide pipeline parameters via the CLI or Nextflow -params-file option. Custom config files including those provided by the -c Nextflow option can be used to provide any configuration except for parameters; see docs.

```

an example command to launch the pipeline from local computer and run it with singularity and a local configraton profile.

nextflow run yourpathto/pathogenseq/main.nf \ -profile singularity \ -c my.config \ --outdir resultssingularity \ --platform \ --illuminareads_assembler shovill

content of the my.config file

params { configprofilename = 'myconfig' configprofiledescription = 'this is a demo'

// resource configuration
max_cpus   = 8
max_memory = '36.GB'
max_time   = '12.h'
// Input data
input = './samplesheet.csv'

}

```

Pipeline output

Fig 1. Pathogenseq output top level layout

Fig 2. Pathogenseq pipeline_info directory layout

Fig 3. Pathogenseq report directory layout

From the above screenshots, you can see:

  • Results of each sample included in the analysis go to its own directry.
  • pipeline_info directory contains software version control information, nextflow workflow report, resource usage report, task report.
  • report directory contains the summary files of each analysis task
Example pathogenseq data analysis outputs for a particalur sample

Credits

pathogenseq was originally written by Xiaoli Dong. Extensive support was provided from other co-authors on the scientific or technical input required for the pipeline: * Dr. Matthew Croxen * Dr. Tarah Lynch

Notes

with conda, fastqc 0.11.9--0 is not working. I need to change the version to 0.12.1.

mobsuite is not working with 3.0.3 in conda, I need to change the mobsuite version to 3.1.4

Reference

Owner

  • Name: Xiaoli Dong
  • Login: xiaoli-dong
  • Kind: user
  • Location: Calgary
  • Company: Public Health Laboratory - South, Alberta Precision Laboratories

Bioinformatician

Citation (CITATIONS.md)

# nf-core/pathogenseq: Citations

## [nf-core](https://pubmed.ncbi.nlm.nih.gov/32055031/)

> Ewels PA, Peltzer A, Fillinger S, Patel H, Alneberg J, Wilm A, Garcia MU, Di Tommaso P, Nahnsen S. The nf-core framework for community-curated bioinformatics pipelines. Nat Biotechnol. 2020 Mar;38(3):276-278. doi: 10.1038/s41587-020-0439-x. PubMed PMID: 32055031.

## [Nextflow](https://pubmed.ncbi.nlm.nih.gov/28398311/)

> Di Tommaso P, Chatzou M, Floden EW, Barja PP, Palumbo E, Notredame C. Nextflow enables reproducible computational workflows. Nat Biotechnol. 2017 Apr 11;35(4):316-319. doi: 10.1038/nbt.3820. PubMed PMID: 28398311.

## Pipeline tools

- [FastQC](https://www.bioinformatics.babraham.ac.uk/projects/fastqc/)

- [MultiQC](https://pubmed.ncbi.nlm.nih.gov/27312411/)
  > Ewels P, Magnusson M, Lundin S, Käller M. MultiQC: summarize analysis results for multiple tools and samples in a single report. Bioinformatics. 2016 Oct 1;32(19):3047-8. doi: 10.1093/bioinformatics/btw354. Epub 2016 Jun 16. PubMed PMID: 27312411; PubMed Central PMCID: PMC5039924.

## Software packaging/containerisation tools

- [Anaconda](https://anaconda.com)

  > Anaconda Software Distribution. Computer software. Vers. 2-2.4.0. Anaconda, Nov. 2016. Web.

- [Bioconda](https://pubmed.ncbi.nlm.nih.gov/29967506/)

  > Grüning B, Dale R, Sjödin A, Chapman BA, Rowe J, Tomkins-Tinch CH, Valieris R, Köster J; Bioconda Team. Bioconda: sustainable and comprehensive software distribution for the life sciences. Nat Methods. 2018 Jul;15(7):475-476. doi: 10.1038/s41592-018-0046-7. PubMed PMID: 29967506.

- [BioContainers](https://pubmed.ncbi.nlm.nih.gov/28379341/)

  > da Veiga Leprevost F, Grüning B, Aflitos SA, Röst HL, Uszkoreit J, Barsnes H, Vaudel M, Moreno P, Gatto L, Weber J, Bai M, Jimenez RC, Sachsenberg T, Pfeuffer J, Alvarez RV, Griss J, Nesvizhskii AI, Perez-Riverol Y. BioContainers: an open-source and community-driven framework for software standardization. Bioinformatics. 2017 Aug 15;33(16):2580-2582. doi: 10.1093/bioinformatics/btx192. PubMed PMID: 28379341; PubMed Central PMCID: PMC5870671.

- [Docker](https://dl.acm.org/doi/10.5555/2600239.2600241)

- [Singularity](https://pubmed.ncbi.nlm.nih.gov/28494014/)
  > Kurtzer GM, Sochat V, Bauer MW. Singularity: Scientific containers for mobility of compute. PLoS One. 2017 May 11;12(5):e0177459. doi: 10.1371/journal.pone.0177459. eCollection 2017. PubMed PMID: 28494014; PubMed Central PMCID: PMC5426675.

GitHub Events

Total
  • Release event: 2
  • Watch event: 5
  • Issue comment event: 1
  • Push event: 15
  • Create event: 2
Last Year
  • Release event: 2
  • Watch event: 5
  • Issue comment event: 1
  • Push event: 15
  • Create event: 2

Committers

Last synced: over 1 year ago

All Time
  • Total Commits: 154
  • Total Committers: 5
  • Avg Commits per committer: 30.8
  • Development Distribution Score (DDS): 0.344
Past Year
  • Commits: 154
  • Committers: 5
  • Avg Commits per committer: 30.8
  • Development Distribution Score (DDS): 0.344
Top Committers
Name Email Commits
Xiaoli Dong 5****g 101
xiaoli-dong x****d@g****m 26
Xiaoli Dong - Laboratory Scientist I x****g@u****a 25
Xiaoli Dong - Laboratory Scientist I x****g@u****a 1
xiaolidong x****g@u****2 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 2
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 2
  • Total pull request authors: 0
  • Average comments per issue: 1.5
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 1
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 1
  • Pull request authors: 0
  • Average comments per issue: 2.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • aslangabriel (1)
Pull Request Authors
Top Labels
Issue Labels
bug (1)
Pull Request Labels

Dependencies

.github/workflows/awsfulltest.yml actions
  • actions/upload-artifact v3 composite
  • seqeralabs/action-tower-launch v1 composite
.github/workflows/awstest.yml actions
  • actions/upload-artifact v3 composite
  • seqeralabs/action-tower-launch v1 composite
.github/workflows/branch.yml actions
  • mshick/add-pr-comment v1 composite
.github/workflows/ci.yml actions
  • actions/checkout v3 composite
  • nf-core/setup-nextflow v1 composite
.github/workflows/clean-up.yml actions
  • actions/stale v7 composite
.github/workflows/fix-linting.yml actions
  • actions/checkout v3 composite
  • actions/setup-node v3 composite
.github/workflows/linting.yml actions
  • actions/checkout v3 composite
  • actions/setup-node v3 composite
  • actions/setup-python v4 composite
  • actions/upload-artifact v3 composite
  • mshick/add-pr-comment v1 composite
  • nf-core/setup-nextflow v1 composite
  • psf/black stable composite
.github/workflows/linting_comment.yml actions
  • dawidd6/action-download-artifact v2 composite
  • marocchino/sticky-pull-request-comment v2 composite
modules/nf-core/abricate/run/meta.yml cpan
modules/nf-core/abricate/summary/meta.yml cpan
modules/nf-core/amrfinderplus/update/meta.yml cpan
modules/nf-core/bakta/bakta/meta.yml cpan
modules/nf-core/bbmap/bbduk/meta.yml cpan
modules/nf-core/csvtk/concat/meta.yml cpan
modules/nf-core/custom/dumpsoftwareversions/meta.yml cpan
modules/nf-core/fastp/meta.yml cpan
modules/nf-core/fastqc/meta.yml cpan
modules/nf-core/flye/meta.yml cpan
modules/nf-core/kraken2/kraken2/meta.yml cpan
modules/nf-core/krakentools/combinekreports/meta.yml cpan
modules/nf-core/medaka/meta.yml cpan
modules/nf-core/megahit/meta.yml cpan
modules/nf-core/mlst/meta.yml cpan
modules/nf-core/nanoplot/meta.yml cpan
modules/nf-core/porechop/porechop/meta.yml cpan
modules/nf-core/samtools/index/meta.yml cpan
modules/nf-core/samtools/sort/meta.yml cpan
modules/nf-core/samtools/view/meta.yml cpan
modules/nf-core/spades/meta.yml cpan
modules/nf-core/unicycler/meta.yml cpan
pyproject.toml pypi
modules/local/medaka/meta.yml cpan
modules/nf-core/samtools/coverage/meta.yml cpan
modules/local/shovill/meta.yml cpan
modules/local/shovill/environment.yml conda
  • shovill 1.1.0.*
modules/local/bwamem2/index/meta.yml cpan
modules/local/bwamem2/mem/meta.yml cpan
modules/local/csvtk/add-header/meta.yml cpan
modules/local/csvtk/concat/meta.yml cpan
modules/local/emmtyper/meta.yml cpan
modules/local/fastp/meta.yml cpan
modules/local/pneumocat/meta.yml cpan
modules/local/tbprofiler/profile/meta.yml cpan
modules/nf-core/abritamr/run/meta.yml cpan
modules/nf-core/bwamem2/index/meta.yml cpan
modules/nf-core/bwamem2/mem/meta.yml cpan
modules/nf-core/emmtyper/meta.yml cpan
modules/local/bwamem2/index/environment.yml pypi
modules/local/bwamem2/mem/environment.yml pypi
modules/local/csvtk/add-header/environment.yml pypi
modules/local/emmtyper/environment.yml pypi
modules/local/pneumocat/environment.yml pypi
modules/local/tbprofiler/profile/environment.yml pypi
modules/nf-core/abritamr/run/environment.yml pypi
modules/nf-core/bwamem2/index/environment.yml pypi
modules/nf-core/bwamem2/mem/environment.yml pypi
modules/nf-core/emmtyper/environment.yml pypi
modules/nf-core/fastp/environment.yml pypi