methylseq

Methylation (Bisulfite-Sequencing) analysis pipeline using Bismark or bwa-meth + MethylDackel

https://github.com/nf-core/methylseq

Science Score: 67.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 10 DOI reference(s) in README
  • Academic publication links
  • Committers with academic emails
    4 of 31 committers (12.9%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (10.4%) to scientific vocabulary

Keywords

bisulfite-sequencing dna-methylation em-seq epigenome epigenomics methyl-seq nextflow nf-core pbat pipeline rrbs workflow

Keywords from Contributors

bioinformatics metagenomics pipelines workflows rna rna-seq dsl2 nf-test illumina singularity-containers
Last synced: 6 months ago · JSON representation ·

Repository

Methylation (Bisulfite-Sequencing) analysis pipeline using Bismark or bwa-meth + MethylDackel

Basic Info
  • Host: GitHub
  • Owner: nf-core
  • License: mit
  • Language: Nextflow
  • Default Branch: master
  • Homepage: https://nf-co.re/methylseq
  • Size: 24.4 MB
Statistics
  • Stars: 169
  • Watchers: 166
  • Forks: 158
  • Open Issues: 27
  • Releases: 20
Topics
bisulfite-sequencing dna-methylation em-seq epigenome epigenomics methyl-seq nextflow nf-core pbat pipeline rrbs workflow
Created almost 8 years ago · Last pushed 7 months ago
Metadata Files
Readme Changelog Contributing License Code of conduct Citation Codeowners

README.md

nf-core/methylseq

GitHub Actions CI Status GitHub Actions Linting StatusAWS CICite with Zenodo nf-test

Nextflow nf-core template version run with conda run with docker run with singularity Launch on Seqera Platform

Get help on SlackFollow on BlueskyFollow on MastodonWatch on YouTube

Introduction

nf-core/methylseq is a bioinformatics analysis pipeline used for Methylation (Bisulfite) sequencing data. It pre-processes raw data from FastQ inputs, aligns the reads and performs extensive quality-control on the results.

nf-core/methylseq metro map

The pipeline is built using Nextflow, a workflow tool to run tasks across multiple compute infrastructures in a very portable manner. It uses Docker / Singularity / Podman / Charliecloud / Apptainer containers making installation trivial and results highly reproducible.

On release, automated continuous integration tests run the pipeline on a full-sized dataset on the AWS cloud infrastructure. This ensures that the pipeline runs on AWS, has sensible resource allocation defaults set to run on real-world datasets, and permits the persistent storage of results to benchmark between pipeline releases and other analysis sources.The results obtained from the full-sized test can be viewed on the nf-core website.

Read more about Bisulfite Sequencing & Three-Base Aligners used in this pipeline here

Pipeline Summary

The pipeline allows you to choose between running either Bismark or bwa-meth / MethylDackel.

Choose between workflows by using --aligner bismark (default, uses bowtie2 for alignment), --aligner bismark_hisat or --aligner bwameth. For higher performance, the pipeline can leverage the Parabricks implementation of bwa-meth (fq2bammeth), which implements the baseline tool bwa-meth in a performant method using fq2bam (BWA-MEM + GATK) as a backend for processing on GPU. To use this option, include the gpu profile along with --aligner bwameth.

Note: For faster CPU runs with BWA-Meth, enable the BWA-MEM2 algorithm using --use_mem2. The GPU pathway (Parabricks) requires -profile gpu and a container runtime (Docker, Singularity, or Podman); Conda/Mamba are not supported for the GPU module.

| Step | Bismark workflow | bwa-meth workflow | | -------------------------------------------- | ------------------------ | --------------------- | | Generate Reference Genome Index (optional) | Bismark | bwa-meth | | Merge re-sequenced FastQ files | cat | cat | | Raw data QC | FastQC | FastQC | | Adapter sequence trimming | Trim Galore! | Trim Galore! | | Align Reads | Bismark (bowtie2/hisat2) | bwa-meth | | Deduplicate Alignments | Bismark | Picard MarkDuplicates | | Extract methylation calls | Bismark | MethylDackel | | Sample report | Bismark | - | | Summary Report | Bismark | - | | Alignment QC | Qualimap (optional) | Qualimap (optional) | | Sample complexity | Preseq (optional) | Preseq (optional) | | Project Report | MultiQC | MultiQC |

Optional targeted sequencing analysis is available via --run_targeted_sequencing and --target_regions_file; see the usage documentation for details.

Usage

[!NOTE] If you are new to Nextflow and nf-core, please refer to this page on how to set-up Nextflow. Make sure to test your setup with -profile test before running the workflow on actual data.

First, prepare a samplesheet with your input data that looks as follows:

samplesheet.csv:

csv sample,fastq_1,fastq_2,genome SRR389222_sub1,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/SRR389222_sub1.fastq.gz,, SRR389222_sub2,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/SRR389222_sub2.fastq.gz,, SRR389222_sub3,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/SRR389222_sub3.fastq.gz,, Ecoli_10K_methylated,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/Ecoli_10K_methylated_R1.fastq.gz,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/Ecoli_10K_methylated_R2.fastq.gz,

Each row represents a fastq file (single-end) or a pair of fastq files (paired end).

Now, you can run the pipeline using default parameters as:

bash nextflow run nf-core/methylseq --input samplesheet.csv --outdir <OUTDIR> --genome GRCh37 -profile <docker/singularity/podman/shifter/charliecloud/conda/institute>

[!WARNING] Please provide pipeline parameters via the CLI or Nextflow -params-file option. Custom config files including those provided by the -c Nextflow option can be used to provide any configuration except for parameters; see docs.

For more details and further functionality, please refer to the usage documentation and the parameter documentation.

Pipeline output

To see the results of an example test run with a full size dataset refer to the results tab on the nf-core website pipeline page. For more details about the output files and reports, please refer to the output documentation.

Credits

nf-core/methylseq was originally written by Phil Ewels (@ewels), and Sateesh Peri (@sateeshperi) is its active maintainer.

We thank the following people for their extensive assistance in the development of this pipeline:

Contributions and Support

If you would like to contribute to this pipeline, please see the contributing guidelines.

For further information or help, don't hesitate to get in touch on the Slack #methylseq channel (you can join with this invite).

Citations

If you use nf-core/methylseq for your analysis, please cite it using the following doi: 10.5281/zenodo.1343417

An extensive list of references for the tools used by the pipeline can be found in the CITATIONS.md file.

You can cite the nf-core publication as follows:

The nf-core framework for community-curated bioinformatics pipelines.

Philip Ewels, Alexander Peltzer, Sven Fillinger, Harshil Patel, Johannes Alneberg, Andreas Wilm, Maxime Ulysse Garcia, Paolo Di Tommaso & Sven Nahnsen.

Nat Biotechnol. 2020 Feb 13. doi: 10.1038/s41587-020-0439-x.

Owner

  • Name: nf-core
  • Login: nf-core
  • Kind: organization
  • Email: core@nf-co.re

A community effort to collect a curated set of analysis pipelines built using Nextflow.

Citation (CITATIONS.md)

# nf-core/methylseq: Citations

## [nf-core/methylseq](https://doi.org/10.5281/zenodo.1343417)

> Phil Ewels, Patrick Hüther, Rickard Hammarén, mashehu, Alexander Peltzer, nf-core bot, Sven F., Johannes Alneberg, Paolo Di Tommaso, Maxime U. Garcia, Colin Davenport, Alessia, Felix Krueger, Guillaume Devailly, Harshil Patel, Robert Syme, VIJAY, & Noirot Céline. (2021). nf-core/methylseq: nf-core/methylseq version 1.6.1 [Nauseous Serpent] (1.6.1). Zenodo. doi: [10.5281/zenodo.4744708](https://doi.org/10.5281/zenodo.4744708)

## [nf-core](https://pubmed.ncbi.nlm.nih.gov/32055031/)

> Ewels PA, Peltzer A, Fillinger S, Patel H, Alneberg J, Wilm A, Garcia MU, Di Tommaso P, Nahnsen S. The nf-core framework for community-curated bioinformatics pipelines. Nat Biotechnol. 2020 Mar;38(3):276-278. doi: 10.1038/s41587-020-0439-x. PubMed PMID: 32055031.

## [Nextflow](https://pubmed.ncbi.nlm.nih.gov/28398311/)

> Di Tommaso P, Chatzou M, Floden EW, Barja PP, Palumbo E, Notredame C. Nextflow enables reproducible computational workflows. Nat Biotechnol. 2017 Apr 11;35(4):316-319. doi: 10.1038/nbt.3820. PubMed PMID: 28398311.

## Pipeline tools

- [FastQC](https://www.bioinformatics.babraham.ac.uk/projects/fastqc/)

  > Andrews, S. (2010). FastQC: A Quality Control Tool for High Throughput Sequence Data [Online].

- [MultiQC](https://pubmed.ncbi.nlm.nih.gov/27312411/)

  > Ewels P, Magnusson M, Lundin S, Käller M. MultiQC: summarize analysis results for multiple tools and samples in a single report. Bioinformatics. 2016 Oct 1;32(19):3047-8. doi: 10.1093/bioinformatics/btw354. Epub 2016 Jun 16. PubMed PMID: 27312411; PubMed Central PMCID: PMC5039924.

- [Trim Galore!](https://www.bioinformatics.babraham.ac.uk/projects/trim_galore/)

  > <https://www.bioinformatics.babraham.ac.uk/projects/trim_galore/>

  <!-- TODO https://github.com/FelixKrueger/TrimGalore/issues/25 -->
  <!-- https://zenodo.org/records/7598955 -->

- [Bismark](https://doi.org/10.1093/bioinformatics/btr167)

  > Felix Krueger, Simon R. Andrews, Bismark: a flexible aligner and methylation caller for Bisulfite-Seq applications, Bioinformatics, Volume 27, Issue 11, 1 June 2011, Pages 1571–1572, doi: [10.1093/bioinformatics/btr167](https://doi.org/10.1093/bioinformatics/btr167)

- [bwa-meth](https://arxiv.org/abs/1401.1129)

  > Pedersen, Brent S. and Eyring, Kenneth and De, Subhajyoti and Yang, Ivana V. and Schwartz, David A. Fast and accurate alignment of long bisulfite-seq reads, arXiv:1401.1129, doi: [10.48550/arXiv.1401.1129](https://doi.org/10.48550/arXiv.1401.1129)

- [Picard](http://broadinstitute.github.io/picard/)

  > Picard Tools, Broad Institute. <http://broadinstitute.github.io/picard/>

- [Qualimap](https://doi.org/10.1093/bioinformatics/btv566)

  > Konstantin Okonechnikov, Ana Conesa, Fernando García-Alcalde, Qualimap 2: advanced multi-sample quality control for high-throughput sequencing data, Bioinformatics, Volume 32, Issue 2, 15 January 2016, Pages 292–294, doi: [10.1093/bioinformatics/btv566](https://doi.org/10.1093/bioinformatics/btv566)

- [Preseq](https://doi.org/10.1038/nmeth.2375)

  > Daley, T., Smith, A. Predicting the molecular complexity of sequencing libraries. Nat Methods 10, 325–327 (2013). doi: [10.1038/nmeth.2375](https://doi.org/10.1038/nmeth.2375)

- [Samtools](https://doi.org/10.1093/gigascience/giab008)

  > Petr Danecek, James K Bonfield, Jennifer Liddle, John Marshall, Valeriu Ohan, Martin O Pollard, Andrew Whitwham, Thomas Keane, Shane A McCarthy, Robert M Davies, Heng Li, Twelve years of SAMtools and BCFtools, GigaScience, Volume 10, Issue 2, February 2021, giab008, doi: [10.1093/gigascience/giab008](https://doi.org/10.1093/gigascience/giab008)

- [Bedtools](https://doi.org/10.1093/bioinformatics/btq033)

  > Aaron R. Quinlan, Ira M. Hall, BEDTools: a flexible suite of utilities for comparing genomic features, Bioinformatics, Volume 26, Issue 6, March 2010, Pages 841–842, doi: [10.1093/bioinformatics/btq03](https://doi.org/10.1093/bioinformatics/btq033)

## Software packaging/containerisation tools

- [Anaconda](https://anaconda.com)

  > Anaconda Software Distribution. Computer software. Vers. 2-2.4.0. Anaconda, Nov. 2016. Web.

- [Bioconda](https://pubmed.ncbi.nlm.nih.gov/29967506/)

  > Grüning B, Dale R, Sjödin A, Chapman BA, Rowe J, Tomkins-Tinch CH, Valieris R, Köster J; Bioconda Team. Bioconda: sustainable and comprehensive software distribution for the life sciences. Nat Methods. 2018 Jul;15(7):475-476. doi: 10.1038/s41592-018-0046-7. PubMed PMID: 29967506.

- [BioContainers](https://pubmed.ncbi.nlm.nih.gov/28379341/)

  > da Veiga Leprevost F, Grüning B, Aflitos SA, Röst HL, Uszkoreit J, Barsnes H, Vaudel M, Moreno P, Gatto L, Weber J, Bai M, Jimenez RC, Sachsenberg T, Pfeuffer J, Alvarez RV, Griss J, Nesvizhskii AI, Perez-Riverol Y. BioContainers: an open-source and community-driven framework for software standardization. Bioinformatics. 2017 Aug 15;33(16):2580-2582. doi: 10.1093/bioinformatics/btx192. PubMed PMID: 28379341; PubMed Central PMCID: PMC5870671.

- [Docker](https://dl.acm.org/doi/10.5555/2600239.2600241)

  > Merkel, D. (2014). Docker: lightweight linux containers for consistent development and deployment. Linux Journal, 2014(239), 2. doi: 10.5555/2600239.2600241.

- [Singularity](https://pubmed.ncbi.nlm.nih.gov/28494014/)

  > Kurtzer GM, Sochat V, Bauer MW. Singularity: Scientific containers for mobility of compute. PLoS One. 2017 May 11;12(5):e0177459. doi: 10.1371/journal.pone.0177459. eCollection 2017. PubMed PMID: 28494014; PubMed Central PMCID: PMC5426675.

GitHub Events

Total
  • Create event: 54
  • Release event: 4
  • Issues event: 90
  • Watch event: 25
  • Delete event: 56
  • Issue comment event: 205
  • Push event: 226
  • Pull request review event: 232
  • Pull request review comment event: 189
  • Pull request event: 161
  • Fork event: 21
Last Year
  • Create event: 54
  • Release event: 4
  • Issues event: 90
  • Watch event: 25
  • Delete event: 56
  • Issue comment event: 205
  • Push event: 226
  • Pull request review event: 232
  • Pull request review comment event: 189
  • Pull request event: 161
  • Fork event: 21

Committers

Last synced: over 2 years ago

All Time
  • Total Commits: 954
  • Total Committers: 31
  • Avg Commits per committer: 30.774
  • Development Distribution Score (DDS): 0.621
Past Year
  • Commits: 248
  • Committers: 12
  • Avg Commits per committer: 20.667
  • Development Distribution Score (DDS): 0.48
Top Committers
Name Email Commits
Phil Ewels p****s@s****e 362
phue p****r@g****m 158
Phil Ewels p****s@s****o 129
njspix 5****x 54
Sateesh Peri p****h@g****m 50
Edmund Miller e****r@p****m 46
Rickard Hammarén r****n@s****e 42
nf-core-bot c****e@n****e 25
Phil Ewels p****l@s****o 13
njspix n****x@v****g 11
matthiasho m****r@k****e 9
phue p****r@g****t 8
Alexander Peltzer a****r@u****e 6
Felix Krueger f****r@a****m 5
mashehu m****u 5
Colin Davenport c****n@h****m 4
SpikyClip 7****p 4
MaxUlysse m****a@g****m 4
Paolo Di Tommaso p****o@g****m 3
Johannes Alneberg j****g@s****e 3
Johannes Alneberg a****g@k****e 2
Wassim Salam 9****1 2
Andreas WILM w****a@g****g 1
runner r****r@f****0 1
Alessia Visconti a****i@g****m 1
Simon Pearce 2****e 1
kevinmenden k****n@t****e 1
Rob Syme r****e@g****m 1
noirot c****t@i****r 1
Sateesh_Peri 3****i 1
and 1 more...
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 56
  • Total pull requests: 133
  • Average time to close issues: 7 months
  • Average time to close pull requests: 20 days
  • Total issue authors: 35
  • Total pull request authors: 27
  • Average comments per issue: 1.95
  • Average comments per pull request: 1.56
  • Merged pull requests: 89
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 16
  • Pull requests: 37
  • Average time to close issues: 2 months
  • Average time to close pull requests: 16 days
  • Issue authors: 11
  • Pull request authors: 11
  • Average comments per issue: 0.31
  • Average comments per pull request: 0.92
  • Merged pull requests: 17
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • sateeshperi (19)
  • bounlu (6)
  • edmundmiller (5)
  • ewels (5)
  • dcarrillox (4)
  • gevro (4)
  • GallVp (3)
  • Emiller88 (3)
  • fbnrst (3)
  • TheodoreMarkulin (3)
  • FelixKrueger (2)
  • jma1991 (2)
  • scoughlan2 (2)
  • torres-HI (1)
  • rbpisupati (1)
Pull Request Authors
  • sateeshperi (76)
  • ewels (41)
  • nf-core-bot (24)
  • Emiller88 (12)
  • edmundmiller (6)
  • GallVp (5)
  • njspix (4)
  • fbnrst (4)
  • Shaun-Regenbaum (4)
  • bounlu (3)
  • FelixKrueger (3)
  • RogerHw (2)
  • geethavenk (2)
  • dcarrillox (2)
  • maxulysse (2)
Top Labels
Issue Labels
enhancement (38) bug (37) dsl2 (6) question (3) high-priority (2) WIP (1) help wanted (1) good first issue (1)
Pull Request Labels
WIP (3) dsl1 (2) enhancement (2) dsl2 (1) bug (1) good first issue (1)

Dependencies

.github/workflows/awsfulltest.yml actions
  • actions/upload-artifact v3 composite
  • nf-core/tower-action v3 composite
.github/workflows/awstest.yml actions
  • actions/upload-artifact v3 composite
  • nf-core/tower-action v3 composite
.github/workflows/branch.yml actions
  • mshick/add-pr-comment v1 composite
.github/workflows/ci.yml actions
  • actions/cache v3 composite
  • actions/checkout v3 composite
  • conda-incubator/setup-miniconda v2 composite
  • eWaterCycle/setup-singularity v5 composite
  • nf-core/setup-nextflow v1 composite
  • pcolby/tap-summary v1 composite
.github/workflows/fix-linting.yml actions
  • actions/checkout v3 composite
  • actions/setup-node v3 composite
.github/workflows/linting.yml actions
  • actions/checkout v3 composite
  • actions/setup-node v3 composite
  • actions/setup-python v4 composite
  • actions/upload-artifact v3 composite
  • mshick/add-pr-comment v1 composite
  • nf-core/setup-nextflow v1 composite
  • psf/black stable composite
.github/workflows/linting_comment.yml actions
  • dawidd6/action-download-artifact v2 composite
  • marocchino/sticky-pull-request-comment v2 composite
.github/workflows/clean-up.yml actions
  • actions/stale v7 composite
modules/nf-core/bismark/align/meta.yml cpan
modules/nf-core/bismark/coverage2cytosine/meta.yml cpan
modules/nf-core/bismark/deduplicate/meta.yml cpan
modules/nf-core/bismark/genomepreparation/meta.yml cpan
modules/nf-core/bismark/methylationextractor/meta.yml cpan
modules/nf-core/bismark/report/meta.yml cpan
modules/nf-core/bismark/summary/meta.yml cpan
modules/nf-core/bwameth/align/meta.yml cpan
modules/nf-core/bwameth/index/meta.yml cpan
modules/nf-core/cat/fastq/meta.yml cpan
modules/nf-core/custom/dumpsoftwareversions/meta.yml cpan
modules/nf-core/fastqc/meta.yml cpan
modules/nf-core/methyldackel/extract/meta.yml cpan
modules/nf-core/methyldackel/mbias/meta.yml cpan
modules/nf-core/multiqc/meta.yml cpan
modules/nf-core/picard/markduplicates/meta.yml cpan
modules/nf-core/preseq/lcextrap/meta.yml cpan
modules/nf-core/qualimap/bamqc/meta.yml cpan
modules/nf-core/qualimap/bamqccram/meta.yml cpan
modules/nf-core/samtools/faidx/meta.yml cpan
modules/nf-core/samtools/flagstat/meta.yml cpan
modules/nf-core/samtools/index/meta.yml cpan
modules/nf-core/samtools/sort/meta.yml cpan
modules/nf-core/samtools/stats/meta.yml cpan
modules/nf-core/trimgalore/meta.yml cpan
pyproject.toml pypi
.github/workflows/release-announcments.yml actions
  • actions/setup-python v4 composite
  • rzr/fediverse-action master composite
  • zentered/bluesky-post-action v0.0.2 composite