methylseq

Methylation (Bisulfite-Sequencing) analysis pipeline using Bismark or bwa-meth + MethylDackel

https://github.com/vibtobilab/methylseq

Science Score: 57.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 7 DOI reference(s) in README
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (12.6%) to scientific vocabulary
Last synced: 6 months ago · JSON representation ·

Repository

Methylation (Bisulfite-Sequencing) analysis pipeline using Bismark or bwa-meth + MethylDackel

Basic Info
  • Host: GitHub
  • Owner: VIBTOBIlab
  • License: mit
  • Language: Nextflow
  • Default Branch: main
  • Size: 19.7 MB
Statistics
  • Stars: 0
  • Watchers: 0
  • Forks: 0
  • Open Issues: 0
  • Releases: 1
Created 7 months ago · Last pushed 7 months ago
Metadata Files
Readme Changelog License Code of conduct Citation Codeowners

README.md

MethylSeq pipeline (TOBI lab version)

GitHub Actions CI Status GitHub Actions Linting StatusAWS CICite with Zenodo

Nextflow run with conda run with docker run with singularity Launch on Nextflow Tower nf-test

Introduction

Note: This pipeline has been modified using the original nf-core/methylseq pipeline (version 2.6.0) to include the optical removal duplicates and some other modules in the Bismark subworkflow. You can find the original pipeline at the following nfcore repository.

MethylSeq is a bioinformatics analysis pipeline used for Methylation (Bisulfite) sequencing data. It pre-processes raw data from FastQ inputs, aligns the reads and performs extensive quality-control on the results.

The pipeline is built using Nextflow, a workflow tool to run tasks across multiple compute infrastructures in a very portable manner. It uses Docker / Singularity containers making installation trivial and results highly reproducible.

On release, automated continuous integration tests run the pipeline on a full-sized dataset on the AWS cloud infrastructure. This ensures that the pipeline runs on AWS, has sensible resource allocation defaults set to run on real-world datasets, and permits the persistent storage of results to benchmark between pipeline releases and other analysis sources.The results obtained from the full-sized test can be viewed on the nf-core website.

Pipeline Summary

The pipeline allows you to choose between running either Bismark or bwa-meth / MethylDackel. Choose between workflows by using --aligner bismark (default, uses bowtie2 for alignment), --aligner bismark_hisat or --aligner bwameth.

| Step | Bismark workflow | bwa-meth workflow | | -------------------------------------------- | -------------------- | --------------------- | | Generate Reference Genome Index (optional) | Bismark | bwa-meth | | Merge re-sequenced FastQ files | cat | cat | | Raw data QC | FastQC | FastQC | | Adapter sequence trimming | Trim Galore! | Trim Galore! | | Align Reads | Bismark | bwa-meth | | Sequencing saturation (optional) | Custom scripts | - | Filter Non Conversion | Bismark | - | | Deduplicate Alignments | Bismark | Picard MarkDuplicates | | Removal of optical duplicates | Picard MarkDuplicates| - | | Extract methylation calls | Bismark | MethylDackel | | Sample report | Bismark | - | | Summary Report | Bismark | - | | Alignment QC | Qualimap | Qualimap | | Sample complexity | Preseq | Preseq | | Project Report | MultiQC | MultiQC |

Usage

[!NOTE] If you are new to Nextflow and nf-core, please refer to this page on how to set-up Nextflow. Make sure to test your setup with -profile test before running the workflow on actual data.

First, prepare a samplesheet with your input data that looks as follows:

samplesheet.csv:

csv sample,fastq_1,fastq_2 SRR389222_sub1,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/SRR389222_sub1.fastq.gz SRR389222_sub2,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/SRR389222_sub2.fastq.gz SRR389222_sub3,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/SRR389222_sub3.fastq.gz Ecoli_10K_methylated,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/Ecoli_10K_methylated_R1.fastq.gz,https://github.com/nf-core/test-datasets/raw/methylseq/testdata/Ecoli_10K_methylated_R2.fastq.gz

Each row represents a fastq file (single-end) or a pair of fastq files (paired end).

Now, you can run the pipeline using:

bash nextflow run main.nf --input samplesheet.csv --outdir <OUTDIR> --genome GRCh37 -profile <docker/singularity/podman/shifter/charliecloud/conda/institute>

[!WARNING] Please provide pipeline parameters via the CLI or Nextflow -params-file option. Custom config files including those provided by the -c Nextflow option can be used to provide any configuration except for parameters; see docs.

For more details and further functionality, please refer to the usage documentation, the parameter documentation and the section below for the parameters that have been added to the modifed version of the pipeline.

Parameters included in the modified version

The original nf-core/methylseq pipeline has been modified to include modules that are important when processing RRBS/cfRRBS samples. The pipeline has been modified by @edogiuili and is currently maintained by Edoardo Giuili (@edogiuili) and Sofie Van de Velde (@sofvdvel).

Removal of optical duplicates

--remove_optic_duplicates

If specified, it removes the optical duplicates. It can be used together with --sequencer (see below).

--sequencer

If the flag --remove_optic_duplicates has been specified, --sequencer will be by default set to NovaSeq. Alternatively, you can specify HiSeq or NextSeq. This will change the OpticalDupsPixelDistance within PicardMarkDuplicates step (NovaSeq: 12000, HiSeq: 2500, NextSeq: 100).

Filter non conversion (Bismark) module

--filter_non_conversion

If specified, it filters out all those reads that have a methylation value >= than a preset threshold in non-CG context where you expect a very low methylation level (<5% usually). For more information please consult the Bismark usage.

--minimum_count

Minimum number of methylation sites for a read to be filtered out (def. 3).

--percentage_cutoff

Minimum methylation percentage for a read to be filtered out (def. 90%).

Sequencing saturation plots

[NOTE:] It's recommended only when using RRBS data, while with WGBS it's recommended to look at the results provided by PreSeq module.

When the flag --rrbs is specified, the pipeline will perform a downsampling of the raw aligned .bam files and calculate the sequencing saturation. The sequencing saturation is calculated as the number of unique CpGs with at least x counts (where x is 3 by default, but can be customized) divided by the theoretical maximum number of CpG (which corresponds to the asymptote of the curve).

--downsampling_percentages

The percentages to use when performing the downsampling (def. "0.1,0.2,0.4,0.6,0.8,1"). This parameter cannot accept 0. It's strongly recommended to no change it, unless there are valid reasons (e.g. your sequencing saturation curve is not informative enough with the default percentages.)

--min_counts

The minimum number of reads necessary to call a unique CpGs in the sequencing curve. By default, it will use '1,3,5' corresponding respectively to 1, 3 and 5 reads.

--skip_seqcurve

If you are using the --rrbs flag and you want to skip the sequencing saturation curve process, activate this flag (def. false).

Pipeline output

To see the results of an example test run with a full size dataset refer to the results tab on the nf-core website pipeline page. For more details about the output files and reports, please refer to the output documentation.

Credits

These scripts were originally written for use at the National Genomics Infrastructure at SciLifeLab in Stockholm, Sweden.

Citations

An extensive list of references for the tools used by the pipeline can be found in the CITATIONS.md file.

You can cite the nf-core publication as follows:

The nf-core framework for community-curated bioinformatics pipelines.

Philip Ewels, Alexander Peltzer, Sven Fillinger, Harshil Patel, Johannes Alneberg, Andreas Wilm, Maxime Ulysse Garcia, Paolo Di Tommaso & Sven Nahnsen.

Nat Biotechnol. 2020 Feb 13. doi: 10.1038/s41587-020-0439-x.

Owner

  • Name: VIBTOBIlab
  • Login: VIBTOBIlab
  • Kind: organization

Citation (CITATIONS.md)

# nf-core/methylseq: Citations

## [nf-core/methylseq](https://doi.org/10.5281/zenodo.1343417)

> Phil Ewels, Patrick Hüther, Rickard Hammarén, mashehu, Alexander Peltzer, nf-core bot, Sven F., Johannes Alneberg, Paolo Di Tommaso, Maxime U. Garcia, Colin Davenport, Alessia, Felix Krueger, Guillaume Devailly, Harshil Patel, Robert Syme, VIJAY, & Noirot Céline. (2021). nf-core/methylseq: nf-core/methylseq version 1.6.1 [Nauseous Serpent] (1.6.1). Zenodo. doi: [10.5281/zenodo.4744708](https://doi.org/10.5281/zenodo.4744708)

## [nf-core](https://pubmed.ncbi.nlm.nih.gov/32055031/)

> Ewels PA, Peltzer A, Fillinger S, Patel H, Alneberg J, Wilm A, Garcia MU, Di Tommaso P, Nahnsen S. The nf-core framework for community-curated bioinformatics pipelines. Nat Biotechnol. 2020 Mar;38(3):276-278. doi: 10.1038/s41587-020-0439-x. PubMed PMID: 32055031.

## [Nextflow](https://pubmed.ncbi.nlm.nih.gov/28398311/)

> Di Tommaso P, Chatzou M, Floden EW, Barja PP, Palumbo E, Notredame C. Nextflow enables reproducible computational workflows. Nat Biotechnol. 2017 Apr 11;35(4):316-319. doi: 10.1038/nbt.3820. PubMed PMID: 28398311.

## Pipeline tools

- [FastQC](https://www.bioinformatics.babraham.ac.uk/projects/fastqc/)

  > Andrews, S. (2010). FastQC: A Quality Control Tool for High Throughput Sequence Data [Online].

- [MultiQC](https://pubmed.ncbi.nlm.nih.gov/27312411/)

  > Ewels P, Magnusson M, Lundin S, Käller M. MultiQC: summarize analysis results for multiple tools and samples in a single report. Bioinformatics. 2016 Oct 1;32(19):3047-8. doi: 10.1093/bioinformatics/btw354. Epub 2016 Jun 16. PubMed PMID: 27312411; PubMed Central PMCID: PMC5039924.

- [Trim Galore!](https://www.bioinformatics.babraham.ac.uk/projects/trim_galore/)

  > <https://www.bioinformatics.babraham.ac.uk/projects/trim_galore/>

  <!-- TODO https://github.com/FelixKrueger/TrimGalore/issues/25 -->
  <!-- https://zenodo.org/records/7598955 -->

- [Bismark](https://doi.org/10.1093/bioinformatics/btr167)

  > Felix Krueger, Simon R. Andrews, Bismark: a flexible aligner and methylation caller for Bisulfite-Seq applications, Bioinformatics, Volume 27, Issue 11, 1 June 2011, Pages 1571–1572, doi: [10.1093/bioinformatics/btr167](https://doi.org/10.1093/bioinformatics/btr167)

- [bwa-meth](https://arxiv.org/abs/1401.1129)

  > Pedersen, Brent S. and Eyring, Kenneth and De, Subhajyoti and Yang, Ivana V. and Schwartz, David A. Fast and accurate alignment of long bisulfite-seq reads, arXiv:1401.1129, doi: [10.48550/arXiv.1401.1129](https://doi.org/10.48550/arXiv.1401.1129)

- [Picard](http://broadinstitute.github.io/picard/)

  > Picard Tools, Broad Institute. <http://broadinstitute.github.io/picard/>

- [Qualimap](https://doi.org/10.1093/bioinformatics/btv566)

  > Konstantin Okonechnikov, Ana Conesa, Fernando García-Alcalde, Qualimap 2: advanced multi-sample quality control for high-throughput sequencing data, Bioinformatics, Volume 32, Issue 2, 15 January 2016, Pages 292–294, doi: [10.1093/bioinformatics/btv566](https://doi.org/10.1093/bioinformatics/btv566)

- [Preseq](https://doi.org/10.1038/nmeth.2375)

  > Daley, T., Smith, A. Predicting the molecular complexity of sequencing libraries. Nat Methods 10, 325–327 (2013). doi: [10.1038/nmeth.2375](https://doi.org/10.1038/nmeth.2375)

## Software packaging/containerisation tools

- [Anaconda](https://anaconda.com)

  > Anaconda Software Distribution. Computer software. Vers. 2-2.4.0. Anaconda, Nov. 2016. Web.

- [Bioconda](https://pubmed.ncbi.nlm.nih.gov/29967506/)

  > Grüning B, Dale R, Sjödin A, Chapman BA, Rowe J, Tomkins-Tinch CH, Valieris R, Köster J; Bioconda Team. Bioconda: sustainable and comprehensive software distribution for the life sciences. Nat Methods. 2018 Jul;15(7):475-476. doi: 10.1038/s41592-018-0046-7. PubMed PMID: 29967506.

- [BioContainers](https://pubmed.ncbi.nlm.nih.gov/28379341/)

  > da Veiga Leprevost F, Grüning B, Aflitos SA, Röst HL, Uszkoreit J, Barsnes H, Vaudel M, Moreno P, Gatto L, Weber J, Bai M, Jimenez RC, Sachsenberg T, Pfeuffer J, Alvarez RV, Griss J, Nesvizhskii AI, Perez-Riverol Y. BioContainers: an open-source and community-driven framework for software standardization. Bioinformatics. 2017 Aug 15;33(16):2580-2582. doi: 10.1093/bioinformatics/btx192. PubMed PMID: 28379341; PubMed Central PMCID: PMC5870671.

- [Docker](https://dl.acm.org/doi/10.5555/2600239.2600241)

  > Merkel, D. (2014). Docker: lightweight linux containers for consistent development and deployment. Linux Journal, 2014(239), 2. doi: 10.5555/2600239.2600241.

- [Singularity](https://pubmed.ncbi.nlm.nih.gov/28494014/)

  > Kurtzer GM, Sochat V, Bauer MW. Singularity: Scientific containers for mobility of compute. PLoS One. 2017 May 11;12(5):e0177459. doi: 10.1371/journal.pone.0177459. eCollection 2017. PubMed PMID: 28494014; PubMed Central PMCID: PMC5426675.

GitHub Events

Total
  • Release event: 1
  • Delete event: 1
  • Push event: 1
  • Create event: 1
Last Year
  • Release event: 1
  • Delete event: 1
  • Push event: 1
  • Create event: 1

Dependencies

modules/local/seqsaturation/meta.yml cpan
modules/local/seqsaturation_methextractor/meta.yml cpan
modules/nf-core/bismark/align/meta.yml cpan
modules/nf-core/bismark/coverage2cytosine/meta.yml cpan
modules/nf-core/bismark/deduplicate/meta.yml cpan
modules/nf-core/bismark/genomepreparation/meta.yml cpan
modules/nf-core/bismark/methylationextractor/meta.yml cpan
modules/nf-core/bismark/report/meta.yml cpan
modules/nf-core/bismark/summary/meta.yml cpan
modules/nf-core/bwameth/align/meta.yml cpan
modules/nf-core/bwameth/index/meta.yml cpan
modules/nf-core/cat/fastq/meta.yml cpan
modules/nf-core/custom/dumpsoftwareversions/meta.yml cpan
modules/nf-core/fastqc/meta.yml cpan
modules/nf-core/methyldackel/extract/meta.yml cpan
modules/nf-core/methyldackel/mbias/meta.yml cpan
modules/nf-core/multiqc/meta.yml cpan
modules/nf-core/picard/markduplicates/meta.yml cpan
modules/nf-core/preseq/lcextrap/meta.yml cpan
modules/nf-core/qualimap/bamqc/meta.yml cpan
modules/nf-core/qualimap/bamqccram/meta.yml cpan
modules/nf-core/samtools/faidx/meta.yml cpan
modules/nf-core/samtools/flagstat/meta.yml cpan
modules/nf-core/samtools/index/meta.yml cpan
modules/nf-core/samtools/queryname_sort/meta.yml cpan
modules/nf-core/samtools/sort/meta.yml cpan
modules/nf-core/samtools/stats/meta.yml cpan
modules/nf-core/trimgalore/meta.yml cpan
modules/nf-core/untar/meta.yml cpan
modules/nf-core/custom/dumpsoftwareversions/environment.yml pypi
modules/nf-core/fastqc/environment.yml pypi
modules/nf-core/multiqc/environment.yml pypi
modules/nf-core/untar/environment.yml pypi
pyproject.toml pypi