nf-vuegen

nf-core module designed to automate report generation from outputs produced by other modules, subworkflows, or pipelines. VueGen creates reports from bioinformatics outputs, supporting formats like PDF, HTML, DOCX, ODT, PPTX, Reveal.js, Jupyter notebooks, and Streamlit web applications.

https://github.com/multiomics-analytics-group/nf-vuegen

Science Score: 67.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 5 DOI reference(s) in README
  • Academic publication links
    Links to: biorxiv.org, zenodo.org
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (13.6%) to scientific vocabulary

Keywords

data-visualization developer-tools nextflow-modules nf-core quarto reports streamlit
Last synced: 4 months ago · JSON representation ·

Repository

nf-core module designed to automate report generation from outputs produced by other modules, subworkflows, or pipelines. VueGen creates reports from bioinformatics outputs, supporting formats like PDF, HTML, DOCX, ODT, PPTX, Reveal.js, Jupyter notebooks, and Streamlit web applications.

Basic Info
  • Host: GitHub
  • Owner: Multiomics-Analytics-Group
  • License: mit
  • Language: Nextflow
  • Default Branch: main
  • Homepage:
  • Size: 3.16 MB
Statistics
  • Stars: 2
  • Watchers: 2
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Topics
data-visualization developer-tools nextflow-modules nf-core quarto reports streamlit
Created 10 months ago · Last pushed 4 months ago
Metadata Files
Readme License Citation

README.md

nf-VueGen Logo

nf-VueGen is a nf-core module designed to automate report generation from outputs produced by other modules, subworkflows, or pipelines.

| Information | Links | | :--- | :--- | | Module | License | | Documentation | View - Documentation | | Build | | | Examples | HTML5 Streamlit| | Discuss on GitHub | GitHub issues GitHub pull requests|

Table of contents:

About the project

The VueGen nf-core module is designed to automate report generation from outputs produced by other modules, subworkflows, or pipelines. The module integrates the VueGen Python library and customizes it for compatibility with the Nextflow environment. VueGen automates the creation of reports from bioinformatics outputs, supporting formats like PDF, HTML, DOCX, ODT, PPTX, Reveal.js, Jupyter notebooks, and Streamlit web applications. Users simply provide a directory with output files and VueGen compiles them into a structured report.

This module is compatible with existing Nextflow reporting tools such as MultiQC, AssemblyQC, and others, allowing their HTML outputs to be embedded as components within VueGen reports.

An overview of the VueGen workflow is shown in the figure below:

VueGen Abstract

A metro-map representation of the VueGen nf-core module is presented below:

nf-VueGen MetroMap

The workflow starts with an input dataset and continues through different stages, generating intermediate outputs in various formats. In the final stage, the VueGen nf-core module collects these outputs from a folder and generates reports in multiple formats.

The VueGen documentation is available at vuegen.readthedocs.io, where you can find detailed information of the package’s classes and functions, installation and execution instructions, and case studies to demonstrate its functionality.

Installation

We are currently working on the integration of VueGen with the nf-core framework. This process can take some time because it requires the approval of the nf-core community. In the meantime, you can clone this repository and use nf-VueGen as a standalone Nextflow module. The main.nf file provides an example of how to use the nf-VueGen module in a Nextflow pieline.

Dependencies

You should have Nextflow installed on your system to run nf-VueGen. Conda or Docker are also required to manage dependencies and create an isolated environment for the nf-VueGen module.

We recommend using Docker to containetize the nf-VueGen environment, ensuring reproducibility and compatibility across different systems. The Docker image is available at quay.io/dtubiosustaindsp/vuegen and is automatically pulled by Nextflow when running the module. The Dockerfiles to build the image is available in the Docker folder of this repository.

If you prefer to use Conda, a virtual environment with the required dependencies is created automatically by Nextflow when running the module, using the information in the modules/environment.yml file.

Execution

[!IMPORTANT] Here we use the Basic_example_vuegen_demo_notebook directory and the Basic_example_vuegen_demo_notebook.yaml configuration file as examples, which are available in the docs/example_data and docs/example_config_files folders, respectively. Make sure to clone this reposiotry to access these contents, or use your own directory and configuration file.

Run nf-VueGen using a directory with the following command:

bash nextflow run main.nf --directory docs/example_data/Basic_example_vuegen_demo_notebook --report_type html -profile docker

It's also possible to provide a configuration file instead of a directory:

bash nextflow run main.nf --config docs/example_config_files/Basic_example_vuegen_demo_notebook_config.yaml --report_type html -profile docker

[!NOTE] If you use Conda for environment management, you should use the -profile conda option instead of -profile docker in the commands above.

The current report types supported by nf-VueGen are: * Streamlit * HTML * PDF * DOCX * ODT * Reveal.js * PPTX * Jupyter

Case studies

nf-VueGen’s functionality is demonstrated through two case studies:

1. Predefined Directory

This introductory case study uses a predefined directory with plots, dataframes, Markdown, and HTML components. Users can generate reports in different formats and modify the configuration file to customize the report structure.

To test this case study, follow the instructions from the Execution section, where Basic_example_vuegen_demo_notebook directory and Basic_example_vuegen_demo_notebook.yaml configuration file are used.

2. Earth Microbiome Project Data

This advanced case study demonstrates the application of nf-VueGen in a real-world scenario using data from the Earth Microbiome Project (EMP). The EMP is an initiative to characterize global microbial taxonomic and functional diversity. The notebook process the EMP data, create plots, dataframes, and other components, and organize outputs within a directory to produce reports. Report content and structure can be adapted by modifying the configuration file. Each report consists of sections on exploratory data analysis, metagenomics, and network analysis.

To test this case study, use the Earth_microbiome_vuegen_demo_notebook directory and the Earth_microbiome_vuegen_demo_notebook.yaml configuration file available in the docs/example_data and docs/example_config_files folders, respectively.

[!NOTE] The EMP case study is available online as HTML and Streamlit reports.

Web application deployment

Once a Streamlit report is generated, it can be deployed as a web application to make it accessible online. There are multiple ways to achieve this:

  • Streamlit Community Cloud: Deploy your report easily using Streamlit Cloud, as demonstrated in the EMP VueGen Demo. The process involves moving the necessary scripts, data, and a requirements.txt file into a GitHub repository. Then, the app can be deployed via the Streamlit Cloud interface. The deployment example is available in the streamlit-report-example branch of the VueGen repository.
  • Standalone Executables: Convert your Streamlit application into a desktop app by packaging it as an executable file for different operating systems. A detailed explanation of this process can be found in this Streamlit forum post.
  • Stlite: Run Streamlit apps directly in the browser with stlite, a WebAssembly port of Streamlit powered by Pyodide, eliminating the need for a server. It also allows packaging apps as standalone desktop executables using stlite desktop.

These options provide flexibility depending on whether the goal is online accessibility, lightweight execution, or local application distribution.

Credits and acknowledgements

Citation

If you use nf-VueGen in your research or publications, please cite it as follows:

APA:

Ayala-Ruano, S., Webel, H., & Santos, A. (2025). VueGen: Automating the generation of scientific reports. bioRxiv. https://doi.org/10.1101/2025.03.05.641152

BibTeX:

bibtex @article{Ayala-Ruano2025VueGen, author = {Ayala-Ruano, Sebastian and Webel, Henry and Santos, Alberto}, title = {VueGen: Automating the generation of scientific reports}, journal = {bioRxiv}, year = {2025}, doi = {10.1101/2025.03.05.641152}, publisher = {Cold Spring Harbor Laboratory}, url = {https://www.biorxiv.org/content/10.1101/2025.03.05.641152}, eprint = {https://www.biorxiv.org/content/10.1101/2025.03.05.641152.full.pdf} }

Contact and feedback

We appreciate your feedback! If you have any comments, suggestions, or run into issues while using VueGen, feel free to open an issue in this repository. Your input helps us make nf-VueGen better for everyone.

Owner

  • Name: Multi-omics Network Analytics Group
  • Login: Multiomics-Analytics-Group
  • Kind: organization
  • Email: albsad@biosustain.dtu.dk
  • Location: Denmark

Citation (CITATION.cff)

cff-version: 1.2.0
message: "If you use VueGen in your research, please cite it as below."
title: "VueGen: Automating the generation of scientific reports"
version: 1.0.0
authors:
  - family-names: "Ayala-Ruano"
    given-names: "Sebastian"
    orcid: "http://orcid.org/0000-0001-9756-6745"
  - family-names: "Webel"
    given-names: "Henry"
    orcid: "http://orcid.org/0000-0001-8833-7617"
  - family-names: "Santos"
    given-names: "Alberto"
    orcid: "http://orcid.org/0000-0002-9163-7730"
doi: "10.1101/2025.03.05.641152"
date-released: "2025-03-05"
url: "https://github.com/YOUR_GITHUB_USERNAME/YOUR_REPO_NAME"
preferred-citation:
  type: article
  authors:
    - family-names: "Ayala-Ruano"
      given-names: "Sebastian"
      orcid: "http://orcid.org/0000-0001-9756-6745"
    - family-names: "Webel"
      given-names: "Henry"
      orcid: "http://orcid.org/0000-0001-8833-7617"
    - family-names: "Santos"
      given-names: "Alberto"
      orcid: "http://orcid.org/0000-0002-9163-7730"
  title: "VueGen: Automating the generation of scientific reports"
  journal: "bioRxiv"
  year: 2025
  doi: "10.1101/2025.03.05.641152"
  url: "https://www.biorxiv.org/content/10.1101/2025.03.05.641152v1"

GitHub Events

Total
  • Watch event: 2
  • Member event: 1
  • Push event: 11
  • Create event: 2
Last Year
  • Watch event: 2
  • Member event: 1
  • Push event: 11
  • Create event: 2

Issues and Pull Requests

Last synced: 9 months ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels

Dependencies

modules/environment.yml pypi