Recent Releases of medaka
medaka - v2.1.1
Added
- Python 3.12 support ### Fixed
- Issue with checking for the presence of dwell information in fastq files. ### Changed
- Behaviour of
medaka_consensuswith--bacteriaoption: if the basecaller model cannot be parsed or is not compatible with the bacterial polishing model, exit with an error instead of falling back to default model. - Replaced
pkg_resourceswithimportlib### Removed - Python 3.8 support (EOL).
- Python
Published by ontresearch 11 months ago
medaka - v2.1.0
Fixed
- Updated documentation with
inferenceandsequencecommand renaming. - Changed default model resolved from bam file from
varianttoconsensus. - Fixed issue with initializing
inferencein Medaka tandem model. - Fixed a memory leak in the Medaka C library and removed redundant memory objects to reduce the footprint. ### Changed
- Fully refactored and redesigned
medaka tandemcode and optimised CPU-based execution. - Read-level models cannot be used with
medaka tandem. - gettrimmedreads now also returns the phase-set, hap and read ids. ### Added
- Consensus models for v5.2.0 basecaller models.
- Added support for read-level consensus models for v5.0.0 and v5.2.0 basecaller models.
- Models
dna_r10.4.1_e8.2_5khz_400bps_supanddna_r10.4.1_e8.2_5khz_400bps_hacadded as aliases to those without_5kz_in their names. - Added
-Boption tomedaka_consensusto allow passing a bed file or region to polish viamedaka inference --regions. - Added
--cpuoption tomedaka inferenceto force CPU and avoid searching for GPUs. - New output format for
medaka tandemtailored for population studies. - New fields to
medaka tandemoutput: depth, read lengths, read names, phase sets, and MAD of read lengths. - Read length–based outlier detection in
medaka tandem.
- Python
Published by ontresearch about 1 year ago
medaka - v2.0.0
Switched from tensorflow to pytorch.
Existing models for recent basecallers have been converted to the new format.
Pytorch format models contain a _pt suffix in the filename.
Changed
- Inference is now performed using PyTorch instead of TensorFlow.
- The
medaka consensuscommand has been renamed tomedaka inferenceto reflect its function in running an arbitrary model and avoid confusion withmedaka_consensus. - The
medaka stitchcommand has been renamed tomedaka sequenceto reflect its function in creating a consensus sequence. - The
medaka variantcommand has been renamed tomedaka vcfto reflect its function in consolidating variants and avoid confusion withmedaka_variant. - Order of arguments to
medaka vcfhas been changed to be more consistent withmedaka sequence. - The helper script
medaka_haploid_varianthas been renamedmedaka_variantto save typing. - Make
--ignore_read_groupsoption available to more medaka subcommands includinginference. ### Removed - The
medaka snpcommand has been removed. This was long defunct as diploid SNP calling had been deprecated, andmedaka variantis used to create VCFs for current models. - Loading models in hdf format has been deprecated.
- Deleted minimap2 and racon wrappers in
medaka/wrapper.py. ### Added - Release conda packages for Linux (x86 and aarch64) and macOS (arm64).
- Option
--lr_scheduleallows using cosine learning rate schedule in training. - Option
--max_valid_samplesto set number of samples in a training validation batch. ### Fixed - Training models with DiploidLabelScheme uses categorical cross-entropy loss instead of binary cross-entropy.
- Python
Published by ontresearch almost 2 years ago
medaka - v1.12.1
(Probably) final version of medaka using tensorflow. Future versions will use pytorch instead.
Fixed
- medaka_consensus: only keep bam tags if input file matches joint polishing pipeline.
- Pin numpy to <2.0.0. ### Added
- Consensus and variant models lookup for v3.5.1 Dorado models.
- Python
Published by ontresearch about 2 years ago
medaka - v1.12.0
Fixed
- tandem: Use haplotag 0 in unphased mode.
- tandem: Don't run consensus if regions set is empty. ### Added
- Models for version 5 basecaller models.
- Expose
sym_indelsoption for training. - Expose
--min_mapqminimum mapping quality alignment fitering option for medaka consensus. - tandem: Option
--ignore_read_groupsto ignore read groups present in input file. - Wrapper script
medaka_consensus_jointand convenience tools (prepare_tagged_bam,get_model_dtypes) to facilitate joint polishing with multiple datatypes.
- Python
Published by ontresearch about 2 years ago
medaka - v1.11.1
Fixed
- Do not exit if model cannot be interpreted, use the default instead.
- An issue with co-ordinate handling in computing variants from alignments. ### Added
- Ability to use basecaller model name as --model argument.
- Better handling or errors when running abpoa.
- Python
Published by ontresearch over 2 years ago
medaka - v1.11.0
Fixed
- Correct suffix of consensus file when
medaka_consensusoutputs a fastq. ### Added - Choice of model file can be introspected from input files. For BAM files the read group (RG) headers are searched according to the dorado specification, whilst for .fastq files the comment section of a number of reads are checked for corresponding read group information. In the latter case see README for information on correctly converting basecaller output to .fastq whilst maintaining the relevant meta information.
medaka tools resolve_modelcan display the model that would automatically be used for a given input file. ### Changed- If no model is provided on command-line interface (medaka consensus, medakaconsensus, and medakahaploid_variant) automatic attempts will be made to choose the appropriate model.
- Python
Published by ontresearch over 2 years ago
medaka - v1.10.0
Changed
- Tensorflow logging level no longer set from Python.
- spoa and parasail are now strict requirements. ### Fixed
- Sort VCF before annotating in
medaka_haploid_variant. - Ignore errors when deleting temporary files.
- The output of the first POA run not being used in the second iteration in smolecule command. ### Added
- Support for Python 3.11.
--spoa_min_coverageoption to smolecule command. ### Removed- Support for Python 3.7.
- Python
Published by ontresearch over 2 years ago
medaka - v1.7.3
Added
- Consensus polishing models for Version 4 basecallers.
- Wheel builds for newer Python versions. ### Fixed
- Deprecated numpy.unicode use. ### Changed
- Set minimum Python version to 3.7.
- Updated tensorflow requirement to 2.8.
- Put lower bound on numpy requirement. ### Removed
- Dropped support for Python 3.6. Security support for Python 3.6 was ended on 23 Dec 2021; as such we have removed support for Python 3.6 and suggest users update their Python version.
- Python
Published by ontresearch over 3 years ago
medaka - v1.7.0
Added
- capability to fill gaps in consensus sequence with a designated character (e.g. 'N') instead of content from a reference sequence.
- option
-rinmedaka_consensusto set the designated fill character. - option
--fill_charinmedaka stitchto set the designated fill character. ### Fixed - CUDA initialization errors during
medaka smolecules stitch phase.
- Python
Published by ontresearch almost 4 years ago
medaka - v1.6.0
Changed
- Updated to tensorflow~=2.7.0.
- Do not always force recreation of minimap2 index in helper scripts.
- PyPI wheel releases now built with libdeflate for faster BAM reading. ### Fixed
- Inclusion of inserted bases immediately after deletion in pileup counts. ### Added
- Makefile can now build environment for macOS M1.
- Publish ARMv8 wheels compatible with NVIDIA's Jetpack 4.6.1 binary.
--qualitiesoption forsmoleculeandstitchto output consensus fastq.
- Python
Published by ontresearch over 4 years ago
medaka - v1.2.2
Minor release
Fixed
- Fixed incorrect read depth annotations in VCFs.
- Fixed missing files in PyPI source distribution.
- Fix
StopIterationissues in newer Pythons. ## Added - Added
-noption tomedaka_variantto add a sample field to outputs. - Set
HDF5_USE_FILE_LOCKING=FALSE, which some users report as useful. - Set
OMP_NUM_THREADS=1required to make Tensorflow anaconda use CPU resource sensibly.
- Python
Published by ontresearch over 5 years ago
medaka - v1.2.0
Performance release
- Improve inference performance by 30%.
- Add efficient multiprocessing to medaka stitch.
- Fix long-standing issue where genome regions could be unprocessed.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 over 5 years ago
medaka - v1.1.3
Bugfix release
- Work around tensorflow threading issue.
- Fix iteration error in retrieving trimmed reads.
- Add ability to
haploid2diploidtool on VCFs generated bymedaka_haploid_variant
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 over 5 years ago
medaka - v1.1.2
Bug fix and feature release
- Fix issues in command-line argument parsing.
- Add true ploidy-1 variant caller.
- Do not break contigs at unpolished regions (fill with input instead).
- Add multi-nucleotide variant decomposition to be compatible with DeepVariant.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 almost 6 years ago
medaka - v1.1.0
Update with new models and features.
- Upgrade to Tensorflow 2.2.
- Add ARM builds to PyPI release.
- Add Python 3.7 and 3.8 builds for x86-64.
- Add PromethION model for Guppy 4.0.11.
- Option to split MNPs to independent SNPs (for compatibility with DeepVariant).
- Fix a few bugs in variant annotation program.
- Single molecule consensus program now uses pyspoa.
- Remove methylation aggregation functionality.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 almost 6 years ago
medaka - v1.0.3
v1.0.3
Minor fixes release.
- Fix occasional mangled sam output in guppy2sam.
- Update htslib ecosystem to 1.10 to fix conda installation issue.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by mwykes about 6 years ago
medaka - v1.0.2
Minor fixes and models release.
- R9.4.1 variant calling models for Guppy 3.6.0 and updated benchmarks.
- Made r941minhigh_g360 the default consensus model.
- VCF GQ is now an integer in line with VCF spec.
- Fixed issue requiring a previous model for training.
- Fixed issue causing -p option of medaka_variant to crash.
- Fixed issue preventing installation in a virtualenv with python <3.6.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by mwykes about 6 years ago
medaka - v1.0.1
Minor fixes release, resolving issues introduced in v1.0.0.
- Fix default model for SNP calling.
- Fix issue causing medaka_consensus to crash.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by mwykes about 6 years ago
medaka - v1.0.0
Models, features and fixes release
- Consensus models for Guppy 3.6.0.
- Add functionality for auto-download of older models.
- Fix to methylation aggregation.
- VCF annotation tool.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by mwykes about 6 years ago
medaka - v0.12.0
Models, features and fixes release
- Variant calling models for R10.3 and R9.4.1 and updated benchmarks.
- Consensus models for Guppy 3.5.1.
- Add read group (RG) tag filtering.
- Add option to create consensus sequence via intermediate .vcf file.
- Update to methylation calling documentation.
- Addition of all-context modified-base aggregation.
- Minor speed improvement.
- Fix bug where force overwrite of output was always enabled.
- Fix bug where variant calling of a region crashed if the region began with a deletion.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by mwykes over 6 years ago
medaka - v0.11.5
R10.3 model and small fixes
- Add model for R10.3 on MinION.
- Fix index/compression issue with RLE workflow
- Write an empty vcf when no variants are found in medaka_variant.
- Fix a rare memory error during feature generation caused by very long indels.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 over 6 years ago
medaka - v0.11.2
Minor fix release
- Fix a memory error in pileup calculation.
- Update variant calling models (improved indel performance) and benchmarks.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 over 6 years ago
medaka - v0.11.1
Minor Release
- Preliminary hard-RLE model for R9.4.1
--regionsargument can now be a.bedfile.- Detect NaNs during training and halt early.
- Workaround pysam interface changes (for conda package).
- Support soft-RLE network training.
This release includes an experimental consensus mode using run-length encoded alignments. Use of this algorithm can be specified using the new "rle" model:
medaka_consensus -m r941_min_high_g340_rle -i basecalls.fasta -d draft.fa
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 over 6 years ago
medaka - v0.11.0
Feature release
- Consensus models for guppy 3.3 and 3.4.
- Aggregation of Guppy modified base probability tables.
- Multi-thread stitching of inference chunks in
medaka_consensus. - Optionally run whatshap phase at the end of
medaka_variant.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 over 6 years ago
medaka - v0.10.1
Minor fix release
- Fix bug where feature matrix was misaligned with coordinate system.
- Add missing arguments from smolecule command.
- Output contig names are no longer written as samtools-style regions.
- Fixed issue with medaka_variant failing on zero-coverage regions.
- Rename incorrectly named diploid SNP calling model.
- Made variant calling faster by resolving trivial bottleneck in variant classification.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 over 6 years ago
medaka - v0.10.0
Feature release
- Switched variant calling to an explicitly diploid calling model.
- Added a
-fforce overwrite option tomedaka_consenses. - Refreshed E. coli benchmark to include effect of
racon. - Refreshed variant calling benchmarks.
- Added C. elegans assembly benchmarks to documentation.
- Fixed bug causing larger than requested overlap in inference chunks.
- Corrected parsing of region strings with multiple
:charaters - Fixed rare consensus stitching error.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 almost 7 years ago
medaka - v0.9.2
Minor fix release.
- Additional fix to handling lowercase reference sequences.
- Fix bug in creation of RLE alignments.
- Update
update_model.pyscript. - Remove option to select labelling scheme during training.
- Unify how LabelSchemes store training data.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 almost 7 years ago
medaka - v0.9.1
Minor fix release
- Fix regression in
medaka stitchandmedaka snpspeed. - Handle lowercase letters in reference sequences.
- Remove
dillandyamlrequirements.
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 almost 7 years ago
medaka - v0.9.0
Bugfix and training refactor release
- Fix readlink issue on MacOS
- Fix bug where medaka_variant did not call indels by default
- Fix bug in determining when to split contigs
- Drop support for older basecaller models (guppy<3.0.3)
- Store models in git-lfs
- Simplify medaka_variant workflow for speed
- Make network feature generation 2x faster
- Add smolecule command
- Log use of GPU and cuDNN, noting workaround for RTX cards
- Refactor labelling of training data and storing of models
- Reimplement RLE feature generation
Please do not attempt to use the "Source code" assets attached below for running medaka, they do not include medaka's model files.
- Python
Published by cjw85 almost 7 years ago
medaka - v0.8.0
v0.8.0
Model release
- Add support for R10 basecaller
- Add support for diploid multi-labelling models
- Upgrade to tensorflow 1.14.0
Note: pypi binaries for the updated tensorflow are linked to CUDA10, previous medaka releases used a tensorflow version that was linked to CUDA9. This only affects users who run medaka on GPU hardware.
- Python
Published by javierblasco about 7 years ago
medaka - v0.6.5
Bug fix release
- Tidy up some parsing and sorting of regions from strings.
- Disable by default validation of output HDF during consensus.
- Refactor variant handling code.
- Ensure medaka consensus is given absolute path to model.
- Fix Makefile for parallel build.
- Python
Published by cjw85 about 7 years ago
medaka - v0.6.0
SNP calling, model, and bugfix release release
- Prototype SNP calling and phasing, benchmarks
- Add model for improved Flip-flop model in Guppy 2.3.5
- Rename models to be more logical
- Update to htslib version 1.9 for long cigars
- Workaround short-contig/no-coverage corner case during pileup.
- Python
Published by cjw85 over 7 years ago
medaka - v0.6.0-alpha.3
Variant calling pre-release
- added
medaka_variantpipeline for diploid variant calling - add whatshap 0.18 dependency
- update to htslib v1.9, handling long cigar strings. (#26)
- Python
Published by cjw85 over 7 years ago
medaka - v0.6.0-alpha.2
Variant calling pre-release
- added
medaka_variantpipeline for diploid variant calling - add whatshap 0.18 dependency
- Python
Published by cjw85 over 7 years ago
medaka - v0.6.0-alpha.1
Variant calling pre-release
- added
medaka_variantpipeline for diploid variant calling
- Python
Published by cjw85 over 7 years ago
medaka - v0.5.0
- Large refactor of training code
- Resolve hanging at the end of training #15
- Switch to CuDNN for GRU layers
- Improved storage and retrieval of features for better IO
- Training speed improved >10X
- Resolve issue with contained chunks during stitching #20
- Changes to
medaka_consensus- checks presence of
minimap2andsamtools - provides more feedback on error #16
- checks presence of
- Python
Published by cjw85 over 7 years ago
medaka - v0.4.0
- Large refactoring of feature and sample generation (https://github.com/nanoporetech/medaka/issues/10) Fixes many small bugs and edge cases
- Resize models for small contigs (https://github.com/nanoporetech/medaka/issues/9)
- Faster Generation of inference features
- Model updates
- Remove redundant samtools tview code
- Ability to handle multiple read types
- Limit CPU usage when running without a GPU
- Python
Published by cjw85 over 7 years ago
medaka - v0.4.0 Release Candidate 4
- Fix bug in
medaka stitchwhen--regionis specified.
- Python
Published by cjw85 over 7 years ago
medaka - v0.4.0 Release Candidate 5
- Accelerate multi-datatype pileup creation.
- Fix some bugs in training.
- Python
Published by cjw85 over 7 years ago
medaka - v0.4.0 Release Candidate 3
- Large refactoring of feature and sample generation
- Resize models for small contigs
- Python
Published by cjw85 over 7 years ago
medaka - v0.4.0 Release Candidate 2
- Fix import error after switching to local imports of keras/tensorflow
- Python
Published by cjw85 over 7 years ago
medaka - v0.4.0 Release Candidate 1
- Faster Generation of inference features
- Remove redundant
samtools tviewcode - Ability to handle multiple read types
- Python
Published by cjw85 over 7 years ago