ctbbio
some useful scripts for working with genomics and sequencing data
Science Score: 33.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
○codemeta.json file
-
○.zenodo.json file
-
✓DOI references
Found 3 DOI reference(s) in README -
✓Academic publication links
Links to: ncbi.nlm.nih.gov -
✓Committers with academic emails
4 of 8 committers (50.0%) from academic institutions -
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (11.9%) to scientific vocabulary
Repository
some useful scripts for working with genomics and sequencing data
Basic Info
- Host: GitHub
- Owner: christophertbrown
- License: mit
- Language: Python
- Default Branch: master
- Size: 2.26 MB
Statistics
- Stars: 18
- Watchers: 1
- Forks: 9
- Open Issues: 1
- Releases: 0
Metadata Files
README.md
bioscripts
some useful scripts for working with genomics and sequencing data
see also bioscripts27
installation
pip install ctbBio
rRNA identification using 16SfromHMM.py and 23SfromHMM.py
The scripts use cmsearch from the Infernal package to do a sequence-based HMM search against 16S and 23S covariance models. The curated model from SSU-Align is used for 16S, and a custom-built model for 23S. The method is similar to what SSU-Align does by default, but accounts for the fact that rRNA genes may contain large insertion sequences.
The method is described in:
"Unusual biology across a group comprising more than 15% of domain Bacteria" - Christopher T. Brown, Laura A. Hug, Brian C. Thomas, Itai Sharon, Cindy J. Castelle, Andrea Singh, Michael J. Wilkins, Kelly C. Wrighton, Kenneth H. Williams & Jillian F. Banfield (Nature 2015).
If using this software, please cite our paper along with Infernal and SSU-Align.
E. P. Nawrocki, D. L. Kolbe, and S. R. Eddy, "Infernal 1.0: inference of RNA alignments.," Bioinformatics, vol. 25, no. 10, pp. 1335–1337, May 2009.
E. P. Nawrocki, "Structural RNA Homology Search and Alignment using Covariance Models," Washington University in Saint Louis, School of Medicine, 2009.
requirements
- python3
- infernal
- rRNA_insertions.py requires HMMER3 and Pfam (use databases env. variable: ~/databases/pfam/Pfam-A.hmm).
databases
- 16S CM: databases/ssu-align-0p1.1.cm
- 23S CM: databases/23S.cm
use env. variable to reference databases (optional)
export ssucmdb="databases/ssu-align-0p1.1.cm"
export lsucmdb="databases/23S.cm"
example usage for finding and analyzing rRNA insertions
- find 16S rRNA genes and insertions
16SfromHMM.py -f <seqs.fa> -m -t 6 > <seqs.16S.fa>
- remove insertions (useful for phylogenetic analyses)
strip_masked.py -f <seqs.16S.fa> -l 10 > <seqs.16S.s10.fa>
note: -l 10 specifies that insertions >= 10 bp are removed
analyze insertions
rRNA_insertions.py <seqs.16S.fa> <False or tax_table.tsv>
ortholog identification between pairs of genomes using orthologer.py
orthologer.py conducts reciprocal usearch similarity searches between pairs of provided genomes to identify reciprocal best hits
genomes can be supplied as either gene or protein multi-fasta files (one file per genome; each ORF must have a unique identifier)
requirements
- python3
usearch
usage
orthologer.py <mode> <genome1> <genome2> <genome...> > orthologer.out
Mode can be either "reference" or "global."
In "reference" mode all searches will be conducted against the first genome that is listed. In "global" mode all possible pairwise searches are conducted between the listed genomes (# searches = #genomes^#genomes).
download genomes from NCBI
for usage see: ncbi_download.py -h
requirements
- python3
- tqdm
wgetesearchandefetchfrom NCBI Direct (optional)
download genomes
cat accessions.list | ncbi_download.py -g -
download proteins
cat accessions.list | ncbi_download.py -g - -s "*protein.faa.gz"
options
The --test option can be used to determine whether or not the accession numbers can be found without downloading the genomes.
The --convert option attempts to convert accession numbers when necessary, but requires that esearch and efetch from NCBI Direct be installed to the system PATH.
Owner
- Login: christophertbrown
- Kind: user
- Repositories: 5
- Profile: https://github.com/christophertbrown
GitHub Events
Total
- Watch event: 1
- Fork event: 1
Last Year
- Watch event: 1
- Fork event: 1
Committers
Last synced: over 2 years ago
Top Committers
| Name | Commits | |
|---|---|---|
| Chris Brown | c****b@c****l | 32 |
| Chris Brown | c****b@c****u | 30 |
| christophertbrown | c****b@i****l | 6 |
| Chris Brown | c****b@c****l | 5 |
| Chris Brown | c****b@c****u | 2 |
| Chris Brown | c****b@a****u | 1 |
| Chris Brown | c****b@b****u | 1 |
| christophertbrown | c****n | 1 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: about 1 year ago
All Time
- Total issues: 1
- Total pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Total issue authors: 1
- Total pull request authors: 0
- Average comments per issue: 7.0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Top Authors
Issue Authors
- nigiord (1)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels
Packages
- Total packages: 1
-
Total downloads:
- pypi 117 last-month
- Total dependent packages: 0
- Total dependent repositories: 0
- Total versions: 47
- Total maintainers: 1
pypi.org: ctbbio
scripts for working with sequencing data
- Homepage: https://github.com/christophertbrown/bioscripts
- Documentation: https://ctbbio.readthedocs.io/
- License: MIT
-
Latest release: 0.47
published almost 7 years ago
Rankings
Maintainers (1)
Dependencies
- biopython *
- networkx *
- numpy *
- pandas *
- python-Levenshtein *
- tqdm *