https://github.com/adithya-s-k/eagle
A framework streamlining Training, Finetuning, Evaluation and Deployment of Multi Modal Language models
Science Score: 13.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
○.zenodo.json file
-
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (12.3%) to scientific vocabulary
Keywords
Repository
A framework streamlining Training, Finetuning, Evaluation and Deployment of Multi Modal Language models
Basic Info
Statistics
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 0
Topics
Metadata Files
README.md
Features
- Diverse Model Support: Llama3, Phi, Mistral, Gemma, and more.
- Versatile Image Encoding: CLIP, Seglip, RADIO, and others.
- Customization Made Simple: YAML files and CLI for adaptability.
- Efficient Resource Utilization: Seamless operation on a single GPU.
- Seamless Deployment: Docker locally or on cloud with Skypilot.
- Comprehensive Documentation: Includes datasets for successful implementation.
Table of Content
- Introduction
- Supported_Models
- Changelog
- Installation
- Pretrain
- Finetune
- Evaluate
- Inference
- Features to be Added
- Citation
11. Acknowledgement
SUPPORTED MODELS
LLMS
- Llama3
- Phi
- Mistral
- Gemma
Vision Encoder/Transformer
Audio Encoder/Transformer
Video Encode/Transformer
Multi Model
CHANGLE LOGS (What's New)
- Version 1.0.1:
- Added support for distributed training.
- Included accelerate library.
- Version 1.0.0:
- Initial release.
Installation
- Clone the repository from GitHub.
- Install dependencies using pip:
pip install -r requirements.txt. - Run
setup.shto set up the environment. - Start using Eagle!
PRETRAIN
- Utilize supported models for pretraining multimodal models.
FINETUNE
- Fine-tune pretrained models with custom datasets or tasks.
EVALUATE
- Evaluate model performance using specified metrics and datasets.
INFERENCE/DEPLOY
- Deploy models for inference on new data or integrate them into existing systems.
Features to be Added
- Add support for accelerate.
- Add support for additional Huggingface models such as falcon, mpt.
CITATION
@article{AdithyaSKolavi2024,
title={Eagle: Unified Platform to train multimodal models},
author={Adithya S Kolavi},
year={2024},
url={https://github.com/adithya-s-k/eagle}
}
ACKNOWLEDGEMENT
We would like to express our gratitude to the creators of LLaVA (Large Language and Vision Assistant) for providing the groundwork for our project. Visit their repository here.
Owner
- Name: Adithya S K
- Login: adithya-s-k
- Kind: user
- Location: Indian
- Company: Cognitivelab
- Website: https://adithyask.com/
- Twitter: adithya_s_k
- Repositories: 60
- Profile: https://github.com/adithya-s-k
Exploring Generative AI • Google DSC Lead'23 • Cloud & Full Stack Engineer • Drones & IoT • FOSS Contributor
GitHub Events
Total
- Watch event: 1
Last Year
- Watch event: 1
Issues and Pull Requests
Last synced: 11 months ago
All Time
- Total issues: 0
- Total pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Total issue authors: 0
- Total pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0
Past Year
- Issues: 0
- Pull requests: 0
- Average time to close issues: N/A
- Average time to close pull requests: N/A
- Issue authors: 0
- Pull request authors: 0
- Average comments per issue: 0
- Average comments per pull request: 0
- Merged pull requests: 0
- Bot issues: 0
- Bot pull requests: 0