gluoncv

Gluon CV Toolkit

https://github.com/dmlc/gluon-cv

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
    10 of 125 committers (8.0%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (11.5%) to scientific vocabulary

Keywords

action-recognition computer-vision deep-learning gan gluon image-classification machine-learning mxnet neural-network object-detection person-reid pose-estimation semantic-segmentation

Keywords from Contributors

deep-neural-networks distributed jax tensor transformer convnext autograd keras reinforcement-learning instance-segmentation
Last synced: 6 months ago · JSON representation

Repository

Gluon CV Toolkit

Basic Info
  • Host: GitHub
  • Owner: dmlc
  • License: apache-2.0
  • Language: Python
  • Default Branch: master
  • Homepage: http://gluon-cv.mxnet.io
  • Size: 37.8 MB
Statistics
  • Stars: 5,888
  • Watchers: 151
  • Forks: 1,206
  • Open Issues: 62
  • Releases: 10
Topics
action-recognition computer-vision deep-learning gan gluon image-classification machine-learning mxnet neural-network object-detection person-reid pose-estimation semantic-segmentation
Created almost 8 years ago · Last pushed about 1 year ago
Metadata Files
Readme License

README.md

Gluon CV Toolkit

Build Status GitHub license PyPI PyPI Pre-release Downloads

PWC PWC PWC PWC PWC

| Installation | Documentation | Tutorials |

GluonCV provides implementations of the state-of-the-art (SOTA) deep learning models in computer vision.

It is designed for engineers, researchers, and students to fast prototype products and research ideas based on these models. This toolkit offers four main features:

  1. Training scripts to reproduce SOTA results reported in research papers
  2. Supports both PyTorch and MXNet
  3. A large number of pre-trained models
  4. Carefully designed APIs that greatly reduce the implementation complexity
  5. Community supports

Please also checkout AutoGluon if you have image classification or object detection needs. We have built the MultimodalPredictor with an improved model zoo, including TIMM, Huggingface, MMDetection and more. With just a few lines of code, you can train and deploy high accuracy computer vision models for your application.

Demo


Check the HD video at Youtube or Bilibili.

Supported Applications

| Application | Illustration | Available Models | |:-----------------------:|:---:|:---:| | Image Classification:
recognize an object in an image. | classification | 50+ models, including
ResNet, MobileNet,
DenseNet, VGG, ... | | Object Detection:
detect multiple objects with their
bounding boxes in an image. | detection | Faster RCNN, SSD, Yolo-v3 | | Semantic Segmentation:
associate each pixel of an image
with a categorical label. | semantic | FCN, PSP, ICNet, DeepLab-v3, DeepLab-v3+, DANet, FastSCNN | | Instance Segmentation:
detect objects and associate
each pixel inside object area with an
instance label. | instance | Mask RCNN| | Pose Estimation:
detect human pose
from images. | pose | Simple Pose| | Video Action Recognition:
recognize human actions
in a video. | action_recognition | MXNet: TSN, C3D, I3D, I3Dslow, <a href="https://gluon-cv.mxnet.io/modelzoo/actionrecognition.html">P3D, <a href="https://gluon-cv.mxnet.io/modelzoo/actionrecognition.html">R3D, <a href="https://gluon-cv.mxnet.io/modelzoo/actionrecognition.html">R2+1D, <a href="https://gluon-cv.mxnet.io/modelzoo/actionrecognition.html">Non-local, <a href="https://gluon-cv.mxnet.io/modelzoo/actionrecognition.html">SlowFast
PyTorch: <a href="https://gluon-cv.mxnet.io/model
zoo/actionrecognition.html">TSN, <a href="https://gluon-cv.mxnet.io/modelzoo/actionrecognition.html">I3D, <a href="https://gluon-cv.mxnet.io/modelzoo/actionrecognition.html">I3Dslow, R2+1D, Non-local, CSN, SlowFast, TPN | | Depth Prediction:
predict depth map
from images. | depth | Monodepth2| | GAN:
generate visually deceptive images | lsun | WGAN, CycleGAN, StyleGAN| | Person Re-ID:
re-identify pedestrians across scenes | re-id |Market1501 baseline |

Installation

GluonCV is built on top of MXNet and PyTorch. Depending on the individual model implementation(check model zoo for the complete list), you will need to install either one of the deep learning framework. Of course you can always install both for the best coverage.

Please also check installation guide for a comprehensive guide to help you choose the right installation command for your environment.

Installation (MXNet)

GluonCV supports Python 3.6 or later. The easiest way to install is via pip.

Stable Release

The following commands install the stable version of GluonCV and MXNet:

```bash pip install gluoncv --upgrade

native

pip install -U --pre mxnet -f https://dist.mxnet.io/python/mkl

cuda 10.2

pip install -U --pre mxnet -f https://dist.mxnet.io/python/cu102mkl ```

The latest stable version of GluonCV is 0.8 and we recommend mxnet 1.6.0/1.7.0

Nightly Release

You may get access to latest features and bug fixes with the following commands which install the nightly build of GluonCV and MXNet:

```bash pip install gluoncv --pre --upgrade

native

pip install -U --pre mxnet -f https://dist.mxnet.io/python/mkl

cuda 10.2

pip install -U --pre mxnet -f https://dist.mxnet.io/python/cu102mkl ```

There are multiple versions of MXNet pre-built package available. Please refer to mxnet packages if you need more details about MXNet versions.

Installation (PyTorch)

GluonCV supports Python 3.6 or later. The easiest way to install is via pip.

Stable Release

The following commands install the stable version of GluonCV and PyTorch:

```bash pip install gluoncv --upgrade

native

pip install torch==1.6.0+cpu torchvision==0.7.0+cpu -f https://download.pytorch.org/whl/torch_stable.html

cuda 10.2

pip install torch==1.6.0 torchvision==0.7.0 ``` There are multiple versions of PyTorch pre-built package available. Please refer to PyTorch if you need other versions.

The latest stable version of GluonCV is 0.8 and we recommend PyTorch 1.6.0

Nightly Release

You may get access to latest features and bug fixes with the following commands which install the nightly build of GluonCV:

```bash pip install gluoncv --pre --upgrade

native

pip install --pre torch torchvision torchaudio -f https://download.pytorch.org/whl/nightly/cpu/torch_nightly.html

cuda 10.2

pip install --pre torch torchvision torchaudio -f https://download.pytorch.org/whl/nightly/cu102/torch_nightly.html ```

Docs 📖

GluonCV documentation is available at our website.

Examples

All tutorials are available at our website!

Resources

Check out how to use GluonCV for your own research or projects.

Citation

If you feel our code or models helps in your research, kindly cite our papers:

``` @article{gluoncvnlp2020, author = {Jian Guo and He He and Tong He and Leonard Lausen and Mu Li and Haibin Lin and Xingjian Shi and Chenguang Wang and Junyuan Xie and Sheng Zha and Aston Zhang and Hang Zhang and Zhi Zhang and Zhongyue Zhang and Shuai Zheng and Yi Zhu}, title = {GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing}, journal = {Journal of Machine Learning Research}, year = {2020}, volume = {21}, number = {23}, pages = {1-7}, url = {http://jmlr.org/papers/v21/19-429.html} }

@article{he2018bag, title={Bag of Tricks for Image Classification with Convolutional Neural Networks}, author={He, Tong and Zhang, Zhi and Zhang, Hang and Zhang, Zhongyue and Xie, Junyuan and Li, Mu}, journal={arXiv preprint arXiv:1812.01187}, year={2018} }

@article{zhang2019bag, title={Bag of Freebies for Training Object Detection Neural Networks}, author={Zhang, Zhi and He, Tong and Zhang, Hang and Zhang, Zhongyue and Xie, Junyuan and Li, Mu}, journal={arXiv preprint arXiv:1902.04103}, year={2019} }

@article{zhang2020resnest, title={ResNeSt: Split-Attention Networks}, author={Zhang, Hang and Wu, Chongruo and Zhang, Zhongyue and Zhu, Yi and Zhang, Zhi and Lin, Haibin and Sun, Yue and He, Tong and Muller, Jonas and Manmatha, R. and Li, Mu and Smola, Alexander}, journal={arXiv preprint arXiv:2004.08955}, year={2020} } ```

Owner

  • Name: Distributed (Deep) Machine Learning Community
  • Login: dmlc
  • Kind: organization

A Community of Awesome Machine Learning Projects

GitHub Events

Total
  • Issues event: 5
  • Watch event: 113
  • Issue comment event: 3
  • Pull request event: 2
  • Fork event: 15
  • Create event: 1
Last Year
  • Issues event: 5
  • Watch event: 113
  • Issue comment event: 3
  • Pull request event: 2
  • Fork event: 15
  • Create event: 1

Committers

Last synced: 9 months ago

All Time
  • Total Commits: 894
  • Total Committers: 125
  • Avg Commits per committer: 7.152
  • Development Distribution Score (DDS): 0.685
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Joshua Z. Zhang c****h@g****m 282
Yi Zhu y****9@g****m 114
Tong He h****7@g****m 78
Mu Li m****i@a****m 46
muli m****i@c****u 43
Hang Zhang 8****9 40
Weisu Yin w****n@u****u 28
Serge Panev s****v@n****m 13
Jerry Zhang j****n@g****m 13
Kuang Haofei h****g@g****m 12
Xinyu Chen x****n@i****m 12
chinakook c****k@m****m 11
Jerry Zhang z****6@c****u 9
Hang Zhang z****g@r****u 7
Jian Guo 1****o 7
Wuxun Zhang w****g@i****m 6
YoungChan c****6@1****m 6
Haibin Lin l****c@g****m 5
Istvan Fehervari g****l@g****m 5
Sheng Zha s****a 5
Thomas Delteil t****1@g****m 5
adursun a****n@o****r 4
Karan Jariwala k****a@g****m 4
Chaitanya Prakash Bapat c****t@g****m 4
BebDong B****g 4
Aston Zhang 2****g 4
Wentao Ma m****a@g****m 3
Huson CHEN 1****1@q****m 3
Xueqing Deng 4****7 3
Eric Junyuan Xie p****g 3
and 95 more...

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 87
  • Total pull requests: 31
  • Average time to close issues: 4 months
  • Average time to close pull requests: 10 days
  • Total issue authors: 84
  • Total pull request authors: 20
  • Average comments per issue: 2.84
  • Average comments per pull request: 2.0
  • Merged pull requests: 17
  • Bot issues: 0
  • Bot pull requests: 1
Past Year
  • Issues: 3
  • Pull requests: 3
  • Average time to close issues: 3 months
  • Average time to close pull requests: N/A
  • Issue authors: 3
  • Pull request authors: 3
  • Average comments per issue: 1.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 1
Top Authors
Issue Authors
  • siriusmehta (2)
  • rikkudo (2)
  • wenzhengzeng (2)
  • osamaibrahim13022 (1)
  • lironglu (1)
  • 791136190 (1)
  • Rong-Tao (1)
  • HentaiBestGenre (1)
  • Mashaakim (1)
  • ninafiona (1)
  • singhalarchit (1)
  • ahmadsharif1 (1)
  • Ninad-Chaudhari (1)
  • VadisettyRahul (1)
  • akowalsk (1)
Pull Request Authors
  • yinweisu (8)
  • 315386775 (4)
  • AnandPolamarasetti (2)
  • h2oa (2)
  • Justsubh01 (2)
  • dependabot[bot] (2)
  • VadisettyRahul (2)
  • KuangHaofei (1)
  • liueo (1)
  • mxbi (1)
  • TrellixVulnTeam (1)
  • josephevans (1)
  • zhanghang1989 (1)
  • zhreshold (1)
  • ChristophReich1996 (1)
Top Labels
Issue Labels
Stale (60) good first issue (2) enhancement (1) call for contribution (1)
Pull Request Labels
dependencies (2)

Packages

  • Total packages: 3
  • Total downloads:
    • pypi 42,411 last-month
  • Total docker downloads: 2,529,412
  • Total dependent packages: 11
    (may contain duplicates)
  • Total dependent repositories: 394
    (may contain duplicates)
  • Total versions: 1,553
  • Total maintainers: 3
  • Total advisories: 1
pypi.org: gluoncv

Gluon CV Toolkit

  • Versions: 1,535
  • Dependent Packages: 11
  • Dependent Repositories: 392
  • Downloads: 42,352 Last month
  • Docker Downloads: 2,529,412
Rankings
Stargazers count: 0.4%
Dependent packages count: 0.7%
Docker downloads count: 0.7%
Dependent repos count: 0.7%
Average: 0.8%
Forks count: 1.2%
Downloads: 1.4%
Maintainers (1)
Last synced: 6 months ago
proxy.golang.org: github.com/dmlc/gluon-cv
  • Versions: 9
  • Dependent Packages: 0
  • Dependent Repositories: 1
Rankings
Forks count: 0.7%
Stargazers count: 0.9%
Average: 3.7%
Dependent repos count: 4.8%
Dependent packages count: 8.5%
Last synced: 6 months ago
pypi.org: gluoncv-torch

MXNet Gluon CV Toolkit

  • Versions: 9
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 59 Last month
Rankings
Stargazers count: 0.4%
Forks count: 1.2%
Dependent packages count: 7.4%
Average: 9.1%
Downloads: 14.4%
Dependent repos count: 22.2%
Maintainers (2)
Last synced: 6 months ago

Dependencies

.github/workflows/build_test.yml actions
  • actions/checkout v2 composite
  • aws-actions/configure-aws-credentials v1 composite
  • dawidd6/action-download-artifact v2 composite
  • haya14busa/action-workflow_run-status v1 composite
  • peter-evans/create-or-update-comment v1.4.3 composite
.github/workflows/stale.yml actions
  • actions/stale v3 composite
.github/workflows/unittest.yml actions
  • actions/checkout v2 composite
  • actions/upload-artifact v2 composite
  • conda-incubator/setup-miniconda v2.0.0 composite
setup.py pypi