Data

Tools

Indexes

Applications

Experiments

Open Source Science

open_clip_training

https://github.com/zinengtang/open_clip_training

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (2.4%) to scientific vocabulary
Last synced: 6 months ago · JSON representation ·

Repository

Basic Info
  • Host: GitHub
  • Owner: zinengtang
  • License: other
  • Language: Python
  • Default Branch: main
  • Size: 2.28 MB
Statistics
  • Stars: 0
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created 10 months ago · Last pushed 10 months ago
Metadata Files
Readme Changelog License Citation

README.md

Installation

pip install -e .

Usage

``` from PIL import Image import open_clip import torch

device = "cuda:6" if torch.cuda.isavailable() else "cpu" modelname = "ViT-SO400M-14-SigLIP"

model_name = "ViT-B-16-SigLIP"

pretrained = ""

model, , transform = openclip.createmodelandtransforms(modelname, pretrained=pretrained) model.preparelatent() model = model.to(device).to(torch.bfloat16) tokenizer = openclip.gettokenizer(modelname)

pooledfeaturestext, lasthiddenstatestext = model.text(tokenizer('a beautiful tree').to(image.device), usessl_head=False)

inputimage = transform(Image.open('input img')).unsqueeze(0).to(device).to(torch.bfloat16) pooledfeaturesvision, lasthiddenstatesvision = model.visual(image, usesslhead=False) ```

Owner

  • Name: Zineng Tang
  • Login: zinengtang
  • Kind: user

Currently UNC-NLP, MURGe-Lab and previously Microsoft Intern

Citation (CITATION.cff) 

cff-version: 1.1.0
message: If you use this software, please cite it as below.
authors:
  - family-names: Ilharco
    given-names: Gabriel
  - family-names: Wortsman
    given-names: Mitchell
  - family-names: Wightman
    given-names: Ross
  - family-names: Gordon
    given-names: Cade   
  - family-names: Carlini
    given-names: Nicholas
  - family-names: Taori
    given-names: Rohan
  - family-names: Dave
    given-names: Achal
  - family-names: Shankar
    given-names: Vaishaal
  - family-names: Namkoong
    given-names: Hongseok
  - family-names: Miller
    given-names: John
  - family-names: Hajishirzi
    given-names: Hannaneh
  - family-names: Farhadi
    given-names: Ali
  - family-names: Schmidt
    given-names: Ludwig
title: OpenCLIP
version: v0.1
doi: 10.5281/zenodo.5143773
date-released: 2021-07-28

GitHub Events

Total
  • Public event: 1
  • Push event: 11
Last Year
  • Public event: 1
  • Push event: 11

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 1
  • Total Committers: 1
  • Avg Commits per committer: 1.0
  • Development Distribution Score (DDS): 0.0
Past Year
  • Commits: 1
  • Committers: 1
  • Avg Commits per committer: 1.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
zinengtang d****o@g****m 1

Issues and Pull Requests

Last synced: 10 months ago

All Time
  • Total issues: 0
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 0
  • Total pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels

Dependencies

.github/workflows/ci.yml actions
  • actions/cache v3 composite
  • actions/checkout v3 composite
  • actions/download-artifact v3 composite
  • actions/setup-python v4 composite
  • actions/upload-artifact v3 composite
.github/workflows/clear-cache.yml actions
  • actions/github-script v6 composite
.github/workflows/python-publish.yml actions
  • actions-ecosystem/action-regex-match v2 composite
  • actions/checkout v2 composite
  • actions/setup-python v2 composite
  • softprops/action-gh-release v1 composite
pyproject.toml pypi
  • ftfy *
  • huggingface-hub *
  • nlpaug *
  • nltk *
  • pandas *
  • pyarrow *
  • regex *
  • sentencepiece *
  • spacy *
  • timm *
  • torch >=1.9.0
  • torchvision *
  • tqdm *
  • transformers *
  • wandb *
  • webdataset *
requirements-test.txt pypi
  • pytest ==7.2.0 test
  • pytest-split ==0.8.0 test
  • timm >=1.0.7 test
  • transformers * test
requirements-training.txt pypi
  • braceexpand *
  • fsspec *
  • ftfy *
  • huggingface_hub *
  • pandas *
  • regex *
  • timm >=1.0.7
  • torch >=1.9.0
  • torchvision *
  • tqdm *
  • transformers *
  • webdataset >=0.2.5
requirements.txt pypi
  • ftfy *
  • huggingface_hub *
  • nltk *
  • regex *
  • sentencepiece *
  • spacy *
  • timm *
  • torch >=1.9.0
  • torchvision *
  • tqdm *
  • transformers *
  • wandb *
  • webdataset *