Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/aspuru-guzik-group/computer-vision-for-the-chemistry-lab

Use convolutional neural net to detect segment and classify material phases and vessels in chemistry lab and other setting involving materials in mostly transparent vessels

https://github.com/aspuru-guzik-group/computer-vision-for-the-chemistry-lab

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: zenodo.org
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.2%) to scientific vocabulary
Last synced: 9 months ago · JSON representation

Repository

Use convolutional neural net to detect segment and classify material phases and vessels in chemistry lab and other setting involving materials in mostly transparent vessels

Basic Info
  • Host: GitHub
  • Owner: aspuru-guzik-group
  • License: mit
  • Language: Python
  • Default Branch: master
  • Size: 4.23 MB
Statistics
  • Stars: 24
  • Watchers: 2
  • Forks: 7
  • Open Issues: 3
  • Releases: 1
Created over 6 years ago · Last pushed over 4 years ago
Metadata Files
Readme License

README.md

Computer vision for recognition segmentation and classification of materials and vessels in the chemistry lab (and other settings)

The methods to in this repository are aimed to detect segment and classify vessels, and material phases, in mostly transparent containers/vessels in the chemistry lab. All the methods here are based on convolutional neural nets (CNN). The methods were trained using the Vector-LabPics dataset.

Semantic segmentation

Network for semantic segmentation of both vessels and materials using fully convolutional net can be found here:

PSP net.

This basically assigns one or more class per pixel. The classes includes vessel or various of materials class such as liquids,solids powder,foam... (Figure 1).

Instance segmentation.

Nets that split the image to instances of materials and vessels (Figure 2) can be found here:

Generator evaluator selector net (Hierarchical)

and:

Mask R-CNN

Vector LabPics dataset

The Vector LabPics dataset contains images of materials and vessels in the chemistry lab and other settings. The images are annotated for both the materials and vessels for both semantic and instance segmentation. Examples can be seen in Figures 1 and 2. The full dataset can be download from Here or here

Figure 1 : Examples for semantic segmentation from the LabPics dataset (GT) and net results (Pred)(Images taken from the NileRed youtube channel).

Figure 1: Examples for instance segmentation from the LabPics dataset (GT) and net results (Pred)(Images taken from the NileRed youtube channel).

Thanks

The images for the LabPics dataset were supplied by the following sources Nessa Carson (@SuperScienceGrl Twitter), Chemical and Engineering Science chemistry in pictures, YouTube channels dedicated to chemistry experiments: NurdRage, NileRed, DougsLab, ChemPlayer, and Koen2All. Additional sources for images include Instagram channels chemistrylover(Joana Kulizic),Chemistry.shz (Dr.Shakerizadeh-shirazi), MinistryOfChemistry, Chemistry And Me, ChemistryLifeStyle, vacuumdistillation, and OrganicChemistryLab

Owner

  • Name: Aspuru-Guzik group repo
  • Login: aspuru-guzik-group
  • Kind: organization

GitHub Events

Total
  • Watch event: 1
Last Year
  • Watch event: 1