davisinteractive

Package to evaluate interactive segmentation with scribbles at DAVIS dataset.

https://github.com/albertomontesg/davis-interactive

Science Score: 18.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
○
codemeta.json file
○
.zenodo.json file
○
DOI references
○
Academic publication links
○
Academic email domains
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (12.8%) to scientific vocabulary

Last synced: 10 months ago · JSON representation ·

Repository

Package to evaluate interactive segmentation with scribbles at DAVIS dataset.

Basic Info

Host: GitHub
Owner: albertomontesg
License: gpl-3.0
Language: Python
Default Branch: master
Homepage: http://interactive.davischallenge.org
Size: 5.73 MB

Statistics

Stars: 59
Watchers: 5
Forks: 8
Open Issues: 4
Releases: 0

Created over 8 years ago · Last pushed about 2 years ago

Metadata Files

Readme License Citation

DAVIS Interactive Evaluation Framework

This is a framework to evaluate interactive segmentation models over the DAVIS 2017 dataset. The code aims to provide an easy-to-use interface to test and validate interactive segmentation models.

This tool is also used to evaluate the Interactive Track of the DAVIS Challenges on Video Object Segmentation. More information about the latest challenge edition in the DAVIS website.

You can find an example of how to use the package in the following repository:

Scribble-OSVOS

DAVIS Scribbles

In the classical DAVIS Semi-supervised Challenge track, the task is to segment an object in a semi-supervised manner, i.e. the given input is the ground truth mask of the first frame. In the DAVIS Interactive Challenge, in contrast, the user input is scribbles, which can be drawn much faster by humans and thus are a more realistic type of input.

The interactive annotation and segmentation consist in an iterative loop which is evaluated as follows:

In the first interaction, a human-annotated scribble for each object in the video sequence is provided to the segmentation model. As a result, the model has to predict a segmentation mask containing all the objects for all the frames.
Note: all the scribbles are annotated in a single frame, but this does not have to be the first frame in the sequence, as the annotators were instructed to annotate the most relevant and meaningful frame. This is in contrast to the semi-supervised track, where - only and strictly - the first frame is annotated.
Then, the predicted masks are submitted to a server that returns human-simulated scribbles. These scribbles are always annotated in a single frame. The frame is selected as the one with the worst evaluation result among a list of frames specified by the user. By default, this list contains all the frames in the sequence.
During the following steps, the segmentation model keeps iterating between predicting the masks using the new scribbles and submitting the masks to obatain new scribbles.

Evaluation: The evaluation metric is the mean of the Region similarity $\mathcal{J}$ and the Contour Accuracy $\mathcal{F}$. More information of the metrics here. The evaluation for the train and val subsets can be done offline at any time, whereas the evaluation for the test-dev has to be done against a server that is only available during the challanges period.

More information: Please check the Installation guide to install the package and dowload the scribbles. Moreover, refer to the Usage guide to learn how to interface your code with the server.

Contributions: If you would like to add new features to the package, please do not hesitate to send a pull request.

Citation

Please cite both papers in your publications if DAVIS or this code helps your research.

tex @article{Caelles_arXiv_2018, author = {Sergi Caelles and Alberto Montes and Kevis-Kokitsi Maninis and Yuhua Chen and Luc {Van Gool} and Federico Perazzi and Jordi Pont-Tuset}, title = {The 2018 DAVIS Challenge on Video Object Segmentation}, journal = {arXiv:1803.00557}, year = {2018} }

latex @article{Pont-Tuset_arXiv_2017, author = {Jordi Pont-Tuset and Federico Perazzi and Sergi Caelles and Pablo Arbel\'aez and Alexander Sorkine-Hornung and Luc {Van Gool}}, title = {The 2017 DAVIS Challenge on Video Object Segmentation}, journal = {arXiv:1704.00675}, year = {2017} }

Owner

Name: Alberto Montes
Login: albertomontesg
Kind: user
Location: Zürich
Company: Google

Website: http://montesg.xyz
Repositories: 42
Profile: https://github.com/albertomontesg

Staff Software Enginner @googlers

Citation (CITATION)

@article{Caelles_arXiv_2018,
  author = {Sergi Caelles and Alberto Montes and Kevis-Kokitsi Maninis and Yuhua Chen and Luc {Van Gool} and Federico Perazzi and Jordi Pont-Tuset},
  title = {The 2018 DAVIS Challenge on Video Object Segmentation},
  journal = {arXiv:1803.00557},
  year = {2018}
}
@inproceedings{Perazzi2016,
  author = {F. Perazzi and J. Pont-Tuset and B. McWilliams and L. {Van Gool} and M. Gross and A. Sorkine-Hornung},
  title = {A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation},
  booktitle = {Computer Vision and Pattern Recognition},
  year = {2016}
}

GitHub Events

Total

Watch event: 1

Last Year

Watch event: 1

Issues and Pull Requests

Last synced: 11 months ago

All Time

Total issues: 33
Total pull requests: 30
Average time to close issues: 20 days
Average time to close pull requests: 1 day
Total issue authors: 8
Total pull request authors: 3
Average comments per issue: 0.97
Average comments per pull request: 1.1
Merged pull requests: 29
Bot issues: 0
Bot pull requests: 1

Past Year

Issues: 0
Pull requests: 1
Average time to close issues: N/A
Average time to close pull requests: N/A
Issue authors: 0
Pull request authors: 1
Average comments per issue: 0
Average comments per pull request: 0.0
Merged pull requests: 0
Bot issues: 0
Bot pull requests: 1

View more stats

Top Authors

Issue Authors

scaelles (15)
albertomontesg (10)
kmaninis (3)
be-redAsmara (1)
heethesh (1)
longmalongma (1)
zyy-cn (1)
zanglam (1)

Pull Request Authors

albertomontesg (23)
scaelles (6)
dependabot[bot] (2)

Top Labels

Issue Labels

enhancement (19) discussion (1) bug (1) performance (1)

Pull Request Labels

dependencies (2)

Packages

Total packages: 1
Total downloads:
- pypi 136 last-month

Total dependent packages: 0
Total dependent repositories: 11
Total versions: 30
Total maintainers: 1

pypi.org: davisinteractive

Evaluation Framework for DAVIS Interactive Segmentation

Homepage: https://github.com/albertomontesg/davis-interactive
Documentation: https://davisinteractive.readthedocs.io/
License: GPL v3
Latest release: 1.0.4
published about 6 years ago

Versions: 30
Dependent Packages: 0
Dependent Repositories: 11
Downloads: 136 Last month

Rankings

Dependent repos count: 4.4%

Stargazers count: 9.3%

Average: 10.0%

Dependent packages count: 10.1%

Forks count: 11.9%

Downloads: 14.2%

Maintainers (1)

albertomontesg