phenobench

PhenoBench Development Kit

https://github.com/prbonn/phenobench

Science Score: 62.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
    1 of 1 committers (100.0%) from academic institutions
  • Institutional organization owner
    Organization prbonn has institutional domain (www.ipb.uni-bonn.de)
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (12.6%) to scientific vocabulary

Keywords

dataset leaf-instance-segmentation panoptic-segmentation phenobench plant-detection semantic-segmentation
Last synced: 6 months ago · JSON representation ·

Repository

PhenoBench Development Kit

Basic Info
  • Host: GitHub
  • Owner: PRBonn
  • License: other
  • Language: Python
  • Default Branch: main
  • Homepage: https://www.phenobench.org
  • Size: 22.5 KB
Statistics
  • Stars: 31
  • Watchers: 5
  • Forks: 5
  • Open Issues: 2
  • Releases: 0
Topics
dataset leaf-instance-segmentation panoptic-segmentation phenobench plant-detection semantic-segmentation
Created over 2 years ago · Last pushed over 2 years ago
Metadata Files
Readme License Citation

README.md

PhenoBench Development Kit

PhenoBench is a large dataset and benchmarks for the semantic interpretation of images of real agricultural fields. Together with the dataset, we provide a development kit that provides:

  • a framework-agnostic data loader.
  • visualization functions for drawing our data format.
  • evaluation scripts, phenobench-eval, for all tasks (also used on the CodaLab servers).
  • validator, called phenobench-validator, checking CodaLab submission files for consistency

For more information on the dataset, please visit www.phenobench.org.

Getting started

  1. Download the dataset.
  2. Install the development kit: pip install phenobench.
  3. Explore the data with the tutorial notebook.
  4. See the code of our baselines as a starting point or train your own models.
  5. See the FAQ for common questions and troubleshooting.

If you discover a problem or have general questions regarding the dataset, don't hesitate to open an issues. We will try to resolve your issue as quickly as possible.

Evaluation scripts (phenobench-eval)

Important: Install all dependencies with pip install "phenobench[eval]".

For evaluating and computing the metrics for a specific task, you can run the phenobench-eval tool as follows:

bash $ phenobench-eval --task <task> --phenobench_dir <dir> --prediction_dir <dir> --split <split> - task is one of the following options: semantics, panoptic, leaf_instances, plant_detection, leaf_detection, or hierarchical. - phenobench_dir is the root directory of the PhenoBench dataset, where train, val directories are located. - prediction_dir is the directory containing the predictions as sub-folders, which depend on the specific tasks. - split is either train or val.

Note that all ablation studies of your approach should run on the validation set. Thus, we also provide a comparably large validation set to enable a solid comparison of different settings of your approach.

CodaLab Submission Validator (phenobench-validator)

Before you submit a zip file to our CodaLab competitions, see also our available benchmarks, you can use the phenobench-validator to check your submission for consistency. The tool is also part of the pip package, therefore after installing the package via pip, you can call the phenobench-validator as follows:

bash $ phenobench-validator --task <task> --phenobench_dir <dir> --zipfile <zipfile> - task is one of the following options: semantics, panoptic, leaf_instances, plant_detection, leaf_detection, or hierarchical. - phenobench_dir is the root directory of the PhenoBench dataset, where train, val directories are located. - zipfile is the zip file that you want to submit to the corresponding benchmark on CodaLab.

Frequently Asked Questions

Question: What are the usage restrictions of the PhenoBench dataset?
Answer: We distribute the dataset using the CC-BY-SA International 4.0 license, which allows research but also commercial usage as long as the dataset is properly attributed (via a citation of the corresponding paper) and distributed with the same license if altered or modified. See also our dataset overview page for the full license text, etc.

Owner

  • Name: Photogrammetry & Robotics Bonn
  • Login: PRBonn
  • Kind: organization
  • Email: cyrill.stachniss@igg.uni-bonn.de
  • Location: Bonn

Photogrammetry & Robotics Lab at the University of Bonn

Citation (CITATION.cff)

cff-version: 1.2.0
preferred-citation:
  title: "PhenoBench — A Large Dataset and Benchmarks for Semantic Image Interpretation in the Agricultural Domain"
  year: "2023"
  type: article
  journal: "arXiv"
  url: https://arxiv.org/pdf/2306.04557.pdf
  codeurl: https://github.com/PRBonn/phenobench-devkit
  authors:
    - family-names: Weyler
      given-names: Jan
    - family-names: Magistri
      given-names: Federico
    - family-names: Marks
      given-names: Elias
    - family-names: Chong
      given-names: Yue Linn
    - family-names: Sodano
      given-names: Matteo
    - family-names: Roggiolani
      given-names: Gianmarco
    - family-names: Chebrolu
      given-names: Nived
    - family-names: Stachniss
      given-names: Cyrill
    - family-names: Behley
      given-names: Jens

GitHub Events

Total
  • Issues event: 3
  • Watch event: 8
  • Issue comment event: 1
  • Fork event: 2
Last Year
  • Issues event: 3
  • Watch event: 8
  • Issue comment event: 1
  • Fork event: 2

Committers

Last synced: about 2 years ago

All Time
  • Total Commits: 2
  • Total Committers: 1
  • Avg Commits per committer: 2.0
  • Development Distribution Score (DDS): 0.0
Past Year
  • Commits: 2
  • Committers: 1
  • Avg Commits per committer: 2.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Jens Behley j****y@i****e 2
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 4
  • Total pull requests: 0
  • Average time to close issues: 6 days
  • Average time to close pull requests: N/A
  • Total issue authors: 4
  • Total pull request authors: 0
  • Average comments per issue: 1.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 1
  • Pull requests: 0
  • Average time to close issues: 14 days
  • Average time to close pull requests: N/A
  • Issue authors: 1
  • Pull request authors: 0
  • Average comments per issue: 2.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • Idol-Dou2021 (1)
  • Camilochiang (1)
  • niqbal996 (1)
  • illrayy (1)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels

Packages

  • Total packages: 1
  • Total downloads:
    • pypi 38 last-month
  • Total dependent packages: 0
  • Total dependent repositories: 1
  • Total versions: 1
  • Total maintainers: 1
pypi.org: phenobench

The official development kit of the PhenoBench dataset (www.phenobench.org).

  • Homepage: https://www.phenobench.org
  • Documentation: https://phenobench.readthedocs.io/
  • License: MIT License Copyright (c) 2023 Jan Weyler, Federico Magistri, Elias Marks, Yue Linn Chong, Matteo Sodano, Gianmarco Roggiolani, Nived Chebrolu, Cyrill Stachniss, Jens Behley. Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
  • Latest release: 0.1.0
    published over 2 years ago
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 38 Last month
Rankings
Dependent packages count: 10.1%
Stargazers count: 16.6%
Forks count: 19.1%
Average: 21.5%
Dependent repos count: 21.6%
Downloads: 40.0%
Maintainers (1)
Last synced: 7 months ago

Dependencies

pyproject.toml pypi
  • Pillow >6.2.1
  • matplotlib *
  • numpy *