Data

Tools

Indexes

Applications

Experiments

Open Source Science

torch-waymo

PyTorch dataloader for Waymo Open Dataset

https://github.com/willguimont/torch_waymo

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (7.0%) to scientific vocabulary

Keywords

dataloader dataset point-cloud pytorch torch waymo
Last synced: 6 months ago · JSON representation ·

Repository

PyTorch dataloader for Waymo Open Dataset

Basic Info
  • Host: GitHub
  • Owner: willGuimont
  • License: mit
  • Language: Python
  • Default Branch: master
  • Homepage:
  • Size: 19.5 KB
Statistics
  • Stars: 14
  • Watchers: 1
  • Forks: 3
  • Open Issues: 1
  • Releases: 0
Topics
dataloader dataset point-cloud pytorch torch waymo
Created about 3 years ago · Last pushed about 2 years ago
Metadata Files
Readme License Citation

README.md

torch_waymo

Load Waymo Open Dataset in PyTorch

Cite this repository: @software{Guimont-Martin_A_PyTorch_dataloader_2023, author = {Guimont-Martin, William}, month = {1}, title = {{A PyTorch dataloader for Waymo Open Dataset}}, version = {0.1.1}, year = {2023} }

Usage

Requires: - Python < 3.10

Download the dataset

```shell

Login to gcloud

gcloud auth login

Download the full dataset

cd gsutil -m cp -r \ "gs://waymoopendatasetv141/individualfiles/training" \ "gs://waymoopendatasetv141/individualfiles/validation" \ . ```

Convert it

```shell

Make a tf venv

python -m venv venvtf source venvtf/bin/activate pip install torch_waymo[waymo]

Convert all the dataset

torch-waymo-convert --dataset

Or only convert the training split

torch-waymo-convert --dataset --split training

Or convert multiple splits

torch-waymo-convert --dataset --split training validation ```

Load it in your project

Now that the dataset is converted, you don't have to depend on waymo-open-dataset-tf-2-6-0 in your project. You can simply install torch_waymo in your project.

shell pip install torch_waymo

Example usage:

```python from torch_waymo import WaymoDataset

train_dataset = WaymoDataset('~/Datasets/Waymo/converted', 'training')

for i in range(10): # frame is of type SimplifiedFrame frame = traindataset[i] print(frame.timestampmicros) ```

Owner

  • Name: William Guimont-Martin
  • Login: willGuimont
  • Kind: user
  • Location: Quebec City, Canada
  • Company: @norlab-ulaval, Université Laval

Ph.D. student in deep learning and mobile robotics at Norlab, Université Laval. Candidate to the engineering profession (CEP). Inventor.

Citation (CITATION.cff) 

# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!

cff-version: 1.2.0
title: torch_waymo: A PyTorch dataloader for Waymo Open Dataset
message: 'If you use this software, please cite it as below.'
type: software
authors:
  - family-names: Guimont-Martin
    given-names: William
    orcid: 'https://orcid.org/0000-0002-8850-8399'
    email: william.guimont-martin.1@ulaval.ca
    affiliation: Université Laval
repository-code: 'https://github.com/willGuimont/torch_waymo'
url: 'https://github.com/willGuimont/torch_waymo'
abstract: Load Waymo Open Dataset in PyTorch
keywords:
  - point cloud
  - torch
  - pytorch
  - dataset
  - waymo
  - dataloader
license: MIT
version: 0.1.1
date-released: '2023-01-31'

GitHub Events

Total
  • Watch event: 3
  • Issue comment event: 1
Last Year
  • Watch event: 3
  • Issue comment event: 1

Committers

Last synced: about 1 year ago

All Time
  • Total Commits: 11
  • Total Committers: 3
  • Avg Commits per committer: 3.667
  • Development Distribution Score (DDS): 0.273
Past Year
  • Commits: 1
  • Committers: 1
  • Avg Commits per committer: 1.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
William Guimont-Martin w****0@h****m 8
William Guimont-Martin w****t 2
Damien LaRocque p****n@g****m 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 1
  • Total pull requests: 1
  • Average time to close issues: N/A
  • Average time to close pull requests: 3 minutes
  • Total issue authors: 1
  • Total pull request authors: 1
  • Average comments per issue: 1.0
  • Average comments per pull request: 0.0
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • simutisernestas (1)
Pull Request Authors
  • IamPhytan (1)
Top Labels
Issue Labels
Pull Request Labels

Packages

  • Total packages: 1
  • Total downloads:
    • pypi 32 last-month
  • Total dependent packages: 0
  • Total dependent repositories: 0
  • Total versions: 5
  • Total maintainers: 1
pypi.org: torch-waymo

Load Waymo Open Dataset in PyTorch

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 32 Last month
Rankings
Dependent packages count: 6.6%
Downloads: 12.7%
Average: 18.2%
Forks count: 19.6%
Stargazers count: 21.8%
Dependent repos count: 30.6%
Maintainers (1)
wigum
Last synced: 6 months ago

Dependencies

pyproject.toml pypi
  • numpy *
  • torch *
  • tqdm *
requirements.txt pypi
  • numpy *
  • torch *
  • tqdm *
requirements_dev.txt pypi
  • black * development