mani-skill

SAPIEN Manipulation Skill Framework, an open source GPU parallelized robotics simulator and benchmark, led by Hillbot, Inc.

https://github.com/haosulab/maniskill

Science Score: 54.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
    Links to: arxiv.org
  • Committers with academic emails
    3 of 21 committers (14.3%) from academic institutions
  • Institutional organization owner
    Organization haosulab has institutional domain (cseweb.ucsd.edu)
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (16.9%) to scientific vocabulary

Keywords

3d-computer-vision computer-vision embodied-ai reinforcement-learning robot-learning robot-manipulation robotics robotics-simulation simulation-environment
Last synced: 6 months ago · JSON representation

Repository

SAPIEN Manipulation Skill Framework, an open source GPU parallelized robotics simulator and benchmark, led by Hillbot, Inc.

Basic Info
  • Host: GitHub
  • Owner: haosulab
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Homepage: https://maniskill.ai/
  • Size: 860 MB
Statistics
  • Stars: 1,983
  • Watchers: 21
  • Forks: 338
  • Open Issues: 111
  • Releases: 35
Topics
3d-computer-vision computer-vision embodied-ai reinforcement-learning robot-learning robot-manipulation robotics robotics-simulation simulation-environment
Created over 3 years ago · Last pushed 6 months ago
Metadata Files
Readme Contributing License Citation

README.md

ManiSkill 3 (Beta)

teaser

Sample of environments/robots rendered with ray-tracing. Scene datasets sourced from AI2THOR and ReplicaCAD

Downloads Open In Colab PyPI version Docs status Discord

ManiSkill is a powerful unified framework for robot simulation and training powered by SAPIEN, with a strong focus on manipulation skills. The entire tech stack is as open-source as possible and ManiSkill v3 is in beta release now. Among its features include: - GPU parallelized visual data collection system. On the high end you can collect RGBD + Segmentation data at 30,000+ FPS with a 4090 GPU! - GPU parallelized simulation, enabling high throughput state-based synthetic data collection in simulation - GPU parallelized heterogeneous simulation, where every parallel environment has a completely different scene/set of objects - Example tasks cover a wide range of different robot embodiments (humanoids, mobile manipulators, single-arm robots) as well as a wide range of different tasks (table-top, drawing/cleaning, dextrous manipulation) - Flexible and simple task building API that abstracts away much of the complex GPU memory management code via an object oriented design - Real2sim environments for scalably evaluating real-world policies 100x faster via GPU simulation. - Sim2real support for deploying policies trained in simulation to the real world - Many tuned robot learning baselines in Reinforcement Learning (e.g. PPO, SAC, TD-MPC2), Imitation Learning (e.g. Behavior Cloning, Diffusion Policy), and large Vision Language Action (VLA) models (e.g. Octo, RDT-1B, RT-x)

For more details we encourage you to take a look at our paper, published at RSS 2025.

Please refer to our documentation to learn more information from tutorials on building tasks to sim2real to running baselines.

NOTE: This project currently is in a beta release, so not all features have been added in yet and there may be some bugs. If you find any bugs or have any feature requests please post them to our GitHub issues or discuss about them on GitHub discussions. We also have a Discord Server through which we make announcements and discuss about ManiSkill.

Users looking for the original ManiSkill2 can find the commit for that codebase at the v0.5.3 tag

Installation

Installation of ManiSkill is extremely simple, you only need to run a few pip installs and setup Vulkan for rendering.

```bash

install the package

pip install --upgrade mani_skill

install a version of torch that is compatible with your system

pip install torch ```

Finally you also need to set up Vulkan with instructions here

For more details about installation (e.g. from source, or doing troubleshooting) see the documentation

Getting Started

To get started, check out the quick start documentation: https://maniskill.readthedocs.io/en/latest/userguide/gettingstarted/quickstart.html

We also have a quick start colab notebook that lets you try out GPU parallelized simulation without needing your own hardware. Everything is runnable on Colab free tier.

For a full list of example scripts you can run, see the docs.

System Support

We currently best support Linux based systems. There is limited support for windows and MacOS at the moment. We are working on trying to support more features on other systems but this may take some time. Most constraints stem from what the SAPIEN package is capable of supporting.

| System / GPU | CPU Sim | GPU Sim | Rendering | | -------------------- | ------- | ------- | --------- | | Linux / NVIDIA GPU | | | | | Windows / NVIDIA GPU | | | | | Windows / AMD GPU | | | | | WSL / Anything | | | | | MacOS / Anything | | | |

Citation

If you use ManiSkill3 (versions mani_skill>=3.0.0) in your work please cite our ManiSkill3 paper as so:

@article{taomaniskill3, title={ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AI}, author={Stone Tao and Fanbo Xiang and Arth Shukla and Yuzhe Qin and Xander Hinrichsen and Xiaodi Yuan and Chen Bao and Xinsong Lin and Yulin Liu and Tse-kai Chan and Yuan Gao and Xuanlin Li and Tongzhou Mu and Nan Xiao and Arnav Gurha and Viswesh Nagaswamy Rajesh and Yong Woo Choi and Yen-Ru Chen and Zhiao Huang and Roberto Calandra and Rui Chen and Shan Luo and Hao Su}, journal = {Robotics: Science and Systems}, year={2025}, }

If you use ManiSkill2 (version mani_skill==0.5.3 or lower) in your work please cite the ManiSkill2 paper as so: @inproceedings{gu2023maniskill2, title={ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills}, author={Gu, Jiayuan and Xiang, Fanbo and Li, Xuanlin and Ling, Zhan and Liu, Xiqiang and Mu, Tongzhou and Tang, Yihe and Tao, Stone and Wei, Xinyue and Yao, Yunchao and Yuan, Xiaodi and Xie, Pengwei and Huang, Zhiao and Chen, Rui and Su, Hao}, booktitle={International Conference on Learning Representations}, year={2023} }

Note that some other assets, algorithms, etc. in ManiSkill are from other sources/research. We try our best to include the correct citation bibtex where possible when introducing the different components provided by ManiSkill.

License

All rigid body environments in ManiSkill are licensed under fully permissive licenses (e.g., Apache-2.0).

The assets are licensed under CC BY-NC 4.0.

Owner

  • Name: Hao Su's Lab, UCSD
  • Login: haosulab
  • Kind: organization

Committers

Last synced: over 1 year ago

All Time
  • Total Commits: 259
  • Total Committers: 21
  • Avg Commits per committer: 12.333
  • Development Distribution Score (DDS): 0.421
Past Year
  • Commits: 164
  • Committers: 13
  • Avg Commits per committer: 12.615
  • Development Distribution Score (DDS): 0.146
Top Committers
Name Email Commits
Stone Tao s****9@g****m 150
Jiayuan-Gu j****u@e****u 40
Jiayuan Gu 1****u 21
Xuanlin (Simon) Li 3****7 15
Xiqiang Liu 9****u 5
arth-shukla 4****a 5
Xander Hinrichsen 1****n 4
Dennis Chen 4****n 3
Zhiao Huang 3****r 3
Fanbo Xiang x****o@g****m 2
CreativeNick 4****k 1
Guru 5****a 1
Mayank Mittal 1****6 1
Nan 6****n 1
sean1295 6****5 1
Fanbo Xiang f****g@e****u 1
Lieλ m****s@q****m 1
PartyPenguin b****5@g****m 1
Tongzhou Mu t****u@g****m 1
Xixin(Asher) x****6@g****m 1
xuanlinli17 x****7@g****m 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 492
  • Total pull requests: 377
  • Average time to close issues: about 1 month
  • Average time to close pull requests: 4 days
  • Total issue authors: 205
  • Total pull request authors: 75
  • Average comments per issue: 2.16
  • Average comments per pull request: 0.47
  • Merged pull requests: 261
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 368
  • Pull requests: 228
  • Average time to close issues: 15 days
  • Average time to close pull requests: 4 days
  • Issue authors: 158
  • Pull request authors: 55
  • Average comments per issue: 1.85
  • Average comments per pull request: 0.39
  • Merged pull requests: 151
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • StoneT2000 (91)
  • songyuc (28)
  • hesic73 (23)
  • YZY14606 (16)
  • CreativeNick (11)
  • yeshenpy (9)
  • Jimntu (8)
  • yqi19 (8)
  • DevinQiao (6)
  • SumeetBatra (6)
  • seungbinjoo (5)
  • jstmn (5)
  • shaido987 (5)
  • j-thapa (5)
  • lyxichigoichie (5)
Pull Request Authors
  • StoneT2000 (210)
  • arth-shukla (18)
  • chenyenru (8)
  • AlexandreBrown (7)
  • Xander-Hinrichsen (7)
  • t-sekai (6)
  • songyuc (5)
  • arnavg115 (4)
  • sean1295 (4)
  • jstmn (4)
  • dwaitbhatt (4)
  • CreativeNick (4)
  • rrzhang139 (4)
  • hesic73 (3)
  • Viswesh-N (3)
Top Labels
Issue Labels
bug (33) question (30) enhancement (29) documentation (12) testing (3) needs context (1) maniskill 2 (1)
Pull Request Labels
bug (5) enhancement (4) question (4) documentation (1) maniskill 2 (1)

Packages

  • Total packages: 4
  • Total downloads:
    • pypi 10,119 last-month
  • Total dependent packages: 0
    (may contain duplicates)
  • Total dependent repositories: 0
    (may contain duplicates)
  • Total versions: 219
  • Total maintainers: 1
proxy.golang.org: github.com/haosulab/maniskill
  • Versions: 11
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 6.5%
Average: 6.7%
Dependent repos count: 6.9%
Last synced: 6 months ago
proxy.golang.org: github.com/haosulab/ManiSkill
  • Versions: 11
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent packages count: 6.5%
Average: 6.7%
Dependent repos count: 6.9%
Last synced: 6 months ago
pypi.org: mani-skill-nightly

ManiSkill3: A Unified Benchmark for Generalizable Manipulation Skills

  • Versions: 160
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 2,651 Last month
Rankings
Dependent packages count: 9.5%
Average: 31.3%
Dependent repos count: 53.2%
Maintainers (1)
Last synced: 6 months ago
pypi.org: mani-skill

ManiSkill3: A Unified Benchmark for Generalizable Manipulation Skills

  • Versions: 37
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 7,468 Last month
Rankings
Dependent packages count: 9.7%
Average: 37.0%
Dependent repos count: 64.2%
Maintainers (1)
Last synced: 6 months ago

Dependencies

.github/workflows/gh-pages.yml actions
  • actions/checkout v3 composite
  • actions/deploy-pages v1 composite
  • actions/setup-python v4 composite
  • actions/upload-pages-artifact v1 composite
.github/workflows/publish-to-pypi.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • pypa/gh-action-pypi-publish release/v1 composite
docker/Dockerfile docker
  • nvidia/cudagl 11.3.1-devel-ubuntu20.04 build
examples/submission/Dockerfile docker
  • haosulab/mani-skill2 latest build
pyproject.toml pypi
requirements.txt pypi
  • GitPython *
  • gdown >=4.6.0
  • gymnasium >=0.28.1
  • h5py *
  • imageio *
  • numpy <1.24
  • opencv-python *
  • pyyaml *
  • rtree *
  • sapien ==2.2.2
  • scipy *
  • tabulate *
  • tqdm *
  • transforms3d *
  • trimesh *
setup.py pypi
warp_maniskill/pyproject.toml pypi
warp_maniskill/setup.py pypi
  • numpy *