365-core4d-a-4d-human-object-human-interaction-dataset-for-collaborative-object-rearrangement

https://github.com/szu-advtech-2024/365-core4d-a-4d-human-object-human-interaction-dataset-for-collaborative-object-rearrangement

Repository

https://github.com/SZU-AdvTech-2024/365-CORE4D-A-4D-Human-Object-Human-Interaction-Dataset-for-Collaborative-Object-REarrangement/blob/main/

#  CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement 

Official repository of "CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement".

### :page_with_curl:[arxiv](https://arxiv.org/pdf/2406.19353) | :house:[Dataset Homepage](https://core4d.github.io/) | :file_folder:[Dataset](https://1drv.ms/f/s!Ap-t7dLl7BFUmHl9Une1E6FLsS4J?e=RLt0Fk)

#### Authors

Chengwen Zhang*, Yun Liu*, Ruofan Xing, Bingda Tang, Li Yi

## Data Update Records

* 2024/8/17: Uploaded V2 of CORE4D-Real, including updated human motions in "CORE4D_Real_human_object_motions_v2"
* 2024/5/31: Uploaded CORE4D-V1

## Data Organization

The data is organized as follows:

```
|--CORE4D_Real
    |--object_models
        ...
    |--human_object_motions
        ...
    |--allocentric_RGBD_videos
        ...
    |--egocentric_RGB_videos
        ...
    |--human_object_segmentations
        ...
    |--camera_parameters
        ...
    |--action_labels.json
|--CORE4D_Synthetic
    |-- 
        |-- human_poses.npy
        |-- object_mesh.obj
        |-- object_poses.npy
    |-- 
        |-- human_poses.npy
        |-- object_mesh.obj
        |-- object_poses.npy
    ...
```

## File Definitions

Please refer to ``docs/file_definitions.md`` for details of our dataset.

## Data Visualization

[1] Environment setup

Our code is tested on Ubuntu 20.04 with one NVIDIA GeForce RTX 3090 GPU. The Driver version is 535.129.03. The CUDA version is 12.2.

Please use the following command to set up the environment:

```x
conda create -n core4d python=3.9
conda activate core4d
= 1.7.1>
= 0.6.1>
cd dataset_utils
pip install -r requirements.txt
```

Then, install smplx from [smplx](https://github.com/vchoutas/smplx), and download [SMPL-X models](https://smpl-x.is.tue.mpg.de/index.html).

[2] Visualize human-object motions

```x
cd dataset_utils
python visualize_human_object_motion.py --dataset_root  --object_model_root