https://github.com/cvir-lab/ppf_framework

https://github.com/cvir-lab/ppf_framework

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (7.7%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: CVIR-Lab
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Size: 1.49 MB
Statistics
  • Stars: 0
  • Watchers: 0
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created 11 months ago · Last pushed 10 months ago
Metadata Files
Readme License

README.md

Dynamic-Target Potential Pursuit Field Reward for UAV Reinforcement Learning

The proposed PPF-based hierarchical reinforcement learning framework

This is the official for manuscript entitled Dynamic-Target Pursuit Potential Field Reward for UAV Reinforcement Learning submitted to IEEE Transactions on Control Systems Technology.

Potential Pursuit Field (PPF), a novel reward shaping framework aimed to address the reward sparsity in reinforcement learning for dynamic target pursuit. By designing a droplet-shaped anisotropic potential field, the proposed PPF model provides dense and direction-aware reward signals while preserving policy invariance through potential-based reward shaping. Building upon PPF, we developed a hierarchical reinforcement learning algorithm, enabling target pursuit and obstacle avoidance in non-line-of-sight(NLOS) environments, simultaneously.

Video Demo

Bilibili

Watch demo (MP4)

Potential Pursuit Field(PPF)

Potential Pursuit Field (PPF)
Art work of Potential Pursuit Field (PPF)

A novel concept of the Potential Pursuit Field (PPF) is proposed to support a continuous and dense reward-shaping function, which can capture anisotropic features and obtain richer gradient information than that of traditional rewards.

Obstacle-free pursuit

Obstacle-free pursuit Obstacle-free pursuit (visualization)

Pursuit with Obstacle envirionment

Obstacle pursuit Obstacle pursuit (visualization)

The entire code and corresponding simulation environment will be released later.

Owner

  • Name: CVIR-Lab
  • Login: CVIR-Lab
  • Kind: organization

GitHub Events

Total
  • Watch event: 1
  • Push event: 13
Last Year
  • Watch event: 1
  • Push event: 13