https://github.com/darioizzo/neurostability

The code used for the paper "On the stability analysis of optimal state feedbacks as represented by deep neural models"

https://github.com/darioizzo/neurostability

Science Score: 23.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
    Links to: arxiv.org
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (12.4%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

The code used for the paper "On the stability analysis of optimal state feedbacks as represented by deep neural models"

Basic Info
  • Host: GitHub
  • Owner: darioizzo
  • License: agpl-3.0
  • Language: Jupyter Notebook
  • Default Branch: master
  • Size: 75.1 MB
Statistics
  • Stars: 14
  • Watchers: 5
  • Forks: 5
  • Open Issues: 0
  • Releases: 0
Created over 7 years ago · Last pushed over 6 years ago
Metadata Files
Readme License

README.md

Stability study of deep networks controlling nonlinear ODEs

This project contains all the python code and pickled network data to reproduce the results in the paper:

Dario Izzo, Dharmesh Tailor and Thomas Vasileiou: "On the stability analysis of optimal state feedbacks as represented by deep neural models" - [https://arxiv.org/abs/1812.02532]

Usage: clone the repository and run the notebooks in Jupyter after having installed (pip or conda) the requested dependencies.

Guidance and Control Network (G&CNET)

Definition:: A G&CNET (Guidance and Control Network) is a type of neuro controller, in particular a deep, artificial, feed forward neural network trained on state-action pairs representing the optimal control actions, with respect to the performance index:

In other words, a G&CNET is a neural optimal feedback for a non linear dynamical system.

An example for a G&CNET architecture is given below, note the softplus units giving continuity properties to the resulting actions.

GECNET neurocontroller for the BEBOP drone

For example a GECNET can perform real time optimal manouvre on board of a BEBOP Parrot drone:

GECNET neurocontroller for the BEBOP drone

GECNET controlling the BEBOP drone

Linear Stability of G&CNETS Neurocontrollers

These deep neural networks are trained to imitate the optimal response and, in the notebooks here available, are loaded from pickled data. The system dynamics can then be linearized around an equilibrium point (hovering, in the case of a BEBOP drone) using the network gradient information coming from e.g. backpropagation. Stability and time delayed analysis can thus be performed and, for example, the root locus for the time delay obtained (and thus a stability margin):

Time delay for a GECNET controlling the BEBOP drone

Stability of a G&CNET nominal trajectory

The ODEs describing the neurocontrolled trajectory is then numerically integrated and its result expanded into a high order Taylor map (note that backpropagation cannot be used here as the derivative order is ~7, so differential algebraic techniques are used instead). The map represents the optimal dynamics close to a nominal trajectory and can thus be used to study and prove its stability. Convergence radius of the Taylor maps is also studied.

Time delay for a GECNET controlling the BEBOP drone

Owner

  • Name: Dario Izzo
  • Login: darioizzo
  • Kind: user
  • Location: Noordwijk
  • Company: European Space Agency

GitHub Events

Total
  • Watch event: 2
Last Year
  • Watch event: 2

Issues and Pull Requests

Last synced: over 1 year ago

All Time
  • Total issues: 2
  • Total pull requests: 0
  • Average time to close issues: 4 days
  • Average time to close pull requests: N/A
  • Total issue authors: 1
  • Total pull request authors: 0
  • Average comments per issue: 1.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • impredicative (2)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels