Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/conglu1997/intelligent-go-explore

Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models

https://github.com/conglu1997/intelligent-go-explore

Science Score: 23.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: arxiv.org
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (10.5%) to scientific vocabulary
Last synced: 11 months ago · JSON representation

Repository

Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models

Basic Info
  • Host: GitHub
  • Owner: conglu1997
  • License: mit
  • Language: Inform 7
  • Default Branch: main
  • Size: 11.2 MB
Statistics
  • Stars: 53
  • Watchers: 4
  • Forks: 4
  • Open Issues: 2
  • Releases: 0
Created about 2 years ago · Last pushed over 1 year ago
Metadata Files
Readme License

README.md

Intelligent Go-Explore

ICLR 2025 arXiv Website Twitter

Intelligent Go-Explore

Intelligent Go-Explore (IGE) integrates the intelligence and internalized human notions of interestingness from giant pretrained foundation models into all stages of the Go-Explore algorithm, enabling foundation model agents to robustly explore in complex environments.

Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models

Cong Lu, Shengran Hu, Jeff Clune. ICLR, 2025.

Table of Contents

Setup

To install and set up the repository, follow these steps:

  1. Clone the repository and create a Python environment:

bash conda create -n ige python=3.11 conda activate ige pip install -r requirements.txt

  1. BabyAI-Text Instructions:

bash git clone https://github.com/flowersteam/Grounding_LLMs_with_online_RL.git cd Grounding_LLMs_with_online_RL pip install blosc cd babyai-text/babyai pip install -e . cd ../gym-minigrid pip install -e . cd .. pip install -e .

  1. TextWorld Instructions:

Make sure you have the necessary system libraries (see TextWorld GitHub) and then install:

bash pip install textworld

Running Instructions

Notes

  • Each environment is encapsulated in its own file, containing the environment definition, IGE implementation, baselines, and prompts.
  • By default, all runs are enabled. Comment out any baselines you do not wish to execute.
  • Ensure that the OPENAI_API_KEY environment variable is set.
  • Adding a new environment/domain: We recommend cloning an existing run.py file, ensuring the random agent baseline works (which does not require foundation models), and then integrating IGE.

Game of 24

Run the Game of 24 environment:

bash python3 game_of_24/run.py

BabyAI-Text

Run the BabyAI-Text environment:

bash python3 babyai/run.py

TextWorld

For TextWorld, several game variants are available:

  • Coin Collector:

bash python3 textworld/run_coin.py

  • The Cooking Game:

bash python3 textworld/run_cooking.py

  • Treasure Hunter:

bash python3 textworld/run_treasure.py

Note: To generate the game files used in TextWorld (located in the tw_games directory), the text_world/misc/make_*.py scripts were utilized.

Citation

If you find this project useful, please consider citing our work:

bibtex @inproceedings{lu2025intelligent, title={Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models}, author={Cong Lu and Shengran Hu and Jeff Clune}, booktitle={The Thirteenth International Conference on Learning Representations}, year={2025}, url={https://openreview.net/forum?id=apErWGzCAA} }

Contact

For any queries, please contact Cong Lu.

Owner

  • Name: Cong Lu
  • Login: conglu1997
  • Kind: user
  • Location: Oxford

Reinforcement Learning PhD Student in MLRG and OxCSML @ Oxford

GitHub Events

Total
  • Issues event: 1
  • Watch event: 18
  • Issue comment event: 3
  • Push event: 3
  • Fork event: 4
Last Year
  • Issues event: 1
  • Watch event: 18
  • Issue comment event: 3
  • Push event: 3
  • Fork event: 4

Committers

Last synced: over 1 year ago

All Time
  • Total Commits: 4
  • Total Committers: 1
  • Avg Commits per committer: 4.0
  • Development Distribution Score (DDS): 0.0
Past Year
  • Commits: 4
  • Committers: 1
  • Avg Commits per committer: 4.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Cong Lu c****7@o****m 4

Issues and Pull Requests

Last synced: over 1 year ago

All Time
  • Total issues: 2
  • Total pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Total issue authors: 2
  • Total pull request authors: 0
  • Average comments per issue: 2.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 2
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 2
  • Pull request authors: 0
  • Average comments per issue: 2.0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • hlsafin (1)
  • Presbiopic-beep (1)
Pull Request Authors
Top Labels
Issue Labels
Pull Request Labels

Dependencies

requirements.txt pypi
  • backoff ==2.2.1
  • ipython ==8.23.0
  • matplotlib ==3.8.0
  • numpy ==1.23.5
  • openai ==1.17.0
  • pandas ==2.0.3
  • sympy ==1.12
  • tqdm ==4.65.0