webarena-langchain-agent

webarena fork with langchain agents

https://github.com/nicholaschenai/webarena-langchain-agent

Science Score: 54.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
    Found CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
    Links to: arxiv.org
  • Academic email domains
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (3.7%) to scientific vocabulary
Last synced: 7 months ago · JSON representation ·

Repository

webarena fork with langchain agents

Basic Info
  • Host: GitHub
  • Owner: nicholaschenai
  • License: apache-2.0
  • Language: Python
  • Default Branch: langchain-react-public
  • Size: 5.68 MB
Statistics
  • Stars: 1
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created over 2 years ago · Last pushed over 2 years ago
Metadata Files
Readme License Citation

README.md

Attribution

The original authors of WebArena can be found here: [Code] [Site] [Paper]

Intro

This repo is a modification of WebArena, forked from version 58061ee914243b07756f578e03e0dc568573a7b5 Sep 28, 2023

Modification: LangChain Structured Tool Chat (STRUCTUREDCHATZEROSHOTREACT_DESCRIPTION)

ReAct prompting for tool/ function selection (i.e. the action space is constrained), so parsing errors cannot happen by design (parsing errors are handled). Validation for tool inputs to ensure agent only acts on valid elements.

Usage:

bash python lc_run.py --instruction_path agent/prompts/jsons/langchain_prompt.json --agent_type lc_agent --test_start_idx 0 --test_end_idx 812 --model gpt-3.5-turbo --result_dir outputs/langchain-agent

Owner

  • Name: Nicholas Chen
  • Login: nicholaschenai
  • Kind: user
  • Company: Artificial Intelligence Research

Citation (CITATION.cff)

@article{zhou2023webarena,
  title={WebArena: A Realistic Web Environment for Building Autonomous Agents},
  author={Zhou, Shuyan and Xu, Frank F and Zhu, Hao and Zhou, Xuhui and Lo, Robert and Sridhar, Abishek and Cheng, Xianyi and Bisk, Yonatan and Fried, Daniel and Alon, Uri and others},
  journal={arXiv preprint arXiv:2307.13854},
  year={2023}
}

GitHub Events

Total
Last Year