Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/aimhubio/terminal-chatbot

https://github.com/aimhubio/terminal-chatbot

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (13.2%) to scientific vocabulary

Keywords from Contributors

experiment-tracking metadata-tracking mlflow mlops prompt-engineering tensorboard
Last synced: 11 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: aimhubio
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Size: 208 KB
Statistics
  • Stars: 3
  • Watchers: 5
  • Forks: 0
  • Open Issues: 1
  • Releases: 0
Created about 3 years ago · Last pushed almost 3 years ago
Metadata Files
Readme License

README.md

A basic implementation of a LangChain chatbot app operated from terminal.

This is a demo project to show how Aim enables building an observability and automation layer for your entire AI System.


About • Using the Chatbot • Observe and Automate with Aim •

ℹ️ About

Repo Structure

This repo contains two python packages: - chatbot: the chatbot implementation with LangChain - chatbot_logger: end-to-end custom observability package for chatbot built with Aim framework.

About Aim

Aim is an open-source development framework for building AI Systems observability and automation.

Aim captures the relationships between different components of the System and enables these three capabilities: - Define and Log AI metadata from everywhere in AI Infra into centralized storage - Build low-code, composable custom observability for logged metadata - Build automations for logged metadata.

With this, Aim enables a new artifact - custom observability and automation layer for every AI System that captures all relevant relationships to fully show the System lineage, its evolution, its state as well as zoom-in zoom-out into every component of it.

Aim helps to recover the broken development lifecycle in AI Systems.

Aim is python-composable. Aim building blocks can be packaged as python packages and reused across different projects. Both separately and all together. See the package chatbot_logger in this repo.

Aim's mission is to democratize AI Dev tools to recover the broken AI Systems development lifecycle.

Using the Chatbot

Installation

  1. Clone the repo
  2. Add .env file at chatbot with serpapi_key and openai_key keys
  3. Install the logger pip install -e ./chatbot_logger (in editable mode)
  4. Install the chatbot pip install -e ./chatbot (in editable mode)

Usage and development

There are two modes of chatbot iteration: Dev and Production.

Production

Execute cd chatbot && chatbot run to run the chatbot. Each chatbot run is a "production" run and uses the version number from chatbot/VERSION as its release version.

Dev

Execute cd chatbot && chatbot run --dev to run the chatbot

Observe and Automate with Aim

The chatbot_logger built with Aim tracks the chatbot both across development and production.

Using Aim

All commands run in dir langchain-chatbot - Start Aim server: aim server --package chatbot_logger - Note: this command to be automatically ran with aim up in future iterations - Start Aim UI: aim up --package chatbot_logger - Checkout Aim docs: aim up --port 43001 --package docs

The chatbot development toolkit

  • Chatbot System Lineage page: full overview of the development and releases of the chatbot

  • Production Sessions page: full overview of the production sessions by the users

  • User Analytics page: select user and see the users' activity breakdown.

  • Production Session: observe the User sessions on the chatbot in detail

Using the built-in playground documentation

Aim comes with a built-in playgroun d documentation. Here is how to start it: aim up --port 43001 --package docs This command will start an Aim instance that's also a playground documentation to experiment with and customize your toolkit.

Next steps: make it your own

There are many ways this package can be extended - Add new metrics that track chatbot efficiencies - Add aggregate metrics of the openai cost - potentially restructure the whole package to better see the lineage of the experiment -> dev session -> release -> user session -> issue -> experiment ->...

Owner

  • Name: Aim
  • Login: aimhubio
  • Kind: organization
  • Location: Berkeley, California

AI Development Environment

GitHub Events

Total
Last Year

Committers

Last synced: about 1 year ago

All Time
  • Total Commits: 54
  • Total Committers: 5
  • Avg Commits per committer: 10.8
  • Development Distribution Score (DDS): 0.407
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Gor Arakelyan a****0@g****m 32
Gev 3****g 15
mihran113 v****n@g****m 4
Ruben Karapetyan k****n@g****m 2
Albert Torosyan t****t@g****m 1

Issues and Pull Requests

Last synced: about 1 year ago

All Time
  • Total issues: 0
  • Total pull requests: 4
  • Average time to close issues: N/A
  • Average time to close pull requests: 10 days
  • Total issue authors: 0
  • Total pull request authors: 3
  • Average comments per issue: 0
  • Average comments per pull request: 0.75
  • Merged pull requests: 2
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
Pull Request Authors
  • mihran113 (2)
  • alberttorosyan (1)
  • roubkar (1)
Top Labels
Issue Labels
Pull Request Labels