Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/anand-kamble/grader-distributed

AI grading system utilizing a distributed architecture for efficient evaluation.

https://github.com/anand-kamble/grader-distributed

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (8.3%) to scientific vocabulary
Last synced: 9 months ago · JSON representation

Repository

AI grading system utilizing a distributed architecture for efficient evaluation.

Basic Info
  • Host: GitHub
  • Owner: anand-kamble
  • Language: Python
  • Default Branch: main
  • Size: 21.7 MB
Statistics
  • Stars: 0
  • Watchers: 2
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created almost 2 years ago · Last pushed almost 2 years ago
Metadata Files
Readme

README.md

Repository Structure

For the structure of the repository I have refered the chats with Perplexity, and ChatGPT
Chat with Perplexity
Chat with ChatGPT

Agentic RAG

There is a bug in llama-index with SimpleDocumentLoader where I was not able to directly run it. The work around which I found around this issue was using the following import statment:
from llama_index.readers.file.docs.base import PDFReader
And also installing the unstructured python package by:
pip install unstructured

Test

For running the tests first go into the test directory. bash cd test

  1. Start all the Ollama servers. bash . ./spawn_ollamas.sh

Make sure to run this command from a non classroom computer, I am using laforge machine which is in the intelligence lab.

  1. Start the benchmark in a new terminal by going into the test folder. bash python benchmark.py

OR

bash python eval_dist.py

Benchmarking

All the benchmarking is done using llama-index and Ollama. You can find the details in the benchmark.md

Owner

  • Name: Anand Kamble
  • Login: anand-kamble
  • Kind: user
  • Location: Tallahassee, FL
  • Company: Florida State University

Graduate student in FSU Scientific Computing

GitHub Events

Total
Last Year

Dependencies

agentic_rag/poetry.lock pypi
  • aiohttp 3.9.5
  • aiosignal 1.3.1
  • annotated-types 0.7.0
  • anyio 4.4.0
  • appnope 0.1.4
  • asttokens 2.4.1
  • attrs 23.2.0
  • beautifulsoup4 4.12.3
  • certifi 2024.7.4
  • cffi 1.16.0
  • charset-normalizer 3.3.2
  • click 8.1.7
  • colorama 0.4.6
  • comm 0.2.2
  • dataclasses-json 0.6.7
  • debugpy 1.8.2
  • decorator 5.1.1
  • deprecated 1.2.14
  • dirtyjson 1.0.8
  • distro 1.9.0
  • executing 2.0.1
  • frozenlist 1.4.1
  • fsspec 2024.6.1
  • greenlet 3.0.3
  • h11 0.14.0
  • httpcore 1.0.5
  • httpx 0.27.0
  • idna 3.7
  • ipykernel 6.29.5
  • ipython 8.26.0
  • jedi 0.19.1
  • joblib 1.4.2
  • jupyter-client 8.6.2
  • jupyter-core 5.7.2
  • llama-cloud 0.0.6
  • llama-index 0.10.52
  • llama-index-agent-openai 0.2.7
  • llama-index-cli 0.1.12
  • llama-index-core 0.10.52.post1
  • llama-index-embeddings-ollama 0.1.2
  • llama-index-embeddings-openai 0.1.10
  • llama-index-indices-managed-llama-cloud 0.2.3
  • llama-index-legacy 0.9.48
  • llama-index-llms-ollama 0.1.5
  • llama-index-llms-openai 0.1.25
  • llama-index-multi-modal-llms-openai 0.1.7
  • llama-index-program-openai 0.1.6
  • llama-index-question-gen-openai 0.1.3
  • llama-index-readers-file 0.1.28
  • llama-index-readers-llama-parse 0.1.6
  • llama-parse 0.4.6
  • marshmallow 3.21.3
  • matplotlib-inline 0.1.7
  • multidict 6.0.5
  • mypy-extensions 1.0.0
  • nest-asyncio 1.6.0
  • networkx 3.3
  • nltk 3.8.1
  • numpy 1.26.4
  • openai 1.35.10
  • packaging 24.1
  • pandas 2.2.2
  • parso 0.8.4
  • pexpect 4.9.0
  • pillow 10.4.0
  • platformdirs 4.2.2
  • prompt-toolkit 3.0.47
  • psutil 6.0.0
  • ptyprocess 0.7.0
  • pure-eval 0.2.2
  • pycparser 2.22
  • pydantic 2.8.2
  • pydantic-core 2.20.1
  • pygments 2.18.0
  • pypdf 4.2.0
  • python-dateutil 2.9.0.post0
  • pytz 2024.1
  • pywin32 306
  • pyyaml 6.0.1
  • pyzmq 26.0.3
  • regex 2024.5.15
  • requests 2.32.3
  • six 1.16.0
  • sniffio 1.3.1
  • soupsieve 2.5
  • sqlalchemy 2.0.31
  • stack-data 0.6.3
  • striprtf 0.0.26
  • tenacity 8.5.0
  • tiktoken 0.7.0
  • tornado 6.4.1
  • tqdm 4.66.4
  • traitlets 5.14.3
  • typing-extensions 4.12.2
  • typing-inspect 0.9.0
  • tzdata 2024.1
  • urllib3 2.2.2
  • wcwidth 0.2.13
  • wrapt 1.16.0
  • yarl 1.9.4
agentic_rag/pyproject.toml pypi
  • ipykernel ^6.29.5 develop
  • llama-index ^0.10.52
  • llama-index-embeddings-ollama ^0.1.2
  • llama-index-llms-ollama ^0.1.5
  • python ^3.11
  • tqdm ^4.66.4
test/pyproject.toml pypi
  • python ^3.11
nginx/Dockerfile docker
  • nginx latest build