graphrag-businessqa-evaluation
https://github.com/danny123456789121/graphrag-businessqa-evaluation
Science Score: 26.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
○CITATION.cff file
-
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (5.9%) to scientific vocabulary
Last synced: 10 months ago
·
JSON representation
Repository
Basic Info
- Host: GitHub
- Owner: Danny123456789121
- License: mit
- Language: Jupyter Notebook
- Default Branch: main
- Size: 811 MB
Statistics
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 0
Created over 1 year ago
· Last pushed over 1 year ago
Metadata Files
Readme
License
Citation
README.md
Graphrag Business QA Evaluation
This repository provides the code and resources for evaluating GraphRAG and a baseline RAG technique in the context of complex business question answering (QA). The project encompasses two methods for constructing an evaluation dataset along with its associated knowledge base. Additionally, it includes two benchmark notebooks that assess the performance of each RAG technique on the respective datasets using RAGAS metrics such as factual correctness, cost, and latency.
Setup
- Clone this repository
- Install Python (3.10-1.12 if using SAP GenAIHub)
- create & activate virtual env
- pip install -r requirements.txt
- create dotenv containing API Keys (Google Gemini, OpenAI)
- follow each notebook for either dataset creation or benchmarking
License
This project is licensed under the MIT License. See the LICENSE file for details.
Owner
- Name: Daniel Kurth
- Login: Danny123456789121
- Kind: user
- Repositories: 2
- Profile: https://github.com/Danny123456789121
GitHub Events
Total
- Push event: 11
- Create event: 3
Last Year
- Push event: 11
- Create event: 3