Data

Tools

Indexes

Applications

Experiments

Open Source Science

privategpt

https://github.com/agladsoft/privategpt

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (11.9%) to scientific vocabulary
Last synced: 6 months ago · JSON representation ·

Repository

Basic Info
  • Host: GitHub
  • Owner: agladsoft
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Size: 2.09 MB
Statistics
  • Stars: 0
  • Watchers: 1
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created about 2 years ago · Last pushed over 1 year ago
Metadata Files
Readme Changelog License Citation

README.md

Llama CPP

📡 Description

This program is designed to provide an answer to a question based on uploaded documents using Llama-model. The program is running on ubuntu:22.04

📜 Installation

alt text

Use the docker to run projects for this program. sh sudo apt install docker-compose

CPU

```sh git clone https://github.com/agladsoft/LocalChatGPT.git

cd LocalChatGPT

sudo docker-compose up ```

Remove code in docker-compose.yml docker deploy: resources: reservations: devices: - driver: nvidia count: all capabilities: [ gpu ] AND change code in app.py class Llama. Code n_gpu_layers=35 to n_gpu_layers=0

GPU

```sh sudo apt update && sudo apt upgrade

ubuntu-drivers devices # install recommended drivers

sudo apt install nvidia-driver-xxx # or sudo ubuntu-drivers autoinstall

sudo nano /etc/security/limits.conf # insert this text without # ↓

* soft nproc 65000

* hard nproc 1000000

* - nofile 1048576

* - memlock unlimited

sudo reboot

wget https://nvidia.github.io/nvidia-docker/gpgkey --no-check-certificate

sudo apt-key add gpgkey

distribution=$(. /etc/os-release;echo $ID$VERSION_ID)

curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | sudo tee /etc/apt/sources.list.d/nvidia-docker.list

sudo apt update && sudo apt-get install -y nvidia-container-toolkit && sudo systemctl restart docker

git clone https://github.com/agladsoft/privateGPT.git

cd privateGPT

sudo docker-compose up ```

💻 Get started

To run the program, write

Docker

sh sudo docker-compose up

🙇‍♂️ Usage

URL is http://127.0.0.1:8001

👋 Contributing

Please check out the Contributing to RATH guide for guidelines about how to proceed.

Thanks to all contributors :heart:

⚖️ License

alt text

This project is under the MIT License. See the LICENSE file for the full license text.

Owner

  • Login: agladsoft
  • Kind: user

Citation (CITATION.cff) 

# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!

cff-version: 1.2.0
title: PrivateGPT
message: >-
  If you use this software, please cite it using the
  metadata from this file.
type: software
authors:
  - given-names: Iván
    family-names: Martínez Toro
    email: ivanmartit@gmail.com
    orcid: 'https://orcid.org/0009-0004-5065-2311'
  - family-names: Gallego Vico
    given-names: Daniel
    email: danielgallegovico@gmail.com
    orcid: 'https://orcid.org/0009-0006-8582-4384'
  - given-names: Pablo
    family-names: Orgaz
    email: pabloogc+gh@gmail.com
    orcid: 'https://orcid.org/0009-0008-0080-1437'
repository-code: 'https://github.com/imartinez/privateGPT'
license: Apache-2.0
date-released: '2023-05-02'

GitHub Events

Total
  • Push event: 42
  • Pull request event: 2
  • Create event: 1
Last Year
  • Push event: 42
  • Pull request event: 2
  • Create event: 1

Dependencies

.github/workflows/actions/install_dependencies/action.yml actions
  • actions/setup-python v4 composite
  • snok/install-poetry v1 composite
.github/workflows/docker.yml actions
  • actions/checkout v4 composite
  • docker/build-push-action v5 composite
  • docker/login-action v3 composite
  • docker/metadata-action v5 composite
.github/workflows/fern-check.yml actions
  • actions/checkout v4 composite
.github/workflows/preview-docs.yml actions
  • actions/checkout v4 composite
  • actions/github-script v4 composite
  • actions/setup-node v4 composite
.github/workflows/publish-docs.yml actions
  • actions/checkout v4 composite
  • actions/setup-node v3 composite
.github/workflows/release-please.yml actions
  • google-github-actions/release-please-action v3 composite
.github/workflows/stale.yml actions
  • actions/stale v8 composite
.github/workflows/tests.yml actions
  • ./.github/workflows/actions/install_dependencies * composite
  • actions/checkout v3 composite
  • actions/upload-artifact v3 composite
poetry.lock pypi
  • 212 dependencies
pyproject.toml pypi
  • boto3 ^1.28.56
  • chromadb ^0.4.13
  • docx2txt 0.8
  • fastapi ^0.103.1
  • injector ^0.21.0
  • llama-cpp-python ^0.2.23
  • llama-index 0.9.3
  • pypdf ^3.16.2
  • python >=3.11,<3.12
  • python-multipart ^0.0.6
  • pyyaml ^6.0.1
  • qdrant-client ^1.6.9
  • uvicorn ^0.24.0.post1
  • watchdog ^3.0.0