Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/anirudh-mehra/scene-sense-main

https://github.com/anirudh-mehra/scene-sense-main

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (6.0%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Basic Info
  • Host: GitHub
  • Owner: anirudh-mehra
  • License: apache-2.0
  • Language: Python
  • Default Branch: main
  • Size: 21.5 KB
Statistics
  • Stars: 0
  • Watchers: 0
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created 12 months ago · Last pushed 12 months ago
Metadata Files
Readme License

README.md

Scene-Sense

Scene Sense is an AI-powered search engine gallery app that revolutionizes the way users interact with their photo collections. With Scene Sense, finding the perfect photo becomes a breeze as users can search using natural language queries.

Note: This is a proof of concept and is not intended for production use.

Inspiration

I was inspired by the idea of using AI to help users find photos in their gallery. I wanted to create a search engine that would allow users to search for photos based on the scene in the photo and be descriptive.

Brief Working

  • Scene Sense uses the CLIP model to understand natural language queries and image content, providing accurate and contextually relevant results.
  • App handles multiple users, a robust user authentication system is implemented using FastAPI. User credentials are stored in MongoDB and it uses password hashing techniques and JSON Web Token (JWT).
  • The app leverages Google Cloud Platform for storage and deployment and Pinecone for embedding management, enabling efficient and fast image retrieval.

Demo

https://github.com/user-attachments/assets/f86b8a68-051e-435b-b24d-6872e36093e2

Owner

  • Login: anirudh-mehra
  • Kind: user

GitHub Events

Total
  • Push event: 1
  • Create event: 2
Last Year
  • Push event: 1
  • Create event: 2

Dependencies

docker-compose.yml docker
requirements.txt pypi
  • Babel ==2.15.0
  • GitPython ==3.1.43
  • Jinja2 ==3.1.4
  • MarkupSafe ==2.1.5
  • PyYAML ==6.0.1
  • Pygments *
  • QtPy ==2.4.1
  • Send2Trash ==1.8.3
  • altair ==5.3.0
  • annotated-types ==0.7.0
  • anyio ==4.4.0
  • argon2-cffi ==23.1.0
  • argon2-cffi-bindings ==21.2.0
  • arrow ==1.3.0
  • asttokens *
  • async-lru ==2.0.4
  • attrs ==23.2.0
  • bcrypt ==4.0.0
  • beautifulsoup4 ==4.12.3
  • bleach ==6.1.0
  • blinker ==1.8.2
  • cachetools ==5.4.0
  • certifi ==2024.7.4
  • cffi ==1.16.0
  • charset-normalizer ==3.3.2
  • click ==8.1.7
  • colorama *
  • comm *
  • cryptography ==43.0.0
  • debugpy *
  • decorator *
  • defusedxml ==0.7.1
  • dnspython ==2.6.1
  • ecdsa ==0.19.0
  • email_validator ==2.2.0
  • exceptiongroup *
  • executing *
  • fastapi ==0.111.1
  • fastapi-cli ==0.0.4
  • fastjsonschema ==2.20.0
  • filelock ==3.15.4
  • fqdn ==1.5.1
  • fsspec ==2024.6.1
  • ftfy ==6.2.0
  • gitdb ==4.0.11
  • google-api-core ==2.19.1
  • google-auth ==2.32.0
  • google-cloud-core ==2.4.1
  • google-cloud-storage ==2.17.0
  • google-crc32c ==1.5.0
  • google-resumable-media ==2.7.1
  • googleapis-common-protos ==1.63.2
  • grpcio ==1.65.1
  • h11 ==0.14.0
  • httpcore ==1.0.5
  • httptools ==0.6.1
  • httpx ==0.27.0
  • huggingface-hub ==0.24.0
  • idna ==3.7
  • importlib_metadata *
  • intel-openmp ==2021.4.0
  • ipykernel *
  • ipython *
  • ipywidgets ==8.1.3
  • isoduration ==20.11.0
  • itsdangerous ==2.2.0
  • jedi *
  • joblib ==1.4.2
  • json5 ==0.9.25
  • jsonpointer ==3.0.0
  • jsonschema ==4.23.0
  • jsonschema-specifications ==2023.12.1
  • jupyter ==1.0.0
  • jupyter-console ==6.6.3
  • jupyter-events ==0.10.0
  • jupyter-lsp ==2.2.5
  • jupyter_client *
  • jupyter_core *
  • jupyter_server ==2.14.2
  • jupyter_server_terminals ==0.5.3
  • jupyterlab ==4.2.4
  • jupyterlab_pygments ==0.3.0
  • jupyterlab_server ==2.27.3
  • jupyterlab_widgets ==3.0.11
  • lz4 ==4.3.3
  • markdown-it-py ==3.0.0
  • matplotlib-inline *
  • mdurl ==0.1.2
  • mistune ==3.0.2
  • mkl ==2021.4.0
  • mpmath ==1.3.0
  • nbclient ==0.10.0
  • nbconvert ==7.16.4
  • nbformat ==5.10.4
  • nest_asyncio *
  • networkx ==3.3
  • nltk ==3.9.1
  • notebook ==7.2.1
  • notebook_shim ==0.2.4
  • numpy ==1.26.4
  • open_clip_torch ==2.26.1
  • orjson ==3.10.6
  • overrides ==7.7.0
  • packaging *
  • pandas ==2.2.2
  • pandocfilters ==1.5.1
  • parso *
  • passlib ==1.7.4
  • pickleshare *
  • pillow ==10.4.0
  • pinecone-client ==5.0.0
  • pinecone-plugin-inference ==1.0.2
  • pinecone-plugin-interface ==0.0.7
  • platformdirs *
  • prometheus_client ==0.20.0
  • prompt_toolkit *
  • proto-plus ==1.24.0
  • protobuf ==4.25.4
  • protoc-gen-openapiv2 ==0.0.1
  • psutil *
  • pure_eval *
  • pyarrow ==17.0.0
  • pyasn1 ==0.6.0
  • pyasn1_modules ==0.4.0
  • pycparser ==2.22
  • pydantic ==2.8.2
  • pydantic-extra-types ==2.9.0
  • pydantic-settings ==2.3.4
  • pydantic_core ==2.20.1
  • pydeck ==0.9.1
  • pymongo ==4.8.0
  • python-dateutil *
  • python-dotenv ==1.0.1
  • python-jose ==3.3.0
  • python-json-logger ==2.0.7
  • python-multipart ==0.0.9
  • pytz ==2024.1
  • pyzmq *
  • qtconsole ==5.5.2
  • referencing ==0.35.1
  • regex ==2024.5.15
  • requests ==2.32.3
  • rfc3339-validator ==0.1.4
  • rfc3986-validator ==0.1.1
  • rich ==13.7.1
  • rpds-py ==0.19.0
  • rsa ==4.9
  • safetensors ==0.4.3
  • setuptools ==69.5.1
  • shellingham ==1.5.4
  • six *
  • smmap ==5.0.1
  • sniffio ==1.3.1
  • soupsieve ==2.5
  • stack-data *
  • starlette ==0.37.2
  • streamlit ==1.36.0
  • sympy ==1.13.1
  • tbb ==2021.13.0
  • tenacity ==8.5.0
  • terminado ==0.18.1
  • timm ==1.0.7
  • tinycss2 ==1.3.0
  • tokenizers ==0.19.1
  • toml ==0.10.2
  • toolz ==0.12.1
  • torch ==2.3.1
  • torchvision ==0.18.1
  • tornado *
  • tqdm ==4.66.4
  • traitlets *
  • transformers ==4.43.2
  • typer ==0.12.3
  • types-python-dateutil ==2.9.0.20240316
  • typing_extensions *
  • tzdata ==2024.1
  • ujson ==5.10.0
  • uri-template ==1.3.0
  • urllib3 ==2.2.2
  • uvicorn ==0.30.3
  • watchdog ==4.0.1
  • watchfiles ==0.22.0
  • wcwidth *
  • webcolors ==24.6.0
  • webencodings ==0.5.1
  • websocket-client ==1.8.0
  • websockets ==12.0
  • wheel ==0.43.0
  • widgetsnbextension ==4.0.11
  • zipp *