Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/awslabs/project-lakechain

:zap: Cloud-native, AI-powered, document processing pipelines on AWS.

https://github.com/awslabs/project-lakechain

Science Score: 13.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (10.5%) to scientific vocabulary

Keywords

aws aws-cdk computer-vision document-processing generative-ai hacktoberfest machine-learning natural-language-processing retrieval-augmented-generation serverless

Keywords from Contributors

document-parser rag
Last synced: 5 months ago · JSON representation

Repository

:zap: Cloud-native, AI-powered, document processing pipelines on AWS.

Basic Info
Statistics
  • Stars: 184
  • Watchers: 11
  • Forks: 26
  • Open Issues: 21
  • Releases: 3
Topics
aws aws-cdk computer-vision document-processing generative-ai hacktoberfest machine-learning natural-language-processing retrieval-augmented-generation serverless
Created about 2 years ago · Last pushed 11 months ago
Metadata Files
Readme Contributing License Code of conduct Security

README.md





Project Lakechain  Static Badge

Cloud-native, AI-powered, document processing pipelines on AWS.

Github Codespaces


Features

  • Composable Composable API to express document processing pipelines using middlewares.
  • Scalable Scales out-of-the box. Process millions of documents, scale to zero automatically when done.
  • Cost Efficient Uses cost-optimized architectures to reduce costs and drive a pay-as-you-go model.
  • Ready to use 60+ built-in middlewares for common document processing tasks, ready to be deployed.
  • GPU and CPU Support Use the right compute type to balance between performance and cost.
  • Bring Your Own Create your own transform middlewares to process documents and extend Lakechain.
  • Ready Made Examples - Quickstart your journey by leveraging 50+ examples we've built for you.

Examples


Summarize
Videos		 Generative
Audio
Podcast		 Video
Chaptering		 RAG
Pipeline		 Face
Detection		 E-mail
Analysis		 Image
Inpainting		 Ollama on
AWS
Video Summarization Generative Audio Podcasts Video Chaptering Service RAG Pipeline Face Detection E-mail Analysis Image Inpainting Ollama on AWS


Getting Started

Head to our documentation which contains all the information required to understand the project, and quickly start building!

What's Lakechain

Project Lakechain is an experimental framework based on the AWS Cloud Development Kit (CDK) that makes it easy to express and deploy scalable document processing pipelines on AWS using infrastructure-as-code. It emphasizes on modularity of pipelines, and provides 40+ ready to use components for prototyping complex document pipelines that can scale out of the box to millions of documents.

This project has been designed to help AWS customers build and scale different types of document processing pipelines, ranging a wide array of use-cases including metadata extraction, document conversion, NLP analysis, text summarization, translations, audio transcriptions, computer vision, Retrieval Augmented Generation pipelines, and much more!

Show me the code

Below is an example of a pipeline that deploys the AWS infrastructure to automatically transcribe audio files uploaded to S3, in just a few lines of code. Scales to millions of documents.





LICENSE

See LICENSE.

Owner

  • Name: Amazon Web Services - Labs
  • Login: awslabs
  • Kind: organization
  • Location: Seattle, WA

AWS Labs

GitHub Events

Total
  • Issues event: 6
  • Watch event: 63
  • Issue comment event: 5
  • Push event: 9
  • Pull request event: 4
  • Fork event: 4
  • Create event: 1
Last Year
  • Issues event: 6
  • Watch event: 63
  • Issue comment event: 5
  • Push event: 9
  • Pull request event: 4
  • Fork event: 4
  • Create event: 1

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 365
  • Total Committers: 5
  • Avg Commits per committer: 73.0
  • Development Distribution Score (DDS): 0.022
Past Year
  • Commits: 157
  • Committers: 3
  • Avg Commits per committer: 52.333
  • Development Distribution Score (DDS): 0.013
Top Committers
Name Email Commits
HQarroum q****h@a****u 357
github-actions[bot] g****] 5
Steffen Grunwald s****g@a****e 1
JGalego j****o@a****t 1
Anush008 a****0@g****m 1
Committer Domains (Top 20 + Academic)
amazon.pt: 1 amazon.de: 1 amazon.lu: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 32
  • Total pull requests: 34
  • Average time to close issues: about 1 month
  • Average time to close pull requests: about 1 month
  • Total issue authors: 6
  • Total pull request authors: 9
  • Average comments per issue: 0.53
  • Average comments per pull request: 0.56
  • Merged pull requests: 8
  • Bot issues: 0
  • Bot pull requests: 15
Past Year
  • Issues: 4
  • Pull requests: 6
  • Average time to close issues: 6 days
  • Average time to close pull requests: about 2 hours
  • Issue authors: 3
  • Pull request authors: 3
  • Average comments per issue: 1.0
  • Average comments per pull request: 0.33
  • Merged pull requests: 4
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • HQarroum (25)
  • moltar (2)
  • Analect (2)
  • mrtj (1)
  • Kraignos (1)
  • mirohiab (1)
Pull Request Authors
  • dependabot[bot] (15)
  • babeuh (4)
  • JGalego (3)
  • HQarroum (2)
  • jeromevdl (2)
  • brnaba-aws (2)
  • steffeng (2)
  • Anush008 (2)
  • GameRoMan (2)
Top Labels
Issue Labels
triage (31) enhancement (12) new-middleware (8) bug (7) framework (7) existing-middleware (6) rfc (2) example (1) documentation (1) typescript-sdk (1) help wanted (1)
Pull Request Labels
dependencies (14) python (8) javascript (6) need-response (2) enhancement (1)

Packages

  • Total packages: 76
  • Total downloads:
    • npm 498 last-month
  • Total dependent packages: 0
    (may contain duplicates)
  • Total dependent repositories: 0
    (may contain duplicates)
  • Total versions: 457
  • Total maintainers: 1
npmjs.org: @project-lakechain/structured-entity-extractor

Extracts structured entities from processed documents.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Stargazers count: 4.4%
Forks count: 4.7%
Average: 18.2%
Dependent repos count: 25.9%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/subtitle-processor

Parses subtitle documents into text and structured data.

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Stargazers count: 6.4%
Forks count: 7.9%
Average: 23.0%
Dependent repos count: 31.9%
Dependent packages count: 45.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/cli

📟 The official CLI for Project Lakechain.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/ollama-embedding-processor

Creates embeddings from documents using Ollama models.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/service-linked-role

Creates a service linked role for a given service in an idempotent way.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 5 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/canny-edge-detector

Creates a new image with the edges detected using the Canny edge detector algorithm.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/neo4j-storage-connector

A data store connector for Neo4j.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 2 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/trafilatura

Extracts text and metadata from HTML documents using Trafilatura.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 5 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/elevenlabs-synthesizer

Synthesizes text into speech using the Elevenlabs API.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/semantic-ontology-extractor

Extracts semantic ontology from processed documents.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/laplacian-image-processor

Computes the Laplacian variance of images.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/lancedb-storage-connector

A data store connector for LanceDB.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/hashing-image-processor

Computes the hashes of images using different algorithms.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 25.9%
Average: 31.8%
Dependent packages count: 37.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/tar-processor

Inflates and deflates Tar documents from a source to a destination bucket.

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 5 Last month
Rankings
Dependent repos count: 30.6%
Average: 37.3%
Dependent packages count: 43.9%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/zip-processor

Inflates and deflates Zip documents from a source to a destination bucket.

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 4 Last month
Rankings
Dependent repos count: 30.6%
Average: 37.3%
Dependent packages count: 43.9%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/reducer

A middleware allowing to reduce multiple events into a single event.

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 6 Last month
Rankings
Dependent repos count: 31.9%
Average: 38.8%
Dependent packages count: 45.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/ffmpeg-processor

Processes media documents using FFMPEG.

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 31.9%
Average: 38.8%
Dependent packages count: 45.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/regexp-text-splitter

Transforms text into chunks of tokens based on regular expressions.

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 31.9%
Average: 38.8%
Dependent packages count: 45.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/transform

A middleware allowing to transform documents on-the-fly.

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 31.9%
Average: 38.8%
Dependent packages count: 45.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/rembg-image-processor

Automatically remove background from images using Rembg.

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 31.9%
Average: 38.8%
Dependent packages count: 45.7%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/transcribe-audio-processor

Transcribes audio files asynchronously using Amazon Transcribe.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/bedrock-text-processors

Generative text processing using Amazon Bedrock models.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/sqs-storage-connector

Stores documents and their metadata in an SQS queue.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/syndication-feed-processor

Parses RSS and Atom syndication feeds.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/character-text-splitter

Transforms text into chunks of tokens using Langchain's character text splitter.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/s3-event-trigger

Triggers pipelines upon events being emitted from S3 buckets.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/tiling-text-splitter

Transforms text into chunks of tokens using the NLTK tiling algorithm.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/s3-storage-connector

Stores documents and their metadata in an S3 Bucket.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/zip-inflate-processor

Inflates Zip archives from a source to a destination bucket.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 65 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/tar-inflate-processor

Inflates tarballs from a source to a destination bucket.

  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 62 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/transformers-text-summarizer

Provides abstractive text summarization using the HuggingFace transformers library.

  • Versions: 2
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 11 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/layers

Lambda layer library used by Project Lakechain.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 7 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/opensearch-storage-connector

Stores document metadata in an OpenSearch index.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 6 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/delay

A middleware inserting a time delay within a pipeline.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/image-metadata-extractor

Extracts the metadata of images.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/sharp-image-transform

A middleware transforming images using the sharp library.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/sentence-transformers

Creates embeddings from text-oriented documents using Sentence Transformers models.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/opensearch-saved-object

Uploads a saved object to OpenSearch using AWS CDK.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/recursive-character-text-splitter

Transforms text into chunks of tokens using Langchain's recursive character text splitter.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 19 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/jmespath-processor

Applies JMESPath expressions to JSON documents.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 4 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/whisper-transcriber

An audio document transcription middleware based on OpenAI Whisper.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 4 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/bert-extractive-summarizer

Provides text summarization using the Bert Extractive Summarizer model.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 2 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/opensearch-vector-storage-connector

Stores document embeddings in an OpenSearch vector index.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/pandoc-text-converter

Converts text-oriented documents into plain text using pandoc.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/bark-synthesizer

Synthesize text to audio using the Bark model.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/opensearch-domain

Creates an OpenSearch domain with Cognito authentication.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 6 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/translate-text-processor

Translates text documents asynchronously using Amazon Translate.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 8 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/sentence-text-splitter

Transforms text into chunks of tokens using a sentence text splitter.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 6 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/pdf-text-converter

Converts PDF documents into different formats.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 2 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/bedrock-image-generators

Image generation using Amazon Bedrock models.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/keybert-text-processor

Extracts the main keywords from a text document using the KeyBERT model.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 2 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/opensearch-index

Creates an OpenSearch index using AWS CDK.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/nlp-text-processor

Extracts features from text documents using natural language processing.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 2 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/sdk

An SDK providing helpers to create Lakechain middlewares in TypeScript.

  • Versions: 9
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 83 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/passthrough

A middleware acting as a passthrough logging received events.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 5 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/clip-image-processor

A document processor generating embeddings for images using the OpenAI Clip model.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 5 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/ecs-cluster

A managed ECS cluster construct with quick autoscaling and EFS storage.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 27 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/audio-metadata-extractor

A middleware extracting metadata from audio documents.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 7 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/blip2-image-processor

A middleware extracting image captioning information from images using the Blip2 model.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/newspaper3k

Extracts text and metadata from HTML documents.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 4 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/image-layer-processor

Applies layer operations on images.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/panns-embedding-processor

A processor generating embeddings for audio documents using Pretrained Audio Neural Networks.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/email-text-processor

Parse e-mail documents into different output formats.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/scheduler-event-trigger

Triggers pipelines upon scheduling events.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/rekognition-image-processor

Processes images using Amazon Rekognition.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/bedrock-embedding-processors

Creates embeddings from documents using Amazon Bedrock models.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 3 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/video-metadata-extractor

Extracts the metadata of video files.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/pinecone-storage-connector

A data store connector for Pinecone.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 4 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/polly-synthesizer

Synthesizes text into speech using Amazon Polly.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 7 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/sqs-event-trigger

Triggers pipelines upon events being emitted from an SQS queue.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 4 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/text-transform-processor

A middleware providing a way to transform text documents at scale.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/opensearch-collection

Creates an OpenSearch Serverless collection in a VPC.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 14 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/firehose-storage-connector

Forwards document metadata to a Firehose delivery stream.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 0 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/core

Core package for building middlewares with Project Lakechain.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 52 Last month
Rankings
Dependent repos count: 33.3%
Average: 40.3%
Dependent packages count: 47.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/ollama-processor

Processes documents using models supported by Ollama.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 2 Last month
Rankings
Dependent repos count: 33.4%
Average: 40.6%
Dependent packages count: 47.9%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago
npmjs.org: @project-lakechain/condition

A middleware allowing to express complex conditions in pipelines.

  • Versions: 7
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 4 Last month
Rankings
Dependent repos count: 33.8%
Average: 41.1%
Dependent packages count: 48.3%
Maintainers (1)
aws-emea-pace
Last synced: 6 months ago

Dependencies

.github/workflows/close-inactive-issues.yml actions
  • actions/stale 3f3b0175e8c66fb49b9a6d5a0cd1f8436d4c3ab6 composite
.github/workflows/on-docs-update.yml actions
  • actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
  • actions/deploy-pages 7a9bd943aa5e5175aeb8502edcc6c1c02d398e10 composite
  • actions/upload-pages-artifact 027b0ddc3de8dbe7e5a699814c4508ca8ecefc5f composite
  • withastro/action 9a7959a16949e620a22e74f81c10cb7ce3b76924 composite
.github/workflows/on-issue-opened.yml actions
  • actions/github-script 1f16022c7518aad314c43abcd029895291be0f52 composite
.github/workflows/on-push.yml actions
.github/workflows/on-workflow-update.yml actions
  • actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
  • zgosalvez/github-actions-ensure-sha-pinned-actions f32435541e24cd6a4700a7f52bb2ec59e80603b1 composite
.github/workflows/release.yml actions
  • actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
.github/workflows/run-build-test.yml actions
  • actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
.github/workflows/run-lint.yml actions
  • actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
  • ludeeus/action-shellcheck cd81f4475ab741e097ec0fe73b692f3e49d66b8c composite
  • lycheeverse/lychee-action c053181aa0c3d17606addfe97a9075a32723548a composite
  • streetsidesoftware/cspell-action 4dc9d4bdf3974ed26d6f2e973c1e168edff47d80 composite
.github/workflows/run-security-checks.yml actions
  • actions/checkout b4ffde65f46336ab88eb53be808477a3936bae11 composite
  • bridgecrewio/checkov-action d403349a9193cf87f58f18a0f09aab1e9e058bde composite
  • gitleaks/gitleaks-action 4df650038e2eb9f7329218df929c2780866e61a3 composite
  • tj-actions/bandit d7f9d3e6020f1b252bc82edd32757ba5bf115f16 composite
.devcontainer/Dockerfile docker
  • mcr.microsoft.com/devcontainers/javascript-node 20 build
packages/middlewares/audio-processors/bark-synthesizer/src/container/Dockerfile docker
  • huggingface/transformers-pytorch-gpu 4.35.2 build
packages/middlewares/audio-processors/whisper-transcriber/src/container/Dockerfile docker
  • python 3.11-slim build
packages/middlewares/embedding-processors/clip-image-processor/src/container/Dockerfile docker
  • pytorch/pytorch 1.13.1-cuda11.6-cudnn8-runtime build
packages/middlewares/embedding-processors/panns-embedding-processor/src/container/Dockerfile docker
  • pytorch/pytorch 1.13.1-cuda11.6-cudnn8-runtime build
packages/middlewares/embedding-processors/sentence-transformers/src/container/Dockerfile docker
  • nvidia/cuda 11.7.1-base-ubuntu22.04 build
packages/middlewares/image-processors/blip2-image-processor/src/container/Dockerfile docker
  • pytorch/pytorch 1.13.1-cuda11.6-cudnn8-runtime build
packages/middlewares/image-processors/image-layer-processor/src/lambdas/filter-processor/Dockerfile docker
  • public.ecr.aws/lambda/python 3.11 build
packages/middlewares/text-processors/bert-extractive-summarizer/src/container/Dockerfile docker
  • huggingface/transformers-pytorch-gpu 4.35.2 build
packages/middlewares/text-processors/bert-extractive-summarizer/src/lambdas/summarizer/Dockerfile docker
  • public.ecr.aws/lambda/python 3.10 build
packages/middlewares/text-processors/keybert-text-processor/src/lambdas/processor/Dockerfile docker
  • public.ecr.aws/lambda/python 3.11 build
packages/middlewares/text-processors/newspaper3k/src/lambdas/parser/Dockerfile docker
  • public.ecr.aws/lambda/python 3.11 build
packages/middlewares/text-processors/pandoc-text-converter/src/lambdas/text-converter/Dockerfile docker
  • pandoc/latex latest-ubuntu build
packages/middlewares/text-processors/sentence-text-splitter/src/lambdas/text-splitter/Dockerfile docker
  • public.ecr.aws/lambda/python 3.11 build
packages/middlewares/text-processors/syndication-feed-processor/src/lambdas/parser/Dockerfile docker
  • public.ecr.aws/lambda/python 3.11 build
packages/middlewares/text-processors/tiling-text-splitter/src/lambdas/text-splitter/Dockerfile docker
  • public.ecr.aws/lambda/python 3.11 build
docs/package-lock.json npm
  • 592 dependencies
docs/package.json npm
  • rimraf ^5.0.5 development
  • @astrojs/starlight ^0.18.1
  • astro ^4.3.7
  • sharp ^0.33.2
examples/end-to-end-use-cases/building-a-document-index/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.1.2 development
  • ts-node ^10.9.2 development
  • @project-lakechain/audio-metadata-extractor ^0.3.0
  • @project-lakechain/image-metadata-extractor ^0.3.0
  • @project-lakechain/nlp-text-processor ^0.3.0
  • @project-lakechain/opensearch-domain ^0.3.0
  • @project-lakechain/opensearch-index ^0.3.0
  • @project-lakechain/opensearch-saved-object ^0.3.0
  • @project-lakechain/opensearch-storage-connector ^0.3.0
  • @project-lakechain/pandoc-text-converter ^0.3.0
  • @project-lakechain/pdf-text-converter ^0.3.0
  • @project-lakechain/rekognition-image-processor ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/sharp-image-transform ^0.3.0
  • @project-lakechain/video-metadata-extractor ^0.3.0
examples/end-to-end-use-cases/building-a-rag-pipeline/cli/package-lock.json npm
  • 149 dependencies
examples/end-to-end-use-cases/building-a-rag-pipeline/cli/package.json npm
  • @types/figlet ^1.5.8 development
  • @types/node ^20.9.3 development
  • @types/prompts ^2.4.9 development
  • rimraf ^5.0.5 development
  • typescript ^5.3.3 development
  • @aws-sdk/credential-provider-node ^3.451.0
  • @opensearch-project/opensearch ^2.5.0
  • commander ^11.1.0
  • figlet ^1.7.0
  • ora ^7.0.1
  • prompts ^2.4.2
  • zod ^3.22.4
  • zod-error ^1.5.0
examples/end-to-end-use-cases/building-a-rag-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.1.2 development
  • ts-node ^10.9.2 development
  • @project-lakechain/bedrock-embedding-processors ^0.3.0
  • @project-lakechain/bedrock-text-processors ^0.3.0
  • @project-lakechain/opensearch-domain ^0.3.0
  • @project-lakechain/opensearch-vector-storage-connector ^0.3.0
  • @project-lakechain/pandoc-text-converter ^0.3.0
  • @project-lakechain/pdf-text-converter ^0.3.0
  • @project-lakechain/recursive-character-text-splitter ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/transcribe-audio-processor ^0.3.0
examples/end-to-end-use-cases/building-a-search-engine/package.json npm
  • @types/node ^20.11.16 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.1.2 development
  • ts-node ^10.9.2 development
  • @project-lakechain/bedrock-embedding-processors ^0.3.0
  • @project-lakechain/clip-image-processor ^0.3.0
  • @project-lakechain/keybert-text-processor ^0.3.0
  • @project-lakechain/opensearch-domain ^0.3.0
  • @project-lakechain/opensearch-vector-storage-connector ^0.3.0
  • @project-lakechain/pandoc-text-converter ^0.3.0
  • @project-lakechain/pdf-text-converter ^0.3.0
  • @project-lakechain/recursive-character-text-splitter ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/sharp-image-transform ^0.3.0
examples/simple-pipelines/embedding-pipelines/bedrock-opensearch-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • ts-node ^10.9.2 development
  • @project-lakechain/bedrock-embedding-processors ^0.3.0
  • @project-lakechain/opensearch-domain ^0.3.0
  • @project-lakechain/opensearch-vector-storage-connector ^0.3.0
  • @project-lakechain/recursive-character-text-splitter ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
examples/simple-pipelines/embedding-pipelines/bedrock-pinecone-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • ts-node ^10.9.2 development
  • @project-lakechain/bedrock-embedding-processors ^0.3.0
  • @project-lakechain/pinecone-storage-connector ^0.3.0
  • @project-lakechain/recursive-character-text-splitter ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
examples/simple-pipelines/embedding-pipelines/clip-embeddings-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • ts-node ^10.9.2 development
  • @project-lakechain/clip-image-processor ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/s3-storage-connector ^0.3.0
examples/simple-pipelines/embedding-pipelines/cohere-opensearch-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • ts-node ^10.9.2 development
  • @project-lakechain/bedrock-embedding-processors ^0.3.0
  • @project-lakechain/opensearch-collection ^0.3.0
  • @project-lakechain/opensearch-vector-storage-connector ^0.3.0
  • @project-lakechain/recursive-character-text-splitter ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
examples/simple-pipelines/embedding-pipelines/panns-opensearch-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • ts-node ^10.9.2 development
  • @project-lakechain/opensearch-domain ^0.3.0
  • @project-lakechain/opensearch-vector-storage-connector ^0.3.0
  • @project-lakechain/panns-embedding-processor ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
examples/simple-pipelines/embedding-pipelines/sentence-transformers-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • ts-node ^10.9.2 development
  • @project-lakechain/opensearch-collection ^0.3.0
  • @project-lakechain/opensearch-vector-storage-connector ^0.3.0
  • @project-lakechain/recursive-character-text-splitter ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/sentence-transformers ^0.3.0
examples/simple-pipelines/storage-connector-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.1.2 development
  • ts-node ^10.9.2 development
  • @project-lakechain/firehose-storage-connector ^0.3.0
  • @project-lakechain/pdf-text-converter ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/s3-storage-connector ^0.3.0
  • @project-lakechain/sqs-storage-connector ^0.3.0
examples/simple-pipelines/summarization-pipelines/audio-recording-summarization-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.0.0 development
  • ts-node ^10.9.2 development
  • @project-lakechain/bedrock-text-processors ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/s3-storage-connector ^0.3.0
  • @project-lakechain/transcribe-audio-processor ^0.3.0
examples/simple-pipelines/summarization-pipelines/extractive-summarization-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.0.0 development
  • ts-node ^10.9.2 development
  • @project-lakechain/bert-extractive-summarizer ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/s3-storage-connector ^0.3.0
examples/simple-pipelines/text-to-speech-pipelines/bark-synthesizer/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.0.0 development
  • ts-node ^10.9.2 development
  • @project-lakechain/bark-synthesizer ^0.3.0
  • @project-lakechain/nlp-text-processor ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/s3-storage-connector ^0.3.0
examples/simple-pipelines/text-to-speech-pipelines/polly-synthesizer/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.0.0 development
  • ts-node ^10.9.2 development
  • @project-lakechain/nlp-text-processor ^0.3.0
  • @project-lakechain/polly-synthesizer ^0.3.0
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/s3-storage-connector ^0.3.0
examples/simple-pipelines/transcription-pipelines/transcribe-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.0.0 development
  • ts-node ^10.9.2 development
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/s3-storage-connector ^0.3.0
  • @project-lakechain/transcribe-audio-processor ^0.3.0
examples/simple-pipelines/transcription-pipelines/whisper-pipeline/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • ts-jest ^29.0.0 development
  • ts-node ^10.9.2 development
  • @project-lakechain/s3-event-trigger ^0.3.0
  • @project-lakechain/s3-storage-connector ^0.3.0
  • @project-lakechain/whisper-transcriber ^0.3.0
package-lock.json npm
  • 1574 dependencies
package.json npm
  • @commitlint/cli 18.6.0 development
  • @commitlint/config-conventional 18.6.0 development
  • @types/jest ^29.5.9 development
  • @types/lodash ^4.14.202 development
  • @types/node ^20.9.3 development
  • @typescript-eslint/eslint-plugin ^7.0.1 development
  • esbuild ^0.20.0 development
  • eslint ^8.56.0 development
  • eslint-config-prettier ^9.1.0 development
  • git-precommit-checks ^3.1.0 development
  • husky ^9.0.10 development
  • jest ^29.7.0 development
  • lerna ^8.0.2 development
  • lint-staged ^15.2.2 development
  • nx ^18.0.2 development
  • prettier ^3.2.5 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • ts-jest ^29.1.2 development
  • ts-node ^10.9.2 development
  • typescript ^5.3.3 development
packages/cli/lib/templates/app/typescript/package.json npm
  • @types/jest ^29.5.12 development
  • @types/node 20.11.17 development
  • aws-cdk 2.126.0 development
  • esbuild ^0.20.0 development
  • jest ^29.7.0 development
  • ts-jest ^29.1.2 development
  • ts-node ^10.9.2 development
  • typescript ~5.3.3 development
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/pdf-text-converter ^0.3.4
  • @project-lakechain/s3-event-trigger ^0.3.4
  • @project-lakechain/s3-storage-connector ^0.3.4
  • aws-cdk-lib 2.126.0
  • constructs ^10.3.0
  • source-map-support ^0.5.21
packages/cli/lib/templates/middleware/typescript/example/package.json npm
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • ts-node ^10.9.2 development
  • typescript ^5.3.3 development
  • @project-lakechain/s3-event-trigger ^0.3.4
  • @project-lakechain/s3-storage-connector ^0.3.4
  • aws-cdk-lib 2.126.0
  • constructs ^10.3.0
  • simple-text-processor file:../
  • source-map-support ^0.5.21
packages/cli/lib/templates/middleware/typescript/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/lodash ^4.14.202 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • typescript ^5.3.3 development
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
  • aws-cdk-lib 2.126.0
  • constructs ^10.3.0
  • esbuild ^0.20.0
  • source-map-support ^0.5.21
packages/cli/package.json npm
  • eslint ^8.56.0 development
  • jest ^29.7.0 development
  • @aws-sdk/client-sts 3.511.0
  • boxen ^7.1.1
  • chalk ^5.3.0
  • cli-table3 ^0.6.3
  • command-exists ^1.2.9
  • commander ^12.0.0
  • diskusage ^1.2.0
  • fs-extra ^11.2.0
  • middleware-chain-js ^2.0.2
  • mkdirp ^3.0.1
  • open ^10.0.3
  • ora ^8.0.1
  • pretty-bytes ^6.1.1
  • prompts ^2.4.2
  • update-notifier ^7.0.0
  • zod ^3.22.4
  • zod-error ^1.5.0
packages/constructs/ecs-cluster/package.json npm
  • @aws-sdk/client-ecs ^3.511.0 development
  • @aws-sdk/client-sqs ^3.511.0 development
  • @types/aws-lambda ^8.10.133 development
  • @types/jest ^29.5.12 development
  • @types/node ^20.11.16 development
  • cdk-nag ^2.28.33 development
  • esbuild ^0.20.0 development
  • eslint ^8.56.0 development
  • jest ^29.7.0 development
  • rimraf ^5.0.5 development
  • ts-jest ^29.1.2 development
  • @aws-lambda-powertools/commons ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/constructs/ecs-cluster/src/lambdas/ecs-task-autoscaler/package.json npm
  • @aws-sdk/client-ecs ^3.511.0 development
  • @aws-sdk/client-sqs ^3.511.0 development
  • @types/aws-lambda ^8.10.119 development
  • aws-sdk-client-mock ^3.0.1 development
  • esbuild ^0.20.0 development
  • eslint ^8.43.0 development
  • tsx ^3.12.7 development
  • @aws-lambda-powertools/commons ^1.9.0
  • @aws-lambda-powertools/logger ^1.9.0
  • @aws-lambda-powertools/metrics ^1.9.0
  • @aws-lambda-powertools/tracer ^1.9.0
packages/constructs/opensearch-collection/package.json npm
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
packages/constructs/opensearch-domain/package.json npm
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • cdk-nag ^2.27.229 development
  • esbuild ^0.20.0 development
  • eslint ^8.56.0 development
  • rimraf ^5.0.5 development
  • ts-jest ^29.1.2 development
packages/constructs/opensearch-index/package.json npm
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • cdk-nag ^2.27.229 development
  • esbuild ^0.20.0 development
  • eslint ^8.56.0 development
  • rimraf ^5.0.5 development
  • ts-jest ^29.1.2 development
  • @aws-sdk/credential-provider-node ^3.451.0
  • @opensearch-project/opensearch ^2.5.0
  • @project-lakechain/opensearch-collection ^0.3.4
packages/constructs/opensearch-saved-object/package.json npm
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • cdk-nag ^2.27.229 development
  • esbuild ^0.20.0 development
  • eslint ^8.54.0 development
  • rimraf ^5.0.5 development
  • ts-jest ^29.1.2 development
  • @aws-sdk/credential-provider-node ^3.451.0
  • @opensearch-project/opensearch ^2.5.0
packages/constructs/opensearch-saved-object/src/lambdas/object-manager/package.json npm
  • @types/aws-lambda ^8.10.119 development
  • esbuild ^0.18.15 development
  • eslint ^8.43.0 development
  • @aws-sdk/credential-provider-node ^3.451.0
  • @opensearch-project/opensearch ^2.3.1
packages/core/package.json npm
  • @types/jest ^29.5.12 development
  • @types/lodash ^4.14.202 development
  • @types/node ^20.8.10 development
  • @types/semver ^7.5.6 development
  • @types/tmp ^0.2.6 development
  • jest ^29.7.0 development
  • rimraf ^5.0.5 development
  • @mermaid-js/mermaid-cli ^10.7.0
  • aws-cdk-lib ^2.126.0
  • constructs ^10.3.0
  • lodash ^4.17.21
  • mime-types ^2.1.35
  • semver ^7.6.0
  • table ^6.8.1
  • tmp ^0.2.1
  • zod ^3.22.4
  • zod-error ^1.5.0
packages/layers/package.json npm
  • @types/jest ^29.5.12 development
  • @types/node ^20.11.16 development
  • esbuild ^0.20.0 development
  • npkill ^0.11.3 development
  • rimraf ^5.0.5 development
  • ts-node ^10.9.2 development
  • @project-lakechain/core ^0.3.4
packages/middlewares/audio-processors/audio-metadata-extractor/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/lodash ^4.14.202 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
  • lodash ^4.17.21
  • music-metadata ^7.14.0
packages/middlewares/audio-processors/bark-synthesizer/package.json npm
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/ecs-cluster ^0.3.4
packages/middlewares/audio-processors/polly-synthesizer/package.json npm
  • @aws-sdk/client-polly ^3.511.0 development
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/audio-processors/transcribe-audio-processor/package.json npm
  • @aws-sdk/client-dynamodb ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @aws-sdk/client-transcribe ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • cdk-nag ^2.28.33 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • ts-jest ^29.1.2 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/audio-processors/whisper-transcriber/package.json npm
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/ecs-cluster ^0.3.4
packages/middlewares/embedding-processors/bedrock-embedding-processor/package.json npm
  • @aws-sdk/client-bedrock-runtime ^3.511.0 development
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.124 development
  • @types/jest ^29.5.5 development
  • @types/node ^20.8.6 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/embedding-processors/clip-image-processor/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/ecs-cluster ^0.3.4
packages/middlewares/embedding-processors/panns-embedding-processor/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/ecs-cluster ^0.3.4
packages/middlewares/embedding-processors/sentence-transformers/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/ecs-cluster ^0.3.4
packages/middlewares/flow-control/delay/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sfn ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.133 development
  • @types/jest ^29.5.12 development
  • @types/node ^20.11.16 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/flow-control/passthrough/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/image-processors/bedrock-image-generators/package.json npm
  • @aws-sdk/client-bedrock-runtime ^3.511.0 development
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/parameters ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/image-processors/blip2-image-processor/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.1 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/ecs-cluster ^0.3.4
packages/middlewares/image-processors/image-layer-processor/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.1 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
packages/middlewares/image-processors/image-metadata-extractor/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/jest ^29.5.7 development
  • @types/lodash ^4.14.202 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • sharp ^0.33.2 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/layers ^0.3.4
  • @project-lakechain/sdk ^0.3.4
  • exifr ^7.1.3
  • fast-average-color ^9.4.0
  • lodash ^4.17.21
packages/middlewares/image-processors/rekognition-image-processor/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/lodash ^4.14.202 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @aws-sdk/client-rekognition ^3.511.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
  • lodash ^4.17.21
packages/middlewares/image-processors/sharp-image-transform/package.json npm
  • @aws-sdk/client-s3 ^3.354.0 development
  • @aws-sdk/client-sns ^3.354.0 development
  • @types/aws-lambda ^8.10.119 development
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • sharp ^0.33.2 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/layers ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/storage-connectors/firehose-storage-connector/package.json npm
  • @aws-sdk/client-firehose ^3.511.0 development
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/storage-connectors/opensearch-storage-connector/package.json npm
  • @aws-sdk/client-firehose ^3.511.0 development
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/storage-connectors/opensearch-vector-storage-connector/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/opensearch-collection ^0.3.4
  • @project-lakechain/opensearch-index ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/storage-connectors/pinecone-storage-connector/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-secrets-manager ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/parameters ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @pinecone-database/pinecone ^2.0.1
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/storage-connectors/s3-storage-connector/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/storage-connectors/sqs-storage-connector/package.json npm
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @project-lakechain/core ^0.3.4
packages/middlewares/text-processors/bedrock-text-processors/package.json npm
  • @aws-sdk/client-bedrock-runtime ^3.511.0 development
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/parameters ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/text-processors/bert-extractive-summarizer/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/ecs-cluster ^0.3.4
packages/middlewares/text-processors/character-text-splitter/package.json npm
  • @aws-sdk/client-s3 ^3.374.0 development
  • @aws-sdk/client-sns ^3.374.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
  • langchain ^0.1.17
  • lodash ^4.17.21
packages/middlewares/text-processors/character-text-splitter/src/lambdas/text-splitter/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/lodash ^4.14.202 development
  • esbuild ^0.20.0 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • langchain ^0.1.17
  • lodash ^4.17.21
packages/middlewares/text-processors/email-text-processor/package.json npm
  • @aws-sdk/client-s3 ^3.374.0 development
  • @aws-sdk/client-sns ^3.374.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/mailparser ^3.4.4 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/layers ^0.3.4
  • @project-lakechain/sdk ^0.3.4
  • lodash ^4.17.21
  • mailparser ^3.6.6
packages/middlewares/text-processors/jmespath-processor/package.json npm
  • @aws-sdk/client-s3 ^3.374.0 development
  • @aws-sdk/client-sns ^3.374.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/jmespath ^0.15.2 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
  • jmespath ^0.16.0
packages/middlewares/text-processors/keybert-text-processor/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
packages/middlewares/text-processors/newspaper3k/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
packages/middlewares/text-processors/nlp-text-processor/package.json npm
  • @aws-sdk/client-comprehend ^3.511.0 development
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.0.0 development
  • @types/lodash ^4.14.202 development
  • @types/node ^20.2.1 development
  • @types/truncate-utf8-bytes ^1.0.2 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
  • lodash ^4.17.21
  • truncate-utf8-bytes ^1.0.2
  • wink-eng-lite-web-model ^1.5.2
  • wink-nlp ^1.14.3
packages/middlewares/text-processors/pandoc-text-converter/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
packages/middlewares/text-processors/pdf-text-converter/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
packages/middlewares/text-processors/recursive-character-text-splitter/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/jest ^29.5.7 development
  • @types/lodash ^4.14.202 development
  • @types/node ^20.8.10 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
  • langchain ^0.1.17
  • lodash ^4.17.21
packages/middlewares/text-processors/recursive-character-text-splitter/src/lambdas/text-splitter/package.json npm
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.126 development
  • @types/lodash ^4.14.202 development
  • esbuild ^0.20.0 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • langchain ^0.1.17
  • lodash ^4.17.21
packages/middlewares/text-processors/sentence-text-splitter/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
packages/middlewares/text-processors/syndication-feed-processor/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4
packages/middlewares/text-processors/text-transform-processor/package.json npm
  • @aws-sdk/client-comprehend ^3.511.0 development
  • @aws-sdk/client-s3 ^3.511.0 development
  • @aws-sdk/client-sns ^3.511.0 development
  • @types/aws-lambda ^8.10.123 development
  • @types/jest ^29.5.5 development
  • @types/node ^20.8.2 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • @aws-lambda-powertools/batch ^1.18.0
  • @aws-lambda-powertools/logger ^1.18.0
  • @aws-lambda-powertools/metrics ^1.18.0
  • @aws-lambda-powertools/tracer ^1.18.0
  • @project-lakechain/core ^0.3.4
  • @project-lakechain/sdk ^0.3.4
packages/middlewares/text-processors/tiling-text-splitter/package.json npm
  • @types/jest ^29.0.0 development
  • @types/node ^20.2.1 development
  • esbuild ^0.20.0 development
  • rimraf ^5.0.5 development
  • shx ^0.3.4 development
  • @project-lakechain/core ^0.3.4