Data

Tools

Indexes

Applications

Experiments

Open Source Science

faas_variability_topic_modeling

https://github.com/lambiond/faas_variability_topic_modeling

Science Score: 18.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ○
    codemeta.json file
  • ○
    .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (6.3%) to scientific vocabulary
Last synced: 10 months ago · JSON representation ·

Repository

Basic Info
  • Host: GitHub
  • Owner: lambiond
  • License: gpl-3.0
  • Language: Python
  • Default Branch: main
  • Size: 76.9 MB
Statistics
  • Stars: 2
  • Watchers: 2
  • Forks: 1
  • Open Issues: 0
  • Releases: 0
Created over 4 years ago · Last pushed almost 4 years ago
Metadata Files
Readme License Citation

README.md

Topic Modeling pipeline

These steps were executed on Ubuntu 20.04 (x86_64)

Setup

Run the setup.sh script to install docker, awscli, deploy training and testing datasets to S3, deploy a docker image to ECR, and deploy lambda functions.

Optional Setup

cronjobs can be setup to run daily at 12am. ```

Configure system local time zone

sudo ln -sf /usr/share/zoneinfo/ /etc/localtime sudo service cron restart sudo service cron status

Edit (ubuntu) users crontab

crontab -e

Insert the following lines

0 0 * * * /home/ubuntu/tcss562topicmodeling/test/test_lambda.sh

Verify crontab edit is successful

crontab -l ```

Test

Execute the test_lambda.sh script in the test directory. ./test/test_lambda.sh <arch> <region> <iterations>

Utilized Tools

Serverless Application Analytics Framework (SAAF) was used for collection of data, see https://github.com/wlloyduw/SAAF

Owner

  • Name: Danielle Lambion
  • Login: lambiond
  • Kind: user

M.S. Computer Science and Systems | University of Washington Tacoma

Citation (CITATION.cff) 

# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!

cff-version: 1.2.0
title: FaaS performance variability study using topic-modeling
message: >-
  If you use this software, please cite it using the
  metadata from this file.
type: software
authors:
  - given-names: Robert
    family-names: Schmitz
    email: rgs1@uw.edu
    orcid: 'https://orcid.org/0000-0002-5279-8793'
    name-suffix: III
  - given-names: Danielle
    family-names: Lambion
    email: dlambion@uw.edu
    orcid: 'https://orcid.org/0000-0002-4507-5490'
url: "https://github.com/lambiond/faas_variability_topic_modeling"
version: 1.0.0
date-released: 2022-01-13

GitHub Events

Total
Last Year

Dependencies

requirements.txt pypi
  • awslambdaric ==2.0.0
  • boto3 ==1.20.17
  • botocore ==1.23.17
  • click ==8.0.3
  • gensim ==4.1.2
  • jmespath ==0.10.0
  • joblib ==1.1.0
  • nltk ==3.6.5
  • numpy ==1.22.1
  • pandas ==1.3.4
  • python-dateutil ==2.8.2
  • pytz ==2021.3
  • regex ==2021.11.10
  • s3transfer ==0.5.0
  • scipy ==1.7.3
  • simplejson ==3.17.2
  • six ==1.16.0
  • smart-open ==5.2.1
  • tqdm ==4.62.3
  • urllib3 ==1.26.7