Data

Tools

Indexes

Applications

Experiments

Open Source Science

https://github.com/awslabs/amazon-timestream-tools

Tools and utilities to enable loading data and building applications with Amazon Timestream.

https://github.com/awslabs/amazon-timestream-tools

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (11.7%) to scientific vocabulary

Keywords from Contributors

projection generic sequences interactive archival scheduler orchestration data-pipelines data-engineering voxel
Last synced: 10 months ago · JSON representation

Repository

Tools and utilities to enable loading data and building applications with Amazon Timestream.

Basic Info
  • Host: GitHub
  • Owner: awslabs
  • License: mit-0
  • Language: Answer Set Programming
  • Default Branch: mainline
  • Homepage:
  • Size: 56.3 MB
Statistics
  • Stars: 249
  • Watchers: 23
  • Forks: 184
  • Open Issues: 13
  • Releases: 0
Created almost 6 years ago · Last pushed 11 months ago
Metadata Files
Readme Contributing License Code of conduct

README.md

Amazon Timestream Tools and Samples

Amazon Timestream is a fast, scalable, fully managed, purpose-built time series database that makes it easy to store and analyze trillions of time series data points per day. Amazon Timestream saves you time and cost in managing the lifecycle of time series data by keeping recent data in memory and moving historical data to a cost optimized storage tier based upon user defined policies. Amazon Timestream’s purpose-built query engine lets you access and analyze recent and historical data together, without having to specify its location. Amazon Timestream has built-in time series analytics functions, helping you identify trends and patterns in your data in near real-time. Timestream is serverless and automatically scales up or down to adjust capacity and performance. Because you don’t need to manage the underlying infrastructure, you can focus on optimizing and building your applications.

Amazon Timestream also integrates with commonly used services for data collection, visualization, and machine learning. You can send data to Amazon Timestream using AWS IoT Core, Amazon Kinesis, Amazon MSK, and open source Telegraf. You can visualize data using Amazon QuickSight, Grafana, and business intelligence tools through JDBC. You can also use Amazon SageMaker with Amazon Timestream for machine learning. For more information on how to use Amazon Timestream see the AWS documentation.

This repository contains sample applications, plugins, notebooks, data connectors, and adapters to help you get started with Amazon Timestream and to enable you to use Amazon Timestream with other tools and services.

Sample applications

This repository contains fully functional sample applications to help you get started with Amazon Timestream.

The getting started application shows how to create a database and table, populate the table with ~126K rows of sample data, and run sample queries. This sample application is currently available for the following programming languages:

To query time series data using Amazon Timestream's JDBC driver, refer to the following application:

Working with other tools and services

To continue to use your preferred data collection, analytics, visualization, and machine learning tools with Amazon Timestream, refer to the following:

Data ingestion and query tools

To understand the performance and scale capabilities of Amazon Timestream, you can run the following workload:

You can use the following tools to continuously send data to Amazon Timestream:

Owner

  • Name: Amazon Web Services - Labs
  • Login: awslabs
  • Kind: organization
  • Location: Seattle, WA

AWS Labs

GitHub Events

Total
  • Issues event: 1
  • Watch event: 11
  • Delete event: 6
  • Issue comment event: 8
  • Push event: 44
  • Pull request review comment event: 153
  • Pull request review event: 165
  • Pull request event: 50
  • Fork event: 7
  • Create event: 7
Last Year
  • Issues event: 1
  • Watch event: 11
  • Delete event: 6
  • Issue comment event: 8
  • Push event: 44
  • Pull request review comment event: 153
  • Pull request review event: 165
  • Pull request event: 50
  • Fork event: 7
  • Create event: 7

Committers

Last synced: about 2 years ago

All Time
  • Total Commits: 271
  • Total Committers: 54
  • Avg Commits per committer: 5.019
  • Development Distribution Score (DDS): 0.86
Past Year
  • Commits: 121
  • Committers: 15
  • Avg Commits per committer: 8.067
  • Development Distribution Score (DDS): 0.686
Top Committers
Name Email Commits
Norbert Funke f****r@a****m 38
dkovalenkoI 1****I 31
manbekaws 7****s 20
dependabot[bot] 4****] 19
Sethu Srinivasan s****n 14
kayalvk k****k@a****m 12
Will Taff w****f@g****m 10
Tiratat Patana-anake t****p 7
Philipp Sacha p****a@a****e 7
Piotr Westfalewicz w****t@a****m 7
EC2 Default User e****r@i****l 6
Taff w****z@1****m 6
Luis Morales m****l 5
karthitect k****r@g****m 5
Tony Gibbs t****b@a****m 5
Sethu Srinivasan s****h@a****m 5
Sethu Srinivasan s****n@g****m 5
Zhihao Liu z****u@a****m 4
Trevor Bonas T****s@i****m 4
Neo Wu t****w@a****m 4
Trevor Bonas 4****s 4
Kuldeep Porwal k****p@a****m 3
Francesco Martini f****i@a****m 3
David Cheng m****g@a****m 3
Charles Lee c****e@a****m 3
grayjh-at-551185274768 g****h@a****m 3
Neha Gupta 5****n 2
abhijithsatyakumar 4****r 2
kasperk81 8****1 2
kporwal-aws 9****s 2
and 24 more...
Committer Domains (Top 20 + Academic)
amazon.com: 21 bitquilltech.com: 1 bobdu.cc: 1 juffinger.org: 1 improving.com: 1 147dda0c051e.ant.amazon.com: 1 ip-172-31-20-84.ec2.internal: 1 amazon.de: 1

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 42
  • Total pull requests: 134
  • Average time to close issues: 6 months
  • Average time to close pull requests: 14 days
  • Total issue authors: 36
  • Total pull request authors: 37
  • Average comments per issue: 1.67
  • Average comments per pull request: 0.25
  • Merged pull requests: 114
  • Bot issues: 0
  • Bot pull requests: 26
Past Year
  • Issues: 2
  • Pull requests: 24
  • Average time to close issues: 1 minute
  • Average time to close pull requests: 14 days
  • Issue authors: 2
  • Pull request authors: 6
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.17
  • Merged pull requests: 19
  • Bot issues: 0
  • Bot pull requests: 5
View more stats
Top Authors
Issue Authors
  • sethusrinivasan (5)
  • charlesjlee (2)
  • warrengabstacruz (2)
  • JuanchiRios (1)
  • mttwise (1)
  • chihying7509 (1)
  • kevintrannz (1)
  • robinje (1)
  • jason-riddle (1)
  • hack-r (1)
  • uc-asv (1)
  • cam8001 (1)
  • murphycrosby (1)
  • AbdelouahabKhelifati (1)
  • odannyboy000 (1)
Pull Request Authors
  • dependabot[bot] (24)
  • trevorbonas (19)
  • dkovalenkoI (11)
  • nfunke (8)
  • bobigbal (8)
  • sethusrinivasan (8)
  • forestmvey (7)
  • piotrwest (6)
  • kayalvizhi-kandasamy (6)
  • tiratatp (5)
  • kporwal-aws (4)
  • fredjoonpark (4)
  • abhijithsatyakumar (4)
  • charlesjlee (3)
  • NeoWu1216 (3)
Top Labels
Issue Labels
enhancement (1) bug (1)
Pull Request Labels
dependencies (24) java (10) javascript (3) go (2) rust (2) .NET (1)

Packages

  • Total packages: 2
  • Total downloads: unknown
  • Total dependent packages: 0
    (may contain duplicates)
  • Total dependent repositories: 2
    (may contain duplicates)
  • Total versions: 10
proxy.golang.org: github.com/awslabs/amazon-timestream-tools
  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Forks count: 1.4%
Stargazers count: 2.2%
Average: 5.0%
Dependent packages count: 7.0%
Dependent repos count: 9.3%
Last synced: 11 months ago
repo1.maven.org: software.amazon.timestream:flink-connector-timestream

Timestream Sink connector for Apache Flink. The sink will buffer, batch, and write data in parallel to Timestream database.

  • Versions: 5
  • Dependent Packages: 0
  • Dependent Repositories: 2
Rankings
Forks count: 15.0%
Dependent repos count: 16.1%
Stargazers count: 21.2%
Average: 25.6%
Dependent packages count: 50.1%
Last synced: 11 months ago

Dependencies

integrations/flink_connector/flink-connector-timestream/pom.xml maven
  • org.projectlombok:lombok 1.18.22 compile
  • software.amazon.awssdk:bom 2.17.203 import
  • org.apache.flink:flink-connector-base 1.13.2
  • org.apache.flink:flink-java 1.13.2
  • org.jacoco:jacoco-maven-plugin 0.8.7
  • org.slf4j:slf4j-api 1.7.32
  • software.amazon.awssdk:aws-crt-client 2.17.204-PREVIEW
  • software.amazon.awssdk:timestreamwrite
  • org.apache.flink:flink-streaming-java_2.12 1.13.2 test
  • org.apache.flink:flink-test-utils_2.12 1.13.2 test
  • org.junit.jupiter:junit-jupiter-engine 5.7.2 test
  • org.mockito:mockito-core 3.2.4 test
integrations/flink_connector/sample-kinesis-to-timestream-app/pom.xml maven
  • org.projectlombok:lombok 1.18.22 compile
  • software.amazon.awssdk:bom 2.17.203 import
  • org.apache.flink:flink-clients_2.12 1.13.2 provided
  • org.apache.flink:flink-java 1.13.2 provided
  • org.apache.flink:flink-streaming-java_2.12 1.13.2 provided
  • com.amazonaws:aws-kinesisanalytics-flink 2.0.0
  • com.amazonaws:aws-kinesisanalytics-runtime 1.2.0
  • de.javakaffee:kryo-serializers 0.45
  • org.apache.flink:flink-connector-kinesis_2.12 1.13.2
  • org.json:json 20210307
  • org.slf4j:slf4j-api 1.7.32
  • org.slf4j:slf4j-log4j12 1.7.32
  • software.amazon.awssdk:timestreamwrite
  • software.amazon.timestream:flink-connector-timestream 0.1
  • org.junit.jupiter:junit-jupiter-engine 5.7.2 test
  • org.mockito:mockito-core 3.2.4 test
integrations/jdbc/pom.xml maven
  • com.amazonaws:aws-java-sdk-bom 1.11.908 import
  • args4j:args4j 2.33
  • com.amazonaws:aws-java-sdk-core
  • com.amazonaws:aws-java-sdk-sts
  • com.amazonaws:aws-java-sdk-timestreamquery 1.11.872
  • com.google.guava:guava 30.0-jre
  • org.jsoup:jsoup 1.15.3
  • org.slf4j:jul-to-slf4j 1.7.24
  • software.amazon.timestream:amazon-timestream-jdbc 1.0.1
sample_apps/java/pom.xml maven
  • com.amazonaws:aws-java-sdk-bom 1.12.118 import
  • args4j:args4j 2.33
  • com.amazonaws:aws-java-sdk-timestreamquery
  • com.amazonaws:aws-java-sdk-timestreamwrite
sample_apps/javaV2/pom.xml maven
  • software.amazon.awssdk:bom 2.17.203 import
  • args4j:args4j 2.33
  • software.amazon.awssdk:apache-client
  • software.amazon.awssdk:timestreamquery
  • software.amazon.awssdk:timestreamwrite
sample_apps_reinvent2021/java/pom.xml maven
  • com.amazonaws:aws-java-sdk-bom 1.12.118 import
  • args4j:args4j 2.33
  • com.amazonaws:aws-java-sdk-core 1.12.118
  • com.amazonaws:aws-java-sdk-iam 1.12.34
  • com.amazonaws:aws-java-sdk-s3 1.12.261
  • com.amazonaws:aws-java-sdk-sqs 1.12.34
  • com.amazonaws:aws-java-sdk-timestreamquery 1.12.118
  • com.amazonaws:aws-java-sdk-timestreamwrite 1.12.118
  • com.google.code.gson:gson 2.8.9
  • com.google.guava:guava 29.0-jre
  • org.apache.commons:commons-lang3 3.6
  • software.amazon.awssdk:iam 2.17.203
  • software.amazon.awssdk:sdk-core 2.17.203
  • software.amazon.awssdk:sns 2.17.203
  • software.amazon.awssdk:sqs 2.17.203
sample_apps_reinvent2021/javaV2/pom.xml maven
  • software.amazon.awssdk:bom 2.17.203 import
  • args4j:args4j 2.203
  • com.google.code.gson:gson 2.8.9
  • org.apache.commons:commons-lang3 3.6
  • org.projectlombok:lombok 1.18.22
  • software.amazon.awssdk:apache-client 2.17.203
  • software.amazon.awssdk:aws-sdk-java 2.17.203
  • software.amazon.awssdk:timestreamquery 2.17.203
  • software.amazon.awssdk:timestreamwrite 2.17.203
sample_apps/js/package-lock.json npm
  • aws-sdk 2.1036.0
  • base64-js 1.5.1
  • buffer 4.9.2
  • events 1.1.1
  • ieee754 1.1.13
  • isarray 1.0.0
  • jmespath 0.15.0
  • minimist 1.2.6
  • punycode 1.3.2
  • querystring 0.2.0
  • sax 1.2.1
  • url 0.10.3
  • uuid 3.3.2
  • xml2js 0.4.19
  • xmlbuilder 9.0.7
sample_apps/js/package.json npm
  • aws-sdk ^2.1036.0
  • minimist ^1.2.6
sample_apps_reinvent2021/js/package.json npm
  • aws-sdk ^2.1036.0
  • minimist ^1.2.5
sample_apps/dotnet/TimestreamDotNetSample.csproj nuget
  • AWSSDK.Core 3.7.5.2
  • AWSSDK.TimestreamQuery 3.7.1
  • AWSSDK.TimestreamWrite 3.7.1
  • CommandLineParser 2.8.0
sample_apps_reinvent2021/dotnet/TimestreamDotNetSample.csproj nuget
  • AWSSDK.Core 3.7.5.4
  • AWSSDK.IdentityManagement 3.7.2.85
  • AWSSDK.S3 3.7.7.1
  • AWSSDK.SQS 3.7.2.2
  • AWSSDK.SecurityToken 3.7.1.96
  • AWSSDK.SimpleNotificationService 3.7.3.5
  • AWSSDK.TimestreamQuery 3.7.1.2
  • AWSSDK.TimestreamWrite 3.7.1.2
  • CommandLineParser 2.8.0
  • Newtonsoft.Json 13.0.2
sample_apps_reinvent2021/python/requirements.txt pypi
  • boto3 >=1.20.13
.github/workflows/main.yml actions
  • actions/checkout v2 composite
  • actions/setup-java v2 composite
  • cicirello/jacoco-badge-generator v2 composite
tools/java/multithreaded-writer/SampleLambdaFromS3CsvIngestion/pom.xml maven
  • com.amazonaws.sample.timestream.multithreaded:sample-local-csv-ingestion 1.0-SNAPSHOT compile
  • com.amazonaws.sample.timestream.multithreaded:timestream-multithreaded-writer 1.0-SNAPSHOT compile
  • org.apache.logging.log4j:log4j-bom 2.14.1 import
  • com.amazonaws:aws-lambda-java-core 1.2.1
  • com.amazonaws:aws-lambda-java-log4j2 1.2.0
  • org.apache.logging.log4j:log4j-1.2-api 2.14.1
  • org.apache.logging.log4j:log4j-slf4j-impl 2.14.1
  • software.amazon.awssdk:s3
  • org.junit.jupiter:junit-jupiter-engine 5.7.2 test
tools/java/multithreaded-writer/SampleLocalCsvIngestion/pom.xml maven
  • info.picocli:picocli 4.5.2 compile
  • org.apache.logging.log4j:log4j-bom 2.14.1 import
  • com.amazonaws.sample.timestream.multithreaded:timestream-multithreaded-writer 1.0-SNAPSHOT
  • org.apache.logging.log4j:log4j-1.2-api 2.14.1
  • org.apache.logging.log4j:log4j-slf4j-impl 2.14.1
  • org.simpleflatmapper:sfm-csv 8.2.3
tools/java/multithreaded-writer/TimestreamMultithreadedWriter/pom.xml maven
  • com.google.code.findbugs:jsr305 3.0.2
  • com.google.guava:guava 32.0.0-jre
  • org.projectlombok:lombok 1.18.12
  • org.slf4j:slf4j-api 1.7.32
  • software.amazon.awssdk:apache-client
  • software.amazon.awssdk:timestreamwrite
tools/java/multithreaded-writer/pom.xml maven
  • software.amazon.awssdk:bom 2.16.97 import
tools/python/continuous-ingestor/requirements.txt pypi
  • boto3 *
  • numpy *
tools/python/perf-scale-workload/requirements.txt pypi
  • boto3 *
  • numpy *
  • pandas *
  • scipy *
  • tdigest *