Recent Releases of https://github.com/awslabs/data-on-eks

https://github.com/awslabs/data-on-eks - v1.2.0

What's Changed

  • feat: Prepare for v2.0 – New DoEKS Website, Deprecation of AI on EKS References, and Removal of Unused Blueprints by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/876

Full Changelog: https://github.com/awslabs/data-on-eks/compare/v1.1.0...v1.2.0

- HCL
Published by vara-bonthu 11 months ago

https://github.com/awslabs/data-on-eks - v1.1.0

⚠️ Deprecation Notice: AI on EKS and Legacy Blueprints

As of this release, several legacy blueprints—including AI on EKS examples—remain available but will be deprecated in the upcoming v2.0 release of Data on EKS.

The upcoming v2.0 will focus exclusively on data-focused blueprints and best practices for running scalable data workloads on Amazon EKS.

If you’re looking for AI/ML workloads, model serving patterns, or blog content that references AI on EKS, please visit the dedicated AI on EKS site: 🔗 https://awslabs.github.io/ai-on-eks/

We encourage all users of AI blueprints to migrate to the AI on EKS repository for continued support and updates.


What's Changed

  • docs: Update and fix documentation for website doc by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/658
  • docs: Fix a link in AWS Batch instructions by @delagoya in https://github.com/awslabs/data-on-eks/pull/659
  • feat: Update gradio client with sample prompt for Llama3.1-405b model inference by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/662
  • feat: Spark operator default to encrypted gp3 PVs by @alanty in https://github.com/awslabs/data-on-eks/pull/674
  • feat: Use unique name for the spark job execution IRSA policy by @alanty in https://github.com/awslabs/data-on-eks/pull/672
  • refactor: Update Kafka Blueprint to use more recent versions of Kafka and Strimzi, and use Karpenter by @chrismld in https://github.com/awslabs/data-on-eks/pull/665
  • feat: BioNemo EKS cluster Using Cloudwatch Observability Plugin by @JohnDzialo in https://github.com/awslabs/data-on-eks/pull/641
  • chore(deps): bump http-proxy-middleware from 2.0.6 to 2.0.7 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/681
  • feat: Spark benchmarks update to 3.5.3 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/683
  • feat: Spark benchmarking updates with generic files by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/688
  • feat: Use official neuron helm chart for device plugin and scheduler by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/687
  • fix: Update EKS module to support AL2023 bootstrapping by @alanty in https://github.com/awslabs/data-on-eks/pull/689
  • fix: Add implicit dependecy for karpenter resources by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/691
  • chore: Update Spark v4 addons by @alanty in https://github.com/awslabs/data-on-eks/pull/692
  • feat: Spark benchmark observability by @alanty in https://github.com/awslabs/data-on-eks/pull/693
  • chore(deps): bump cookie and express in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/678
  • chore: Remove cluster-autoscaler examples for spark operator by @alanty in https://github.com/awslabs/data-on-eks/pull/695
  • fix: Add all VPC CIDRs to VPCe config by @alanty in https://github.com/awslabs/data-on-eks/pull/697
  • feat: Add spark benchmark test data generation changes by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/694
  • docs: Update Spark Benchmark Docs by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/698
  • docs: Add data generation doc updates for spark benchmark by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/699
  • chore: Spark examples update by @alanty in https://github.com/awslabs/data-on-eks/pull/696
  • docs: Document how to run the TPCDS benchmarks by @alanty in https://github.com/awslabs/data-on-eks/pull/700
  • docs: Spark Benchmarks on Graviton R-series by @alanty in https://github.com/awslabs/data-on-eks/pull/701
  • style: Add cf insights by @candonov in https://github.com/awslabs/data-on-eks/pull/703
  • docs: Troubleshooting section for IPv6 policy by @alanty in https://github.com/awslabs/data-on-eks/pull/705
  • fix: Update spark ipv6 install.sh by @alanty in https://github.com/awslabs/data-on-eks/pull/704
  • feat: Trino blueprint upgrade by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/702
  • feat: Export Trino metrics to Prometheus and enable autoscalling with KEDA by @bbgu1 in https://github.com/awslabs/data-on-eks/pull/712
  • chore(deps): bump nanoid from 3.3.7 to 3.3.8 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/714
  • chore(deps): bump cross-spawn from 7.0.3 to 7.0.6 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/710
  • chore: Corrected paths for install.sh/cleanup.sh commands in jark.md by @ak-org in https://github.com/awslabs/data-on-eks/pull/719
  • feat: Enhance Spark operator blueprint to add S3 Tables support by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/721
  • docs: Add website documentation for using S3 Tables with Spark Operator by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/722
  • feat: Add an example of using S3 tables with jupyter hub by @nabuskey in https://github.com/awslabs/data-on-eks/pull/723
  • fix: Flink operator blueprint deployment errors by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/731
  • Update ADOPTERS.md by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/735
  • feat: Enable spark-operator prometheus metrics by @alanty in https://github.com/awslabs/data-on-eks/pull/737
  • feat: Add Karpenter and EMR Spark Dashboards to spark-operator by @alanty in https://github.com/awslabs/data-on-eks/pull/738
  • fix: Disable spark-operator podmonitor by @alanty in https://github.com/awslabs/data-on-eks/pull/742
  • docs: Clarifying where customers need the table bucket ARN vs Table ARN by @davlaur in https://github.com/awslabs/data-on-eks/pull/743
  • feat: Add Grafana dashboard for kubeflow Spark Operator by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/744
  • feat: DeepSeek-R1 on EKS blueprint by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/745
  • chore(deps): bump aws-cdk-lib from 2.80.0 to 2.177.0 in /analytics/cdk/emr-eks by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/733
  • feat: Fixes to security vulnerabilities by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/746
  • fix: Cleanup load balancers in spark operator cleanup by @alanty in https://github.com/awslabs/data-on-eks/pull/749
  • style: Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc) by @e-mi-lio in https://github.com/awslabs/data-on-eks/pull/750
  • fix: Trino scale-down to zero with KEDA by @bbgu1 in https://github.com/awslabs/data-on-eks/pull/726
  • fix: Update Spark-operator kubecost by @alanty in https://github.com/awslabs/data-on-eks/pull/759
  • docs: NVIDIA triton server monitoring namespace fix by @ronaldosaheki in https://github.com/awslabs/data-on-eks/pull/765
  • feat: For issue #706 Ray serve with Llama.cpp for CPU inference on Graviton by @ddynwzh1992 in https://github.com/awslabs/data-on-eks/pull/739
  • feat: Add Spark operator benchmark kit by @alanty in https://github.com/awslabs/data-on-eks/pull/764
  • chore: Spark blueprint version bump by @alanty in https://github.com/awslabs/data-on-eks/pull/763
  • feat: Update EMR Spark RAPIDs blueprint by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/762
  • feat: Spark operator Benchmarks update by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/769
  • feat: Add an example notebook for S3 Tables by @nabuskey in https://github.com/awslabs/data-on-eks/pull/771
  • fix: Add missing S3 tables permission by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/776
  • feat: Spark observability improvements by @alanty in https://github.com/awslabs/data-on-eks/pull/778
  • chore(deps): bump @babel/runtime from 7.24.7 to 7.26.10 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/787
  • chore(deps): bump @babel/helpers from 7.24.7 to 7.26.10 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/786
  • chore(deps): bump @babel/runtime-corejs3 from 7.24.7 to 7.26.10 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/785
  • chore(deps): bump prismjs from 1.29.0 to 1.30.0 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/780
  • chore(deps): bump jinja2 from 3.1.5 to 3.1.6 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/777
  • fix: Datahub version upgrade by @bbgu1 in https://github.com/awslabs/data-on-eks/pull/784
  • feat: Adding example for Fine-tuning Llama3 with LoRA using HuggingFace Optimum Neuron on AWS Trainium by @VijoyChoyi in https://github.com/awslabs/data-on-eks/pull/779
  • refactor: Updated adapter and hpa to use queuecomputeratio by @freschri in https://github.com/awslabs/data-on-eks/pull/790
  • docs: Announce Data-on-EKS split and AI-on-EKS migration by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/794
  • chore(deps): bump aws-cdk-lib from 2.177.0 to 2.184.0 in /analytics/cdk/emr-eks by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/795
  • fix: Update ingress-nginx by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/796
  • chore: Fix pre-commit errors by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/797
  • chore(deps): bump tar-fs in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/798
  • feat: Updates to AI on EKS repo by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/799
  • chore(deps): bump image-size from 1.1.1 to 1.2.1 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/804
  • feat: Add Aerospike blueprint by @sud82 in https://github.com/awslabs/data-on-eks/pull/800
  • fix: Spark dashboard fixes by @alanty in https://github.com/awslabs/data-on-eks/pull/807
  • chore(deps): bump aws-cdk-lib from 2.184.0 to 2.187.0 in /analytics/cdk/emr-eks by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/805
  • chore(deps): bump estree-util-value-to-estree from 3.1.2 to 3.3.3 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/810
  • fix: Update s3tables examples to use iceberg rest catalog api by @nabuskey in https://github.com/awslabs/data-on-eks/pull/816
  • chore(deps): bump aws-cdk-lib from 2.187.0 to 2.189.1 in /analytics/cdk/emr-eks by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/817
  • chore(deps): bump http-proxy-middleware from 2.0.7 to 2.0.9 in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/818
  • chore: Fix pre-commit issues by @alanty in https://github.com/awslabs/data-on-eks/pull/827
  • docs: Adding Trino Best Practices by @senkinnar in https://github.com/awslabs/data-on-eks/pull/803
  • fix: Added and updated commands in the spark-yunikorn example for proper execution by @abhisnan in https://github.com/awslabs/data-on-eks/pull/830
  • chore(deps): bump flask from 3.1.0 to 3.1.1 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/835
  • chore: Fixing Typos by @senkinnar in https://github.com/awslabs/data-on-eks/pull/834
  • fix: Website build issue with html tag by @nabuskey in https://github.com/awslabs/data-on-eks/pull/836
  • ci: Pre commit fixes by @alanty in https://github.com/awslabs/data-on-eks/pull/838
  • chore(deps): bump flask-cors from 5.0.0 to 6.0.0 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/837
  • chore(deps): bump tar-fs in /website by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/847
  • feat: Restructure best practices web page by @nabuskey in https://github.com/awslabs/data-on-eks/pull/846
  • fix: Spark History server upgrade by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/842
  • fix: Pin Karpenter dashboard to a commit by @nabuskey in https://github.com/awslabs/data-on-eks/pull/855
  • chore: Upgrade flink to emr-7.9.0 by @chethanuk in https://github.com/awslabs/data-on-eks/pull/843
  • feat: Merge changes from spark workshop branch by @alanty in https://github.com/awslabs/data-on-eks/pull/844
  • chore: Pin aws and helm modules to previous major version by @alanty in https://github.com/awslabs/data-on-eks/pull/859
  • feat: EMR on EKS Upgrade to EKS 1.33 and EMR on EKS 7.9.0 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/862
  • revert: Restore Spark dashboards by @alanty in https://github.com/awslabs/data-on-eks/pull/864
  • fix: karpenter version in module flink on eks by @berry2012 in https://github.com/awslabs/data-on-eks/pull/869
  • chore(deps): bump urllib3 from 2.3.0 to 2.5.0 in /analytics/terraform/spark-k8s-operator/examples/benchmark/spark-operator-benchmark-kit by @dependabot[bot] in https://github.com/awslabs/data-on-eks/pull/861

New Contributors

  • @chrismld made their first contribution in https://github.com/awslabs/data-on-eks/pull/665
  • @JohnDzialo made their first contribution in https://github.com/awslabs/data-on-eks/pull/641
  • @candonov made their first contribution in https://github.com/awslabs/data-on-eks/pull/703
  • @ak-org made their first contribution in https://github.com/awslabs/data-on-eks/pull/719
  • @davlaur made their first contribution in https://github.com/awslabs/data-on-eks/pull/743
  • @e-mi-lio made their first contribution in https://github.com/awslabs/data-on-eks/pull/750
  • @ronaldosaheki made their first contribution in https://github.com/awslabs/data-on-eks/pull/765
  • @ddynwzh1992 made their first contribution in https://github.com/awslabs/data-on-eks/pull/739
  • @VijoyChoyi made their first contribution in https://github.com/awslabs/data-on-eks/pull/779
  • @freschri made their first contribution in https://github.com/awslabs/data-on-eks/pull/790
  • @sud82 made their first contribution in https://github.com/awslabs/data-on-eks/pull/800
  • @abhisnan made their first contribution in https://github.com/awslabs/data-on-eks/pull/830
  • @chethanuk made their first contribution in https://github.com/awslabs/data-on-eks/pull/843
  • @berry2012 made their first contribution in https://github.com/awslabs/data-on-eks/pull/869

Full Changelog: https://github.com/awslabs/data-on-eks/compare/v1.0.4...v1.1.0

- HCL
Published by vara-bonthu 11 months ago

https://github.com/awslabs/data-on-eks - v1.0.4

What's Changed

  • fix: Update cleanup script by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/595
  • fix: Update karpenter version for trainium-inferentia blueprint by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/599
  • docs: Add video link for Deploy accelerator-agnostic inference pipelines to Amazon EKS by @TalHibner in https://github.com/awslabs/data-on-eks/pull/600
  • feat: Replaced NIM architecture diagram with self-made NIM on EKS arch diagram by @hustshawn in https://github.com/awslabs/data-on-eks/pull/612
  • feat: RayServe with vLLM using AWS Neuron on Amazon EKS by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/607
  • feat: Mountpoint S3 for loading additional Spark Jars by @bainskb in https://github.com/awslabs/data-on-eks/pull/606
  • feat: Support preloading container images into Bottlerocket data volumes with Karpenter by @lindarr915 in https://github.com/awslabs/data-on-eks/pull/587
  • chore: Delete ai-ml/kubeflow directory by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/619
  • feat: Updated mountpoint-s3 for spark readme by @bainskb in https://github.com/awslabs/data-on-eks/pull/618
  • feat: Trainium blueprint upgrade and Llama3.1 405b Distributed inference example by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/622
  • feat: Neuron scheduler update for trainium-inferentia blueprints by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/624
  • feat: Website Updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/626
  • feat: Updates to the sidebar by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/627
  • feat: Added deprecating notes; added Jark stack doc;added warnings for ML p… by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/628
  • feat: NVIDIA NIM Updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/631
  • feat: Udate NVIDIA NIM blueprint with grafana dashboard and docs by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/633
  • feat: Add OpenWebUI for vllm-rayserve-inf2 blueprint by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/635
  • feat: Updated EMR on EKS Blueprint by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/638
  • chore: Update PULLREQUESTTEMPLATE.md by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/643
  • chore: Add access entry for workshop by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/644
  • fix: Use eks module for access_entries for trn-inf blueprint by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/646
  • chore(deps): bump send and express in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/653
  • chore(deps): bump serve-static and express in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/652
  • feat: Updates to the llama3.1 405 model scripts by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/655
  • feat: Add cloudwatch eks add on with enhanced monitoring for neuron by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/651
  • chore: Update cmd-shell image to python3.11 by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/656
  • docs: Website documentation for vllm inferencing using rayserve on AWS Inferentia by @sindhupalakodety in https://github.com/awslabs/data-on-eks/pull/637
  • feat: Adding support for AWS Batch by @delagoya in https://github.com/awslabs/data-on-eks/pull/620
  • docs: Ray vLLM Inf2 website doc updates by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/657
  • feat: Observability for RayServe and vLLM GPU by @shivam-dubey-1 in https://github.com/awslabs/data-on-eks/pull/642
  • feat: Add binpacking examples by @hitsub2 in https://github.com/awslabs/data-on-eks/pull/615
  • feat: Spark K8s Operator on EKS IPv6 cluster by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/499

New Contributors

  • @TalHibner made their first contribution in https://github.com/awslabs/data-on-eks/pull/600
  • @bainskb made their first contribution in https://github.com/awslabs/data-on-eks/pull/606
  • @sindhupalakodety made their first contribution in https://github.com/awslabs/data-on-eks/pull/637
  • @delagoya made their first contribution in https://github.com/awslabs/data-on-eks/pull/620
  • @shivam-dubey-1 made their first contribution in https://github.com/awslabs/data-on-eks/pull/642

Full Changelog: https://github.com/awslabs/data-on-eks/compare/v1.0.3...v1.0.4

- HCL
Published by vara-bonthu over 1 year ago

https://github.com/awslabs/data-on-eks - v1.0.3

What's Changed

  • 🚀 Initial commit for DoEKS by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/1
  • removed package-lock.json file by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/2
  • Adding package-lock.json file by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/3
  • Fixing the git node package dependa alert by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/4
  • Fix to github pages deployment by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/5
  • Updated Test environment by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/6
  • removed deployment branch as main for website by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/7
  • changed publish dire to ./website by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/8
  • baseurl for the site changed by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/9
  • Searchbar added to website by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/32
  • Karpenter Graviton Provisioner support for EMR on EKS by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/37
  • Doc updates for Airflow and fixes to spark operator by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/38
  • Trigger EMR on EKS jobs with Apache Airflow by @victorgu-github in https://github.com/awslabs/data-on-eks/pull/39
  • Website updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/40
  • 🦄 Apache YuniKorn batch scheduler with EMR on EKS by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/42
  • Updates to github workflows by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/44
  • EMR on EKS Gang scheduling example by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/49
  • Added FluentBit config to write logs to S3 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/50
  • MWAA doc fix by @victorgu-github in https://github.com/awslabs/data-on-eks/pull/48
  • Argo workflows on EKS example and doc by @victorgu-github in https://github.com/awslabs/data-on-eks/pull/43
  • KubeCost addon for EMR on EKS Karpenter by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/52
  • argo workflow enhancement by @victorgu-github in https://github.com/awslabs/data-on-eks/pull/53
  • fix: Fixed the karpenter example hard-coded the provisioner region by @hustshawn in https://github.com/awslabs/data-on-eks/pull/55
  • Bump loader-utils from 2.0.2 to 2.0.3 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/57
  • Bump minimatch, recursive-readdir and serve-handler in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/58
  • Folder structure and major updates to docs by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/59
  • Github workflow security updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/60
  • daily tag gh flow added by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/61
  • Bump loader-utils from 2.0.3 to 2.0.4 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/62
  • fix broken link after folder structure change by @victorgu-github in https://github.com/awslabs/data-on-eks/pull/63
  • Feat: Apache Kafka using Strimzi on EKS by @AlyIbrahim in https://github.com/awslabs/data-on-eks/pull/47
  • Fix link to Kafka docs. by @brianhammons in https://github.com/awslabs/data-on-eks/pull/64
  • Better positioning EMR on EKS by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/72
  • add cdk blueprint for emr-eks by @lmouhib in https://github.com/awslabs/data-on-eks/pull/45
  • Architecture diagram for home page by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/73
  • Update import for emr on eks blueprint by @lmouhib in https://github.com/awslabs/data-on-eks/pull/74
  • Add analytics reference architecture blog by @lmouhib in https://github.com/awslabs/data-on-eks/pull/75
  • Fix the aws cli command by @lmouhib in https://github.com/awslabs/data-on-eks/pull/78
  • VPC endpoints added;s3 state for e2e tests by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/77
  • Add storage considerations and managed alternatives sections to Kafka… by @brianhammons in https://github.com/awslabs/data-on-eks/pull/79
  • [feat] ACK EMR on EKS Controller pattern and example by @victorgu-github in https://github.com/awslabs/data-on-eks/pull/81
  • [enhancement] Change argo workflow example to create spark app in a new ns by @victorgu-github in https://github.com/awslabs/data-on-eks/pull/84
  • Feat: Observability on Spark on EKS by @victorgu-github in https://github.com/awslabs/data-on-eks/pull/85
  • EMR on EKS Doc improvement by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/83
  • EMR on EKS Karpenter with YuniKorn updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/87
  • fixing bug in CloudWatch Logs autocreate in helm bcoz terraform alrea… by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/88
  • Add Troubleshooting page by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/90
  • [enhancement] update argo workflows based on blog comments by @victorgu-github in https://github.com/awslabs/data-on-eks/pull/89
  • Bump json5 from 2.2.1 to 2.2.3 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/91
  • Bump json5 from 2.2.1 to 2.2.3 in /analytics/cdk/emr-eks by @dependabot in https://github.com/awslabs/data-on-eks/pull/92
  • Bump ua-parser-js from 0.7.31 to 0.7.33 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/96
  • Bump http-cache-semantics from 4.1.0 to 4.1.1 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/100
  • Bump @sideway/formula from 3.0.0 to 3.0.1 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/103
  • Website update to Docu@2.3.1 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/106
  • Bump node-fetch and docusaurus in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/108
  • Data on EKS Logo added with footer icons by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/109
  • Removing the Robot font by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/110
  • Added EMR cluster Name to output.tf so instructions work by @rbarcia in https://github.com/awslabs/data-on-eks/pull/113
  • Spark Live UI added by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/114
  • remove deprecated format and increaes volume timeout to 60 seconds by @nabuskey in https://github.com/awslabs/data-on-eks/pull/119
  • EMR on EKS with Karpenter example with V5 EKS Blueprints by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/121
  • feat: EMR on EKS Fargate pattern with new approach by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/102
  • Update Adopters and Add policy of SSM to karpenter role by @srikaanthpenugonda in https://github.com/awslabs/data-on-eks/pull/123
  • Readme update by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/124
  • Data on EKS workshop module by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/125
  • Apache NiFi on EKS by @codesometech in https://github.com/awslabs/data-on-eks/pull/99
  • Cleanup scripts added by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/126
  • add workshop util by @lmouhib in https://github.com/awslabs/data-on-eks/pull/129
  • modifying job submission by changing to input variables rather than hardcoding by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/130
  • Workshop content update by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/133
  • fix for karpenter provisioner by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/134
  • Bump webpack from 5.74.0 to 5.76.1 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/135
  • adding ebs volume example by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/132
  • Updated all the addons to use v4.25.0 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/136
  • minor bug in compute provisioner script by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/137
  • Correct URL in README.md by @mfjackson in https://github.com/awslabs/data-on-eks/pull/141
  • Fsx for lustre added as module to Karpenter example by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/139
  • Removing link from Adopters page by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/142
  • added preserve field to true to avoid destroy issues by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/144
  • simplifying deployment experience by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/143
  • chore: Remove accidental commits by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/145
  • feat: Updates to the Ray blueprint by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/111
  • doc: Add Kubeflow on AWS page by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/147
  • Improve guide by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/148
  • EMR EKS Workshop module updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/146
  • RAID-0 config for NVMe based SSD EC2 instances with Karpenter Provisioners by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/156
  • Add CloudNativePG operator. by @jihed in https://github.com/awslabs/data-on-eks/pull/127
  • CloudNativePG by @jihed in https://github.com/awslabs/data-on-eks/pull/159
  • initialize terraform in install scripts by @nabuskey in https://github.com/awslabs/data-on-eks/pull/161
  • update secrets name by @jihed in https://github.com/awslabs/data-on-eks/pull/160
  • Fix documentation error in ray pytorch example by @elyall in https://github.com/awslabs/data-on-eks/pull/165
  • Spark operator refactor by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/170
  • fix pre-commit run by @jihed in https://github.com/awslabs/data-on-eks/pull/173
  • EMR EKS Blueprints leveraging the sub terraform modules by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/174
  • Updated broken links on Readme by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/177
  • Removed the cluster name variable by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/178
  • Bump node-fetch and docusaurus in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/168
  • Flink Operator on EKS by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/180
  • Security critical fixes for docusaurus by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/181
  • Bump xml2js and @aws-quickstart/eks-blueprints in /analytics/cdk/emr-eks by @dependabot in https://github.com/awslabs/data-on-eks/pull/183
  • add output for amp by @lmouhib in https://github.com/awslabs/data-on-eks/pull/184
  • delta lake example by @rajarshighosal in https://github.com/awslabs/data-on-eks/pull/182
  • updated website doc for delta lake example by @rajarshighosal in https://github.com/awslabs/data-on-eks/pull/188
  • Bump yaml from 2.1.3 to 2.2.2 in /analytics/cdk/emr-eks by @dependabot in https://github.com/awslabs/data-on-eks/pull/195
  • Dependabot security fix for GOT and TRIM packages by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/196
  • Monitoring ML Workflows using Kubeflow on Amazon EKS by @elamaran11 in https://github.com/awslabs/data-on-eks/pull/202
  • Fix region mismatch in XGBoost example by @raykrueger in https://github.com/awslabs/data-on-eks/pull/204
  • Spark Operator blueprint upgrade to EKS 1.26 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/205
  • Fix region mismatch in pytorch example by @raykrueger in https://github.com/awslabs/data-on-eks/pull/207
  • Fix ray example docs by @raykrueger in https://github.com/awslabs/data-on-eks/pull/208
  • EMR on EKS with Karpenter updated to Kubernetes 1.26 by @mihneaspirescu in https://github.com/awslabs/data-on-eks/pull/210
  • Fixed intallation scripts and removed default region from variables.tf by @lusoal in https://github.com/awslabs/data-on-eks/pull/211
  • fixed broken link in spark observability module by @lusoal in https://github.com/awslabs/data-on-eks/pull/214
  • remove acl using bucket policy by @hitsub2 in https://github.com/awslabs/data-on-eks/pull/218
  • Website restructure and Dynamic EBS volumes for karpenter userdata by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/221
  • Fixed links for EMR EKS Inro page by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/222
  • EMR NVIDIA Spark Rapids Blueprint added by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/224
  • Modify Python script and execution shell script to customize Docker i… by @tanmatth in https://github.com/awslabs/data-on-eks/pull/225
  • Feat/emr eks spark operator by @lmouhib in https://github.com/awslabs/data-on-eks/pull/220
  • DataHub on EKS by @bbgu1 in https://github.com/awslabs/data-on-eks/pull/213
  • Kafka on EKS - EKS Bluprints V5 Mitigation by @AlyIbrahim in https://github.com/awslabs/data-on-eks/pull/169
  • pre-commit updates and vpc module version uplifted by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/227
  • EMR spark rapids website and XGBoost example update by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/229
  • Bump aws-cdk-lib from 2.51.1 to 2.80.0 in /analytics/cdk/emr-eks by @dependabot in https://github.com/awslabs/data-on-eks/pull/226
  • Reduce the number of times we run apply by @raykrueger in https://github.com/awslabs/data-on-eks/pull/233
  • Upgrade Airflow to 2.5.3 and EKS to 1.26 by @jagpk in https://github.com/awslabs/data-on-eks/pull/230
  • Jupyterhub on EKS by @rajarshighosal in https://github.com/awslabs/data-on-eks/pull/228
  • Updated readme with correct links by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/234
  • feat: Refactor/update kafka v5 by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/231
  • feat: Docs update for Jupyterhub and Spark rapids by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/236
  • fix: Bump cdk and remove package-lock.json by @lmouhib in https://github.com/awslabs/data-on-eks/pull/238
  • Bump stylelint from 14.16.1 to 15.10.1 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/239
  • chore: Fix linting errors to pass CI checks by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/242
  • chore: Change Prometheus with for kube-prometheus-stack by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/241
  • chore: Update module versions to standardize and remove deprecation errors/warnings by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/243
  • Bump semver from 5.7.1 to 5.7.2 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/245
  • chore: Remove VPC CNI IRSA role; utilize permissions provided on EC2 node IAM role by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/244
  • chore: Change Prometheus to kube-prometheus-stack by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/246
  • chore: Update Spark operator example to use new bootstrap flag for instance store volume RAID0 configuration by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/237
  • chore: Update Karpenter provisioner codeblock for self-managed Airflow by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/247
  • fix: Update Spark install script to remove target apply on addons modules by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/250
  • chore: Replace local EMR on EKS module with virtual cluster sub-module from terraform-aws-emr by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/249
  • chore: Emr-eks-karpenter blueprint updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/252
  • feat: Trainium blueprint Part1 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/251
  • fix: Added a fix for Grafana to use sigv4 authentication by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/253
  • chore: README Update with logo by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/254
  • chore: Add remote AMP for Grafana by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/256
  • Bump word-wrap from 1.2.3 to 1.2.4 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/258
  • chore: EMR Spark Rapids upgrade by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/259
  • feat: EMR on EKS with Karpenter Managed Endpoint by @youngjeong46 in https://github.com/awslabs/data-on-eks/pull/261
  • mwaa v5 migration by @bbgu1 in https://github.com/awslabs/data-on-eks/pull/248
  • refactor: Update Argo Workflow with EKS Blueprints V5 and new EKS Data Addons by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/262
  • chore: Deleted argo-events folder in Argo Workflow by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/263
  • feat: Grafana service account fix by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/266
  • chore: Replace local eks-data-addons with upstream repository by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/264
  • chore: KubePrometheusStack Helm chart config fix by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/269
  • chore: Add output gp3 storageClass to kube-prometheus-stack by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/268
  • feat: Added Trainium blueprint docs and examples by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/272
  • fix: Missing Kafka metrics in Grafana dashboard by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/276
  • feat: Added labels to the node group by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/279
  • docs: Update link for self-managed-airflow by @eladkal in https://github.com/awslabs/data-on-eks/pull/280
  • feat: Adding Autoscaling, Observability, and Beam(python) modules by @senkinnar in https://github.com/awslabs/data-on-eks/pull/275
  • Revert "feat: Adding Autoscaling, Observability, and Beam(python) modules" by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/286
  • feat: Networking best practices section by @alanty in https://github.com/awslabs/data-on-eks/pull/287
  • feat: Airflow upgrade and CWlogs fixes by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/290
  • refactor: Modify minsize and desiresize for kafka nodegroup by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/292
  • feat: Enhance JupyterHub Performance: GPU Acceleration and Time-Slicing Support by @lusoal in https://github.com/awslabs/data-on-eks/pull/277
  • fix: Fix s3 bucket variable name for Fluentbit in emr-eks workshop by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/293
  • docs: Updated typos by @parth-pandit in https://github.com/awslabs/data-on-eks/pull/291
  • feat: Trainium on EKS architecture, karpenter support and more examples by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/295
  • feat: Website updates for collapsible content by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/296
  • fix: Grafana dashboard for the latest prometheus grafana stack by @melodyyangaws in https://github.com/awslabs/data-on-eks/pull/297
  • fix: Expect correct number of arguments in the taxi data loader script by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/303
  • fix: Updated tfsec with expected excludes by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/306
  • fix: Updated tfsec and removed duplicates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/307
  • feat: Update the CloudNativePG operator blueprints by @jihed in https://github.com/awslabs/data-on-eks/pull/302
  • fix: SystemUpdate job and datahub upgrade to 0.10.4 by @bbgu1 in https://github.com/awslabs/data-on-eks/pull/270
  • feat: Add JARK stack by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/308
  • fix: Spark operator installation script by @nabuskey in https://github.com/awslabs/data-on-eks/pull/311
  • fix: Correct vpc endpoint terraform variable type by @nabuskey in https://github.com/awslabs/data-on-eks/pull/313
  • fix: Timeout in install.sh and cleanup.sh in the jark-stack by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/315
  • fix: Disable service mutation webhook when deploying LBC in jark-stack by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/317
  • fix: Modify kubectl_manifest resource to depoloy volcano and torchx e… by @ajpaws in https://github.com/awslabs/data-on-eks/pull/319
  • feat: Volcano Helm chart added to Trainium blueprint by @elygerou in https://github.com/awslabs/data-on-eks/pull/320
  • Jupyterhub blog by @lusoal in https://github.com/awslabs/data-on-eks/pull/321
  • feat: Added warning note to all public endpoints by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/322
  • fix: JupyterHub Images by @lusoal in https://github.com/awslabs/data-on-eks/pull/326
  • feat: Updates for jupyterhub blueprint for observability by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/327
  • fix: Updated karpenter compute provisioner profile with traints by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/331
  • feat: Jupyterhub blueprint updates for GPU and Neuron by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/328
  • fix: Adds a conditional to check for amiFamily to use the right deviceName by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/335
  • fix: Use correct instanceFamily for Trainium by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/339
  • chore(deps): bump postcss from 8.4.25 to 8.4.31 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/340
  • fix: Update ray for breaking change in upstream module for karpenter additional policies by @normalfaults in https://github.com/awslabs/data-on-eks/pull/344
  • fix: Changed Karpenter provisioner name to match the correct instance type by @lusoal in https://github.com/awslabs/data-on-eks/pull/349
  • chore(deps): bump @babel/traverse from 7.21.4 to 7.23.2 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/350
  • fix: Change fs type to work around EBS CSI driver issue by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/352
  • fix cleanup script for jark-stack blueprint by @csantanapr in https://github.com/awslabs/data-on-eks/pull/354
  • chore: Remove references to kubeflow by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/358
  • chore: Argo Workflow blueprint and website updated by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/355
  • feat: Llama2 Chat Inference with Inf2 instances by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/356
  • docs: Fix doc for trainium-inferentia by @allamand in https://github.com/awslabs/data-on-eks/pull/361
  • feat: MPI operator installation code for distributed training use case by @sanjeevrg89 in https://github.com/awslabs/data-on-eks/pull/362
  • chore: Argo Workflow blueprint example updated by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/364
  • docs: Update links under analytics patterns by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/365
  • docs: Fix typo by @mantcz in https://github.com/awslabs/data-on-eks/pull/366
  • docs: Update README.md by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/367
  • docs: Change duplicate 100.65.0.0/16 to 100.66.0.0/16 by @jplock in https://github.com/awslabs/data-on-eks/pull/368
  • chore: Update Kafka blueprint by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/373
  • chore: Bump helm provider version in jupyterhub blueprint by @asmacdo in https://github.com/awslabs/data-on-eks/pull/378
  • fix: Changed Karpenter manifests to match newer version os Karpenter v0.32.1 by @lusoal in https://github.com/awslabs/data-on-eks/pull/384
  • feat: Jupyterhub cognito fine grained access control by @dorukozturk in https://github.com/awslabs/data-on-eks/pull/380
  • fix: Cleanup VPC as when cleaning jupyterhub by @asmacdo in https://github.com/awslabs/data-on-eks/pull/386
  • feat: Add codespell config, pre-commit and dedicated workflow (to catch new typos) and get typos fixed by @yarikoptic in https://github.com/awslabs/data-on-eks/pull/385
  • chore: Fix pre-commit run errors by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/387
  • feat: Add MLflow Tracking blueprint by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/334
  • chore(deps): Bump axios, @docusaurus/core and @docusaurus/preset-classic in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/383
  • feat: Spark Operator Blueprint update by @alanty in https://github.com/awslabs/data-on-eks/pull/359
  • feat: Adding Apache pinot support by @wahab-io in https://github.com/awslabs/data-on-eks/pull/353
  • fix: [Flink] - Push operator version to 1.7.0 as 1.4.0 is unavailable by @flo-mair in https://github.com/awslabs/data-on-eks/pull/395
  • Fixed type for kubectl by @jaradtke-aws in https://github.com/awslabs/data-on-eks/pull/394
  • Aligned provided output to match the command shown (Ray install validation) by @jaradtke-aws in https://github.com/awslabs/data-on-eks/pull/391
  • Fixed EMR container operator import by @arthi-j in https://github.com/awslabs/data-on-eks/pull/400
  • closes #312 Allow access to EKS cluster from MWAA security group by @arthi-j in https://github.com/awslabs/data-on-eks/pull/399
  • feat: Added Llama2 training examples to trainium-inferentia module by @sanjeevrg89 in https://github.com/awslabs/data-on-eks/pull/388
  • Provided links to Open Source project landing page for Services listed by @jaradtke-aws in https://github.com/awslabs/data-on-eks/pull/389
  • chore(deps): Bump follow-redirects from 1.15.3 to 1.15.4 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/392
  • feat: EMR on EKS Blueprint upgrade with Karpenter v0.32.1 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/402
  • AZ mapping Code changes by @sanjeevrg89 in https://github.com/awslabs/data-on-eks/pull/421
  • refactor: Trainium inferentia karpenter provisioners update by @lusoal in https://github.com/awslabs/data-on-eks/pull/420
  • fix: Removed duplicates by @lusoal in https://github.com/awslabs/data-on-eks/pull/423
  • feat: Spark operator Karpenter upgrade by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/425
  • feat: Update karpenter self-managed-airflow to use karpenter_resources chart by @lusoal in https://github.com/awslabs/data-on-eks/pull/426
  • Correct typos and sync with blog post by @5cp in https://github.com/awslabs/data-on-eks/pull/428
  • feat: Upgrade to latest Karpenter and s3 mount example by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/427
  • feat: Add sample blueprint to run stable diffusion model on inferentia2 using rayserve by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/406
  • Fix BERT pretraining trn1 example by @5cp in https://github.com/awslabs/data-on-eks/pull/435
  • feat: Spark RAPIDS blueprint upgrade by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/436
  • feat: Flink blueprint upgrade to latest Karpenter by @senkinnar in https://github.com/awslabs/data-on-eks/pull/439
  • refactor: Upgrade ray version for stable diffusion inference by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/438
  • feat: Upgrade Airflow 2.7.1 by @jagpk in https://github.com/awslabs/data-on-eks/pull/440
  • feat: Trino on EKS by @youngjeong46 in https://github.com/awslabs/data-on-eks/pull/437
  • fix: For issue 429 "Unable to deploy llama2 on Eks/Ray Serve/inf2" by @harishvs in https://github.com/awslabs/data-on-eks/pull/430
  • fix: Remove broken links in gen ai doc overview page by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/460
  • feat: Argo Workflow blueprint upgrade to latest Karpenter by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/459
  • fix: Datahub upgrade to version 0.12.0 by @bbgu1 in https://github.com/awslabs/data-on-eks/pull/452
  • feat: Deploy Gradio UI App as a k8s deployment and service for stable diffusion inference by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/461
  • fix: Fix typo in the cleanup script by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/462
  • fix: Update script name to install cuda by @swapandeep in https://github.com/awslabs/data-on-eks/pull/407
  • fix: Update ray-cluster karpenter_provisioner capacity-type to on-demand by @bluecrayon52 in https://github.com/awslabs/data-on-eks/pull/424
  • feat: MLflow blueprint upgrade to latest Karpenter by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/464
  • feat: Bionemo on Eks by @dorukozturk in https://github.com/awslabs/data-on-eks/pull/457
  • feat: Upgrading to latest instance types and optimizing JVM configs by @wahab-io in https://github.com/awslabs/data-on-eks/pull/467
  • feat: Override eksdataaddons jupyterhub chart version default by @asmacdo in https://github.com/awslabs/data-on-eks/pull/470
  • feat: Add architecture diagram in doc website for stable-diffusion-inf2 blueprint by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/466
  • [feat] Add P series example nodegroup to jark stack example by @alanty in https://github.com/awslabs/data-on-eks/pull/465
  • docs: Typo in documentation by @willi-mueller in https://github.com/awslabs/data-on-eks/pull/473
  • chore(deps): Bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/476
  • chore(deps): Bump follow-redirects from 1.15.4 to 1.15.6 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/471
  • chore(deps): Bump express from 4.18.2 to 4.19.2 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/477
  • fix: Remove unwanted taints for neuron-device-plugin ds for stable diffusion and llama2 models by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/479
  • docs: Update doc website for inference examples by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/481
  • docs: Spark operator updates by @raykrueger in https://github.com/awslabs/data-on-eks/pull/484
  • chore: Update codespell.yml to skip excalidraw files by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/489
  • feat: JARK stack update with Argo Workflows, Karpenter and KubeRay by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/487
  • feat: Modified example to run multiArch Spark jobs in parallel by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/490
  • feat: Update stable-diffusion-neuron docker image by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/492
  • chore: Taxi trip script improvements by @raykrueger in https://github.com/awslabs/data-on-eks/pull/500
  • chore: Clean up pre-commit warnings and delays by @raykrueger in https://github.com/awslabs/data-on-eks/pull/491
  • feat: Add EMR runtime for flink operator blueprint by @mithun008 in https://github.com/awslabs/data-on-eks/pull/485
  • chore: Revert "chore: Clean up pre-commit warnings and delays" by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/507
  • feat: Gen-ai folder updates and JARK install doc for SD by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/511
  • feat: Upgrade Karpenter version for EMR-on-EKS blueprint by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/510
  • feat: New Gen-AI Blueprint for Serving Inference Using Mistral-7b-Instruct-V0.2 Model on AWS Inferentia2 by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/512
  • feat: Apache Superset feature support by @sguruvar in https://github.com/awslabs/data-on-eks/pull/447
  • fix: Remove trailing curly from wildcard bucket arn by @dacort in https://github.com/awslabs/data-on-eks/pull/514
  • docs: Adding Clickhouse blueprint doc by @linesa-dot in https://github.com/awslabs/data-on-eks/pull/522
  • chore: Remove pullrequesttarget from plan examples workflow by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/524
  • fix: Updated sec fix to Github workflows to pr commit sha by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/526
  • feat: Add a pattern for llama3 on inferentia2 by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/528
  • fix: Update installation script for Stable diffusion GPU blueprint by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/531
  • feat: Spark Streaming using Spark Operator by @lusoal in https://github.com/awslabs/data-on-eks/pull/516
  • docs: Improve Superset on EKS doc by @sguruvar in https://github.com/awslabs/data-on-eks/pull/530
  • fix: RayServe script name mismatch in Dockerfile by @charan-amzn in https://github.com/awslabs/data-on-eks/pull/538
  • feat: New Gen AI pattern - Llama2 Distributed Pre-training on Trn1 with RayTrain and KubeRay Operator by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/536
  • feat: Llama2 inf2 Ray inference upgrade and bug fix by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/540
  • feat: Updates for Inferentia-Trainium workshop by @sanjeevrg89 in https://github.com/awslabs/data-on-eks/pull/541
  • fix: Incorrect command to provide Linux permission on the AWS Trainium on EKS Blueprint #533 by @AbrahamArellano in https://github.com/awslabs/data-on-eks/pull/542
  • feat: NVIDIA Triton server Blueprint with vLLM by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/535
  • fix: Triton deployment path fix by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/549
  • feat: Upgrade ray version on mistral7b on inf2 blueprint by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/550
  • Fix minor typo in path by @guikcd in https://github.com/awslabs/data-on-eks/pull/546
  • feat: tags + security group and karpenter helm config updates by @sanjeevrg89 in https://github.com/awslabs/data-on-eks/pull/548
  • feat: Jupyterhub blueprint upgrade by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/554
  • feat: Add Ray head Pod high availability with Redis by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/555
  • feat: Upgrade Spark operator blueprint to EKS 1.30 and fluent-bt changes by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/558
  • fix: Dependabot Security Alert Fix for Docusaurus Packages by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/561
  • feat: Add blueprint for using RayServe with vLLM on gpus by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/563
  • feat: Updates for Spark on EKS workshop by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/568
  • fix: Updates to triton-vllm blueprint by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/571
  • docs: Featuring Data on EKS public videos on the homepage by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/570
  • docs: Update ADOPTERS.md by @halilmr in https://github.com/awslabs/data-on-eks/pull/573
  • feat: Add Elyra notebook server example by @omrishiv in https://github.com/awslabs/data-on-eks/pull/575
  • fix: Add yaml code block in documentation prometheus section by @jaimejorge in https://github.com/awslabs/data-on-eks/pull/577
  • feat: Additional vLLM config for RayServe pattern by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/574
  • feat: Add Llama3 model for triton-server pattern by @hustshawn in https://github.com/awslabs/data-on-eks/pull/578
  • feat: NVIDIA NIM on EKS Pattern by @hustshawn in https://github.com/awslabs/data-on-eks/pull/565
  • docs: Add video link for analytics Spark on EKS with Argo Workflow and Argo Events by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/579
  • fix: Fixed NIM pattern install.sh script and NGC Key instruction by @hustshawn in https://github.com/awslabs/data-on-eks/pull/582
  • fix: Converge vllm examples by @omrishiv in https://github.com/awslabs/data-on-eks/pull/580
  • feat: Add custom metrics based scaling for NVIDIA Triton server by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/583
  • fix: Fix Triton server model loading error by @ratnopamc in https://github.com/awslabs/data-on-eks/pull/584
  • feat: Jupyterhub oauth support by @omrishiv in https://github.com/awslabs/data-on-eks/pull/581
  • fix: NIM Pattern Enhancement 20240716 by @hustshawn in https://github.com/awslabs/data-on-eks/pull/588

New Contributors

  • @vara-bonthu made their first contribution in https://github.com/awslabs/data-on-eks/pull/1
  • @victorgu-github made their first contribution in https://github.com/awslabs/data-on-eks/pull/39
  • @hustshawn made their first contribution in https://github.com/awslabs/data-on-eks/pull/55
  • @dependabot made their first contribution in https://github.com/awslabs/data-on-eks/pull/57
  • @AlyIbrahim made their first contribution in https://github.com/awslabs/data-on-eks/pull/47
  • @brianhammons made their first contribution in https://github.com/awslabs/data-on-eks/pull/64
  • @dalbhanj made their first contribution in https://github.com/awslabs/data-on-eks/pull/72
  • @lmouhib made their first contribution in https://github.com/awslabs/data-on-eks/pull/45
  • @rbarcia made their first contribution in https://github.com/awslabs/data-on-eks/pull/113
  • @nabuskey made their first contribution in https://github.com/awslabs/data-on-eks/pull/119
  • @srikaanthpenugonda made their first contribution in https://github.com/awslabs/data-on-eks/pull/123
  • @codesometech made their first contribution in https://github.com/awslabs/data-on-eks/pull/99
  • @mfjackson made their first contribution in https://github.com/awslabs/data-on-eks/pull/141
  • @askulkarni2 made their first contribution in https://github.com/awslabs/data-on-eks/pull/145
  • @jihed made their first contribution in https://github.com/awslabs/data-on-eks/pull/127
  • @elyall made their first contribution in https://github.com/awslabs/data-on-eks/pull/165
  • @rajarshighosal made their first contribution in https://github.com/awslabs/data-on-eks/pull/182
  • @elamaran11 made their first contribution in https://github.com/awslabs/data-on-eks/pull/202
  • @raykrueger made their first contribution in https://github.com/awslabs/data-on-eks/pull/204
  • @mihneaspirescu made their first contribution in https://github.com/awslabs/data-on-eks/pull/210
  • @lusoal made their first contribution in https://github.com/awslabs/data-on-eks/pull/211
  • @hitsub2 made their first contribution in https://github.com/awslabs/data-on-eks/pull/218
  • @tanmatth made their first contribution in https://github.com/awslabs/data-on-eks/pull/225
  • @bbgu1 made their first contribution in https://github.com/awslabs/data-on-eks/pull/213
  • @ovaleanu made their first contribution in https://github.com/awslabs/data-on-eks/pull/231
  • @bryantbiggs made their first contribution in https://github.com/awslabs/data-on-eks/pull/242
  • @youngjeong46 made their first contribution in https://github.com/awslabs/data-on-eks/pull/261
  • @eladkal made their first contribution in https://github.com/awslabs/data-on-eks/pull/280
  • @senkinnar made their first contribution in https://github.com/awslabs/data-on-eks/pull/275
  • @alanty made their first contribution in https://github.com/awslabs/data-on-eks/pull/287
  • @parth-pandit made their first contribution in https://github.com/awslabs/data-on-eks/pull/291
  • @ajpaws made their first contribution in https://github.com/awslabs/data-on-eks/pull/319
  • @elygerou made their first contribution in https://github.com/awslabs/data-on-eks/pull/320
  • @normalfaults made their first contribution in https://github.com/awslabs/data-on-eks/pull/344
  • @csantanapr made their first contribution in https://github.com/awslabs/data-on-eks/pull/354
  • @allamand made their first contribution in https://github.com/awslabs/data-on-eks/pull/361
  • @sanjeevrg89 made their first contribution in https://github.com/awslabs/data-on-eks/pull/362
  • @mantcz made their first contribution in https://github.com/awslabs/data-on-eks/pull/366
  • @jplock made their first contribution in https://github.com/awslabs/data-on-eks/pull/368
  • @asmacdo made their first contribution in https://github.com/awslabs/data-on-eks/pull/378
  • @dorukozturk made their first contribution in https://github.com/awslabs/data-on-eks/pull/380
  • @yarikoptic made their first contribution in https://github.com/awslabs/data-on-eks/pull/385
  • @wahab-io made their first contribution in https://github.com/awslabs/data-on-eks/pull/353
  • @flo-mair made their first contribution in https://github.com/awslabs/data-on-eks/pull/395
  • @jaradtke-aws made their first contribution in https://github.com/awslabs/data-on-eks/pull/394
  • @arthi-j made their first contribution in https://github.com/awslabs/data-on-eks/pull/400
  • @5cp made their first contribution in https://github.com/awslabs/data-on-eks/pull/428
  • @harishvs made their first contribution in https://github.com/awslabs/data-on-eks/pull/430
  • @swapandeep made their first contribution in https://github.com/awslabs/data-on-eks/pull/407
  • @bluecrayon52 made their first contribution in https://github.com/awslabs/data-on-eks/pull/424
  • @willi-mueller made their first contribution in https://github.com/awslabs/data-on-eks/pull/473
  • @mithun008 made their first contribution in https://github.com/awslabs/data-on-eks/pull/485
  • @sguruvar made their first contribution in https://github.com/awslabs/data-on-eks/pull/447
  • @dacort made their first contribution in https://github.com/awslabs/data-on-eks/pull/514
  • @linesa-dot made their first contribution in https://github.com/awslabs/data-on-eks/pull/522
  • @charan-amzn made their first contribution in https://github.com/awslabs/data-on-eks/pull/538
  • @AbrahamArellano made their first contribution in https://github.com/awslabs/data-on-eks/pull/542
  • @guikcd made their first contribution in https://github.com/awslabs/data-on-eks/pull/546
  • @halilmr made their first contribution in https://github.com/awslabs/data-on-eks/pull/573
  • @omrishiv made their first contribution in https://github.com/awslabs/data-on-eks/pull/575
  • @jaimejorge made their first contribution in https://github.com/awslabs/data-on-eks/pull/577

Full Changelog: https://github.com/awslabs/data-on-eks/commits/v1.0.3

- HCL
Published by vara-bonthu almost 2 years ago

https://github.com/awslabs/data-on-eks - v1.0.2

What's Changed

  • remove deprecated format and increaes volume timeout to 60 seconds by @nabuskey in https://github.com/awslabs/data-on-eks/pull/119
  • EMR on EKS with Karpenter example with V5 EKS Blueprints by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/121
  • feat: EMR on EKS Fargate pattern with new approach by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/102
  • Update Adopters and Add policy of SSM to karpenter role by @srikaanthpenugonda in https://github.com/awslabs/data-on-eks/pull/123
  • Readme update by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/124
  • Data on EKS workshop module by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/125
  • Apache NiFi on EKS by @codesometech in https://github.com/awslabs/data-on-eks/pull/99
  • Cleanup scripts added by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/126
  • add workshop util by @lmouhib in https://github.com/awslabs/data-on-eks/pull/129
  • modifying job submission by changing to input variables rather than hardcoding by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/130
  • Workshop content update by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/133
  • fix for karpenter provisioner by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/134
  • Bump webpack from 5.74.0 to 5.76.1 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/135
  • adding ebs volume example by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/132
  • Updated all the addons to use v4.25.0 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/136
  • minor bug in compute provisioner script by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/137
  • Correct URL in README.md by @mfjackson in https://github.com/awslabs/data-on-eks/pull/141
  • Fsx for lustre added as module to Karpenter example by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/139
  • Removing link from Adopters page by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/142
  • added preserve field to true to avoid destroy issues by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/144
  • simplifying deployment experience by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/143
  • chore: Remove accidental commits by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/145
  • feat: Updates to the Ray blueprint by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/111
  • doc: Add Kubeflow on AWS page by @askulkarni2 in https://github.com/awslabs/data-on-eks/pull/147
  • Improve guide by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/148
  • EMR EKS Workshop module updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/146
  • RAID-0 config for NVMe based SSD EC2 instances with Karpenter Provisioners by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/156
  • Add CloudNativePG operator. by @jihed in https://github.com/awslabs/data-on-eks/pull/127
  • CloudNativePG by @jihed in https://github.com/awslabs/data-on-eks/pull/159
  • initialize terraform in install scripts by @nabuskey in https://github.com/awslabs/data-on-eks/pull/161
  • update secrets name by @jihed in https://github.com/awslabs/data-on-eks/pull/160
  • Fix documentation error in ray pytorch example by @elyall in https://github.com/awslabs/data-on-eks/pull/165
  • Spark operator refactor by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/170
  • fix pre-commit run by @jihed in https://github.com/awslabs/data-on-eks/pull/173
  • EMR EKS Blueprints leveraging the sub terraform modules by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/174
  • Updated broken links on Readme by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/177
  • Removed the cluster name variable by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/178
  • Bump node-fetch and docusaurus in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/168
  • Flink Operator on EKS by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/180
  • Security critical fixes for docusaurus by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/181
  • Bump xml2js and @aws-quickstart/eks-blueprints in /analytics/cdk/emr-eks by @dependabot in https://github.com/awslabs/data-on-eks/pull/183
  • add output for amp by @lmouhib in https://github.com/awslabs/data-on-eks/pull/184
  • delta lake example by @rajarshighosal in https://github.com/awslabs/data-on-eks/pull/182
  • updated website doc for delta lake example by @rajarshighosal in https://github.com/awslabs/data-on-eks/pull/188
  • Bump yaml from 2.1.3 to 2.2.2 in /analytics/cdk/emr-eks by @dependabot in https://github.com/awslabs/data-on-eks/pull/195
  • Dependabot security fix for GOT and TRIM packages by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/196
  • Monitoring ML Workflows using Kubeflow on Amazon EKS by @elamaran11 in https://github.com/awslabs/data-on-eks/pull/202
  • Fix region mismatch in XGBoost example by @raykrueger in https://github.com/awslabs/data-on-eks/pull/204
  • Spark Operator blueprint upgrade to EKS 1.26 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/205
  • Fix region mismatch in pytorch example by @raykrueger in https://github.com/awslabs/data-on-eks/pull/207
  • Fix ray example docs by @raykrueger in https://github.com/awslabs/data-on-eks/pull/208
  • EMR on EKS with Karpenter updated to Kubernetes 1.26 by @mihneaspirescu in https://github.com/awslabs/data-on-eks/pull/210
  • Fixed intallation scripts and removed default region from variables.tf by @lusoal in https://github.com/awslabs/data-on-eks/pull/211
  • fixed broken link in spark observability module by @lusoal in https://github.com/awslabs/data-on-eks/pull/214
  • remove acl using bucket policy by @hitsub2 in https://github.com/awslabs/data-on-eks/pull/218
  • Website restructure and Dynamic EBS volumes for karpenter userdata by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/221
  • Fixed links for EMR EKS Inro page by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/222
  • EMR NVIDIA Spark Rapids Blueprint added by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/224
  • Modify Python script and execution shell script to customize Docker i… by @tanmatth in https://github.com/awslabs/data-on-eks/pull/225
  • Feat/emr eks spark operator by @lmouhib in https://github.com/awslabs/data-on-eks/pull/220
  • DataHub on EKS by @bbgu1 in https://github.com/awslabs/data-on-eks/pull/213
  • Kafka on EKS - EKS Bluprints V5 Mitigation by @AlyIbrahim in https://github.com/awslabs/data-on-eks/pull/169
  • pre-commit updates and vpc module version uplifted by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/227
  • EMR spark rapids website and XGBoost example update by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/229
  • Bump aws-cdk-lib from 2.51.1 to 2.80.0 in /analytics/cdk/emr-eks by @dependabot in https://github.com/awslabs/data-on-eks/pull/226
  • Reduce the number of times we run apply by @raykrueger in https://github.com/awslabs/data-on-eks/pull/233
  • Upgrade Airflow to 2.5.3 and EKS to 1.26 by @jagpk in https://github.com/awslabs/data-on-eks/pull/230
  • Jupyterhub on EKS by @rajarshighosal in https://github.com/awslabs/data-on-eks/pull/228
  • Updated readme with correct links by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/234
  • feat: Refactor/update kafka v5 by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/231
  • feat: Docs update for Jupyterhub and Spark rapids by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/236
  • fix: Bump cdk and remove package-lock.json by @lmouhib in https://github.com/awslabs/data-on-eks/pull/238
  • Bump stylelint from 14.16.1 to 15.10.1 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/239
  • chore: Fix linting errors to pass CI checks by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/242
  • chore: Change Prometheus with for kube-prometheus-stack by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/241
  • chore: Update module versions to standardize and remove deprecation errors/warnings by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/243
  • Bump semver from 5.7.1 to 5.7.2 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/245
  • chore: Remove VPC CNI IRSA role; utilize permissions provided on EC2 node IAM role by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/244
  • chore: Change Prometheus to kube-prometheus-stack by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/246
  • chore: Update Spark operator example to use new bootstrap flag for instance store volume RAID0 configuration by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/237
  • chore: Update Karpenter provisioner codeblock for self-managed Airflow by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/247
  • fix: Update Spark install script to remove target apply on addons modules by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/250
  • chore: Replace local EMR on EKS module with virtual cluster sub-module from terraform-aws-emr by @bryantbiggs in https://github.com/awslabs/data-on-eks/pull/249
  • chore: Emr-eks-karpenter blueprint updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/252
  • feat: Trainium blueprint Part1 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/251
  • fix: Added a fix for Grafana to use sigv4 authentication by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/253
  • chore: README Update with logo by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/254
  • chore: Add remote AMP for Grafana by @ovaleanu in https://github.com/awslabs/data-on-eks/pull/256
  • Bump word-wrap from 1.2.3 to 1.2.4 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/258
  • chore: EMR Spark Rapids upgrade by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/259
  • feat: EMR on EKS with Karpenter Managed Endpoint by @youngjeong46 in https://github.com/awslabs/data-on-eks/pull/261
  • mwaa v5 migration by @bbgu1 in https://github.com/awslabs/data-on-eks/pull/248

New Contributors

  • @nabuskey made their first contribution in https://github.com/awslabs/data-on-eks/pull/119
  • @srikaanthpenugonda made their first contribution in https://github.com/awslabs/data-on-eks/pull/123
  • @codesometech made their first contribution in https://github.com/awslabs/data-on-eks/pull/99
  • @mfjackson made their first contribution in https://github.com/awslabs/data-on-eks/pull/141
  • @askulkarni2 made their first contribution in https://github.com/awslabs/data-on-eks/pull/145
  • @jihed made their first contribution in https://github.com/awslabs/data-on-eks/pull/127
  • @elyall made their first contribution in https://github.com/awslabs/data-on-eks/pull/165
  • @rajarshighosal made their first contribution in https://github.com/awslabs/data-on-eks/pull/182
  • @elamaran11 made their first contribution in https://github.com/awslabs/data-on-eks/pull/202
  • @raykrueger made their first contribution in https://github.com/awslabs/data-on-eks/pull/204
  • @mihneaspirescu made their first contribution in https://github.com/awslabs/data-on-eks/pull/210
  • @lusoal made their first contribution in https://github.com/awslabs/data-on-eks/pull/211
  • @hitsub2 made their first contribution in https://github.com/awslabs/data-on-eks/pull/218
  • @tanmatth made their first contribution in https://github.com/awslabs/data-on-eks/pull/225
  • @bbgu1 made their first contribution in https://github.com/awslabs/data-on-eks/pull/213
  • @jagpk made their first contribution in https://github.com/awslabs/data-on-eks/pull/230
  • @ovaleanu made their first contribution in https://github.com/awslabs/data-on-eks/pull/231
  • @bryantbiggs made their first contribution in https://github.com/awslabs/data-on-eks/pull/242
  • @youngjeong46 made their first contribution in https://github.com/awslabs/data-on-eks/pull/261

Full Changelog: https://github.com/awslabs/data-on-eks/compare/v1.0.1...v1.0.2

- HCL
Published by vara-bonthu almost 3 years ago

https://github.com/awslabs/data-on-eks - v1.0.1 Final release for Version1

NOTE: This is the final release for Data on EKS Version1 blueprints(Final Tag v1.0.1). We will be updating the DoEKS blueprints with major changes and it will be published under Version2 onwards

What's Changed

  • Bump loader-utils from 2.0.3 to 2.0.4 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/62
  • fix broken link after folder structure change by @season1946 in https://github.com/awslabs/data-on-eks/pull/63
  • Feat: Apache Kafka using Strimzi on EKS by @AlyIbrahim in https://github.com/awslabs/data-on-eks/pull/47
  • Fix link to Kafka docs. by @brianhammons in https://github.com/awslabs/data-on-eks/pull/64
  • Better positioning EMR on EKS by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/72
  • add cdk blueprint for emr-eks by @lmouhib in https://github.com/awslabs/data-on-eks/pull/45
  • Architecture diagram for home page by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/73
  • Update import for emr on eks blueprint by @lmouhib in https://github.com/awslabs/data-on-eks/pull/74
  • Add analytics reference architecture blog by @lmouhib in https://github.com/awslabs/data-on-eks/pull/75
  • Fix the aws cli command by @lmouhib in https://github.com/awslabs/data-on-eks/pull/78
  • VPC endpoints added;s3 state for e2e tests by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/77
  • Add storage considerations and managed alternatives sections to Kafka… by @brianhammons in https://github.com/awslabs/data-on-eks/pull/79
  • [feat] ACK EMR on EKS Controller pattern and example by @season1946 in https://github.com/awslabs/data-on-eks/pull/81
  • [enhancement] Change argo workflow example to create spark app in a new ns by @season1946 in https://github.com/awslabs/data-on-eks/pull/84
  • Feat: Observability on Spark on EKS by @season1946 in https://github.com/awslabs/data-on-eks/pull/85
  • EMR on EKS Doc improvement by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/83
  • EMR on EKS Karpenter with YuniKorn updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/87
  • fixing bug in CloudWatch Logs autocreate in helm bcoz terraform alrea… by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/88
  • Add Troubleshooting page by @dalbhanj in https://github.com/awslabs/data-on-eks/pull/90
  • [enhancement] update argo workflows based on blog comments by @season1946 in https://github.com/awslabs/data-on-eks/pull/89
  • Bump json5 from 2.2.1 to 2.2.3 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/91
  • Bump json5 from 2.2.1 to 2.2.3 in /analytics/cdk/emr-eks by @dependabot in https://github.com/awslabs/data-on-eks/pull/92
  • Bump ua-parser-js from 0.7.31 to 0.7.33 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/96
  • Bump http-cache-semantics from 4.1.0 to 4.1.1 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/100
  • Bump @sideway/formula from 3.0.0 to 3.0.1 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/103
  • Website update to Docu@2.3.1 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/106
  • Bump node-fetch and docusaurus in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/108
  • Data on EKS Logo added with footer icons by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/109
  • Removing the Robot font by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/110
  • Added EMR cluster Name to output.tf so instructions work by @rbarcia in https://github.com/awslabs/data-on-eks/pull/113
  • Spark Live UI added by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/114

New Contributors

  • @AlyIbrahim made their first contribution in https://github.com/awslabs/data-on-eks/pull/47
  • @brianhammons made their first contribution in https://github.com/awslabs/data-on-eks/pull/64
  • @dalbhanj made their first contribution in https://github.com/awslabs/data-on-eks/pull/72
  • @lmouhib made their first contribution in https://github.com/awslabs/data-on-eks/pull/45
  • @rbarcia made their first contribution in https://github.com/awslabs/data-on-eks/pull/113

Full Changelog: https://github.com/awslabs/data-on-eks/compare/v1.0.0...v1.0.1

- HCL
Published by vara-bonthu over 3 years ago

https://github.com/awslabs/data-on-eks - v0.1 DoEKS initial release

What's Changed

  • 🚀 Initial commit for DoEKS by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/1
  • removed package-lock.json file by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/2
  • Adding package-lock.json file by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/3
  • Fixing the git node package dependa alert by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/4
  • Fix to github pages deployment by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/5
  • Updated Test environment by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/6
  • removed deployment branch as main for website by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/7
  • changed publish dire to ./website by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/8
  • baseurl for the site changed by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/9
  • Searchbar added to website by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/32
  • Karpenter Graviton Provisioner support for EMR on EKS by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/37
  • Doc updates for Airflow and fixes to spark operator by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/38
  • Trigger EMR on EKS jobs with Apache Airflow by @season1946 in https://github.com/awslabs/data-on-eks/pull/39
  • Website updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/40
  • 🦄 Apache YuniKorn batch scheduler with EMR on EKS by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/42
  • Updates to github workflows by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/44
  • EMR on EKS Gang scheduling example by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/49
  • Added FluentBit config to write logs to S3 by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/50
  • MWAA doc fix by @season1946 in https://github.com/awslabs/data-on-eks/pull/48
  • Argo workflows on EKS example and doc by @season1946 in https://github.com/awslabs/data-on-eks/pull/43
  • KubeCost addon for EMR on EKS Karpenter by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/52
  • argo workflow enhancement by @season1946 in https://github.com/awslabs/data-on-eks/pull/53
  • fix: Fixed the karpenter example hard-coded the provisioner region by @hustshawn in https://github.com/awslabs/data-on-eks/pull/55
  • Bump loader-utils from 2.0.2 to 2.0.3 in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/57
  • Bump minimatch, recursive-readdir and serve-handler in /website by @dependabot in https://github.com/awslabs/data-on-eks/pull/58
  • Folder structure and major updates to docs by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/59
  • Github workflow security updates by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/60
  • daily tag gh flow added by @vara-bonthu in https://github.com/awslabs/data-on-eks/pull/61

New Contributors

  • @vara-bonthu made their first contribution in https://github.com/awslabs/data-on-eks/pull/1
  • @season1946 made their first contribution in https://github.com/awslabs/data-on-eks/pull/39
  • @hustshawn made their first contribution in https://github.com/awslabs/data-on-eks/pull/55
  • @dependabot made their first contribution in https://github.com/awslabs/data-on-eks/pull/57

Full Changelog: https://github.com/awslabs/data-on-eks/commits/v0.1

- HCL
Published by vara-bonthu over 3 years ago