Recent Releases of dtaas

dtaas - DTaaS v0.7.0

🚀 New Features

Summary

Feature complete digital twin automation component
Distributed and scalable execution of digital twins
Secure installation of platform services
New git integration into the library microservice
Quick check on the website configuration
Complete migration of installation setup to docker compose
Better developer onboarding

In Detail

The Digital Twin as a Service (DTaaS) has three major components. The first is Common Services which includes third-party open source software that fulfill communication, storage and dashboard requirements. The second is Private Desktop Environment / User Workspace which provides lightweight desktop environment for users to develop their digital twins (DTs). The third component is DT Automation that provides automated Compose, Configuration and Execution for DTs on top of Gitlab DevOps infrastructure.

DTaaS components

The DT automation features got a new boost with implementation of Compose interface that helps with browsing through available DT components and creating DTs from them. The features related to reconfiguration and execution of DTs have been refactored into for better stability. The execution logs of DT execution had control characters in the previous release. This release fixes them to have cleaner logs. We are working on improving the code quality of the automation features further and hence, these features have been kept in the preview mode for now. These DT automation features are available via links on the Workbench page.

This release adds help and docker compose files for easy installation of integrated Gitlab and its runners. With this integration, the execution of DTs is no longer limited to the server on which the DTaaS is installed and is truly scalable now. It is even possible to integrate your containerized DTs having many microservices.

Previously, we have used Javascript files to install the platform services - InfluxDB, MongoDB, Grafana, RabbitMQ and MQTT services. They are replaced by a single docker compose file for installing all the platform services. The dedicated MQTT service has been substituted by the MQTT plugin of the RabbitMQ server thereby enhancing the security footprint and management hassle of an extra docker container. More importantly, all the security services have a default TLS mode enabled so that you can just add your TLS certificates to make the services secure. In addition, two new python scripts have been added to aid with user account creation in InfluxDB and RabbitMQ brokers.

The documentation has been updated to reflect the new features. In addition, the video recordings on DTaaS specifically targeted at non-technical and technical users, developers and administrators have been updated as well.

A new configuration validation feature has been developed for the client web interface. The administrators and users can now check for potential configuration issues with the react client website. There are also library package upgrades to reduce the security vulnerabilities in the client, library microservice and runner packages.

The library microservice has previously served files from local directory of the DTaaS installation server. Now there is a new git mode which enables cloning of Gitlab repositories into user workspaces. The long-term goal is to have seamless integration of the user workspace and DT automation components of the DTaaS software. The git mode of the library microservice adds the necessary features to reduce the gap.

There have been conscious effort to reduce the onboarding threshold for new developers. The new dev container environments can be used to perform all the software development in the DTaaS project. The Github workflows and developer's docker compose files have been improved to fix problems with the react script compilation issues. The defunct codeclimate code quality integration has been replaced with qlty and sonarcube.

All in all, this release overtakes the previous release in terms of the additional features and better security.

What's Changed

Add Create tab into Digital Twins page preview by @VanessaScherma in https://github.com/INTO-CPS-Association/DTaaS/pull/1005
Increments version of client package by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1060
Fixes the stalling container by @atomicgamedeveloper in https://github.com/INTO-CPS-Association/DTaaS/pull/1063
Libms git mode by @nichlaes in https://github.com/INTO-CPS-Association/DTaaS/pull/1047
Fix Libms readme and include dependabot upgrades by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1092
Add Library page preview by @VanessaScherma in https://github.com/INTO-CPS-Association/DTaaS/pull/1081
1093 bug wrong docker files for library microservice by @nichlaes in https://github.com/INTO-CPS-Association/DTaaS/pull/1102
Dependency upgrades for libms and runner by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1112
Updates to PR-1082 by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1115
Improves installation scripts by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1157
Preview code migration of constants by @atomicgamedeveloper in https://github.com/INTO-CPS-Association/DTaaS/pull/1161
Fix codecov config by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1185
Validates client config reopen by @atomicgamedeveloper in https://github.com/INTO-CPS-Association/DTaaS/pull/1181
Fix client website publish step by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1186
Improve services using docker compose by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1209
feature: Optimized devContainer develop- and build times by @Microchesst in https://github.com/INTO-CPS-Association/DTaaS/pull/1202
Minor improvements over PR 1163 by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1220
Adds qlty config by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1254

New Contributors

@Microchesst made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/1202

Full Changelog: https://github.com/INTO-CPS-Association/DTaaS/compare/v0.6.0...v0.7

- TypeScript
Published by prasadtalasila 9 months ago

dtaas - DTaaS v0.6.0

🚀 New Features

Tighter integration of Gitlab with the DTaaS
An experimental integration of Gitlab DevOps with ability to perform automated execution of digital twins.
Both HTTP and HTTPS installation possibilities
Update to runner package for limiting the execution to permitted commands (as specified in the configuration)
New recorded videos showcasing the capabilities of DTaaS for general, and technical users. There is also a dedicated video on showcasing the examples.
Updates to documentation as per the new release files
Library microservice previously had problems working on Windows. That bug is fixed.
Improved code quality by refactoring and better testing. The end-to-end tests on client website are now functional
Updates to all the third-party library package used in the software

🪡 What's Changed

Update Account tabs and add group list by @atomicgamedeveloper in https://github.com/INTO-CPS-Association/DTaaS/pull/838
Logging out of Gitlab and clearing session storage by @atomicgamedeveloper in https://github.com/INTO-CPS-Association/DTaaS/pull/793
Improves installation and docs by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/855
Adds integration tests to client website by @atomicgamedeveloper in https://github.com/INTO-CPS-Association/DTaaS/pull/863
Adds gitlab API into client codebase by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/894
676 libms commander error on windows by @nichlaes in https://github.com/INTO-CPS-Association/DTaaS/pull/888
Developer documentation updates by @hkirk in https://github.com/INTO-CPS-Association/DTaaS/pull/908
Playwright e2e reconfiguration by @atomicgamedeveloper in https://github.com/INTO-CPS-Association/DTaaS/pull/871
Updates documentation by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/927
only publish docker image if version is not yet published by @nichlaes in https://github.com/INTO-CPS-Association/DTaaS/pull/926
Add 'Execute' tab to Digital Twins page preview by @VanessaScherma in https://github.com/INTO-CPS-Association/DTaaS/pull/903
887 upgrade dependencies of libms by @nichlaes in https://github.com/INTO-CPS-Association/DTaaS/pull/943
Adds integrated gitlab to DTaaS installation by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/961
Adds issue and pull request templates by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/967
Publish docker images to DockerHub by @aryanpingle in https://github.com/INTO-CPS-Association/DTaaS/pull/958
Fix and Refactor Github Workflows by @aryanpingle in https://github.com/INTO-CPS-Association/DTaaS/pull/970
Add 'Manage' tab to Digital Twins page preview by @VanessaScherma in https://github.com/INTO-CPS-Association/DTaaS/pull/957
Fixes #986: Converts repository owner name to lowercase by @aryanpingle in https://github.com/INTO-CPS-Association/DTaaS/pull/987
952 include configuration for git mode in libms by @nichlaes in https://github.com/INTO-CPS-Association/DTaaS/pull/965
Runner limit permitted commands by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1016
Update runner dependencies by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1017
Improves Docker Installation Files (on top of #988) by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1019
Github Action publish to npm for libms by @nichlaes in https://github.com/INTO-CPS-Association/DTaaS/pull/1024
893 upgrade client dependencies reopened by @atomicgamedeveloper in https://github.com/INTO-CPS-Association/DTaaS/pull/1028
Updates Pr 1037 by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1039
Fix runner version and upgrade runner dependencies by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1042
Fix 983 documentation by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/1057

New Contributors

@atomicgamedeveloper made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/838
@hkirk made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/908
@aryanpingle made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/958

Full Changelog: https://github.com/INTO-CPS-Association/DTaaS/compare/v0.5.0...v0.6.0-pre-release

- TypeScript
Published by prasadtalasila over 1 year ago

dtaas - DTaaS v0.5.0

What's Changed

Updates example docs by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/600
Upgrade runner dependencies by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/601
Add powershell scripts and new example by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/634
Cleans up the code in Account react component (updates PR #632) by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/657
Improves docker compose files by @astitva1905 in https://github.com/INTO-CPS-Association/DTaaS/pull/660
Fix github actions and upgrade dependencies by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/677
Fix github actions by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/678
Upgrade eslint plugin jest of libms microservice by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/679
Runner config with execution by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/614
Runner deps fix by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/698
DTaaS CLI: Base structure and User add/Delete for Compose by @astitva1905 in https://github.com/INTO-CPS-Association/DTaaS/pull/578
Implements CLI options for runner and adds devContainer config by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/732
Git and help icon buttons by @VanessaScherma in https://github.com/INTO-CPS-Association/DTaaS/pull/731
Refactor docker installation and docs by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/764
Fixes github actions and minor docs issues by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/780
Removes the redundant ssl codebase by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/781
Fixes the mistake in config of libms in docker compose files by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/784
Fix Dockerfiles and npm package READMEs by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/802
Adds new documentation by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/803

New Contributors

@VanessaScherma made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/731

Full Changelog: https://github.com/INTO-CPS-Association/DTaaS/compare/v0.4.0...v0.5.0

- TypeScript
Published by prasadtalasila over 1 year ago

dtaas - DTaaS v0.4.0

The documentation for this release is available online.

Improvements in this release:

For users:

Available for localhost installation. You can experience the DTaaS software right on your computer without the need for a web server.
The pre-installed packages in user workspaces have been reduced. The net result is improved execution speed of programs in user workspaces.
The landing page for different library assets has been same in the previous releases. The latest release customizes the library page to show only the relevant assets.
This release comes with three new examples. They are:
- The industrial PLCs use OPC UA protocol extensively. Water treatment plant with OPC-UA example showcases the use of OPC-UA protocol for a digital twin running inside DTaaS.
- The composition of DT assets is a powerful idea leading to building more complex twins. The three water tank example showcases the use of Maestro co-simulation tool to build new tools and use them in new digital twins. This example uses DTManager framework also demonstrates the possibility of using third-party DT frameworks inside DTaaS.
- The flex cell example also uses DTManager to create a digital twin of two collaborative robots. The example demonstrates use of configuration, save and analyze lifecycle phases.

For Administrators:

Simplified trial and production installation. The installation time is significantly reduced.
The library microservices is now available as a dedicated npm package. You can install and use the same as a standalone software package. You can run multiple instances of library microservice on a single server. (NOTE: The gitlab mode of library microservice has become non-functional due to changes in the API of the upstream Gitlab. The problem has not been fixed as of this release date. Hence, the gitlab mode of library microservice has been removed in this release.)
Updates the third-party software dependencies used in the DTaaS software. These updates have removed twenty high and medium risk security vulnerabilities identified by the code analyzers.
The virtual machine installation using vagrant has been improved to include recent software updates.
Adds MongoDB as a new platform service.

For Developers:

Adds pre-commit framework to improve git hooks.
Makes the yarn commands cross-platform so that developers can work on Windows and Linux Operating Systems .
Publishes library microservice directly from the github actions

Ongoing Development

The ongoing development activities present an opportunity for collaboration in research and software development spheres. The currently active areas of work are:

Secure digital twin platforms
A dedicated microservice named digital twin runner (DT Runner) for providing API interface to digital twins. This software component has the potential to turn a DT into a dedicated set of services.
Development of run-time monitoring enabled digital twins in DTaaS.
Integrate execution of digital twins on the DevOps infrastructure of Gitlab.
Fully functional-installation of DTaaS in docker and kubernetes environments.

Contributors

This release has been made possible by contributions from: Astitva Sehgal, Caroline Lei, Cesar Vela, Emre Temel, Huiqi Zhou, Mads Kelberg, Linda Nguyen, Nichlaes Sørensen, Nicklas Pedersen, Oliver Geneser, Ramon Bendinger, Santiago Gil Arboleda and Yohan Unver.

Legal Stuff

The DTaaS software is released under The INTO-CPS Association License. There are multiple third-party software integrated into the DTaaS. The list of third-party software and their licenses are available online.

- TypeScript
Published by prasadtalasila almost 2 years ago

dtaas - DTaaS v0.3.0

Features

Single Sign On

This release of DTaaS supports third-party OAuth single sign on for the frontend React website. The default installation setup suggests a standalone Gitlab instance to provide OAuth. However, any OAuth provider supporting PKCE authentication flow can be integrated into the React website to provide the necessary user authentication.

Library microservice

Some improvements in this release are:

Commandline Interface (CLI): The library microservice has an intuitive CLI with an option to specify the configuration file. It is possible to save the configuration file in a private location and provide the file location at run-time to the microservice.
The code is more thoroughly tested in this release.
Updates all the libraries to latest versions in order to avoid any potential security vulnerabilities

The new release is API compliant with the previous release.

Documentation

The documentation has been expanded based on the feedback from the existing users, developers and external collaborators. The updated documentation is available online for this release. The new release comes with three well-documented digital twin examples.

Examples

There is now documentation for examples. There is also a script to download examples into your user workspace. All these examples are self-contained and require neither external nor internal services to work.

Installation

Some significant improvements are:

Updates the docker containers to latest releases of dependencies. The versions of Traefik, and platform services have been brought inline with the latest releases.
Adds MQTT broker as new platform service.
Simplifies installation of the DTaaS platform services, namely RabbitMQ and MQTT brokers, Grafana and InfluxDB services. Adds a single installation script to install all the platform services.
Updates to the installation documentation for admins. Adds graphical illustrations to admin documentation setup to provide better insights into the installation setup.

Complete DTaaS Software

Similar to previous release, a single step install script is part of this release. This script installs DTaaS software with default credentials and users on a Ubuntu server OS. You can use it to check a test installation of DTaaS.

sh wget https://raw.githubusercontent.com/INTO-CPS-Association/DTaaS/release-v0.3/deploy/single-script-install.sh bash single-script-install.sh

Select Components

The DTaaS software architecture, design and implementation follows microservices pattern. It is possible to install and use react client and library microservice separately.

Software Development

Major highlights are:

Adds code to publish the library microservice as an npm package.
Improve the software quality and document the development process.
Add documentation on the development process followed in the prohject to help the new developers participate in the software development.

What's Changed

Fix linting and test coverage errors in lib microservice by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/89
Improves code quality configuration by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/92
Feature/distributed demo - Updating documentation and scripts by @astitva1905 in https://github.com/INTO-CPS-Association/DTaaS/pull/101
Updates github actions and documentation by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/102
Resolve Documentation issues by @astitva1905 in https://github.com/INTO-CPS-Association/DTaaS/pull/103
Updates to library microservice HTTP documentation by @lindot11 and @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/115
Updates documentation (Improves #114) by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/117
Fix broken links by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/120
Updates npm packages of lib microservice by @OliverGeneser in https://github.com/INTO-CPS-Association/DTaaS/pull/112
Set Documentation style (mdlrc), Resolve Issues by @astitva1905 in https://github.com/INTO-CPS-Association/DTaaS/pull/122
Updates dependabot configuration by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/139
Updates install scripts by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/150
Refactor shell scripts to reduce duplication by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/170
Fix services script by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/173
Updates to admin and example documentation by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/190
Package library microservice by @lindot11 and @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/195
Update npm dependencies for runner by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/211
Update examples documentation by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/212
Updates docs by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/215
Update services installation by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/240

New Contributors

@astitva1905 made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/101
@OliverGeneser made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/112
@lindot11 and @MadsKelberg made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/195

Contributors

@astitva1905 @OliverGeneser @lindot11 @MadsKelberg @Omarley7 @SyntaxXeror @DaloonOfDoom @ravvnen @KarstenMalle @Artin13 @prasadtalasila

- TypeScript
Published by prasadtalasila over 2 years ago

dtaas - DTaaS v0.2.0

Features

Multiuser support

The second release of DTaaS supports multiple users. Now all the users are presented with a landing page asking for their username. The client website is configured based on the username. All the tools at the disposal of users are presented in a new Workbench page.

Library microservice

This release also brings a new microservice for serving reusable assets from file system. The files can either be on local computer or exist on a remote gitlab instance. The microservice can provide listing of files or allow the users to download a file. The microservice API is GraphQL compliant.

Documentation

The much desired documentation is available online for this release. The documentation is mostly directed towards users but there is some information for the DTaaS software administrators as well.

Installation

There is also a simpler installation setup vis-a-vis v0.1.0-alpha release.

It is now possible to install DTaaS in either a Linux machine or on vagrant virtual machines. A single step install script is part of this release. This script installs DTaaS software with default credentials and users on a Ubuntu server OS. You can use it to check a test installation of DTaaS.

sh wget https://github.com/INTO-CPS-Association/DTaaS/releases/download/v0.2.0/single-script-install.sh bash single-script-install.sh

Software Development

The developers have put in a lot of effort to improve the software quality and test coverage. There is now redux-based state management in the client website. This should enable client-side persistence and all the goodies it brings to the users.

What's Changed

Creation of Lib service by @ravvnen in https://github.com/INTO-CPS-Association/DTaaS/pull/9
Code climate issues - Client side by @Omarley7 in https://github.com/INTO-CPS-Association/DTaaS/pull/27
First part of merge, private routes by @Artin13 in https://github.com/INTO-CPS-Association/DTaaS/pull/40
WebApp update - Code quality by @Omarley7 in https://github.com/INTO-CPS-Association/DTaaS/pull/37
Removed all unused routes (#50) by @Omarley7 in https://github.com/INTO-CPS-Association/DTaaS/pull/44
Added links to workbench by @SyntaxXeror in https://github.com/INTO-CPS-Association/DTaaS/pull/46
User specific iframe routes in Library and DT… by @Omarley7 in https://github.com/INTO-CPS-Association/DTaaS/pull/51
Server integrable LIB MS by @ravvnen in https://github.com/INTO-CPS-Association/DTaaS/pull/54
Sign page reduced + rearranged docs by @Omarley7 in https://github.com/INTO-CPS-Association/DTaaS/pull/57
fix testing by @ravvnen in https://github.com/INTO-CPS-Association/DTaaS/pull/62
Adds more documentation and updates github workflow for docs by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/81
Completes the documentation by @prasadtalasila in https://github.com/INTO-CPS-Association/DTaaS/pull/82

Contributors

@Omarley7 @SyntaxXeror @DaloonOfDoom @ravvnen @KarstenMalle @Artin13 @prasadtalasila

- TypeScript
Published by prasadtalasila over 2 years ago

dtaas - DTaaS - Digital Twin as a Service

This first release of the software helps with the replication of DTaaS on their machines. You need to have VirtualBox and Vagrant installed on Ubuntu 20.04 to continue with the setup.

The DTaaS-vagrant.zip helps you with creation of vagrant virtual machine.

It is our intent to release reusable components from this codebase. To support that goal, we are also releasing a configurable web client (DTaaS-client.zip) for the software.

All the feedback is welcome. We appreciate the efforts of current collaborators and welcome new contributors.

New Contributors

@apetriceanu made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/1
@prasadtalasila made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/4
@Omarley7 made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/7
@SyntaxXeror made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/20
@ravvnen made their first contribution in https://github.com/INTO-CPS-Association/DTaaS/pull/9

Full Changelog: https://github.com/INTO-CPS-Association/DTaaS/commits/v0.1.0-alpha

- TypeScript
Published by prasadtalasila almost 3 years ago