Releases | Open Source Science

https://github.com/sematic-ai/sematic - v0.41.0

What's Changed

[improvement] Remove Enterprise Edition Licensing, restore Apache 2.0 for all code including features previously limited to EE.
[improvement] Add support for python 3.13, drop support for 3.8.

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.40.0...v0.41.0

Helm Chart Version

1.2.1

Compatibility

Sematic Servers of this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly!

- Python
Published by augray about 1 year ago

https://github.com/sematic-ai/sematic - v0.40.0

What's Changed

[feature] Allow custom labels and annotations for Ray integration
[bugfix] Fix an issue with tuple type casting checks

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.39.1...v0.40.0

Helm Chart Version

1.2.0

Compatibility

Sematic Servers of this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly!

- Python
Published by augray over 1 year ago

https://github.com/sematic-ai/sematic - 0.39.1

What's Changed

[bugfix] Fix DB migrations from clean installs after SQLAlchemy upgrade

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.39.0...v0.39.1

Helm Chart Version

1.1.23

Compatibility

Sematic Servers of this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly! Note that if your project depends on sqlalchemy in some way besides Sematic, you may need to take action to upgrade to this release.

Thanks for your first-time contribution, @bcalvert-graft !

- Python
Published by augray over 1 year ago

https://github.com/sematic-ai/sematic - v0.39.0

What's Changed

[improvement] BREAKING CHANGE: Upgrade SQLAlchemy to a >=2.0.0 version
[improvement] Add support for python 3.11 and 3.12

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.38.1...v0.39.0

Helm Chart Version

1.1.22

Compatibility

Sematic Servers of this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly! Note that if your project depends on sqlalchemy in some way besides Sematic, you may need to take action to upgrade to this release.

- Python
Published by augray over 1 year ago

https://github.com/sematic-ai/sematic - v0.38.1

What's Changed

[feature] Allow pipeline authors to specify approved Kubernetes annotations and labels

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.38.0...v0.38.1

Helm Chart Version

1.1.21

Compatibility

Sematic Servers of this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly!

- Python
Published by augray over 1 year ago

https://github.com/sematic-ai/sematic -

What's Changed

[improvement] Add more pod information before deleting kubernete jobs
[bugfix] Stop the CloudRunner from marking itself as canceled when its pod is evicted
[bugfix] Improve the CloudRunner's ability to take advantage of parallelism

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.37.0...v0.38.0

Helm Chart Version

1.1.20

Compatibility

Sematic Servers of this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly!

- Python
Published by augray almost 2 years ago

https://github.com/sematic-ai/sematic - 0.37.0

What's Changed

[improvement] Make log reading more responsive
[bugfix] Fix an issue when rendering subclasses of dataclasses in collections
[bugfix] Fix an issue with rendering of the completion date

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.36.0...v0.37.0

Helm Chart Version

1.1.19

Compatibility

Sematic Servers of this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly!

- Python
Published by augray almost 2 years ago

https://github.com/sematic-ai/sematic - 0.36.0

What's Changed

[feature] Allow custom Kubernetes resources to be specified for the CloudRunner.
[feature] Add APIs for blocking on a run and getting its output using the run id.
[improvement] Open a new tab when command/CTRL-clicking a row from the pipeline and run search results.
[improvement] Have the cleaner clean pipeline run metadata when the runner pod is gone.
[improvement] Provide more informative error message when doing comparisons with Futures.
[improvement] Ensure server pods restart following helm configmap changes.
[bugfix] Fail with more explicit error message when writes to external storage fail.
[bugfix] Add email domain fallback for Google OAuth.
[bugfix] Fix bug with timeouts that occur at the same moment for multiple runs.
[bugfix] Make Kuberay version parsing more robust for Ray integration.

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.35.0...v0.36.0

Helm Chart Version

1.1.18

Compatibility

Sematic Servers of this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly!

Thanks for your contribution, @kaushil24 !

- Python
Published by augray about 2 years ago

https://github.com/sematic-ai/sematic - 0.35.0

What's Changed

[feature] Add support for deploying to GKE on GCP
[feature] Make the new Dashboard the default version. This had been an opt-in Beta until now. You can still switch back to the old version from your user icon
[feature] Allow pulling images from private image registries that aren't automatically accessible on the basis of the Service Accounts
[improvement] Minor documentation, Dashboard, logging, and internal API validation improvements
[improvement] Minor improvement to Dashboard homepage layout for ergonomics
[improvement] Improve visibility of development documentation
[bugfix] BREAKING CHANGE: Avoid corner-case deployment error by always requiring a dedicated Socket.io microservice instance
[bugfix] Fix a bug where the CLI pipeline cancelation signal was sent to an incorrect Server address
[bugfix] Fix transitive dependency errors
[bugfix] Fix a serialization error for the Union type
[bugfix] Avoid logging an unhelpful stack trace for the CLI version command when the Server is unreachable
[bugfix] Fix incorrect Dashboard rendering of an info message for cached Runs
[bugfix] Propagate concept renaming to user-facing messages in the Dashboard

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.34.1...v0.35.0

Helm Chart Version

1.1.17

Compatibility

Sematic Servers of this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly!

- Python
Published by tscurtu over 2 years ago

https://github.com/sematic-ai/sematic - 0.34.1

What's Changed

[feature] Make bazel image generation macro configurable
[improvement] Various improvements to sematic version
[improvement] Speed up cleanup for certain pipeline cancellations/failures
[bugfix] Fix bug with displaying live logs in the new dashboard
[bugfix] Enable proper type-checking for list, set in python >=3.10
[bugfix] Remove possibility for "payload too large" with mnist example

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.34.0...v0.34.1

Compatibility

Sematic Servers on this version can support pip packages back to v0.30.0.

Corresponding Helm Chart Release

1.1.16

- Python
Published by augray over 2 years ago

https://github.com/sematic-ai/sematic - v0.34.0

What's Changed

[feature] New API to trigger a Pipeline rerun with Artifact ID overrides for the root run function's input parameters.
[improvement] Adjust header menu order to better align with user habits
[improvement] Restyle the state icons to make it more obvious
[improvement] Better error message for Ray cluster from non-standalone function
[improvement] Make runner reentrant

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.33.0...v0.34.0

Compatibility

Sematic Servers on this version can support pip packages back to v0.30.0.

Corresponding Helm Chart Release

1.1.15

- Python
Published by chance-sematic over 2 years ago

https://github.com/sematic-ai/sematic - v0.33.0

What's Changed

[feature] Enable the Grafana plugin in the new UI
[feature] Show user privacy in the new UI
[feature] Support expand/collapse all in the new UI artifact display
[feature] New landing page in the new UI
[feature] Add --no-cache option for Docker builds
[improvement] Display cloned state icon for cloned runs in the new UI
[improvement] Changes to backend data model in preparation for upcoming features
[improvement] Improve run cancellations for local runs
[improvement] Minor visual improvements to new DAG view UI
[improvement] Add Llama 2 to fine-tuning example
[bugfix] Make the recent DB upgrade script more robust
[bugfix] Allow changing back to old UI from unauthenicated local executions
[bugfix] Resolve an issue with node expand/collapses in new DAG view
[bugfix] Miscellaneous bug fixes in the new UI
[bugfix] Fix prompt display in fine-tuning example
[bugfix] Avoid collisions with public Docker repos for Docker builds

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.32.0...v0.33.0

Compatibility

Sematic Servers on this version can support pip packages back to v0.30.0.

Corresponding Helm Chart Release

1.1.14

New Contributors

None

- Python
Published by augray over 2 years ago

https://github.com/sematic-ai/sematic - v0.32.0

What's Changed

[feature] Publish a new version of the Dashboard UI, which is currently in "Beta". You can switch to the new version by clicking on the pop-up banner, and between the two versions through your profile window pop-up.
[improvement] Add constraints to the DB schema in order to improve validations. In case you get any errors during the upgrade, please contact us on Discord so that we can assist you.
[improvement] Added documentation for custom user metrics[^1]
[improvement] Improve error messaging for unschedulable pipeline runs
[improvement] When running the CLI via Bazel, use the current directory as the working directory
[improvement] Add Hugging Face model types, visualizations, and documentation
[example] Add an example pipeline which fine tunes LLMs that summarize a text
[deprecation] Ended backwards-compatibility support for Calculator, which had been renamed to Function in v0.30.0
[deprecation] Ended backwards-compatibility support for pre-v0.27.0 log message sourcing and for an API response serialization
[bugfix] Fix a bug where long running jobs' durations were not correctly rendered
[bugfix] Fix a regression where the URL generated in Slack updates was incorrect
[bugfix] Redact the DB URL from the migration logs
[bugfix] Fix a bug where the Native Docker Build System did not support image URIs in quotes
[bugfix] Add missing configuration to deployment documentation
[bugfix] Fix clipping of metrics graphs in the Dashboard when new data points are received

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.31.2...v0.32.0

Compatibility

Sematic Servers on this version can support pip packages back to v0.30.0.

Upgrade Instructions

Please see these instructions on how to ensure you can use the new version correctly!

Corresponding Helm Chart Release

1.1.13

New Contributors

@twitchax made their first contribution in https://github.com/sematic-ai/sematic/pull/944

Thank you @twitchax!

[^1]: This feature is for Sematic's "Enterprise Edition" only. Please reach out if you are interested in using Sematic EE.

- Python
Published by tscurtu over 2 years ago

https://github.com/sematic-ai/sematic - 0.31.2

What's changed

[improvement] Add ability to customize images for Ray workers
[improvement] Add image pull secrets and pull policy to migration pod

Full Changelog https://github.com/sematic-ai/sematic/compare/v0.31.1...v0.31.2

Compatibility

Sematic Servers on this version can support pip packages back to v0.30.0.

- Python
Published by snoshy over 2 years ago

https://github.com/sematic-ai/sematic - 0.31.1

What's changed

[improvement] Add index on edges for source/dest run ids

Full Changelog https://github.com/sematic-ai/sematic/compare/v0.31.0...v0.31.1

Compatibility

Sematic Servers on this version can support pip packages back to v0.30.0.

- Python
Published by snoshy over 2 years ago

https://github.com/sematic-ai/sematic - 0.31.0

What's changed

[feature] Enable remote execution using pure-Docker, without bazel
[feature] Support live-metrics during Sematic Function execution[^1]
[feature] Add visualization for Prompt/Response pairs
[example] Add Hacker News summarization example
[improvement] Expose all Kubernetes classes in the base sematic module
[improvement] Switch from a WSGI server & gevent to an ASGI server (uvicorn)
[bugfix] Ensure UI-reruns don't automatically "rerun from here" for the root run
[bugfix] Fix an issue that prevented rendering of matplotlib figures
[bugfix] Remove a password that could be shown in cleaner logs
[bugfix] Include missing information from a local storage error message

Full Changelog https://github.com/sematic-ai/sematic/compare/v0.30.0...v0.31.0

Thank you @kaushil24 for your contribution!

Compatibility

Sematic Servers on this version can support pip packages back to v0.30.0.

[^1]: This feature is for Sematic's "Enterprise Edition" only. Please reach out if you are interested in using Sematic EE.

- Python
Published by augray over 2 years ago

https://github.com/sematic-ai/sematic - 0.30.0

What's changed

[feature] Grafana dashboards tailored for Sematic installable via Helm
[feature] User metrics SDK
[feature] Add horizontal pod autoscaling and pod disruption budget support
[feature] Health endpoint to display DB health in dashboard
[feature] Add support for set types
[feature] Add GitHub commit check support
[improvement] Have resolver continue in in a new resolution if resolver restarts
[improvement] Log request IDs in server
[improvement] Early resolution failure is more robust
[improvement] Make API retries more robust
[improvement] Enable run search deep links
[deprecation] Calculator renamed to Function
[bugfix] Fixed a DAG view display issue
[bugfix] Fixed application logs being duplicated
[bugfix] Adjust the Name column width distribution
[bugfix] Add missing call to init to Function

Full Changelog https://github.com/sematic-ai/sematic/compare/v0.29.0...v0.30.0

Thank you @kaushil24 for your contribution!

Compatibility

Sematic Servers on this version can support pip packages back to v0.24.1.

Upgrade Instructions

Default Kubernetes deployments of the Sematic server will now run with 2 pods for the API server, in order to enable high availability. As such, the memory and CPU requests and limits for each pod has been halved.

- Python
Published by snoshy over 2 years ago

https://github.com/sematic-ai/sematic - 0.29.0

What's changed

[feature] Garbage collection CRON job
[feature] Enable customization of local storage path
[feature] Add Sematic Grafana dashboard as helm package
[feature] Add support for function timeout
[improvement] Enable backward logs scrolling
[improvement] Rename inline=False to standalone=True
[deprecation] Remove direct support for matplotlib figures, use Image instead
[bugfix] Constraint plotly version for MNIST example
[bugfix] Fix Kuberay autoscale

Full Changelog https://github.com/sematic-ai/sematic/compare/v0.28.1...v0.29.0

Compatibility

Sematic Servers on this version can support pip packages back to v0.24.1.

New contributors

Many thanks to @kaushil24 and @v-pwais.

- Python
Published by neutralino1 almost 3 years ago

https://github.com/sematic-ai/sematic - 0.28.1

What's Changed

[improvement] Allow selecting S3 paths in UI
[improvement] Backend logging improvements
[bugfix] Ensure gevent import doesn't monkeypatch standard lib late when importing Sematic
[bugfix] Resolve issue with S3 links in the UI for S3 "directories"
[bugfix] Eliminate one situation that could lead to duplicated logs in the UI
[bugfix] Fix a casting issue with floats

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.28.0...v0.28.1

Compatibility

Sematic Servers on this version can support pip packages back to v0.24.1.

- Python
Published by chance-an almost 3 years ago

https://github.com/sematic-ai/sematic - 0.28.0

What's Changed

[feature] Display metrics for pipelines (success rate, run count, runtime)
[feature] Added support for setting and memorizing a dev debug flag for the Dashboard
[deprecation] Deprecate Kubernetes 1.22 support
[improvement] Backend improvements to syncing with Kubernetes job states
[improvement] Several minor logging improvements and fixes
[bugfix] Enable local server to run with python 3.10
[bugfix] Ensured different users can rerun a pipeline
[bugfix] Ensured pipeline reruns use the submitting user's credentials
[bugfix] Ensure canceled/terminated runs have proper runtime display
[bugfix] Properly display duration for cloned runs
[bugfix] Fix matplotlib figure serialization, use Sematic Image type for support
[bugfix] Make storage object URL redirects consistent
[bugfix] Remove possible infinite reconnect loop when canceling local runs
[bugfix] Fixed a bug where the Resolver Socket.io client would not be cleanly closed
[bugfix] Fix corner case in the comparison of sqlite versions
[bugfix] Wrap long pipeline import paths in pipeline/run display

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.27.0...v0.28.0

Compatibility

Sematic Servers on this version can support pip packages back to v0.24.1.

- Python
Published by augray almost 3 years ago

https://github.com/sematic-ai/sematic - 0.27.0

What's Changed

[feature] Added new S3Location and S3Bucket types that render S3 links in the Dashboard, and documented them
[feature] Added a new Image type that render images in the Dashboard, and documented it
[example] Added TorchLightning + Resnet + Ray example
[example] Added Ray AIR example
[example] Added various enhancements to the example Testing Pipeline
[improvement] BREAKING CHANGE: image_layers field in sematic_pipeline bazel macro now ONLY gets passed to image layering, and not also to the Sematic binary target. if you are using image_layers to express dependencies of a pipeline, you will now need to duplicate them in the deps field.
[improvement] Added support for Python 3.10
[improvement] Added support for Python 3.10-style type hints
[improvement] The Dashboard login flow will now redirect to the requested page instead of to the homepage
[improvement] Displaying the user who started a Run in the Dashboard Run list page and in the Run history drop-down
[improvement] Various documentation updates and fixes
[improvement] Various log message improvements and enhancements
[improvement] Sped up Docker image generation through various improvements
[improvement] Automatically update npm dependencies when building the wheel
[improvement] Added deep-linking selected panel stickiness in the Dashboard
[improvement] Filtered only pipelines launched by the current user in the Dashboard homepage last run widget
[improvement] Documented Ray integration architecture
[improvement] Improved wheel building portability by defaulting to bash
[improvement] Improved reaction time of the CloudResolver after a very long-running cloud Run has ended
[improvement] Improved handling of incorrect cleanup of or errors in subprocess spawned by user code
[improvement] Various internal refactorings, cleanups, and build improvements
[improvement] Switched from MB and GB to GiB and MiB in the Ray configurations, for consistency and standardization reasons
[improvement] Added checks and documentation for the new libmagic dependency
[improvement] Resolution failures caused by Resolver errors now get marked as failed instead of canceled
[bugfix] Pinned MNIST example pipeline dependencies after a new dependency release broke the execution
[bugfix] Fixed a bug that prevented the browser back/forward buttons from working correctly in the Dashboard
[bugfix] Fixed a bug that sometimes prevented the Dashboard Run tree panel from updating
[bugfix] Fixed sorting of the Runs in the Dashboard Run tree panel by creation time
[bugfix] Fixed a race condition where Kubernetes job updates would be incorrectly handled, and added safeguards for incorrect Run state transitions
[bugfix] Fixed a bug where killing a subprocess spawned by user code would prematurely terminate the Run, or leave the Resolver in an inconsistent state
[bugfix] Fixed a race condition that would prevent a fresh deployment on Kubernetes due to missing resources
[bugfix] Fixed a bug in the Dashboard that prevented the log panel error messages from refreshing when seeking to a different Run
[bugfix] Fixed a bug where failure to notify the Dashboard or Resolver with Run updates via socketio messages would cause the Resolution to fail

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.26.0...v0.27.0

Compatibility

Sematic Servers on this version can support pip packages back to v0.24.1.

- Python
Published by tscurtu almost 3 years ago

https://github.com/sematic-ai/sematic - 0.26.0

What's Changed

[feature] Added optional anonymized user analytics to track Sematic usage
[improvement] Atomic database migrations with Helm hooks
[improvement] Move future pickle storage to new server-generated locations
[improvement] Refactor in-app links to use react router
[improvement] Minor UI test improvements with Cypress
[improvement] Minor documentation fixes for rerun-from-here
[bugfix] Fix noop SQL migrations

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.25.0...v0.26.0

Compatibility

Sematic servers on this version can support pip packages back to v0.24.1

- Python
Published by snoshy almost 3 years ago

https://github.com/sematic-ai/sematic - 0.25.0

What's Changed

[feature] New dashboard page showing a searchable list of runs
[feature] Enable links to runs using only the run id (pipeline path not required)
[improvement] Expose image layer caching configuration for bazel-built pipelines
[improvement] Make allocation timeouts for Ray clusters configurable
[improvement] Small changes to layout of pipeline display page
[improvement] Have Ray workers use same Kubernetes SA as Sematic workers
[improvement] Minor user docs improvements
[bugfix] Fix a bug that was preventing configuration of Slack via helm
[bugfix] Remove error occurring when a local settings file configures server-only settings
[bugfix] Be more resilient against non-standard failures during torch imports
[bugfix] More robust cleanup of Ray clusters on pipeline cancellation

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.24.1...v0.25.0

Compatibility

Sematic servers on this version can support pip packages back to v0.22.1

- Python
Published by augray about 3 years ago

https://github.com/sematic-ai/sematic - 0.24.1

What's Changed

[improvement] Show more detailed errors on failures of DB migrations
[bugfix] Reduce wheel size

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.24.0...v0.24.1

Compatibility

Sematic servers on this version can support pip packages back to v0.22.1

- Python
Published by augray about 3 years ago

https://github.com/sematic-ai/sematic - 0.24.0

What's Changed

[feature] Introduction of RayCluster[^1]
[feature] "Tee" cloud function logs so they appear in Sematic dashboard and the pod logs
[improvement] Visualize better which run was the true "root failure" when a resolution fails
[improvement] Improve an error message when using untyped dicts in type annotations
[improvement] Various improvements to Sematic internal test infrastructure
[bugfix] Remove a possible server crash for local servers running on Macs
[bugfix] Eliminate a bug that could leave runs hanging if multiple cancellation events were sent
[bugfix] Fix a bug that removed a useful default for image tag in the Helm chart
[bugfix] Rename an incorrectly named helm-chart value for Slack integration
[bugfix] Gracefully terminate runs when a resolver pod restarts mid-resolution

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.23.0...v0.24.0

Compatibility

Sematic servers on this version can support pip packages back to v0.22.1

[^1]: This feature is for Sematic's "Enterprise Edition" only. Please reach out if you are interested in using Sematic EE.

- Python
Published by augray about 3 years ago

https://github.com/sematic-ai/sematic - 0.23.0

What's Changed

[feature] Ability to deploy socket.io micro-service separately.
[feature] Expose external resources in the dashboard.
[feature] Slack notification integration for failed resolutions.
[feature] Support the debug query parameter which can be added to any URL to enforce the front-end application to emit logs.
[improvement] Minor dependency and CI improvement.
[improvement] Minor development documentation improvements.
[bugfix] Fix a bug in the dashboard which prevents successful resolution of status update.

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.22.2...v0.23.0

Compatibility

Sematic servers on this version can support pip packages back to version v0.21.1

- Python
Published by chance-an about 3 years ago

https://github.com/sematic-ai/sematic - 0.22.2

What's Changed

[feature] Add the ability to cache the output of a function and avoid its re-execution in the future
[feature] Add the ability to disable Sematic log ingestion for remote runs
[feature] Expose cloned run information in the dashboard
[improvement] Minor logging improvements
[improvement] Support configuring plugins from the CLI
[improvement] Add support for Bazel 6.0.0
[improvement] Add a link in output panel pointing to logs panel in case of error
[improvement] Improve robustness of data persistence
[improvement] Minor Helm documentation improvements
[improvement] Make the header sticky on the run details page
[improvement] Minor dashboard experience improvement
[improvement] Internal API endpoints expansion
[improvement] Support for non-deterministic cached builds in Bazel
[bugfix] Support override of settings even when no settings file exists
[bugfix] Minor cross version client support fixes
[bugfix] Make _getitem importable on graph cloning

Compatibility

Sematic servers on this version can support pip packages back to version v0.21.1

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.22.1...v0.22.2

- Python
Published by snoshy about 3 years ago

https://github.com/sematic-ai/sematic - 0.22.1

What's Changed

[feature] Hide some "utility" autogenerated runs in the UI (ex: _getitem)
[improvement] Added functionality to some server APIs
[bugfix] To the script to allow auto-upgrading settings files. IMPORTANT: Users should run sematic migrate upon install

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.22.0...v0.22.1

Migration

⚠️ Users should run this command after installation in order to migrate their settings files: bash $ sematic migrate

Compatibility

The new 0.22.1 Server supports communicating with Clients with version 0.21.1 or later, but it introduces new features which are only available for Clients versions 0.22.0 or later.

- Python
Published by tscurtu about 3 years ago

https://github.com/sematic-ai/sematic - 0.22.0

What's Changed

[feature] Expose in the dashboard when a run is cloned from another
[feature] Allow specifying multiple e-mail domains that can authenticate to Sematic
[feature] Deep linking for highlighting nested runs in the dashboard
[feature] Deep linking for tabs in the dashboard
[feature] Support clicking artifacts in the DAG view to get to their display page
[feature] Allow configuration for expanded shared memory on cloud workers
[feature] BREAKING CHANGE: Significant changes to our helm chart. Read our deployment docs for more information.
[improvement] Improvements to logging UI performance
[improvement] Give an error message if there are futures that are not used for a function's final output
[improvement] Avoid warning about SQLite version when SQLite is not in use
[improvement] User-facing documentation revamp
[bugfix] Add sematic.testing to python wheel
[bugfix] Fix a bug with deserializing Tuple objects
[bugfix] Propagate tags and properties to cloned runs
[bugfix] Improve the behavior of the logging UI in case of errors
[bugfix] Better display of Union types in the dashboard
[bugfix] Add a missing requirement for one of the example pipelines
[bugfix] Prevent the dashboard from spamming the backend with requests
[bugfix] Fix corrupted settings files from 0.21.1

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.21.1...v0.22.0

Compatibility

The new 0.22.0 Server supports communicating with Clients with version 0.21.1 or later, but it introduces new features which are only available for Clients with the new 0.22.0 version.

- Python
Published by tscurtu about 3 years ago

https://github.com/sematic-ai/sematic - 0.21.1

What's Changed

[bugfix] Add back feature allowing configuration of custom API URL to be used by workers

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.21.0...v0.21.1

- Python
Published by augray about 3 years ago

https://github.com/sematic-ai/sematic - 0.21.0

What's Changed

[feature] Add CLI for reading/following logs for a run
[feature] Enable configuration for the Kubernetes service account the workers will use
[feature] Enable getting the id of the current run and root run from inside a Sematic func
[feature] Add custom display for Enum objects
[improvement] Settings file split between user settings settings.yaml and server settings server.yaml
[improvement] Make the run links in notes more obvious
[improvement] Fail early if attempting to retry an execution older than the server supports.
[bugfix] Fix a bug deserializing Union values. Note that once you are using this release, if you try to "rerun from here" using a pipeline that has Union values in it that were produced prior to this version of Sematic, the rerun will likely fail with a serialization issue.
[bugfix] BREAKING CHANGE: The examples' README files have been renamed to README.md in order for them to correctly render as MarkDown files. This change is required by the Bazel example_pipeline target as well
[bugfix] Missing broadcasts upon server-side run save
[bugfix] Cache version check
[bugfix] Fix a bug with loading logs with in-progress runs when you have reached the end
[bugfix] Fix a bug with displaying matplotlib figures in cloud deployments
a variety of "behind-the-scenes" changes & refactors

New Contributors

@KatkaG made their first contribution in https://github.com/sematic-ai/sematic/pull/324

Thank you @KatkaG for your contribution!

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.20.1...v0.21.0

- Python
Published by augray about 3 years ago

https://github.com/sematic-ai/sematic - 0.20.1

What's Changed

[bugfix] Add support for subclasses of ABCMeta

New Contributors

@materight made their first contribution in https://github.com/sematic-ai/sematic/pull/220

Thank you @materight for your contribution!

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.20.0...v0.20.1

- Python
Published by tscurtu about 3 years ago

https://github.com/sematic-ai/sematic - 0.20.0

What's Changed

[feature] Add datetime class and basic visualization
[feature] Support for switching between environment profiles
[feature] Add dynamic-shape testing pipeline
[improvement] Replace deprecated sklearn dependency with scikit-learn
[improvement] Support abstract base classes in type annotations
[improvement] Support automatic conversion of tuple-of-futures to future-tuple
[improvement] Change log-ingestion to use deltas rather than full files
[bugfix] Fix various DB migration script issues and add old sqlite3 version warning
[bugfix] Workaround for DB migration when Python installation comes with old sqlite3 version
[bugfix] Various minor build, execution, and code validation improvements and fixes
[bugfix] Add missing server permission to Helm chart
[bugfix] Fix various corner-case bugs which prevented re-running Resolutions
[bugfix] Fix launching example pipeline which require cli args
[bugfix] Fix rendering multi-line docstrings in the UI
[bugfix] Make server not start if the DB migration fails

New Contributors

@erikcek made their first contribution in https://github.com/sematic-ai/sematic/pull/220
@snoshy made their first contribution in https://github.com/sematic-ai/sematic/pull/321
@kamalesh0406 made their first contribution in https://github.com/sematic-ai/sematic/pull/322
@chance-an made their first contribution in https://github.com/sematic-ai/sematic/pull/325

Thank you @erikcek and @kamalesh0406 for your contributions! Welcome @snoshy and @chance-an!

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.19.2...v0.20.0

- Python
Published by tscurtu over 3 years ago

https://github.com/sematic-ai/sematic - 0.19.2

What's Changed

Various minor housekeeping improvements
Fix a bug in a DB migration script

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.19.1...v0.19.2

- Python
Published by tscurtu over 3 years ago

https://github.com/sematic-ai/sematic - 0.19.1

What's Changed

Various minor documentation improvements
Fix various bugs which prevented restarting resolutions from the UI

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.19.0...v0.19.1

- Python
Published by tscurtu over 3 years ago

https://github.com/sematic-ai/sematic - 0.19.0

What's Changed

Expose Kubernetes infra failures in the Run panel
Enable restarting resolutions from the command line from a particular run, using different code
Enable restarting resolutions from the UI from a particular run
Support for easier testing of Sematic pipelines
Fix max parallelism for detached mode

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.18.1...v0.19.0

- Python
Published by tscurtu over 3 years ago

https://github.com/sematic-ai/sematic - 0.18.1

What's Changed

Remove SQLAlchemy model dependencies from Python migrations
Enable usage of multiple base images in detached mode

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.18.0...v0.18.1

- Python
Published by tscurtu over 3 years ago

https://github.com/sematic-ai/sematic - 0.18.0

What's Changed

Add ability to limit the number of parallel runs within a pipeline
Support for multiple bazel base container images
Ensure at one list element is displayed and increase max number displayed
Make sure retry works when parent exception class is specified

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.17.2...v0.18.0

- Python
Published by augray over 3 years ago

https://github.com/sematic-ai/sematic - 0.17.2

What's Changed

Correct fix GitInfo for custom Bazel workspaces

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.17.1...v0.17.2

- Python
Published by tscurtu over 3 years ago

https://github.com/sematic-ai/sematic - 0.17.1

What's Changed

* Add Sematic version cli command
* Fix cancel button upon completion 
* Bump minimum client version to 0.17.0
* Fix GitInfo for custom Bazel workspaces

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.17.0...v0.17.1

- Python
Published by tscurtu over 3 years ago

https://github.com/sematic-ai/sematic - 0.17.0

What's Changed

Function Retry on failure
Expose pipeline git commit info in the UI
Cancel resolution support

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.16.0...v0.17.0

- Python
Published by tscurtu over 3 years ago

https://github.com/sematic-ai/sematic - 0.16.0

What's Changed

Support enums in Sematic function annotations
Allow specifying Kubernetes tolerations for cloud jobs
Redesign log view UI Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.15.1...v0.16.0

- Python
Published by augray over 3 years ago

https://github.com/sematic-ai/sematic - 0.15.1

What's Changed

Ensure log ingestion happens when using bazel cloud jobs and dev=False
Avoid spamming the server with requests for logs for incomplete runs without logs

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.15.0...v0.15.1

- Python
Published by augray over 3 years ago

https://github.com/sematic-ai/sematic - 0.15.0

What's Changed

Display logs for cloud jobs in the UI. Note: This feature will require your server to have the ability to list objects in the S3 bucket you're using for Sematic storage.
Ensure the push of docker images by bazel works with docker credential helpers Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.14.0...v0.15.0

- Python
Published by augray over 3 years ago

https://github.com/sematic-ai/sematic - 0.14.0

What's Changed

In prior versions, anyone who needed to submit a pipeline execution had to get set up to access the Kubernetes cluster where the jobs would run. As of this release, users only need to get set up to access a Sematic server, and the server will handle all communication with Kubernetes. This improves user experience as well as security. It does mean that anyone running cloud execution may need to change their deployment so that the server can access Kubernetes. We've updated the deployment docs with instructions and created a Helm chart to ease deployment. As a summary of this release:

BREAKING CHANGE: For cloud execution, users submitting pipelines for execution no longer need Kubernetes access. Users who have deployed the Sematic server using docker will need to either (a) switch to deploying the server on Kubernetes or (b) use their Sematic deployment only for metadata tracking instead of metadata tracking + cloud execution.
Remove job environment variables from resolution API response
Lower the probability of evictions of resolution jobs and improve handling of that situation Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.13.0...v0.14.0

- Python
Published by augray over 3 years ago

https://github.com/sematic-ai/sematic - 0.13.0

What's Changed

Bugfix for dicitonary visualization
When running in cloud mode, have the server log to stdout
Enable mounting Kubernetes secrets into the containers for sematic funcs Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.12.0...v0.13.0

- Python
Published by augray over 3 years ago

https://github.com/sematic-ai/sematic - 0.12.0

What's Changed

BREAKING CHANGE: Allow specifying resource requirements for Kubernetes jobs. KubernetesResourceRequirements has a new required field, requests
Add has_container_image() API for better control over launch workflows
Fix a bug with direct run urls Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.11.0...v0.12.0

- Python
Published by augray over 3 years ago

https://github.com/sematic-ai/sematic - 0.11.0

What's Changed

Add a get_artifact_value API to retreive artifacts by ID
Add ability to link to individual runs on the UI, not just pipelines
Add option to serve local server from 0.0.0.0
Add capability to use different API URLs for local vs remote client usage
Enable environment variable to change Sematic config directory
Add exceptions and other improved app logs to the server log files
Solve a bug with displaying empty lists in the UI Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.10.0...v0.11.0

- Python
Published by augray over 3 years ago

https://github.com/sematic-ai/sematic - 0.10.0

What's Changed

Added support for python 3.8
Friendly error message for unsupported Python version
Friendly error message when clients don't match server version Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.9.0...v0.10.0

- Python
Published by augray over 3 years ago

https://github.com/sematic-ai/sematic - 0.9.0

What's Changed

Baseline Grafana integration for log panels by @neutralino1 in https://github.com/sematic-ai/sematic/pull/72

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.8.0...v0.9.0

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.8.0

What's Changed

Persist stack traces and display in UI by @neutralino1 in https://github.com/sematic-ai/sematic/pull/71

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.7.0...v0.8.0

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.7.0

What's Changed

M1 Mac support for Bazel build by @neutralino1 in https://github.com/sematic-ai/sematic/pull/68
Initial setup of titanic survival prediction example by @nvinayvarma189 in https://github.com/sematic-ai/sematic/pull/55
Fix linting of titanic example by @neutralino1 in https://github.com/sematic-ai/sematic/pull/69
Authentication by @neutralino1 in https://github.com/sematic-ai/sematic/pull/70

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.6.0...v0.7.0

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.6.0

What's Changed

Cloud execution – basic Kubernetes integration by @neutralino1 in https://github.com/sematic-ai/sematic/pull/66
Documentation for Cloud execution by @neutralino1 in https://github.com/sematic-ai/sematic/pull/67

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.5.1...v0.6.0

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.5.1

What's Changed

Fixes Timestamp JSON serialization by defaulting to str by @neutralino1 in https://github.com/sematic-ai/sematic/pull/64

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.5.0...v0.5.1

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.4.0

What's Changed

Docker image to deploy server in cloud instance by @neutralino1 in https://github.com/sematic-ai/sematic/pull/59
Rename credentials to settings and remove app layer by @neutralino1 in https://github.com/sematic-ai/sematic/pull/60
Save graph via the API instead of directly to the DB by @neutralino1 in https://github.com/sematic-ai/sematic/pull/61

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.3.1...v0.4.0

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.3.1

What's Changed

Adding feature flags for demo features by @neutralino1 in https://github.com/sematic-ai/sematic/pull/57
Setting up feature flags to hide un-implemented features by @neutralino1 in https://github.com/sematic-ai/sematic/pull/58

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.3.0...v0.3.1

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.3.0

What's Changed

SnowflakeTable type and $ sematic credentials set by @neutralino1 in https://github.com/sematic-ai/sematic/pull/49
Tuple support, SDK + UI by @neutralino1 in https://github.com/sematic-ai/sematic/pull/51
Support for dictionaries: SDK + UI by @neutralino1 in https://github.com/sematic-ai/sematic/pull/53
fix public roadmap link in docs by @jaichopra in https://github.com/sematic-ai/sematic/pull/54
update: docs by @nvinayvarma189 in https://github.com/sematic-ai/sematic/pull/50
Update README.md by @jaichopra in https://github.com/sematic-ai/sematic/pull/52

New Contributors

@nvinayvarma189 made their first contribution in https://github.com/sematic-ai/sematic/pull/50

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.2.0...v0.3.0

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.2.0

What's Changed

Notes scroll fix and snackbar by @neutralino1 in https://github.com/sematic-ai/sematic/pull/45
SilentResolver to enable no-tracking testing by @neutralino1 in https://github.com/sematic-ai/sematic/pull/46
Display links to docs in exception message on unsupported Future operations by @neutralino1 in https://github.com/sematic-ai/sematic/pull/48
Fix null bug in glid data grid display for dataframes by @neutralino1 in https://github.com/sematic-ai/sematic/pull/44

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.1.2-alpha...v0.2.0

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.1.2-alpha

Bugfix in example execution

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.1.1-alpha

What's Changed

Support for returning lists of futures by @neutralino1 in https://github.com/sematic-ai/sematic/pull/41
A dummy dynamic graph example by @neutralino1 in https://github.com/sematic-ai/sematic/pull/42
Many UI fixes
$ sematic new fixes

Full Changelog: https://github.com/sematic-ai/sematic/compare/v0.1.0-alpha...v0.1.1-alpha

- Python
Published by neutralino1 over 3 years ago

https://github.com/sematic-ai/sematic - 0.1.0-alpha

What's Changed

Create a run in the DB when a future is scheduled by @neutralino1 in https://github.com/sematic-ai/sematic/pull/1
Adding missing tests and docstrings by @neutralino1 in https://github.com/sematic-ai/sematic/pull/6
Basic documentation infrastructure by @neutralino1 in https://github.com/sematic-ai/sematic/pull/7
Refactor type system around builtins and typing by @neutralino1 in https://github.com/sematic-ai/sematic/pull/8
Persist run state machine in the DB by @neutralino1 in https://github.com/sematic-ai/sematic/pull/9
Basic add example by @neutralino1 in https://github.com/sematic-ai/sematic/pull/10
Basic API server and GET /runs endpoint by @neutralino1 in https://github.com/sematic-ai/sematic/pull/11
Basic UI shell + paginated runs list by @neutralino1 in https://github.com/sematic-ai/sematic/pull/12
Support for group_by and filters in /api/v1/runs by @neutralino1 in https://github.com/sematic-ai/sematic/pull/13
Baseline dashboard view by @neutralino1 in https://github.com/sematic-ai/sematic/pull/14
Handling calculator failures in the state machine by @neutralino1 in https://github.com/sematic-ai/sematic/pull/15
Persist input and output artifacts by @neutralino1 in https://github.com/sematic-ai/sematic/pull/16
Simpler serialization: default to JSON, binary is exception by @neutralino1 in https://github.com/sematic-ai/sematic/pull/17
Add run docstrings and pipeline view draft by @neutralino1 in https://github.com/sematic-ai/sematic/pull/18
Mira theme by @neutralino1 in https://github.com/sematic-ai/sematic/pull/19
Migrate from RunArtifact to Edge by @neutralino1 in https://github.com/sematic-ai/sematic/pull/20
MNIST PyTorch example by @neutralino1 in https://github.com/sematic-ai/sematic/pull/21
Single graph endpoint and cleaner socket endpoint by @neutralino1 in https://github.com/sematic-ai/sematic/pull/22
Switch to PostgreSQL for local DB and test DB by @neutralino1 in https://github.com/sematic-ai/sematic/pull/23
Gunicorn, more robust handling of child processes by @neutralino1 in https://github.com/sematic-ai/sematic/pull/24
Migrate on start by @neutralino1 in https://github.com/sematic-ai/sematic/pull/25
Enable run examples in the CLI by @neutralino1 in https://github.com/sematic-ai/sematic/pull/26
Fix pipeline state refresh in UI by @neutralino1 in https://github.com/sematic-ai/sematic/pull/27
[bugfix] Make sure that migration files are always returned in a sorted order by @neutralino1 in https://github.com/sematic-ai/sematic/pull/28
[bugfix] Make sure API payloads contain UTC timestamps by @neutralino1 in https://github.com/sematic-ai/sematic/pull/29
Company handbook docs by @jaichopra in https://github.com/sematic-ai/sematic/pull/32
DataFrame support, matplotlib support, liver disease example by @neutralino1 in https://github.com/sematic-ai/sematic/pull/30
New Slack Layout by @neutralino1 in https://github.com/sematic-ai/sematic/pull/33
Minor UI fixes by @neutralino1 in https://github.com/sematic-ai/sematic/pull/34
$ sematic new <project_name> [--from <example>] by @neutralino1 in https://github.com/sematic-ai/sematic/pull/35
Confusion matrix in PyTorch example and UI fixes by @neutralino1 in https://github.com/sematic-ai/sematic/pull/36
sematic_example Bazel macro by @neutralino1 in https://github.com/sematic-ai/sematic/pull/37
Notes backend by @neutralino1 in https://github.com/sematic-ai/sematic/pull/38
Notes front-end by @neutralino1 in https://github.com/sematic-ai/sematic/pull/39
Landing page by @neutralino1 in https://github.com/sematic-ai/sematic/pull/40

New Contributors

@neutralino1 made their first contribution in https://github.com/sematic-ai/sematic/pull/1
@jaichopra made their first contribution in https://github.com/sematic-ai/sematic/pull/32

Full Changelog: https://github.com/sematic-ai/sematic/commits/v0.1.0-alpha

- Python
Published by neutralino1 over 3 years ago

Recent Releases of https://github.com/sematic-ai/sematic

https://github.com/sematic-ai/sematic - v0.41.0

What's Changed

Helm Chart Version

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic - v0.40.0

What's Changed

Helm Chart Version

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic - 0.39.1

What's Changed

Helm Chart Version

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic - v0.39.0

What's Changed

Helm Chart Version

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic - v0.38.1

What's Changed

Helm Chart Version

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic -

What's Changed

Helm Chart Version

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic - 0.37.0

What's Changed

Helm Chart Version

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic - 0.36.0

What's Changed

Helm Chart Version

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic - 0.35.0

What's Changed

Helm Chart Version

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic - 0.34.1

What's Changed

Compatibility

Corresponding Helm Chart Release

https://github.com/sematic-ai/sematic - v0.34.0

What's Changed

Compatibility

Corresponding Helm Chart Release

https://github.com/sematic-ai/sematic - v0.33.0

What's Changed

Compatibility

Corresponding Helm Chart Release

New Contributors

https://github.com/sematic-ai/sematic - v0.32.0

What's Changed

Compatibility

Upgrade Instructions

Corresponding Helm Chart Release

New Contributors

https://github.com/sematic-ai/sematic - 0.31.2

What's changed

Compatibility

https://github.com/sematic-ai/sematic - 0.31.1

What's changed

Compatibility

https://github.com/sematic-ai/sematic - 0.31.0

What's changed

Compatibility

https://github.com/sematic-ai/sematic - 0.30.0

What's changed

Compatibility

Upgrade Instructions

https://github.com/sematic-ai/sematic - 0.29.0

What's changed