Releases | Open Source Science

What's Changed

Changes 🛠

fix: align registered Runtime & appended Worker timeout by @kemingy in https://github.com/mosecorg/mosec/pull/653 ### Exciting New Features 🎉
feat: adopt uv for venv and package management by @kemingy in https://github.com/mosecorg/mosec/pull/635 ### More Documentation 📚
docs: add pixi by @kemingy in https://github.com/mosecorg/mosec/pull/643 ### Minor changes 🧹
chore: bump dep version by @kemingy in https://github.com/mosecorg/mosec/pull/634
chore: push to ghcr, fix typos by @kemingy in https://github.com/mosecorg/mosec/pull/636
chore: fix the modelz link in readme by @kemingy in https://github.com/mosecorg/mosec/pull/641
chore: bump zstd to avoid the yanked version by @kemingy in https://github.com/mosecorg/mosec/pull/642
chore: group the dependabot prs by @kemingy in https://github.com/mosecorg/mosec/pull/645
chore: allow zlib license by @kemingy in https://github.com/mosecorg/mosec/pull/649
chore: add code owner by @kemingy in https://github.com/mosecorg/mosec/pull/650

Full Changelog: https://github.com/mosecorg/mosec/compare/0.9.3...0.9.5

- Python
Published by kemingy 9 months ago

mosec - 0.9.3

[!note] Set as pre-release because I forgot to update the version in the Cargo.toml. :cry: Also, this only contains a CI fix to the previous release, should check the previous changelog.

What's Changed

Changes 🛠

fix: maturin release action with latest stable toolchain by @kemingy in https://github.com/mosecorg/mosec/pull/631

Full Changelog: https://github.com/mosecorg/mosec/compare/0.9.2...0.9.3

- Python
Published by kemingy about 1 year ago

What's Changed

Changes 🛠

fix: dockerfile mosec bin path & cargo-deny trigger by @kemingy in https://github.com/mosecorg/mosec/pull/621
Fix bibtex by @lkevinzc in https://github.com/mosecorg/mosec/pull/625 ### Exciting New Features 🎉
feat: find out the installed mosec path by @kemingy in https://github.com/mosecorg/mosec/pull/624
feat: change to rust edition 2024 by @kemingy in https://github.com/mosecorg/mosec/pull/630 ### Minor changes 🧹
chore: fix github pages by @kemingy in https://github.com/mosecorg/mosec/pull/618
chore: add cargo deny to lint cargo dependencies by @kemingy in https://github.com/mosecorg/mosec/pull/619
chore: fix cargo deny by @kemingy in https://github.com/mosecorg/mosec/pull/620
chore: fix discord badge by @kemingy in https://github.com/mosecorg/mosec/pull/622
chore: add ubuntu arm to ci test by @kemingy in https://github.com/mosecorg/mosec/pull/623

Full Changelog: https://github.com/mosecorg/mosec/compare/0.9.1...0.9.2

- Python
Published by kemingy about 1 year ago

What's Changed

Exciting New Features 🎉

feat: deprecate py3.8 by @kemingy in https://github.com/mosecorg/mosec/pull/602
feat: switch to OIDC PyPI release by @kemingy in https://github.com/mosecorg/mosec/pull/613
feat: bump axum to 0.8, enable 3.13 test by @kemingy in https://github.com/mosecorg/mosec/pull/615
feat: adopt maturin by @kemingy in https://github.com/mosecorg/mosec/pull/616 ### More Documentation 📚
docs: add sitemap and robots by @kemingy in https://github.com/mosecorg/mosec/pull/603
docs: add openapi keyword to readme by @kemingy in https://github.com/mosecorg/mosec/pull/611 ### Minor changes 🧹
chore: add MSRV by @kemingy in https://github.com/mosecorg/mosec/pull/612
chore: fix release ci yml by @kemingy in https://github.com/mosecorg/mosec/pull/617

Full Changelog: https://github.com/mosecorg/mosec/compare/0.9.0...0.9.1

- Python
Published by kemingy about 1 year ago

What's Changed

Exciting New Features 🎉

feat: support gzip & zstd compression by @kemingy in https://github.com/mosecorg/mosec/pull/599

Full Changelog: https://github.com/mosecorg/mosec/compare/0.8.9...0.9.0

- Python
Published by kemingy over 1 year ago

What's Changed

Exciting New Features 🎉

feat: decrease the guard check interval, bump version by @kemingy in https://github.com/mosecorg/mosec/pull/596 ### More Documentation 📚
docs: update embedding.md by @eltociear in https://github.com/mosecorg/mosec/pull/574 ### Minor changes 🧹
chore: upgrade lychee action and accept 403 forbidden by @kemingy in https://github.com/mosecorg/mosec/pull/580
chore: fix the dynamic extra dependencies by @kemingy in https://github.com/mosecorg/mosec/pull/591 ### Others 🔔
[Docs] Add sourceeditlink to point to the correct path by @sravan1946 in https://github.com/mosecorg/mosec/pull/578
Update README.md by @lkevinzc in https://github.com/mosecorg/mosec/pull/593

New Contributors

@eltociear made their first contribution in https://github.com/mosecorg/mosec/pull/574
@sravan1946 made their first contribution in https://github.com/mosecorg/mosec/pull/578

Full Changelog: https://github.com/mosecorg/mosec/compare/0.8.8...0.8.9

- Python
Published by kemingy over 1 year ago

What's Changed

Changes 🛠

fix: replace pkg_resources with importlib by @kemingy in https://github.com/mosecorg/mosec/pull/563 ### Exciting New Features 🎉
feat: add http/2 support by @kemingy in https://github.com/mosecorg/mosec/pull/568

Full Changelog: https://github.com/mosecorg/mosec/compare/0.8.7...0.8.8

- Python
Published by kemingy over 1 year ago

What's Changed

Refactoring 🧬

refactor: HTTPStautsCode -> HTTPStatusCode by @monologg in https://github.com/mosecorg/mosec/pull/552 ### Minor changes 🧹
chore: freeze numpy < 2 by @kemingy in https://github.com/mosecorg/mosec/pull/543
chore: bump version for derive_more by @kemingy in https://github.com/mosecorg/mosec/pull/561
chore: replace once_cell with std OnceLock by @kemingy in https://github.com/mosecorg/mosec/pull/562

New Contributors

@monologg made their first contribution in https://github.com/mosecorg/mosec/pull/552

Full Changelog: https://github.com/mosecorg/mosec/compare/0.8.6...0.8.7

- Python
Published by kemingy over 1 year ago

What's Changed

Changes 🛠

Fix rerank server error by @miaojinc in https://github.com/mosecorg/mosec/pull/537
fix: annotations lazy evaluation by @kemingy in https://github.com/mosecorg/mosec/pull/538 ### Minor changes 🧹
chore: rm ci cache by @kemingy in https://github.com/mosecorg/mosec/pull/539

New Contributors

@miaojinc made their first contribution in https://github.com/mosecorg/mosec/pull/537

Full Changelog: https://github.com/mosecorg/mosec/compare/0.8.5...0.8.6

- Python
Published by kemingy over 1 year ago

What's Changed

Changes 🛠

fix: upgrade to hyper 1 by @kemingy in https://github.com/mosecorg/mosec/pull/478 ### Minor changes 🧹
chore: upload artifacts to os specific dir and merge downloads by @kemingy in https://github.com/mosecorg/mosec/pull/489

Full Changelog: https://github.com/mosecorg/mosec/compare/0.8.2...0.8.3

- Python
Published by kemingy about 2 years ago

What's Changed

Exciting New Features 🎉

feat: use utc time for log by @kemingy in https://github.com/mosecorg/mosec/pull/471 ### More Documentation 📚
docs: organize the examples folder by @kemingy in https://github.com/mosecorg/mosec/pull/456
docs: add emb example by @kemingy in https://github.com/mosecorg/mosec/pull/457 ### Minor changes 🧹
chore: fix the docker image tags by @kemingy in https://github.com/mosecorg/mosec/pull/454

Full Changelog: https://github.com/mosecorg/mosec/compare/0.8.1...0.8.2

- Python
Published by kemingy about 2 years ago

What's Changed

Exciting New Features 🎉

feat: add endpoint label to the code metrics by @kemingy in https://github.com/mosecorg/mosec/pull/437
feat: add py 3.12 test and release by @kemingy in https://github.com/mosecorg/mosec/pull/447 ### More Documentation 📚
docs: add build from source code guide by @kemingy in https://github.com/mosecorg/mosec/pull/431 ### Minor changes 🧹
chore: fix CI docker release tag by @kemingy in https://github.com/mosecorg/mosec/pull/428
chore: bump utoipa version, update dep license file by @kemingy in https://github.com/mosecorg/mosec/pull/453

Full Changelog: https://github.com/mosecorg/mosec/compare/0.8.0...0.8.1

- Python
Published by kemingy over 2 years ago

What's Changed

Exciting New Features 🎉

feat: support swagger-ui for the openapi by @n063h in https://github.com/mosecorg/mosec/pull/407
feat: support multi-route with shared workers by @kemingy in https://github.com/mosecorg/mosec/pull/423 ### More Documentation 📚
docs: update readme about pid 1 and dynamic batching by @kemingy in https://github.com/mosecorg/mosec/pull/400
docs: fix readthedocs build config by @kemingy in https://github.com/mosecorg/mosec/pull/401
docs: add performance tuning guide by @kemingy in https://github.com/mosecorg/mosec/pull/409
docs: add concepts, faq, migration guide by @kemingy in https://github.com/mosecorg/mosec/pull/411 ### Minor changes 🧹
chore: add readthedoc support by @kemingy in https://github.com/mosecorg/mosec/pull/396
chore: add gpu docker image in release by @kemingy in https://github.com/mosecorg/mosec/pull/398
chore: align the naming, fix the test lint by @kemingy in https://github.com/mosecorg/mosec/pull/399
chore: add the codeql lint config by @kemingy in https://github.com/mosecorg/mosec/pull/406
chore: fix the sphinx ci by @kemingy in https://github.com/mosecorg/mosec/pull/412
chore: use collapsible readme by @lkevinzc in https://github.com/mosecorg/mosec/pull/413
chore: add conda-forge badge to the readme by @kemingy in https://github.com/mosecorg/mosec/pull/425
chore: increase the timeout for stable diffusion example by @kemingy in https://github.com/mosecorg/mosec/pull/427

Full Changelog: https://github.com/mosecorg/mosec/compare/0.7.2...0.8.0

- Python
Published by kemingy over 2 years ago

What's Changed

Exciting New Features 🎉

feat: provide openapi doc by @n063h in https://github.com/mosecorg/mosec/pull/370
feat: support server sent event by @kemingy in https://github.com/mosecorg/mosec/pull/333
feat: support --log-level CLI argument by @kemingy in https://github.com/mosecorg/mosec/pull/394 ### Refactoring 🧬
refactor: sse abstraction in worker and coordinator by @kemingy in https://github.com/mosecorg/mosec/pull/391 ### Minor changes 🧹
chore: add sleep to service test to catch the check bug by @kemingy in https://github.com/mosecorg/mosec/pull/380

Full Changelog: https://github.com/mosecorg/mosec/compare/0.7.1...0.7.2

- Python
Published by kemingy over 2 years ago

What's Changed

Changes 🛠

fix: check child process exit code by @kemingy in https://github.com/mosecorg/mosec/pull/379

Full Changelog: https://github.com/mosecorg/mosec/compare/0.7.0...0.7.1

- Python
Published by kemingy over 2 years ago

What's Changed

Changes 🛠

fix: use try to import msgspec by @lkevinzc in https://github.com/mosecorg/mosec/pull/368
fix: plasma mixin should use super serde with shm storage by @kemingy in https://github.com/mosecorg/mosec/pull/369
fix: args should only be checked when server is used by @kemingy in https://github.com/mosecorg/mosec/pull/371 ### Exciting New Features 🎉
feat: add content type to the inference response header by @kemingy in https://github.com/mosecorg/mosec/pull/360
feat: support redis shm mixin by @n063h in https://github.com/mosecorg/mosec/pull/367
feat: support dynamic inference route by @cutecutecat in https://github.com/mosecorg/mosec/pull/374 ### More Documentation 📚
docs: mark ipc wrapper as deprecated by @kemingy in https://github.com/mosecorg/mosec/pull/378 ### Minor changes 🧹
chore: better logo for night mode by @lkevinzc in https://github.com/mosecorg/mosec/pull/365

New Contributors

@cutecutecat made their first contribution in https://github.com/mosecorg/mosec/pull/374

Full Changelog: https://github.com/mosecorg/mosec/compare/0.6.7...0.7.0

- Python
Published by kemingy over 2 years ago

What's Changed

Exciting New Features 🎉

feat: change plasma plugin to mixin by @kemingy in https://github.com/mosecorg/mosec/pull/350
feat: support request validation according to annotation by @kemingy in https://github.com/mosecorg/mosec/pull/352 ### More Documentation 📚
docs: fix plasma related doc, add deprecate warning by @kemingy in https://github.com/mosecorg/mosec/pull/354
docs: combine the metrics related page by @kemingy in https://github.com/mosecorg/mosec/pull/358 ### Minor changes 🧹
chore: only enable nightly test for Linux by @kemingy in https://github.com/mosecorg/mosec/pull/346
chore: Add tencent cloud by @gaocegege in https://github.com/mosecorg/mosec/pull/356

Full Changelog: https://github.com/mosecorg/mosec/compare/0.6.6...0.6.7

- Python
Published by kemingy almost 3 years ago

What's Changed

Changes 🛠

fix: avoid timeout test failing and orphan service in CI by @kemingy in https://github.com/mosecorg/mosec/pull/323 ### Exciting New Features 🎉
feat: change parking lot mutex to std mutex by @kemingy in https://github.com/mosecorg/mosec/pull/315
feat: add prefix to differentiate Mosec & user logs by @n063h in https://github.com/mosecorg/mosec/pull/318
feat: use axum instead of pure hyper by @kemingy in https://github.com/mosecorg/mosec/pull/322
feat: Set timeout for worker.forward by @n063h in https://github.com/mosecorg/mosec/pull/321

New Contributors

@n063h made their first contribution in https://github.com/mosecorg/mosec/pull/318

Full Changelog: https://github.com/mosecorg/mosec/compare/0.6.4...0.6.5

- Python
Published by kemingy almost 3 years ago

What's Changed

Changes 🛠

fix: hold one lock at a time to avoid the deadlock in nested function by @kemingy in https://github.com/mosecorg/mosec/pull/316 ### Minor changes 🧹
chore: skip the lint&test step in release by @kemingy in https://github.com/mosecorg/mosec/pull/312
chore: add nightly bad req test by @kemingy in https://github.com/mosecorg/mosec/pull/313
chore: use absolute import path by @lkevinzc in https://github.com/mosecorg/mosec/pull/314

Full Changelog: https://github.com/mosecorg/mosec/compare/0.6.3...0.6.4

- Python
Published by kemingy almost 3 years ago

What's Changed

Changes 🛠

fix: resolve deadlock when lots of client requests closed before response by @kemingy in https://github.com/mosecorg/mosec/pull/311

Full Changelog: https://github.com/mosecorg/mosec/compare/0.6.2...0.6.3

- Python
Published by kemingy almost 3 years ago

mosec - v0.6.2

If you find this software useful for your research, please consider citing

@software{yang2021mosec, title = {{MOSEC: Model Serving made Efficient in the Cloud}}, author = {Yang, Keming and Liu, Zichen and Cheng, Philip}, url = {https://github.com/mosecorg/mosec}, year = {2021} }

What's Changed

Changes 🛠

fix: align warmup example format in dry run by @kemingy in https://github.com/mosecorg/mosec/pull/308
fix: wait all the worker init done in dry run by @kemingy in https://github.com/mosecorg/mosec/pull/310 ### Others 🔔
update citation by @lkevinzc in https://github.com/mosecorg/mosec/pull/309

Full Changelog: https://github.com/mosecorg/mosec/compare/0.6.1...0.6.2

- Python
Published by kemingy almost 3 years ago

mosec - v0.6.1

What's Changed

Exciting New Features 🎉

feat: add metric for dynamic batching duration by @kemingy in https://github.com/mosecorg/mosec/pull/304
feat: add numbin as an IPC mixin by @kemingy in https://github.com/mosecorg/mosec/pull/305
feat: add py.typed file by @kemingy in https://github.com/mosecorg/mosec/pull/306

Full Changelog: https://github.com/mosecorg/mosec/compare/0.6.0...0.6.1

- Python
Published by kemingy almost 3 years ago

mosec - v0.6.0

What's Changed

Exciting New Features 🎉

feat: Add adopters by @gaocegege in https://github.com/mosecorg/mosec/pull/292
feat: enable configuring wait time for different stages by @kemingy in https://github.com/mosecorg/mosec/pull/295
feat: support dry run the service by @kemingy in https://github.com/mosecorg/mosec/pull/299
feat: support set up the arguments through environment variables by @kemingy in https://github.com/mosecorg/mosec/pull/301 ### More Documentation 📚
docs: refine readme and example codes by @lkevinzc in https://github.com/mosecorg/mosec/pull/287
docs: change to sphinx docs by @kemingy in https://github.com/mosecorg/mosec/pull/288
docs: fix links and rearrange readme by @lkevinzc in https://github.com/mosecorg/mosec/pull/290
docs: add CI links checker by @kemingy in https://github.com/mosecorg/mosec/pull/293
docs: minor fix on README.md by @lkevinzc in https://github.com/mosecorg/mosec/pull/294
docs: add favicon by @kemingy in https://github.com/mosecorg/mosec/pull/302

New Contributors

@gaocegege made their first contribution in https://github.com/mosecorg/mosec/pull/292

Full Changelog: https://github.com/mosecorg/mosec/compare/0.5.1...0.6.0

- Python
Published by kemingy almost 3 years ago

mosec - v0.5.1