Releases | Open Source Science

ck - CMX v4.1.4: bug fixes

Fixes for MLPerf inference v5.0

- Python
Published by gfursin about 1 year ago

CMX V4.1.3

fixed a bug with "cmx -log" (#1410)
fixed a bug with "cmx -repro" (#1409)

CMX V4.1.2

fixed error reporting in cm/cmx info artifact if artifact not found
added "cmx get repo" or "cmx get repo {repo alias}" or "cm get repo" (#1405)
added support for PAT in "cmx pull repo {url}" (#1381)

CMX V4.1.1

fixed legacy interfaces

- Python
Published by gfursin over 1 year ago

ck - CM/CMX V4.1.0: fixed legacy interfaces

CMX V4.1.0

fixed legacy interfaces
added -v flag to print version
improved help

- Python
Published by gfursin over 1 year ago

From February 2025, CMX V4.0.2 serves as drop-in, backward-compatible replacement for the earlier Collective Mind framework (CM) and other MLCommons automation prototypes, while providing a simpler and more robust interface.

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.5.3: bug fixes

fixed bug with cm info repo and cmx info repo: https://github.com/mlcommons/ck/issues/1378

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.5.2: regular improvements based on user feedback

added -i flag to print memory and disk use before running CM/CMX commands: https://github.com/mlcommons/ck/issues/1375
added utils.getdiskuse
added utils.getmemoryuse
formatted Python modules from the internal repository using autopep8

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.5.1

added Collective Mind architecture diagram: https://github.com/mlcommons/ck/tree/master/docs/specs/cm-diagram-v3.5.1.png
added tabulate as requirement based on user feedback
updated white paper: https://arxiv.org/abs/2406.16791
merged Anandu's docs update
added links to archived repositories to keep development history (ck, cm-mlops, etc)

- Python
Published by ctuning-admin over 1 year ago

ck - Collective Mind (CM/CMX) v3.4.4: regular enhancements based on user feedback

improved error reporting in utils.loadjson and utils.loadyaml
added utils.substitute_template
enhanced 'cm pull repo' based on user feedback

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.4.3:

V3.4.3

fixed pyproject.toml
fixed docs generation
improved cm pull repo with branch and SHA (#1355)

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.4.2: added new reusable functions

Added several reusable functions from MLPerf automations: - added utils.flattendict - added utils.safeint - added utils.safefloat - added utils.getset - added utils.digits

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.4.1: added pyproject.toml to install CM and deprecated setup.py

V3.4.1

added pyproject.toml to install CM and deprecated setup.py
reduced Python min version in pyproject.toml to 3.7 for backwards compatibility

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.3.4: several improvements

added utils.path2: add quotes if spaces in path
added utils.updatedictwithflatkey: update dictionary via flat key (x.y.z)
added utils.getvaluefromdictwithflatkey get value from dict via flat key (x.y.z)
added utils.load_module universal python module loader

- Python
Published by gfursin over 1 year ago

ck - V3.3.3: improving logging

moved "CMX stack error" to -log
improved CMX error reporting
fixed CM logger issue

- Python
Published by gfursin over 1 year ago

ck - V3.3.1

allow "cm/cmx pull repo {URL}" along with "cm/cmx pull repo --url={URL}"
CMX: added "automationfullpath" to -log

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.2.9: fixed minor bugs

fixed minor bug with JSON console output
fixed minor bug with console in cmind.x function

- Python
Published by gfursin over 1 year ago

ck -

fixed Docker test for mlperf-inference with cm4mlops
made minor improvement in error handling and messages
Fixed type of "unknown_keys" to list to be serializable: https://github.com/mlcommons/ck/issues/1335
Added support to print warning instead of error (useful for help)

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.2.5: various improvements and bug fixes

CMX: improved logging
CMX: improved error handling (show module path and line number)
CMX: fixed bug when detecting unknown control flag
CMX: do not change output to json if -j or --json just print json in the end ...
added --new_branch to cm pull repo and cm checkout repo
fixed a bug in cm show repo (removed dependency on cm4mlops and used subprocess.check_output)
fixed action help and flag -h to work with all automations: https://github.com/mlcommons/ck/issues/1325
added -f to the CMX core to be backwards compatible with CM commands like cm rm cache -f

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.2.3: regular improvements and bug fixes

added --new_branch to cm pull repo and cm checkout repo
fixed a bug in cm show repo (removed dependency on cm4mlops and used subprocess.check_output)
fixed action help and flag -h to work with all automations: https://github.com/mlcommons/ck/issues/1325
added -f to the CMX core to be backwards compatible with CM commands like cm rm cache -f

- Python
Published by gfursin over 1 year ago

ck - CM/CMX v3.2.0: many new features

I have added many important features to CMX pending for a very long time: - added utils.test_input to test if input has keys and report them as error - added prefix_cmx key to cmr.yaml to customize cmx pull repo - improved CMX logging (-log and -logfile): https://github.com/mlcommons/ck/issues/1317 - print control flags in help (cmx -h | cmx -help): https://github.com/mlcommons/ck/issues/1318 - fail if control flag is not recognized: https://github.com/mlcommons/ck/issues/1315 - added -repro flag to record various info to cmx-repro directory: https://github.com/mlcommons/ck/issues/1319 - print call stack when error > 32 to be able to trace error cause: https://github.com/mlcommons/ck/issues/1320 can be combined with -log=debug and -logfile

- Python
Published by gfursin over 1 year ago

ck - v3.1.0: simplified and changed process_input function API

- Python
Published by gfursin over 1 year ago

ck - CM v3.0.3: a few improvements

added -raise to raise errors for debugging (https://github.com/mlcommons/ck/issues/1309)
added --extracmdgit and --extracmdpip to cm/cmx pull repo (https://github.com/mlcommons/ck/issues/1308)

- Python
Published by ctuning-admin over 1 year ago

ck - CM v3.0.2: fixed cm init

- Python
Published by gfursin over 1 year ago

ck - CM v3.0.1: prototyping simpler interface

CM v3 includes a prototype of a simpler and cleaner version of Python cmind.access() and CLI. It should not influence existing CM4MLOps automation scripts and workflows for MLPerf and other projects from CM v2.x . Both interfaces will co-exist in the future.

- Python
Published by ctuning-admin over 1 year ago

ck - CM v2.4.0: extension to CM repos to install requirements.txt

added install_python_requirements to the CM repo description (cmr.yaml) to install requirements to a current python with CM installation if needed

- Python
Published by gfursin over 1 year ago

ck - CM V2.3.9: improved "cm init" and CLI

added --min == --skip to cm init for readability
added --checkout to cm init to handle checkout
added support to set CLI parameter to False if it ends with -, i.e. --no-cache- -> i['no_cache'] = False --no-cache -> i['no_cache'] = True

- Python
Published by gfursin over 1 year ago

ck - CM V2.3.8: better handling of CM git repos

added --skip and --url flags to cm init
added support to pull CM repos using --url with "git@"

- Python
Published by gfursin over 1 year ago

ck - CM V2.3.7: better support for debugging

added cmind.core.debug to make it easier to debug CM automations
added env CMCORESKIPFIXREPO_PATH to skip fixing non-existent repo paths

- Python
Published by gfursin over 1 year ago

ck - CM v2.3.6: minor fixes

fixed "cm init" on Windows
added basic CM tests on MacOS
added "cm add script" tests

- Python
Published by gfursin over 1 year ago

ck - CM v2.3.5: added "cm init"

added cm init to check system deps and pull mlcommons@cm4mlops by default, i.e. pip install cmind && cm init
fixed branch and checkout functionality in cm pull repo

- Python
Published by gfursin almost 2 years ago

ck - CM v2.3.4: minor documentation update

- Python
Published by gfursin almost 2 years ago

ck - CM v2.3.2

fixed "cm pull repo --branch={BRANCH NAME}" behavior for all OS
added GitHub tests for Windows
added more tests for CM-MLPerf workflows for different hardware

- Python
Published by ctuning-admin almost 2 years ago

ck - CM v2.3.0 release

Important change: we added automatic CM repo alias from mlcommons@ck to mlcommons@cm4mlops unless branch and checkout are used!
we improved CM python package API generation and uploaded it here - we will move it to MLCommons when ready!
we added timezone to utils.getcurrentdate_time to correctly time stamp various experiments!

- Python
Published by ctuning-admin about 2 years ago

ck - cm-mlops-arc-20240428

Archive of the cm-mlops repository to reproduce older workflows before migrating to mlcommons@cm4mlops.

- Python
Published by gfursin about 2 years ago

ck - CM v2.2.0: a few major improvements to support Visual Studio debugging and min CM version

CM v2.2.0 release:

fixed detection of a CM artifact using 'cm info .' when inside virtual env entries.
added "cmind.utils.debug_here" function to attach remote Python debugger and tested with Visual Studio Code.
added test to avoid checking out CM repo that was not pulled
added utils.safeloadjson to return empty dict if file doesn't exist
added utils.compare_versions to check min version requirements for automations and entries
removed outdated convert_path (https://github.com/mlcommons/ck/issues/1219)
added utils.checkiftrueyeson (https://github.com/mlcommons/ck/issues/1216)
check "mincmversion" in CM automations and CM scripts (use _cm.yaml or _cm.json)

- Python
Published by gfursin about 2 years ago

ck - CM v2.1.2 supporting dependencies for CM repositories

- Python
Published by gfursin about 2 years ago

ck - CM v2.1.1: support for the new mlcommons@cm4mlops repo

We have moved cm-mlops sub-repo to a standalone repo at https://github.com/mlcommons/cm4mlops .

- Python
Published by gfursin about 2 years ago

ck - CM v2.0.4: general improvements and minor bug fixes

added skip of delayed help to simplify output of cmr [tags] --help
revisited automatically generated READMEs for CM scripts (automation recipes) based on user feedback: https://github.com/mlcommons/ck/issues/1169
improved deleting of CM artifacts (entries) on Windows
print tags when deleting CM artifacts (entries)

- Python
Published by gfursin about 2 years ago

ck - CM v2.0.3: improved handling of CM repositories

added support to handle broken CM repositories: https://github.com/mlcommons/ck/issues/1177
added "cm checkout repo mlcommons@ck --branch=dev" to make it easier to switch branches
added "cm import repo" to import repository in the current directory

- Python
Published by gfursin about 2 years ago

ck - CM v2.0.2: improved handling of CM repositories based on user feedback

added support to update all CM Git repos in one go: "cm pull repo"
added support to show extra info about CM Git repos: "cm show repo"
added explicit support for Private Access Token (PAT) when pulling private CM repos: cm pull repo ctuning@mlcommons-ck-reproduce-inference-v4.0 --pat={GITHUB PAT}
added support to remove CM repositories via "cm rm repo" even if read only (required for Windows)
added support to self-fix CM repo list if repository was manually deleted

- Python
Published by gfursin about 2 years ago

ck - v2+: a major update with a new GUI and Python 3.12+ support

a major update with Python 3.12+ support, the new CM automation recipes and a new GUI to compose modular AI systems and optimize them across diverse models, datasets, software and hardware:
https://access.cknowledge.org/playground/?action=scripts
https://access.cknowledge.org/playground/?action=howtorun
https://access.cknowledge.org/playground/?action=reproduce
added setuptools as dependency to detect package versions

- Python
Published by gfursin over 2 years ago

ck - V1.6.2 bug fixes and improvements for users

fixed "cm pull repo" if repo already exists
improved --help for common automations and CM scripts (automation recipes)
fixed a few minor bugs
added support to print directories and files for a given CM entry via "cm info {automation} {artifact|--tags}"

- Python
Published by gfursin over 2 years ago

ck - V1.6.1 release for MLPerf inference v4.0

Various improvements and fixes based on the feedback from MLPerf inference v4.0 submitters:

added support for Python 3.12 (removed "pkg" dependency)
improved --help for common automations and CM scripts (automation recipes)
fixed a few minor bugs
added --depth to "cm pull repo" to reduce size of stable repos
added possibility to download zip repository in "cm pull repo --url={...}.zip" to download small and stable repositories with CM automation recipes
updated core documentation

- Python
Published by gfursin over 2 years ago

ck - Stable release of CM v1.5.3 and Collective Knowledge v3 supporting MLPerf inference benchmark v3.1+

Stable release of the MLCommons CM automation language v1.5.3 and Collective Knowledge v3 supporting MLPerf inference benchmark v3.1+ and our community submissions.

- Python
Published by gfursin over 2 years ago

ck - CM v1.5.2: minor improvements for MLPerf inference and Artifact Evaluation

fixed minor bug with auto-initializion of cmind for cmind.error and cmind.halt for external scripts
added --min to cm find repo xyz --min to print path to CM xyz repo without any extra info Needed for artifact evaluation at ACM MICRO'23
added cm where repo xyz to print path to xyz CM repo without any extra info Needed for artifact evaluation at ACM MICRO'23

- Python
Published by gfursin over 2 years ago

ck - CM v1.5.1: bug fixes

fixed a bug when merging dictionaries in variations (detected when running MLPerf inference with GPT-J): https://github.com/mlcommons/ck/issues/858

- Python
Published by gfursin almost 3 years ago

ck - CM v1.5.0: bug fixes

Fixed a serious (though rare) bug in indexing when mixing entries with UIDs and aliases.

- Python
Published by gfursin almost 3 years ago

ck - V1.4.1: added "cme" binary shortcut for "cm run experiment"

- Python
Published by gfursin almost 3 years ago

ck - V1.4.0 new "cmr" binary and support for TinyMLPerf

added cmr binary as a shortcut for "cm run script"
fixed minor bug with repo/automation/artifact detection in the current path with "."
various improvements in CM-MLOps repository to support TinyMLPerf

- Python
Published by gfursin almost 3 years ago

ck - V1.3.0: indexing and silent mode turned on by default

Turned on artifact indexing by default (can be turned off by setting CM_INDEX to "no", "off" or "false")
Turned on --silent mode in "cm run script" by default Can be turned off via --verbose or -v flags
Fixed duplicate version detection for Python packages
Added --new_tags for "cm copy" to add new tags to newly created artifacts
Added --new_tags for "cm add" to add new tags to newly created artifacts
Added basic check for forbidden artifact names such as "."

- Python
Published by gfursin about 3 years ago

ck - V1.2.2: bug fixes

Fixed minor bug during cm detect repo (turn off indexing).

- Python
Published by gfursin about 3 years ago

ck - V1.2.1

V1.2.0: Major update: transparent indexing of all artifacts to speed up search and scripts by ~10..50x.

It is currently OFF by default for further testing. You can turn it on and test by setting this environment variable: "CM_INDEX=yes|on|true".

V1.2.1: Fixed Bug in indexing to avoid returning duplicate artifacts when wildcards are used.

- Python
Published by gfursin about 3 years ago

ck - MLCommons CM v1.1.6

Minor fixes and updates: https://github.com/mlcommons/ck/blob/master/cm/CHANGES.md#v116

- Python
Published by gfursin about 3 years ago

ck - MLCommons CM aka CK2 v1.1.3

Stable release of the MLCommons CM automation meta-framework from the MLCommons taskforce on education and reproducibility: - improved removal of CM entries on Windows - fixed https://github.com/mlcommons/ck/issues/574 - improved detection of CM entries with "." - added --yaml option in "cm add" to save meta in YAML - added --savetojson to save output to JSON (useful for web services) - extended "cm info {automation} {artifact}" (copy to clipboard)

- Python
Published by gfursin over 3 years ago

ck - Stable release of MLCommons CM v1.1.1

Stable release from the MLCommons taskforce on education and reproducibility to automate MLPerf inference at the Student Cluster Competition at SuperComputing'22: * https://github.com/mlcommons/ck/blob/master/docs/tutorials/sc22-scc-mlperf.md * https://github.com/mlcommons/ck/blob/master/docs/tutorials/sc22-scc-mlperf2.md * https://wandb.ai/cmind/cm-mlperf-sc22-scc-retinanet-offline * https://twitter.com/DrHaiAhNam/status/1592221106290688001

- Python
Published by gfursin over 3 years ago

ck - Stable release of MLCommons CM v1.1.0

Stable release from the MLCommons taskforce on education and reproducibility to automate MLPerf inference at the Student Cluster Competition at SuperComputing'22: * https://github.com/mlcommons/ck/blob/master/docs/tutorials/sc22-scc-mlperf.md * https://github.com/mlcommons/ck/blob/master/docs/tutorials/sc22-scc-mlperf2.md * https://wandb.ai/cmind/cm-mlperf-sc22-scc-retinanet-offline * https://twitter.com/DrHaiAhNam/status/1592221106290688001

- Python
Published by gfursin over 3 years ago

ck - cm-v1.0.5

Stable release from the MLCommons taskforce on education and reproducibility to test the MLPerf inference benchmark automation for the Student Cluster Competition at SC'22.

- Python
Published by gfursin over 3 years ago

ck - MLCommons CM v1.0.0 - the next generation of the MLCommons Collective Knowledge framework

This is the stable release of the MLCommons Collective Mind framework v1.0.1 with reusable and portable MLOps components - the next generation of the MLCommons Collective Knowledge framework developed to modularize AI/ML Systems and automate their benchmarking, optimization and design space exploration based on the mature MLPerf methodology.

After donating the CK framework to the MLCommons, we have been developing this portable workflow automation technology as a community effort within the open education workgroup to modularize MLPerf and make it easier to plug in real-world tasks, models, data sets, software and hardware from the cloud to the edge.

We are very glad to see that more than 80% of all performance results and more than 95% of all power results were automated by the MLCommons CK v2.6.1 in the latest MLPerf inference round thanks to submissions from Qualcomm, Krai, Dell, HPE and Lenovo!

We invite you to join our public workgroup to continue developing this portable workflow framework and reusable automation for MLOps and DevOps as a community effort to: * develop an open-source educational toolkit to make it easier to plug any real-world ML & AI tasks, models, data sets, software and hardware into the MLPerf benchmarking infrastructure; * automate design space exploration of diverse ML/SW/HW stacks to trade off performance, accuracy, energy, size and costs; * help end-users reproduce MLPerf results and deploy the most suitable ML/SW/HW stacks in production; * support collaborative and reproducible research.

(C)opyright MLCommons 2022

Shortcuts

- Python
Published by gfursin over 3 years ago

ck - MLCommons CM toolkit v0.7.24 - the first stable release to modularize and automate MLPerf inference v2.1

Stable release of the MLCommons CM toolkit - the next generation of the CK framework developed in the open workgroup to modularize and automate MLPerf benchmarks.

- Python
Published by gfursin over 3 years ago

ck - A fix to support Python 3.9+

This release includes a fix for issue #184 .

- Python
Published by gfursin over 4 years ago

ck - Stable release for MLCommons CK v2.6.0

This is a stable release of the MLCommons CK framework with a few minor fixes to automate MLPerf inference benchmark v2.0+ submissions.

- Python
Published by gfursin over 4 years ago

ck - Several improvements including the possibility to skip arbitrary dependencies from CK workflows

fixed copyright note in the License file
improved problem reporting in module:program
important fix in "module:program" detected while preparing MLPerf inference out-of-the-box benchmarking: clean tmp directory when running CK workflow that doesn't have compilation!
added --remove_deps flag to module:program and module:env as suggested by CK users to be able to remove some dependencies from CK program workflows and thus use natively installed compilers, tools, libraries and other components - useful to debugging and testing. This flag takes a list of keys from dependencies from a given program workflows separated by comma.
added the latest contributors to the CK project.

- Python
Published by gfursin almost 5 years ago

ck - Extra improvements for MLPerf inference

added 'ckhtmlend_note' key to customize CK result dashboard
fixed Pareto frontier filter
added "ck filter_2d math.frontier" for MLPerf inference

- Python
Published by gfursin almost 5 years ago

ck - Community extensions

This release includes multiple CK extensions based on the user feedback: * added --j flag to "ck install package" to update CKHOSTCPUNUMBEROFPROCESSORS env and force number of processes in "make -j" if used by a given package * added ck.cfg key "pipuser". If yes, add --user when to pip when installing CK repositories. Turn it on as follows: $ ck set kernel var.pip_user=yes See ticket #157 * print path to the CK kernel when invoking "ck" * extended "result" module to use meta.json as a base for all sub configurations (to simplify configuration for multiple dashboards - useful for MLPerf)

- Python
Published by gfursin almost 5 years ago

ck - support for the new CK dashboards and other improvements

added result.cfg to configure CK dashboards
improved module:result to push results to CK dashboards
improved module:dashboard to work with new CK dashboards
improved module:wfe to work with new CK dashboards
added module:ck-platform to work with cKnowledge.io platform (moved cbench functionality from the CK incubator to the CK module to work with cKnowledge.io dashboards directly)
provided better support to work with CK modules as standard Python packages (see module:ck-platform as example)

- Python
Published by gfursin almost 5 years ago

ck - regular extensions based on user feedback

added support to automatically add simple packages from Git: ck add package:my-git-repo --git={URL} --tags=my-repo --env_ext=MY_GIT_REPO
added module:mlperf.result to abstract official MLPerf results
added key "skipglobaldeps" to program meta to skip global dependencies for a given command line (for example, only to install python deps for a given program)
improved handling of a situation when CK environment has changed and make it possible to continue running a workflow at user risk (useful for debugging)

- Python
Published by gfursin almost 5 years ago

ck - various extensions

added "pull" function to module:docker
if only 1 tag exists in Docker, select it automatically
updated docs
fixed ck run docker --command="something" on Linux
added --min_run to module:program to avoid pre/post processing and just run a command. Useful to install Python requirements for a given program CMD. We use it in MLPerf automation.

- Python
Published by gfursin about 5 years ago

ck - automatically installing Python requirements from pulled repos

auto-install Python requirements from pulled repositories
added --bash to docker:module to run bash in a container
removed outdated and unnecessary files
added --command flag to "run docker" to run a specific command such as ck run docker:xyz --command="ck show env"

- Python
Published by gfursin about 5 years ago

ck - many enhancements to handle adaptive Docker containers via CK

added module "docker.template" to support adaptive CK containers
added rebuild function to module:docker to rebuild images (#145)
added support for multiple Docker tags in module:docker . See example: https://github.com/octoml/mlops/tree/main/docker/ck-template-mlperf
added "default_org" key in a CK Docker entry meta to specify default organization
added "outdated" and "aging" keys in Docker images to warn user about the status of a given Docker container
added main CK and MLPerf repositories to Zenodo to ensure reproducibilty
added common function "tested" to mark CK entries as tested, i.e. "ck tested docker:mlperf-inference-v0.7.openvino"

- Python
Published by gfursin about 5 years ago

ck - "ck search" improvement for entries with inheritance

improved "ck search" to search tags in entries with inheritance
fixed function "ck status"

- Python
Published by gfursin about 5 years ago

ck - enhancement of the inheritance mechanism and a few bug fixes

We keep original meta of a given entry when updating, copying or moving it rather than expanding it with all the base entries.W

- Python
Published by gfursin about 5 years ago

ck - basic support for inheritance of CK entries

added support for basic inheritance in CK entries via "baseentry" key. Useful to simplify program, package and soft modules. See ticket #143.
added program.template, soft.template and package.template modules to describe base entries for inheritance.

- Python
Published by gfursin about 5 years ago

ck - fixed a major bug in the installation system

- Python
Published by gfursin about 5 years ago

ck - added missing requirements.txt to the main distro

- Python
Published by gfursin about 5 years ago

ck - simplifying setup.py

added requirements.txt file with pyyaml
simplified setup.py script
added incubating projects to simplify CK

- Python
Published by gfursin about 5 years ago

ck - aggregated fixes and improvements

V2.0.7
- fixed problem in module:program to return error when pre/post processing fails
- added more tests to catch bugs in program workflows
- fixed a new bug in the program workflow
- updated docs
V2.0.6
- improved module:program meta to be able to use global CMD run_time parameters for all command lines (useful to run different MLPerf scenarios with similar run time parameters)
V2.0.5
- added possibility to pull CK repositories from different GitHub organizations as follows: "ck pull repo:{organization}@{repo}"
- removed old and not used meta "backupdatauid" and "data_name" from program entries
V2.0.4
- fixed modules mlperf.inference and mlperf.mobilenets to cache results in local:tmp:{some cache}
V2.0.3
- fixed a minor bug in module:program
V2.0.2
- Added --printskipstats to "ck benchmark program" to reduce output for MLPerf benchmarks
- Added --print_files to "ck benchmark program" to print multiple files after MLPerf benchmarking
- Removed several data zips that are not required for the releases

- Python
Published by gfursin about 5 years ago

ck - improving script generation and support for Python 3.8+

Updated deprecated function in web server to support Python 3.8+
We now use Python to generate ck and ck.bat scripts! If you install CK for different python versions, you can use a specific one as follows:
python3.7 -m ck version

- Python
Published by gfursin about 5 years ago

ck - Apache 2.0 license

We now use Apache 2.0 license based on the feedback from the majority of users
The code did not change from the last version 1.55.17.
We plan to focus on incubating projects (see "incubator" directory) to redesign CK and make it simpler, faster and more Pythonic - we plan to use version 3.x for the new design.

- Python
Published by gfursin about 5 years ago

ck - fixed major bug and added MLPerf tests

fixed a bug in module:env.
added more MLPerf tests from https://github.com/ctuning/ck-ml to find above bug.
added detection of packages with problems to print notes about how to solve them (useful for ImageNet 2012 packages where direct download is no longer available).

- Python
Published by gfursin about 5 years ago

ck - added LICENSE.third-party.txt and module:docs

added module:docs to be more compatible with standard repos
added LICENSE.third-party.txt

- Python
Published by gfursin about 5 years ago

ck - improved error reporting

improved error reporting in packages and programs
print "Enter -1 to use CK packages" when detecting soft to install CK packages instead of detecting already installed software

- Python
Published by gfursin about 5 years ago

ck - A few extensions

Added module:doc to the distribution
Test environment variable "CKSKIPSAVINGPYTHONBIN" during CK installation to skip detecting and recording python binary to ck-python.cfg to avoid mixing up virtual environments.
When CK_PYTHON is defined during CK installation, record it to ck-python.cfg to preserve the default version.

- Python
Published by gfursin about 5 years ago

ck - Improving package installation

Important change: do not ask to select variations in "ck install package" when there are 2 or more variations! Needed to distinguish between selecting different versions of a given package or customizing the same package!

- Python
Published by gfursin about 5 years ago

ck - added --force_version to "ck detect soft"

Added --force_version to "ck detect soft" to force version. Useful to automate autodetection of imagenet, for example.

- Python
Published by gfursin about 5 years ago

ck - added --quiet to install packages

added --quiet flag to automatically enter default answer to most questions

- Python
Published by gfursin about 5 years ago

ck - added --default flag to the package module

added --default flag to ck install package to automatically select 0 when multiple packages and variations available.

- Python
Published by gfursin about 5 years ago

ck - improving package installation

extended module:package to ask a user to select a variation for a given package when there are multiple versions available.

- Python
Published by gfursin about 5 years ago

ck - minor extensions

added --tags to "ck find" action to be able to search for entries by tags and return their paths
added module:doc to abstract documentation

- Python
Published by gfursin about 5 years ago

ck - fix cpu & gpu set_freq commands

Updated 2 modules: https://github.com/ctuning/ck-env/pull/116

- Python
Published by gfursin about 5 years ago

ck - minor fixes and module improvements

fixed minor API typo
improvements from Arm to 2 CK modules: platform.cpu and platform.gpu: https://github.com/ctuning/ck-env/pull/113

- Python
Published by gfursin about 5 years ago

ck - Updating modules

Regular minor updates: * removed two outdated modules * updated module:program * added incubator projects

- Python
Published by gfursin over 5 years ago

ck - Fixing previous broken release

This release provides fixes for the broken V1.50.0 release (missing modules).

- Python
Published by gfursin over 5 years ago

ck - Including all stable CK modules

Note: this release is broken - please use V1.55.0+ instead!

This release incorporates all stable CK modules inside the CK framework to ensure the stability of CK workflows and components!

It was suggested by several users during our last questionnaire.

This should make it easier to test all components and workflows when users update modules.

We have also prepared a new with a collection of all portable workflows, automation actions and reusable artifacts for AI and ML in the CK format: https://github.com/ctuning/ai . All these components are also available at the CK platform.

- Python
Published by gfursin over 5 years ago

ck - Celebrating 170,000 downloads and CK-powered MLPerf v0.7 inference benchmark automation for edge devices

We release the new version of the CK framework V1.17.0 with new functionality and bug fixes to celebrate 170,000 downloads and CK-powered MLPerf v0.7 inference benchmark automation for edge devices!

Please take this quick questionnaire to help us shape the future of the CK project!

News:

The CK project overview was accepted for Philosophical Transactions A of the Royal Society: peer-reviewed preprint

New functionality and bug fixes:

Added support to use YAML files via CK CLI: ck action @file.yaml
Added simplified command ck init repo to create a CK repository in the current directory
Improved CK kernel API documentation and converted it to the Google format: https://ck.readthedocs.io/en/latest/src/ck.html
Improved CK documentation: https://ck.readthedocs.io
Provided a better integration with cKnowledge.io platform and the possibility to download stable components recursively
Fixed a bug when adding new CK actions with an internal or already existing name

- Python
Published by gfursin over 5 years ago

ck - several improvements

improved tests on Linux, MacOS and Windows
prototyped: testing the status of repositories (stable and warning)

- Python
Published by gfursin about 6 years ago

ck - Fixed UTF-8 issue with README during installation

We fixed a UTF-8 problem with README.md in the setup.py (thanks to the feedback from Arm colleagues).

- Python
Published by gfursin over 6 years ago

ck - Improved compatibility with the open CodeReef platform

We improved the compatibility with the open CodeReef platform (https://codereef.ai/static/docs) and fixed minor issues:

ck webhelp now shows published components at the CodeReef portal
ck webapi now shows module API at the CodeReef portal
Added "ck codereef " to show information about published components at the CodeReef portal
fixed repo update
added backward compatibility for the search via ElasticSearch
[experimental] prototyped automatic downloading of stable CK components from the CodeReef portal (https://codereef.ai/portal)
do not ask for "web support" by default when adding actions
Allowed ' character in names of CK entries
Added 2020
Simplified Readme

- Python
Published by gfursin over 6 years ago

ck - fixed bug with Python 2.7 installation and added a few new productivity functions

V1.11.4
- fixed problem when ck-python.cfg contains non-existent python
- fixed problem with allowed action_names (should not start with number but can have numbers in the middle)
- fixed problem with ElasticSearch when renaming entries
- Added key "usegitinsteadofhttps" to kernel cfg to substitute https:// with git@ in repositories
- fixed problem with pip installation using Python 2.7 (thanks to @alered01 from Arm)
- added possibility to log all used CK entries to find out all dependencies turn on: ck set kernel --var.logckentries={file} turn off: ck set kernel --var.logckentries=""

- Python
Published by gfursin over 6 years ago

ck - improved installation procedure and new productivity functions

New in this release: * minor clean up of the API doc * now copying default repo to $HOME/.ck/{version} to be able to always find it * added possibility to split dirs for the whole repo (to be able to exchange repos with split directories) * added commands "private", "recache", "splitalldirs" to ck add/update repo * added try/catch around encode/decode routines to better support non-UTF locale * can use wildcards when searching for UIDs * added repomoduleuoa to be able to execute module from a specific repository

- Python
Published by gfursin over 6 years ago

ck - bug fix with installation via LinuxBrew

Enhancements in this version:

fixed typo
added possibility to force index data for specific repos via local kernel meta: "index_repos":[list of repo UIDs and aliases]
bug fix for split directories if UID is used for an entry with alias
fixed link to CK slack channel
added zip_safe=False (to fix problems when installed via LinuxBrew)

- Python
Published by gfursin over 6 years ago

ck - Many enhancements for server/cloud deployment

Changes in this version: * added possibility to add sub-directory for all entries of a given module based on first N characters of an entry name; this is needed to handle millions of entries; it can be configured via local kernel meta: "splitdirs":{"module UOA":N} * fixed ck.bat on Windows (if CKROOT has spaces) * improved "ck help" function * added support for the latest ElasticSearch via Python client * improved CK search via ElasticSearch * added possibility to auto convert all entry names to lower case; it can be configured via local kernel meta: "forcelower":"yes" * added check for allowed entry names; it can be configured as RE via local kernel meta: "allowedentrynames": "^[A-Za-z0-9@. -]$" * added check for allowed action names in modules; it can be configured as RE via local kernel meta: "allowedactionnames": "^[A-Za-z_-]$" * added possibility to index data for only specific modules via local kernel meta: "indexmodules":[list of module UIDs and aliases] * removed AUTHORS.txt as non-standard (leaving CONTRIBUTIONS.txt) * added possibility to skip SSL certificate check for remote repositories * added CK kernel functions savestate(), restore_state, reinit to let multiple CK instances co-exist

- Python
Published by gfursin over 6 years ago

Recent Releases of ck

ck - CMX v4.1.4: bug fixes

ck - CMX V4.1.3: bug fixes

CMX V4.1.3

CMX V4.1.2

CMX V4.1.1

ck - CM/CMX V4.1.0: fixed legacy interfaces

CMX V4.1.0

ck - CMX V4.0.2

ck - CM/CMX v3.5.3: bug fixes

ck - CM/CMX v3.5.2: regular improvements based on user feedback

ck - CM/CMX v3.5.1

ck - Collective Mind (CM/CMX) v3.4.4: regular enhancements based on user feedback

ck - CM/CMX v3.4.3:

V3.4.3

ck - CM/CMX v3.4.2: added new reusable functions

ck - CM/CMX v3.4.1: added pyproject.toml to install CM and deprecated setup.py

V3.4.1

ck - CM/CMX v3.3.4: several improvements

ck - V3.3.3: improving logging

ck - V3.3.1

ck - CM/CMX v3.2.9: fixed minor bugs

ck -

ck - CM/CMX v3.2.5: various improvements and bug fixes

ck - CM/CMX v3.2.3: regular improvements and bug fixes

ck - CM/CMX v3.2.0: many new features

ck - v3.1.0: simplified and changed process_input function API

ck - CM v3.0.3: a few improvements

ck - CM v3.0.2: fixed cm init

ck - CM v3.0.1: prototyping simpler interface

ck - CM v2.4.0: extension to CM repos to install requirements.txt

ck - CM V2.3.9: improved "cm init" and CLI

ck - CM V2.3.8: better handling of CM git repos

ck - CM V2.3.7: better support for debugging

ck - CM v2.3.6: minor fixes

ck - CM v2.3.5: added "cm init"

ck - CM v2.3.4: minor documentation update

ck - CM v2.3.2

ck - CM v2.3.0 release

ck - cm-mlops-arc-20240428

ck - CM v2.2.0: a few major improvements to support Visual Studio debugging and min CM version

ck - CM v2.1.2 supporting dependencies for CM repositories

ck - CM v2.1.1: support for the new mlcommons@cm4mlops repo

ck - CM v2.0.4: general improvements and minor bug fixes

ck - CM v2.0.3: improved handling of CM repositories

ck - CM v2.0.2: improved handling of CM repositories based on user feedback

ck - v2+: a major update with a new GUI and Python 3.12+ support

ck - V1.6.2 bug fixes and improvements for users

ck - V1.6.1 release for MLPerf inference v4.0

ck - Stable release of CM v1.5.3 and Collective Knowledge v3 supporting MLPerf inference benchmark v3.1+

ck - CM v1.5.2: minor improvements for MLPerf inference and Artifact Evaluation

ck - CM v1.5.1: bug fixes

ck - CM v1.5.0: bug fixes

ck - V1.4.1: added "cme" binary shortcut for "cm run experiment"

ck - V1.4.0 new "cmr" binary and support for TinyMLPerf

ck - V1.3.0: indexing and silent mode turned on by default

ck - V1.2.2: bug fixes

ck - V1.2.1

ck - MLCommons CM v1.1.6

ck - MLCommons CM aka CK2 v1.1.3

ck - Stable release of MLCommons CM v1.1.1

ck - Stable release of MLCommons CM v1.1.0

ck - cm-v1.0.5

ck - MLCommons CM v1.0.0 - the next generation of the MLCommons Collective Knowledge framework

Shortcuts

ck - MLCommons CM toolkit v0.7.24 - the first stable release to modularize and automate MLPerf inference v2.1

ck - A fix to support Python 3.9+

ck - Stable release for MLCommons CK v2.6.0

ck - Several improvements including the possibility to skip arbitrary dependencies from CK workflows

ck - Extra improvements for MLPerf inference

ck - Community extensions

ck - support for the new CK dashboards and other improvements

ck - regular extensions based on user feedback

ck - various extensions

ck - automatically installing Python requirements from pulled repos

ck - many enhancements to handle adaptive Docker containers via CK

ck - "ck search" improvement for entries with inheritance

ck - enhancement of the inheritance mechanism and a few bug fixes

ck - basic support for inheritance of CK entries

ck - fixed a major bug in the installation system