Recent Releases of cresset
cresset - Removing `brew` again. Changing `pure` color from blue to cyan for better visibility.
Removed brew because of installation failures.
Changed the color of the pure current directory to cyan as the default dark blue was difficult to read.
- Dockerfile
Published by veritas9872 about 2 years ago
cresset - Breaking changes for a major update.
Added Brew to images.
Remove hub service due to its role being similar to simple.
Renamed CCA to CCC.
- Dockerfile
Published by veritas9872 about 2 years ago
cresset - Zenodo publication release
Update the ruff version. This is just to create a new release with Zenodo enabled.
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - Update PyTorch compilation process.
Release for Zenodo publication.
Update PyTorch compilation to use modern CMake and the nvcc bugfix.
Update documentation to fix typos and be more descriptive.
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - Add `zsh` styles to non-interactive images.
The non-interactive images now have basic support for shared .zshrc configurations.
However, they no longer have zsh as a requirement, allowing users to change shells, etc.
This will likely be useful if the non-interactive images are used interactively post-download, such as in interactive Kubernetes or as a reproducibility image uploaded to Docker Hub, etc.
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - Enable specifying `Makefile` configurations via the `.env` file.
Aside from many updates and bug fixes, the biggest change is that the Makefile now reads the .env file and no longer takes any variables from the host shell unless given during the make command invocation. Also, lots of new rules for ruff that I found reasonable.
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - Add support for reproducible installation via `conda-lock`.
The simple service can now install an environment from conda-lock files.
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - New simplified services!
This is a very large release that adds many new services.
Until now, Cresset has mainly focused on customizability at the expense of very complicated configurations.
Also, it has had no support for Kubernetes.
Now, the focus has changed to providing a simplified user interface as opposed to making the template customizable.
Also, the old deploy stage was removed to reduce clutter in the main Dockerfile.
While the Dockerfile is still recommended for maximum customizability, users who do not need any custom compilation and just wish for an easy-to-set-up development and training environment can use the other services.
Also, the new build-only Makefile command and INTERACTIVE_MODE=exclude option allow users to create images for distribution more easily.
Finally, the simple service has been set up to allow the use of conda-lock which is the strictest form of reproducibility in conda. This will help those with the strictest requirements needs. Moreover, because it consists only of official or verified images, the simple service will also help allay security concerns.
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - PyTorch 2.0 updates
Backwards compatibility breaking changes to support PyTorch 2.0.
A known issue is that the pip installation does not work on the deploy stage for Ubuntu 22.04.
This will be fixed ASAP.
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - Last release to support PyTorch 1.x.
This is a patch release to save all the work before updating to PyTorch 2.x, which has several breaking changes, most notably in the build-time dependencies.
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - Replace `flake8` and `isort` with `ruff`.
Replacing flake8 and isort configurations and pre-commits with ruff, which is much faster and more modern.
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - Add Makefile commands for Pyre and Pre-commit.
What's Changed
- Dev/add utils by @veritas9872 in https://github.com/cresset-template/cresset/pull/65
Full Changelog: https://github.com/cresset-template/cresset/compare/v0.6.0...v0.6.1
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - Add automation tools and configurations.
What's Changed
- Update conda installation method and conda manager. by @veritas9872 in https://github.com/cresset-template/cresset/pull/51
- Update/base by @veritas9872 in https://github.com/cresset-template/cresset/pull/52
- Dev/make by @veritas9872 in https://github.com/cresset-template/cresset/pull/56
- Fix default names. by @veritas9872 in https://github.com/cresset-template/cresset/pull/60
- Automation updates. by @veritas9872 in https://github.com/cresset-template/cresset/pull/64
Full Changelog: https://github.com/cresset-template/cresset/compare/v0.5.0...v0.6.0
- Dockerfile
Published by veritas9872 almost 3 years ago
cresset - New years release for 2023.
Changed the training environment so that conda is now the preferred package manager instead of just the virtual environment.
Fixed many bugs and issues to make the project easier to use.
- Dockerfile
Published by veritas9872 about 3 years ago
cresset - More cleanup
Separate out installing PyTorch and related libraries.
Rename download-only stages as fetch for better contrast with build stages.
Updates in the documentation.
- Dockerfile
Published by veritas9872 over 3 years ago
cresset - Updates for Ubuntu 22.04 LTS and Python 3.10.
Remove legacy features and clean up the documentation. Test out Ubuntu 22.04 LTS and Python 3.10.
- Dockerfile
Published by veritas9872 over 3 years ago
cresset - Updates for a more sophisticated development experience.
Support for external files for installation. The NSight systems debian binary cannot be installed via the command line. An external .deb file is therefore used. Also, Git Large File System (LFS) is used to prevent the .git directory from bloating. The build guidelines have also changed in order to make the meaning clearer (I think). CCA is no longer mandatory and the .env file is guarded by a separate recipe. Python package installation is now fully parallel with apt package installation. Finally figured out how to get separate volume paths for different hosts. Using docker-compose.override.yaml was decided to be the best approach. Documentation still needs work.
- Dockerfile
Published by veritas9872 over 3 years ago
cresset - Quick hacks due to unstable URLs.
This is a hack release forced by the sudden failure of URLs in TorchAudio and the Kakao mirror for PyPI. Although both have simple fixes, these issues mean that users must become more involved with the details. To ensure that the build does not fail for new users, TorchAudio source builds and using PyPI mirrors have been temporarily disabled. These functionalities will be restored ASAP.
- Dockerfile
Published by veritas9872 almost 4 years ago
cresset - Create release before W&B event.
Summary
Total makeover of the entire project from the ground up. Most documentation concerning how to use the Makefile for building Docker images and speed gains have been removed. More documentation and examples will come soon.
What's Changed
- Hotfix password by @veritas9872 in https://github.com/cresset-template/cresset/pull/24
- Updates for Cresset by @veritas9872 in https://github.com/cresset-template/cresset/pull/25
- Version 0.2 breaking update. by @veritas9872 in https://github.com/cresset-template/cresset/pull/27
Full Changelog: https://github.com/cresset-template/cresset/compare/v0.1.2...v0.2.0
- Dockerfile
Published by veritas9872 almost 4 years ago
cresset - Focus on helping to build.
What's Changed
- Hotfix password by @veritas9872 in https://github.com/cresset-template/cresset/pull/24
- Updates for Cresset by @veritas9872 in https://github.com/cresset-template/cresset/pull/25
- Version 0.2 breaking update. by @veritas9872 in https://github.com/cresset-template/cresset/pull/27
Full Changelog: https://github.com/cresset-template/cresset/compare/v0.1.2...v0.2.0-rc2
- Dockerfile
Published by veritas9872 about 4 years ago
cresset - Complete rewrite based on first principles.
New Features:
1. Ubuntu 16.04 LTS support (not tested rigorously).
2. CentOS and UBI support (not tested at all).
3. MKL removal support for non-intel CPUs.
4. Implementation of apt and pip package requirements files.
5. Build-time optimizations for much faster build speeds. Caffe2 is disabled by default. Build tests are also disabled by default.
6. LLD v11.2 used for faster linking during compilation.
7. Jemalloc 5.2.1 used as the memory allocator for faster build and runtimes.
8. Utilization of conda-forge and intel channels for optimized libraries.
9. Addition of new docker-compose services for development.
10. Inclusion of missing variable guards for the compute capability variable CCA during initialization of Docker Compose and Makefile build.
Breaking Changes:
1. The Compute Capability variable CC has been renamed CCA to avoid clashing with the C Compiler CC variable.
2. Project renamed Cresset for greater memorability.
Also fixed many bugs that I found.
- Dockerfile
Published by veritas9872 about 4 years ago
cresset - Add `zsh` functionality & fix NGC image bugs
Added new zsh functionality such as auto-complete and syntax highlighting.
If these distract more than they help, simply comment out the installation.
The NGC image had a bug where shell was fixed to bash and could not be changed to sh.
This was (sort-of) fixed by using printf instead of echo.
Also, the NGC image was not using the mirror link due to an additional pip.conf file inside /opt/conda.
The code was accommodated to manage.
Finally, the docker-compose.yaml full service had a bug in listing image to cache from. This too was fixed.
- Dockerfile
Published by veritas9872 about 4 years ago
cresset - Updates and bug fixes.
Mostly stylistic updates and some minor bugfixes.
Benchmarking code is now cleaner, with CPU benchmarking also available.
Explanation of how to use the .env file in make commands now included.
- Dockerfile
Published by veritas9872 about 4 years ago
cresset - Initial stable release.
Initial Stable Release
First release with semantic versioning.
The project is now rather stable and thoroughly debugged, seeing as how there have been no bug reports for over a month.
I have decided to adopt semantic versioning, even though I am worried that some people will not use the project now that there is a scary v0.x in front. Rest assured that the project works very well and that bugs are most likely due to the host environment or something the user did, not the project code itself.
What's changed
Unlike the previous versions (which I will call the alpha version from now on), the default shell is now zsh instead of bash.
I have set the pure prompt as the default because of its compatibility with most terminals.
The project can now use requirements.txt files, which was a feature in very high demand.
I have also included benchmark.py for easy benchmarking. This was the most highly sought after functionality due to my claims of speed enhancements.
Now anyone can measure the speed differences for themselves.
Slightly friendlier README organization. No images though.
- Dockerfile
Published by veritas9872 about 4 years ago