Machine Learning Systems

Principles and Practices of Engineering Artificially Intelligent Systems

About This Book

The open-source textbook that teaches you to build real-world AI systems from edge devices to cloud deployment. Originally developed as Harvard University's CS249r course by Prof. Vijay Janapa Reddi, now used by universities and students worldwide.

Our mission: Expand access to AI systems education worldwide empowering learners, one chapter and one lab at a time.

Why This Book Exists

"This grew out of a concern that while students could train AI models, few understood how to build the systems that actually make them work. As AI becomes more capable and autonomous, the critical bottleneck won't be the algorithms - it will be the engineers who can build efficient, scalable, and sustainable systems that safely harness that intelligence."

** Vijay Janapa Reddi**

What You'll Learn

Go beyond training models master the full stack of real-world ML systems.

| Topic | What You'll Build | |-------|------------------| | System Design | Scalable, maintainable ML architectures | | Data Engineering | Robust pipelines for collection, labeling, and processing | | Model Deployment | Production-ready systems from prototypes | | MLOps & Monitoring | Reliable, continuously operating systems | | Edge AI | Resource-efficient deployment on mobile, embedded, and IoT |

Support This Work

Community & Resources

| Resource | Description | |----------|-------------| | Main Site | Complete learning platform | | TinyTorch | Educational ML framework | | Discussions | Ask questions, share insights | | Community | Join our global learning community |

For Different Audiences

Students

• Read online
• Download PDF
• Try hands-on labs

Educators

• Course materials
• Instructor resources
• Teaching guides

Contributors

• Contribution guide
• Development setup
• Join discussions

Quick Start

For Readers

```bash

Read online (continuously updated)

open https://mlsysbook.ai

Or download PDF for offline access

curl -O https://mlsysbook.ai/Machine-Learning-Systems.pdf ```

For Contributors

```bash git clone https://github.com/harvard-edge/cs249rbook.git cd cs249rbook

Quick setup (recommended)

./binder setup # Setup environment and dependencies ./binder doctor # Check system health

Fast development workflow

./binder preview intro # Fast chapter development ./binder build intro # Build specific chapter ./binder build # Build complete book (HTML) ./binder help # See all commands ```

Contributing

We welcome contributions from the global community! Here's how you can help:

Ways to Contribute

• ** Content** Suggest edits, improvements, or new examples
• ** Tools** Enhance development scripts and automation
  
• ** Design** Improve figures, diagrams, and visual elements
• ** Localization** Translate content for global accessibility
• ** Infrastructure** Help with build systems and deployment

Quality Standards

All contributions benefit from automated quality assurance: - Pre-commit validation Automatic cleanup and checks - Content review Formatting and style validation - Testing Build and link verification - Peer review Community feedback

*Start Contributing *

Development

Book Binder CLI (Recommended)

The Book Binder is our lightning-fast development CLI for streamlined building and iteration:

```bash

Chapter development (fast iteration)

./binder preview intro # Build and preview single chapter ./binder preview intro,ml_systems # Build and preview multiple chapters

Complete book building

./binder build # Build complete website (HTML) ./binder pdf # Build complete PDF ./binder epub # Build complete EPUB

Management

./binder clean # Clean artifacts ./binder status # Show current status ./binder doctor # Run health check ./binder help # Show all commands ```

Development Commands

```bash

Book Binder CLI (Recommended)

./binder setup # First-time setup ./binder build # Build complete HTML book ./binder pdf # Build complete PDF book
./binder epub # Build complete EPUB book ./binder preview intro # Preview chapter development

Traditional setup (if needed)

python3 -m venv .venv source .venv/bin/activate pip install -r tools/dependencies/requirements.txt pre-commit install ```

Project Structure

MLSysBook/ binder # Fast development CLI (recommended) quarto/ # Main book content (Quarto) contents/ # Chapter content core/ # Core chapters labs/ # Hands-on labs frontmatter/ # Preface, acknowledgments backmatter/ # References and resources parts/ # Book parts and sections _extensions/ # Quarto extensions config/ # Build configurations _quarto-html.yml # Website build configuration _quarto-pdf.yml # PDF build configuration data/ # Cross-reference and metadata files assets/ # Images, styles, media filters/ # Lua filters scripts/ # Build scripts _quarto.yml # Active config (symlink) tools/ # Development automation scripts/ # Organized development scripts content/ # Content management tools cross_refs/ # Cross-reference management genai/ # AI-assisted content tools maintenance/ # System maintenance scripts testing/ # Test and validation scripts utilities/ # General utility scripts dependencies/ # Package requirements setup/ # Setup and configuration config/ # Project configuration dev/ # Development configurations linting/ # Code quality configurations quarto/ # Quarto publishing settings docs/ # Documentation BINDER.md # Binder CLI guide BUILD.md # Build instructions DEVELOPMENT.md # Development guide contribute.md # Contribution guidelines CHANGELOG.md # Project changelog CITATION.bib # Citation information pyproject.toml # Python project configuration README.md # This file

Documentation

• Binder CLI Guide Fast development with the Book Binder
• Development Guide Comprehensive setup and workflow
• Maintenance Guide Daily tasks and troubleshooting
  
• Build Instructions Detailed build process
• Contribution Guidelines How to contribute effectively

Publishing

```bash

Interactive publishing (recommended)

./binder publish

Command-line publishing

./binder publish "Description" COMMIT_HASH

Manual workflow (if needed)

./binder build html && ./binder build pdf

Then use GitHub Actions to deploy

```

Publishing Options: - ./binder publish Unified command with interactive and command-line modes - GitHub Actions Automated deployment via workflows

Getting Started

```bash

First time setup

./binder setup

Check system health

./binder doctor

Quick preview

./binder preview intro ```

Citation & License

Citation

bibtex @inproceedings{reddi2024mlsysbook, title = {MLSysBook.AI: Principles and Practices of Machine Learning Systems Engineering}, author = {Reddi, Vijay Janapa}, booktitle = {2024 International Conference on Hardware/Software Codesign and System Synthesis (CODES+ ISSS)}, pages = {41--42}, year = {2024}, organization = {IEEE}, url = {https://mlsysbook.org} }

License

This work is licensed under Creative Commons AttributionNonCommercialShareAlike 4.0 International (CC BY-NC-SA 4.0). You may share and adapt the material for non-commercial purposes with appropriate credit.

Contributors

Thanks goes to these wonderful people who have contributed to making this resource better for everyone:

Vijay Janapa Reddi	Zeljko Hrcek	Marcelo Rovai	jasonjabbour	Ikechukwu Uchendu
Kai Kleinbard	Naeem Khoshnevis	Sara Khosravi	Douwe den Blanken	Jeffrey Ma
shanzehbatool	Elias	Jared Ping	Itai Shapira	Maximilian Lam
Jayson Lin	Andrea	Sophia Cho	Alex Rodriguez	Korneel Van den Berghe
Zishen Wan	Colby Banbury	Mark Mazumder	Divya Amirtharaj	Srivatsan Krishnan
Abdulrahman Mahmoud	Aghyad Deeb	marin-llobet	Haoran Qiu	oishib
Jared Ni	ELSuitorHarvard	Emil Njor	Michael Schnebly	Aditi Raju
Jae-Won Chung	Yu-Shun Hsiao	Henry Bae	Shvetank Prakash	Emeka Ezike
Andrew Bass	Jennifer Zhou	Arya Tschand	Pong Trairatvorakul	Matthew Stewart
Marco Zennaro	Eura Nofshin	Bruno Scaglione	Tauno Erik	Alex Oesterling
gnodipac886	Fin Amin	Allen-Kuang	TheHiddenLayer	Gauri Jain
Fatima Shah	Sercan Aygn	The Random DIY	Baldassarre Cesarano	Yang Zhou
yanjingl	Abenezer Angamo	Jason Yik	| Arnav Shukla	Aritra Ghosh
happyappledog	abigailswallow	Bilge Acun	Andy Cheng	Cursor Agent
Emmanuel Rassou	Jessica Quaye	Vijay Edupuganti	Shreya Johri	Sonia Murthy
Costin-Andrei Oncescu	formlsysbookissue	Annie Laurie Cook	Jothi Ramaswamy	Batur Arslan
Curren Iyer	Fatima Shah	Edward Jin	a-saraf	songhan
jvijay	Zishen

Trigger build