Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
-
Updated
Jul 13, 2026 - Python
The general deployment process consists of several interrelated activities with possible transitions between them. These activities can occur at the producer side or at the consumer side or both.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
[ECCV 2022] ByteTrack: Multi-Object Tracking by Associating Every Detection Box
StackStorm (aka "IFTTT for Ops") is event-driven automation for auto-remediation, incident responses, troubleshooting, deployments, and more for DevOps and SREs. Includes rules engine, workflow, 160 integration packs with 6000+ actions (see https://exchange.stackstorm.org) and ChatOps. Installer at https://docs.stackstorm.com/install/index.html
All-in-One Development Tool based on PaddlePaddle
🪄 Turns your machine learning code into microservices with web API, interactive GUI, and more.
OpenMMLab Model Deployment Framework
Cobbler is a versatile Linux deployment server
Turn any computer or edge device into a command center for your computer vision projects.
Deploy your agentic worfklows to production
Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
Deploy a ML inference service on a budget in less than 10 lines of code.
Create deployable system images from OS X installer
A powerful model compression framework for LLMs and LVLMs, adapted for NVIDIA GPUs and Huawei Ascend NPUs.
Published in CNCF Landscape: A MCP server for Kubernetes.
Powerful CLI tool to simplify Amazon ECS deployments, rollbacks & scaling
Train and Deploy an ML REST API to predict crypto prices, in 10 steps
A production-ready runtime framework for agent apps with secure tool sandboxing, Agent-as-a-Service APIs, scalable deployment, full-stack observability, and broad framework compatibility.
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
Continuously build, test, and deploy to any platform and cloud
A modern container-based CI/CD platform, easily assemble and run pipelines with high performance
Manage flaky unit tests. Click a checkbox to instantly disable any test on all branches. Works with your current test suite
Manage and automate Github Deployments across repos and organizations
Lets developers schedule PRs to be merged at a specific date/time. Useful for scheduling posts on static blog frameworks
Best-in-class CNCF Harbor based Container Image Management for individuals, teams and organizations
One-click delivery automation for Web Developers
A self-service platform for software development teams that accelerates deployment by simplifying cloud infrastructure
Build, deploy, and maintain your Rails apps on any cloud or server
Skycap is a container native CI/CD tool