model-deployment-framework

BentoML is a Python framework that simplifies machine learning model deployment by packaging models into production-ready API services with built-in optimization features like dynamic batching and multi-model orchestration.