Serving machine learning models with FastAPI: It’s not all about speed

Sourced from: http://blog.amplemarket.com/serving-machine-learning-models-with-fastapi/

Serving machine learning models with FastAPI: It’s not all about speed

Serving and deploying Machine Learning models is a topic that can get complicated quite fast. At Amplemarket, my team and I, like to keep things simple.

Let me show you how.

1. Simplicity is key

At Amplemarket, we’re big fans of simplifying. We know that the less code we have to write, the fewer bugs we’re likely to introduce. FastAPI allows us to take a trained model and create an API for it, in less than 10 lines of code! That’s pretty incredible.

Let’s say you are creating a model that is trained on the Iris data set that predicts the species of a plant given some information about it. Previously, we would have saved our model to a pickle file, and sent it to our engineering team; perhaps we would have even scheduled a meeting with them to discuss how to use this model. We would also have sent some docume… Read More

Leave a Comment

Your email address will not be published. Required fields are marked *