Model packaging
High-level information about the packaging of models using Ersilia Pack
To package models in Ersilia, there are two essential components, namely the Ersilia model template, and the Ersilia Pack tool. Ersilia Pack creates a FastAPI app based on the information available in a given model repository, based on the template.
Ersilia Pack is a lightweight, plug-and-play framework to serve AI models from the Ersilia Model Hub via an API.
It allows developers to:
Package models with their dependencies
Run them as web services
Submit data and retrieve predictions
Monitor jobs and system performance
Access detailed model metadata
Detailed documentation on Ersilia Pack is available in the corresponding GitHub repository. Here, we simply provide a high-level overview of the tool.
Typical Workflow
Lint a model repository to check it has the correct structure
Package the model into a self-contained bundle
Serve the model via API locally or in the cloud
Interact with the model through documented endpoints
Last updated
Was this helpful?