Skip to content

Deployment

DeploymentStep

Bases: PipelineStep

Pipeline step for deploying a model using FastAPI and ONNX Runtime.

Source code in textforge/deployment.py 
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
class DeploymentStep(PipelineStep):
    """Pipeline step for deploying a model using FastAPI and ONNX Runtime."""

    def __init__(self):
        """Initialize DeploymentStep."""
        super().__init__()

    def run(self, model_path, quantize: bool = False):
        """Run the deployment process.

        Args:
            model_path (str): Path to the model directory.
            quantize (bool, optional): Flag to indicate whether to quantize the model. Defaults to False.
        """
        serve(model_path, quantize)

    def save(self):
        """Save deployment configuration or artifacts.

        Note:
            This method is currently a placeholder.
        """
        pass

__init__()

Initialize DeploymentStep.

Source code in textforge/deployment.py 
32
33
34
def __init__(self):
    """Initialize DeploymentStep."""
    super().__init__()

run(model_path, quantize=False)

Run the deployment process.

Parameters:

Name Type Description Default
model_path str

Path to the model directory.

 required
quantize bool

Flag to indicate whether to quantize the model. Defaults to False.

 False
Source code in textforge/deployment.py 
36
37
38
39
40
41
42
43
def run(self, model_path, quantize: bool = False):
    """Run the deployment process.

    Args:
        model_path (str): Path to the model directory.
        quantize (bool, optional): Flag to indicate whether to quantize the model. Defaults to False.
    """
    serve(model_path, quantize)

save()

Save deployment configuration or artifacts.

Note

This method is currently a placeholder.

Source code in textforge/deployment.py 
45
46
47
48
49
50
51
def save(self):
    """Save deployment configuration or artifacts.

    Note:
        This method is currently a placeholder.
    """
    pass