Inference Architecture MLOps Pattern for Large Language Models in the cloud

mlops, triton nvidia server, inference end point, aws, lambda function

2022