SageMaker Deployment Architecture

Let’s say we’ve trained a machine learning model on SageMaker and now want to deploy it as an API endpoint that can handle up to 100 requests per second with low latency.

How would you design the end-to-end deployment architecture using AWS services, and what considerations would you have for scalability and monitoring?