Website:
360labs.dev
Job details:
About 360 Labs
An AI-native software dev house, product studio and an AI engineering lab.
About the role:
We need an AI Deployment Engineer who can take AI models out of notebooks and put them into production. Your job is to make sure the models our AI engineers build actually run reliably, efficiently, and at scale for real users. If you're the kind of person who thinks about latency, uptime, and GPU costs instead of just accuracy scores, you'll fit right in.
What You'll Be Doing
- Taking AI models that the team has built and getting them running on servers so real users can access them
- Wrapping models in simple API endpoints using FastAPI or Flask so other developers can plug into them
- Using Docker to package and deploy models consistently across different environments
- Keeping an eye on deployed models to make sure they're running properly and not eating up unnecessary costs
- Helping AI engineers test and ship new model versions without breaking what's already live
- Setting up basic cloud infrastructure (AWS/GCP) to host and serve AI models
- Writing clear documentation so the rest of the team knows how things are deployed and how to troubleshoot
- Learning and applying basic optimization techniques like batching requests and caching responses to keep things fast
- Troubleshooting when something breaks in production and getting it back up quickly
What You Should Have
- Comfortable with Python and familiar with at least one ML framework (PyTorch or TensorFlow)
- Hands-on experience with Docker and basic container management
- Some experience deploying any kind of ML model to a server or cloud environment (even personal projects)
- Familiarity with cloud platforms like AWS or GCP, especially GPU instances
- Basic Linux command line skills and comfort working in terminal environments
- Understanding of APIs and how model inference gets served to end users
- Ability to troubleshoot and debug deployment issues independently
Compensation
This role will be paid well. We compensate fairly based on what you bring to the table and the value you create.
Click on Apply to know more.