Skip to content
Thinqmesh
Back to Job Search

LLMOps Engineer

Keep AI systems reliable, observable and affordable once they are in production.

Job Description

Role
LLMOps Engineer
Role description
Build the platform that runs AI in production, including deployment, evaluation pipelines, tracing, cost control and governance.
Must-have skills
Cloud infrastructure, containers, CI/CD, observability for LLM systems and Python
Good-to-have skills
Model serving, GPU infrastructure, prompt versioning and tools such as Langfuse or Braintrust
Minimum experience
3 to 6 years
Educational qualification
A degree in computer science, engineering or a related field, or equivalent practical experience

Summary

As an LLMOps Engineer at Thinqmesh, you will keep AI systems reliable once real people depend on them. You will build the platform that deploys, traces, evaluates and controls the cost of every model-powered feature we run.

Your work makes it safe for the whole team to move quickly, because every change is tested and every answer can be traced.

Why This Role Matters Now

As AI moves from pilots into production, the hard problems become operational: models change, costs climb and failures are subtle. Observability and cost optimisation now appear as core requirements in AI job postings, and organisations need engineers who can apply the discipline of DevOps to systems that behave differently from ordinary software.

Roles and Responsibilities

You will build deployment and release pipelines for AI applications, including versioning of prompts and models. You will run evaluation in continuous integration, set up tracing and alerting, and track quality, latency and cost in production.

You will design for failure with fallbacks and rate limits, manage model hosting where it is needed, and put in place the controls that keep data and access secure.

  • Build deployment pipelines, with versioning of prompts and models
  • Run evaluation in continuous integration
  • Set up tracing, alerting, and quality, latency and cost tracking
  • Design for failure with fallbacks and rate limits
  • Keep data and access secure

Professional and Technical Skills

You bring at least three years in DevOps, platform or machine learning engineering, with strong cloud, container and CI/CD experience, and practical knowledge of how LLM systems behave in production. You write good Python and you enjoy making complex systems dependable.

Experience with model serving, GPU infrastructure, or tools such as Langfuse or Braintrust would be a clear advantage.

  • 3 or more years in DevOps, platform or machine learning engineering
  • Strong cloud, container and CI/CD experience
  • Practical knowledge of LLM systems in production
  • Good Python
  • Model serving or GPU experience is a plus

Tools You Will Use

  • Python
  • Docker
  • Kubernetes
  • Terraform
  • AWS
  • GitHub Actions
  • Grafana
  • Linux
  • Ollama
  • PyTorch

Additional Information

This role is hybrid or remote. It is full time in Noida, and a consultant role in San Francisco, Tustin and London. You will work closely with the client teams and colleagues you support.

Production systems sometimes need attention outside normal hours, and we share that fairly across the team.

We read every application ourselves. Show us something you have built or shipped, because real work gives us far more to talk about than a list of tools.

Stay Connected

Join Us

Explore open roles that match your interests and skills.

Introduce Yourself

Tell us what you do best, and we will keep you in mind as roles open.

Upfyn

Stop Chatting. Start Building With AI

A free live Masterclass, guided by the engineers who build our products. You leave with something that works.

Join the Free Masterclass (opens in a new tab)

Seats are limited, and the waitlist is invited first.