Website:
cerebras.ai
Job details:
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.
This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.
Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.
About The Role
We are looking for an ML Engineer who can take a model from its reference implementation to efficient execution on AI accelerator hardware. You will own model bring-up, develop MLIR-based lowering paths, validate numerical correctness, and optimize performance across the model, compiler, kernels, and runtime.
This role combines practical knowledge of model architectures with strong compiler and systems engineering skills.
We are looking for an ML Engineer who can take a model from its reference implementation to efficient execution on AI accelerator hardware. You will own model bring-up, develop MLIR-based lowering paths, validate numerical correctness, and optimize performance across the model, compiler, kernels, and runtime.
This role combines practical knowledge of model architectures with strong compiler and systems engineering skills.
Responsibilities
- Bring up new models: Understand model architectures, load and convert weights, implement supported execution paths, and establish correctness against reference implementations.
- Lower models to hardware using MLIR: Develop and extend dialects, graph transformations, lowering passes, and hardware-specific mappings.
- Support model operations: Enable attention, matrix multiplication, normalization, positional embeddings, and other operators through compiler and kernel changes.
- Optimize execution: Improve operator fusion, tensor layouts, tiling, memory allocation, data movement, and parallel execution.
- Optimize inference: Tune prefill and decode performance, KV cache management, batching, and quantization to improve latency, throughput, and memory efficiency.
- Validate model quality: Investigate numerical differences and measure the accuracy impact of precision changes and compiler optimizations.
- Diagnose bottlenecks: Use profiling, execution traces, and hardware counters to identify compute, memory, communication, and runtime limitations.
- Work closely with hardware, compiler, kernel, and runtime teams to deliver reliable model support and repeatable performance benchmarks.
Required Qualifications
- Strong programming skills in C++ and Python.
- Hands-on experience bringing up and debugging ML models in PyTorch or a comparable framework.
- Practical experience with MLIR, including dialects, rewrite patterns, transformation passes, and lowering pipelines.
- Understanding of compiler fundamentals, including intermediate representations, dataflow analysis, and code generation.
- Understanding of transformer architectures, attention mechanisms, tensor operations, and numerical precision.
- Experience profiling and optimizing workloads on GPUs or other AI accelerators.
- Ability to debug correctness and performance issues across model code, compiler-generated code, kernels, and runtime execution.
Preferred Qualifications
- Experience with LLM inference, including GQA, sliding-window attention, MoE, KV caching, and speculative decoding.
- Experience with FP16, BF16, FP8, or low-bit quantization and their accuracy and performance tradeoffs.
- Experience developing accelerator kernels or hardware-specific compiler backends.
- Familiarity with distributed execution, model parallelism, and accelerator memory hierarchies.
- Contributions to MLIR, LLVM, inference frameworks, or related open-source projects.
Why Join Cerebras
About
People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:
- Build a breakthrough AI platform beyond the constraints of the GPU.
- Publish and open source their cutting-edge AI research.
- Work on one of the fastest AI supercomputers in the world.
- Enjoy job stability with startup vitality.
- Our simple, non-corporate work culture that respects individual beliefs.
Find out more about what it's like to work at Cerebras
here!
Apply today and become part of the forefront of groundbreaking advancements in AI!
Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.
This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.
Click on Apply to know more.
