Senior Machine Learning Systems Engineer
Working at Atlassian
Atlassians can choose where they work whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.
About the Central AI Org
Our organization is dedicated to driving AI innovation across all Atlassian products and platforms. We aim to deliver seamless AI experiences while establishing a robust Atlassian AI infrastructure for the future. Our purpose is to:
- Develop horizontal AI capabilities and infrastructure that can be leveraged across all products.
- Establish a centralized Search, Q&A, and Conversational AI system that integrates seamlessly with all Atlassian products.
- Explore integrating Atlassian products with AI solutions beyond the Atlassian ecosystem.
About the AI & ML Platform Team
- Our team's goal is to build the foundations to democratize AI and Machine Learning for Atlassian's teams, customers, and ecosystem. We aim to build productive, reliable tools that empower Atlassian teams to harness AI. These tools will facilitate the development, deployment, measurement, and operation of AI & ML models and experiences.
About This Role
Senior ML System Engineer
In this role, you are expected to
- Architect and implement scalable distributed infrastructure for model serving (load balancing, auto-scaling, batch scheduling, global KV cache).
- Optimize latency and throughput of model inference under real production workloads.
- Build reliable, high-concurrency serving systems that serve billions of requests reliably
- Benchmark, fine-tune, and accelerate inference engines.
- Create robust CI/CD infrastructure for seamless model deployment and inference engine updates.
- Partner with senior ML engineers to finetune open-source LLMs and deploy
Compensation
At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. We follow consistent hiring practices and account for each candidate's skills, knowledge, and experience when setting base pay within the range. Please visit go.atlassian.com/payzones for more information on which locations are included in each of our geographic pay zones. However, please confirm the zone for your specific location with your recruiter.This role may also be eligible for benefits, bonuses, commissions, and equity.
In The
United States
Zone A
Zone B
Zone C
: $171,063 - $223,332
On your first day, we'll expect you to have
- 5+ years of software engineering experience, 2+ years of system performance optimization experience
- Deep low-level systems programming (C/C++ or Rust)
- Experience with large-scale, high-concurrent production serving.
- Experience with GPU inference engines (vLLM, SGLang, Triton, TensorRT-LLM, etc.).
- Strong background in system optimizations: batching, caching, load balancing, parallelism.
It would be great, but not required if you have
- Low-level inference optimizations: GPU kernels
- Algorithmic inference optimizations: quantization, speculative decoding, distillation
- Experience with testing, benchmarking, and reliability of inference services.
- Experience designing and implementing CI/CD infrastructure for inference.
Benefits & Perks
go.atlassian.com/perksandbenefits
.
Not included in the source posting: what you'll do, qualifications.
Skills
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.