Kafka Platform Engineer
About the role
Job Title
L ocation
Position Type
Salary Range
Sponsorship
Job Summary
Kafka Platform Engineer
10+ years of experience
Apache Kafka
Confluent Platform
Key Responsibilities
- Architect, deploy, and manage highly available
Apache Kafka
Confluent Platform
environments supporting enterprise-scale event-driven applications.
- Design Kafka cluster topology, broker configuration, partitioning strategies, replication, capacity planning, and performance optimization for high-throughput workloads.
- Implement enterprise-grade security using
SASL, SSL/mTLS, ACLs, RBAC
, encryption, and authentication mechanisms.
- Design and manage
Kafka Connect
Schema Registry
Kafka Streams
ksqlDB
, and event streaming pipelines for real-time data integration.
- Develop and maintain Infrastructure as Code using
Terraform
Ansible
, or similar automation frameworks to provision and manage Kafka infrastructure.
- Design and implement High Availability (HA), Disaster Recovery (DR), backup, failover, and cross-region replication strategies.
- Build comprehensive monitoring, alerting, logging, and observability solutions using
Prometheus, Grafana, OpenTelemetry, ELK
, and Confluent monitoring tools.
- Optimize cluster performance, troubleshoot production issues, conduct root cause analysis, and implement long-term platform improvements.
- Support Kafka deployments on
Kubernetes
Strimzi
Confluent Operator
AWS MSK
Azure Event Hubs (Kafka API)
Confluent Cloud
.
- Collaborate with application developers, data engineers, DevOps, SRE, and enterprise architects to establish event-driven architecture standards and best practices.
- Conduct architecture reviews, establish platform governance, perform code reviews, and mentor engineers on Kafka development and operations.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related technical discipline.
•
10+ years of professional experience
5+ years of hands-on Apache Kafka or Confluent Platform experience
.
- Expert-level knowledge of
Kafka internals
, including partitions, replication, brokers, ISR, consumer groups, offset management, and performance tuning.
- Extensive experience implementing Kafka security using
SASL, SSL/mTLS, ACLs, RBAC
, and enterprise authentication mechanisms.
- Strong hands-on experience with
Kafka Connect
Schema Registry
Kafka Streams
ksqlDB
, and real-time event streaming architectures.
- Experience implementing
High Availability (HA)
Disaster Recovery (DR)
, multi-cluster replication, and cross-region failover strategies.
- Advanced scripting skills using
Python
Bash
Go
Terraform
Ansible
, or similar tools.
- Strong experience with observability platforms including
Prometheus
Grafana
OpenTelemetry
ELK
, and distributed tracing solutions.
- Excellent troubleshooting, communication, documentation, stakeholder management, and technical leadership skills.
Preferred Qualifications
Confluent Certified Administrator
Confluent Certified Developer
certification.
- Experience operating Kafka on
Kubernetes
Strimzi
Confluent Operator
, or similar operators.
- Hands-on experience with managed Kafka services including
AWS MSK
Confluent Cloud
Azure Event Hubs (Kafka API)
Google Cloud Managed Kafka
.
- Experience with stream processing technologies such as
Apache Flink
Apache Spark Structured Streaming
Apache Beam
.
- Knowledge of
data governance
How to Apply
Not included in the source posting: about the role, benefits.
Skills
Who can apply
The employer didn't state any visa, work authorization, citizenship or clearance requirements in this posting. Confirm with the employer before applying.
Read automatically from the employer's posting text. Always confirm with the employer — requirements can change after a job is published.