Website:
ironbook.ai
Job details:
We are looking for an experienced Confluent Solution Architect with 5–8 years of experience in designing and implementing real-time data streaming solutions using Confluent Kafka and the broader Kafka ecosystem. The ideal candidate will have strong expertise in event-driven architecture, Kafka platform design, cloud technologies, data integration, and scalable streaming solutions.
Key Responsibilities
- Design and architect scalable, highly available Confluent Kafka / Apache Kafka solutions based on business and technical requirements.
- Develop event-driven and real-time data streaming architectures across enterprise environments.
- Define Kafka cluster architecture, topics, partitions, replication, retention, and performance strategies.
- Design and implement Confluent Platform / Confluent Cloud solutions.
- Work with Kafka Connect, Connectors, Schema Registry, ksqlDB and other Confluent components.
- Develop integration patterns for connecting Kafka with databases, applications, APIs and enterprise data platforms.
- Define security architecture including SSL/TLS, SASL, RBAC/ACLs, authentication and authorization.
- Design disaster recovery, high availability, fault tolerance and business continuity strategies for Kafka environments.
- Perform capacity planning, performance tuning, monitoring and troubleshooting of Kafka platforms.
- Collaborate with application, cloud, DevOps, data engineering and infrastructure teams to deliver streaming solutions.
- Provide technical leadership and guidance to development and engineering teams on Kafka best practices.
- Create solution architecture documents, technical specifications, design diagrams and implementation guidelines.
- Evaluate new Confluent/Kafka capabilities and recommend improvements to existing streaming platforms.
Required Skills
- 5–8 years of experience in Kafka / Confluent technologies.
- Strong hands-on experience with Apache Kafka and Confluent Platform/Confluent Cloud.
- Strong understanding of Kafka architecture, including:
- Brokers
- Topics and partitions
- Producers and consumers
- Consumer groups
- Replication and fault tolerance
- Retention and log management
- Experience with Kafka Connect and Confluent Connectors.
- Strong knowledge of Confluent Schema Registry and Avro/JSON/Protobuf.
- Experience with ksqlDB / Kafka Streams is preferred.
- Strong understanding of event-driven architecture and distributed systems.
- Experience with cloud platforms such as AWS, Azure or GCP.
- Experience with containerization and orchestration technologies such as Docker and Kubernetes.
- Strong knowledge of API, database and enterprise application integration.
- Experience with Kafka security, monitoring and performance optimization.
- Good understanding of CI/CD and DevOps practices.
Preferred Qualifications
- Confluent certifications such as Confluent Certified Developer or Administrator.
- Experience with Confluent Cloud and managed Kafka services.
- Experience designing large-scale, high-throughput streaming platforms.
- Knowledge of observability tools such as Prometheus, Grafana, Datadog or similar.
- Experience with infrastructure-as-code tools such as Terraform.
- Experience working in Agile/Scrum environments.
Key Competencies
- Solution architecture and technical design
- Kafka/Confluent expertise
- Event-driven architecture
- Cloud architecture
- Data integration
- Performance and scalability
- Security and high availability
- Technical leadership
- Problem-solving and communication skills
Education
Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
What We Offer
- Opportunity to work on large-scale, real-time data streaming platforms
- Exposure to modern cloud, data and event-driven technologies
- Collaborative and technically driven work environment
Click on Apply to know more.
