ETL Platform Automation Engineer

VySystems

Website: vysystems.com
Job details:

Job Summary:

We are seeking an experienced ETL Platform Automation Engineer to drive modernization of our Ab Initio-based data platform. This role focuses on automation, containerization, and cloud-native deployment of ETL workloads, along with ensuring stability and performance of existing on-premise environments.

You will play a key role in enabling Ab Initio workloads to run on containerized infrastructure (Docker/Kubernetes) and deploying them on Google Kubernetes Engine (GKE), while building scalable automation frameworks using Ansible and CI/CD pipelines.

Key Responsibilities

Platform Engineering & Automation

• Design and implement automation solutions for Ab Initio platform operations.
• Containerize ETL workloads using Docker/OCI standards and deploy on Kubernetes (GKE).
• Build and maintain infrastructure-as-code and configuration management using Ansible (roles, inventories, reusable playbooks).
• Develop CI/CD pipelines for build, test, and deployment of ETL applications and platform components.
• Standardize deployment patterns and improve platform scalability and reliability.

Operations & Reliability

• Manage and support ETL workloads running on on-prem VM environments and cloud platforms.
• Provide L2/L3 support, including troubleshooting, root cause analysis (RCA), and incident resolution.
• Perform performance tuning for batch and streaming ETL jobs.
• Ensure high availability, fault tolerance, and system resilience.

Observability & Monitoring

• Implement and maintain observability solutions (metrics, logs, traces).
• Monitor system health and proactively address performance bottlenecks.
• Participate in incident and problem management processes.

Collaboration & Documentation

• Collaborate with ETL developers, SREs, InfoSec, and Cloud Platform teams to define best practices.
• Create and maintain architecture diagrams, standards, and operational documentation.
• Drive adoption of automation and DevOps best practices across teams.

Required Skills & Experience

• 6+ years of experience in Platform Engineering, SRE, DevOps, or ETL engineering with strong automation focus.
• Hands-on Ab Initio platform-level experience (not just development).
• Strong expertise in:
• Containerization (Docker/OCI)
• Kubernetes fundamentals and production deployments (preferably GKE)
• Ansible (roles, inventories, idempotent playbooks, orchestration at scale)
• Experience with CI/CD pipelines (Git-based workflows, artifact repositories, image scanning).
• Strong knowledge of Linux systems, networking, and troubleshooting in on-prem VM environments.
• Experience with observability tools (monitoring, logging, tracing).
• Solid understanding of incident/problem management processes

Preferred Qualifications

• Experience with hybrid environments (on-prem + cloud).
• Exposure to security best practices and compliance (InfoSec alignment).
• Familiarity with infrastructure automation and GitOps practices.
• Experience working in large-scale enterprise ETL ecosystems

Click on Apply to know more.