Insight Global
Website:
insightglobal.com
Job details:
Job Summary
We are seeking a Senior Elastic Engineer to design, build, and operate an enterprise‑grade logging and observability platform. This role will focus on deploying and managing large‑scale ELK / Elastic environments across cloud and containerized platforms, supporting high‑volume data ingestion, real‑time analytics, and production‑critical workloads. The ideal candidate has strong experience with Elasticsearch on Kubernetes (ECK), cloud platforms, and CI/CD practices, and is comfortable supporting production systems in a fast‑paced environment.
Key Responsibilities
- Design, develop, deploy, and maintain an enterprise logging and observability platform using Elasticsearch, Logstash, Kibana, Fleet, and Beats.
- Implement and manage Elastic clusters on Kubernetes using Elastic Cloud on Kubernetes (ECK), ensuring scalability, resiliency, and high availability.
- Support CI/CD pipelines and deployment automation using GitLab and Harness.
- Work across AWS and GCP cloud environments, including experience with OpenSearch.
- Contribute to platform and architecture design by evaluating trade‑offs related to scalability, resiliency, performance, availability, and security.
- Perform capacity planning, solution reviews, and performance tuning for medium to large Elastic clusters.
- Design and implement solutions to analyze business and operational data, including Elasticsearch data modeling and index design.
- Develop and manage high‑volume, real‑time data ingestion pipelines, integrating logs from applications, systems, infrastructure, and access logs.
- Collaborate with streaming and buffering technologies such as Kafka and Redis to ensure reliable data flow.
- Design and maintain multi‑tenant Kibana dashboards and visualization solutions for diverse stakeholder groups.
- Establish and enforce operational best practices for large‑scale Elastic environments.
- Optimize and tune Filebeat and Logstash configurations to meet performance and reliability requirements.
- Research emerging Elastic features and enhancements, and lead upgrades aligned with business and customer needs.
- Provide production support, including participation in an on‑call rotation for critical Elastic applications.
Required Qualifications
- Bachelor’s degree in Computer Science or a related field, or equivalent practical experience.
- 5+ years of hands‑on experience supporting Elasticsearch and/or OpenSearch in production environments, managing medium to large clusters.
- Strong experience with on‑prem infrastructure, virtual machines, containers (Docker), and Container‑as‑a‑Service platforms.
- Demonstrated experience deploying and managing the ELK Stack to process data from multiple and diverse sources.
- Hands‑on expertise with Kibana visualization strategies, dashboards, controls, and alerting.
- Deep understanding of Elasticsearch index design, including sharding, replicas, aliases, and lifecycle management.
- Experience integrating with Elastic APIs.
- Strong working knowledge of Logstash plugins, filters, regular expressions, and grok patterns.
- Exposure to SQL and query optimization concepts.
- Background in Core Java development and UI development.
- Experience with Kafka, Redis, or similar buffering/streaming tools.
- Solid understanding of security and access management concepts within Elastic environments.
- Willingness to participate in a rotational on‑call schedule, including occasional weekend support.
Nice to Have
- Experience operating Elastic in multi‑cloud or hybrid environments
- Observability, monitoring, or SRE background
- Experience supporting business analytics use cases on Elasticsearch
This position pays $10-$14/hr USD (₹17-₹24 LPA)
Click on Apply to know more.