Flag job

Report

Technical Lead - Data Engineer

Min Experience

5 years

Location

BANGALORE

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

About Zluri: Zluri is a cloud-native SaaSOps platform enabling modern enterprises with SaaS Management and Identity Governance. Zluri empowers IT and Security teams to gain visibility into their SaaS landscape, unlock recurring savings, & securely govern access with provisioning and de-provisioning. Zluri’s technology is powered by a deep discovery engine, in-built iPaas and its evolving AI, enabling companies to easily navigate & control complex SaaS ecosystems. Trusted by over 250 global customers, Zluri is committed to delivering innovative, reliable, and scalable solutions that empower organizations to optimize their SaaS usage, ensure compliance, and enhance identity governance practices. We’re a Series B-funded organization and is backed by stellar investors like Lightspeed India, Mass Mutual Ventures, Endiya Partners, and Kalaari Capital. You can read more about why we are building Zluri here - https://www.zluri.com/blog/why-zluri-why-now/. Responsibilities: Build, maintain and optimize the data pipeline architecture at Zluri Develop ETL pipelines based on the requirements following best practices, specifications, and standards Work with project teams provide input and assistance in the design, development, and support of ETL and database components following standard software development lifecycle Work with the team to ensure that ETL and database components conform to global standards via thorough code reviews Mentor junior programmers in the team and plan their skill development Determine the technical needs for the team to work on a project assigned or third-party tools Documenting the data requirements, data format and tool dependencies Flexibility and ability to adapt to new technological changes as per project need Requirements: ● 5+ years of experience in solving multi-dimensional data problems ● Knowledge of multiple cloud storage options like S3, Redshift, or BigQuery is a must ● Should be well versed with MySQL, NoSQL ● Knowledge of Pandas and Spark is a must. Knowledge of working with DBT is a plus ● Knowledge of Python, SQL, shell script is a must and Javascript (Node.js) is good to have ● Knowledge of streaming services like AWS streams / Kafka / Google Pub/sub is a good to have ● Knowledge of Queue systems like Rabbit MQ, SQS and building pipelines using the same is very much needed ● Knowledge on Dockers, Kubernetes is good to have ● Familiarity with multiple cloud providers (AWS, Azure & GCP) is good to have ● Should be familiar with strategies for Real-time analytics and batch processing ● Masters or Bachelor’s degree in Computer Science or the equivalent in experience

About the company

Zluri is a cloud-native SaaSOps platform enabling modern enterprises with SaaS Management and Identity Governance. Zluri empowers IT and Security teams to gain visibility into their SaaS landscape, unlock recurring savings, & securely govern access with provisioning and de-provisioning. Zluri’s technology is powered by a deep discovery engine, in-built iPaas and its evolving AI, enabling companies to easily navigate & control complex SaaS ecosystems.

Skills

data pipeline
ETL
MySQL
NoSQL
Pandas
Spark
Python
SQL
shell script
Javascript
AWS
Kafka
Google Pub/sub
Rabbit MQ
SQS
Docker
Kubernetes
AWS
Azure
GCP