Flag job

Report

Senior Data Engineer - Big Data

Salary

₹25 - 35 LPA

Min Experience

5 years

Location

Bagalur, Karnataka, India

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

We're Hiring! Data Engineer Bangalore.

Lifesight is on a mission to empower businesses with advanced data intelligence!. We are a fast-growing SaaS company helping brands leverage data & AI for better customer acquisition and retention. With 300+ customers across the US, Singapore, India, Australia, and the UK, we deal with petabytes of data and process 400TB+ daily to power attribution and measurement platforms.

Now, we are looking for a Sr. Data Engineer to join our growing team in Bangalore! If you love working with big data, cloud environments, and cutting-edge technologies like Apache Spark, Kafka, Airflow, Presto, and NoSQL databases, this is the opportunity for you.

What Youll Be Doing

  • Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 100s of terabytes of data ingested every day and petabyte-sized data warehouse and elasticsearch cluster.
  • Build quality data solutions and refine existing diverse datasets to simplified models encouraging self-service.
  • Build data pipelines that optimize on data quality and are resilient to poor quality data sources.
  • Own the data mapping, business logic, transformations and data quality Low level systems debugging, performance measurement & optimization on large production clusters.
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects.
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures.

Were Excited If You Have

  • Proficiency in Python and pyspark.
  • Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames.
  • Create Java/ Scala Spark jobs for data transformation and aggregation.
  • Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
  • Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.
  • Good understanding of the architecture and functioning of Distributed database systems.
  • Experience working with various file formats like Parquet, Avro, etc for large volumes of data.
  • Experience with one or more NoSQL databases.
  • Experience with AWS, GCP.
  • 5+ years of professional experience as a data or software engineer.

Why Join Us?

At Lifesight, we believe in growing togethernot just as a company, but as individuals.

We foster an environment where innovation, collaboration, and personal well-being are valued just as much as business success.

Beyond leveraging smart technology to solve complex challenges, we cultivate a workplace culture that prioritizes work-life balance and team camaraderie.

Heres What You Can Expect

  • Be part of one of the fastest-growing and most successful Marketing Measurement Platform making a global impact.
  • Join as an early team member, influencing key decisions on tech stack, product development, and strategies for building scalable solutions.
  • Work in small, agile teams within a non-bureaucratic, fast-paced environment.
  • Enjoy a culture of empowerment, where you have the space to achieve your objectives and drive meaningful impact.
  • Receive competitive compensation and benefits.
  • Thrive in a collaborative and engaging work environment that values professional growth and team bonding.

(ref:hirist.tech)

About the company

Lifesight is on a mission to empower businesses with advanced data intelligence. We are a fast-growing SaaS company helping brands leverage data & AI for better customer acquisition and retention. With 300+ customers across the US, Singapore, India, Australia, and the UK, we deal with petabytes of data and process 400TB+ daily to power attribution and measurement platforms.

Skills

python
pyspark
apache spark
kafka
airflow
presto
nosql
aws
gcp