Senior Data Engineer

Overview

Company name: Saltmine | HQ Location: San Francisco, California | Website | LinkedIn

Role: Senior Data Engineer

• Salary: Rs. 40-65 lakhs per annum
• Experience: 6-9 years
• Location: Bangalore (Hybrid)
• Type: Full-time

Saltmine is looking for a highly skilled Senior Data Platform Engineer to join our growing team. You will play a critical role in building and scaling our data platform to support complex data processing and analytics needs. As part of this role, you will lead the design and development of scalable systems that handle large volumes of batch and real-time data, enabling data-driven insights and business decisions across the company. This is an exciting opportunity for someone who is passionate about cutting-edge data technologies, cloud-native environments, and driving business impact through data infrastructure.

Key Responsibilities:

1. Data Platform Design and Development:
   Architect, build, and maintain a scalable and reliable data platform that supports batch processing, real-time data streams, and advanced analytics. Ensure the platform can handle the growing needs of the business in a cost-efficient and performance-optimized manner.
2. Data Pipeline Management:
   Develop and manage ETL/ELT pipelines to support data ingestion, transformation, and distribution across the organization. Ensure that these pipelines are scalable, resilient, and optimized for performance.
3. Real-Time Data Processing:
   Design and implement real-time data processing solutions using tools like Apache Kafka and Apache Flink, ensuring low-latency, high-throughput data streams for business-critical applications.
4. Data Storage Optimization:
   Lead the design and optimization of data lakes and data warehouses. Ensure efficient data storage, retrieval, and cost management in cloud environments.
5. System Reliability and Monitoring:
   Implement monitoring solutions and data quality frameworks to ensure the accuracy, reliability, and security of data. Proactively identify and resolve performance bottlenecks and data pipeline issues.
6. Collaboration and Cross-Team Support:
   Collaborate with data scientists, analysts, and product teams to understand business requirements and deliver scalable data solutions. Ensure that the platform supports both current and future data use cases.
7. Data Security and compliance:
   Implement and champion data security and compliance measures to ensure data integrity and privacy
8. Technical Leadership:
   Provide technical leadership and mentorship to junior engineers. Promote best practices in system design, coding, and deployment processes across the team.
9. Automation and Infrastructure as Code (IaC):
   Automate data infrastructure management and deployments using tools like Terraform and Ansible, ensuring consistency, repeatability, and reduced operational overhead.

Required Qualifications

1. 6+ years of hands-on experience in data platform engineering, with expertise in architecting and maintaining scalable data platforms.
2. Proven experience designing and implementing both batch and real-time data pipelines in cloud environments (AWS preferred).
3. Deep expertise in distributed data processing frameworks (e.g., Apache Spark, Presto) and real-time streaming technologies (Kafka, Flink).
4. Experience with modern data lake architectures and table formats like Hudi, Iceberg, or Delta Lake.
5. Strong hands-on programming skills in Python and/or Java, with the ability to build robust, scalable, and maintainable code for complex data systems
6. Hands-on SQL and/or NoSQL experience
7. Hands-on experience with Infrastructure as Code (Terraform or Ansible) for managing cloud infrastructure.
8. Experience in performance tuning and optimization of large-scale data systems.
9. Proficient in scoping and prioritizing tasks, focusing on delivering incremental improvements, while remaining flexible and responsive to evolving project needs.
10. Excellent communication and leadership skills, with a track record of mentoring junior engineers.
11. Bachelor’s/Master's degree in Computer Science, Engineering, or a related field

Preferred Qualifications

1. Experience with DataOps and CI/CD pipelines in data engineering
2. Experience in building data platforms from bottom up
3. Knowledge of Kubernetes is a significant plus
4. Experience in a startup environment, with a willingness to innovate and adapt to changing business needs.

About us

Saltmine is a rapidly growing technology firm in the Commercial Real Estate space disrupting the $300B workspace design-build market. We are applying modern technology to transform the process by which office design is done from workplace strategy to programming to design and procurement. With deep roots in technology and architecture design, we've built a first of its kind SaaS platform that empowers occupiers and their business partners to design inspiring and efficient spaces. The company is headquartered in San Francisco with offices in NYC, Boston, Budapest, Vietnam, and Singapore, with an incredibly talented group of employees. We have closed our Series A funding round from marquee VC firms from Singapore & USA.