Senior Backend Engineer

As a Software Engineer (Backend), you will be working on... Sundial's scalable and complex backend systems that powers its core Insights and Analytics layer. Including the data processing engines, APIs, and services. Building and optimising OLAP Engines and data pipelines using technologies like Trino, Spark, DuckDB, and SQL. You will work with highly concurrent OLAP systems which can scale across very large Data Lakes. Implementing efficient highly parallel data transformation and analytics features with Go, SQL, and Pandas, leveraging data science algorithms at scale. Designing and implementing event-driven architectures to support Sundial's highly responsive and scalable data infrastructure, including a sophisticated Query Management system that manages query state using event-driven processes. Building and enhancing Sundial's Multi-Tenant SaaS Data Platform in Public Cloud environments, leveraging technologies such as EKS, RDS (Postgres for semantic storage), OpenSearch, and EMR-based Livy for managing Spark jobs. Collaborating with customers and data teams to understand backend requirements, enhance data access, and ensure high availability and scalability, including working with data stored in Delta Lake format. Experience with similar formats like Iceberg or Hudi is also valuable. Designing and building backend systems and features from scratch at a rapid pace while maintaining high quality and reliability.

Sundial is a top VC-backed early-stage startup headquartered at San Francisco Bay Area, US with a second office in Bengaluru, India. Our founders are industry veterans Chandra Narayanan, previo usly Chief Data Scientist at Sequoia Capital, and Julie Zhuo, previously VP, Design and Research at Facebook, author of a bestselling management book. We are a small team of top talent, high caliber Engineers, Data Scientists, Designers and PMs (currently 36 in India, 4 in US) and rapidly growing. We are on a mission to help builders make meaningful use of data to fulfil their vision. Sundial automatically diagnoses a product's data to explain the "what" and the "why" to enable faster and better decision making.