Wissen Infotech
Website:
wissen.com
Job details:
Wissen Technology is Hiring for Lead Databricks Developer
About Wissen Technology:
At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset—ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge technology expertise, and a relentless focus on quality. We don’t just meet expectations—we exceed them by ensuring faster time-to-market, reduced rework, and greater alignment with client objectives. We have a proven track record of building mission-critical systems across industries, including financial services, healthcare, retail, manufacturing, and more. Wissen stands apart through its unique delivery models. Our outcome-based projects ensure predictable costs and timelines, while our agile pods provide clients with the flexibility to adapt to their evolving business needs. Wissen leverages its thought leadership and technology prowess to drive superior business outcomes. Our success is powered by top-tier talent. Our mission is clear: to be the partner of choice for building world-class custom products that deliver exceptional impact—the first time, every time.
Job Summary: We are seeking an experienced Lead Databricks Developer with deep expertise in Spark, PySpark, and SQL to design, build, and optimize large-scale data processing solutions. The ideal candidate will have strong hands-on experience in cloud-based data environments (preferably AWS) and will be capable of leading end-to-end data engineering initiatives. This role involves collaborating with cross‑functional teams, ensuring high data quality, and building robust pipelines to support business analytics and data-driven decision-making.
Experience: 8- 12 Years
Location: Bangalore
Mode of Work: Full time
Key Responsibilities:
- Design, develop, and maintain scalable data processing applications using Python, PySpark, and Apache Spark.
- Work in cloud-based environments—AWS preferred, with flexibility to work on Azure Databricks.
- Collaborate closely with data engineers, data scientists, analysts, and business stakeholders to understand requirements and deliver effective solutions.
- Ensure data integrity, reliability, and performance across data pipelines and workflows.
- Write clean, well-structured, and maintainable code following industry best practices.
- Perform exploratory data analysis and implement data validation frameworks.
- Monitor and troubleshoot performance bottlenecks in Spark jobs and data workflows.
- Implement and manage CI/CD pipelines for automated build, test, and deployment of data pipelines.
- Optimize data pipelines for cost, performance, and scalability in cloud environments.
Requirements:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 8–12 years of experience in data engineering with a strong focus on Databricks and Spark/PySpark.
- Strong proficiency in SQL and experience working with relational databases.
- Advanced hands‑on experience in Python for data engineering.
- Solid understanding of cloud platforms (AWS preferred; Azure Databricks acceptable).
- Experience with Git or other version control systems.
- Strong analytical thinking, debugging, and problem‑solving skills.
- Excellent communication and cross‑team collaboration abilities.
Good To Have Skills:
- Experience with Delta Lake, Unity Catalog, or advanced Databricks features.
- Exposure to data warehousing concepts and dimensional modeling.
- Familiarity with Airflow, Glue, or other workflow orchestration tools.
- Knowledge of data security, governance, and compliance best practices.
- Understanding of DevOps, containerization (Docker), or Kubernetes.
- Experience integrating Databricks with BI tools (Power BI, Tableau, etc.).
- Knowledge of machine learning workflows or MLOps within Databricks is a plus.
Wissen Sites:
Website: www.wissen.com
LinkedIn: https://www.linkedin.com/company/wissen-technology
Wissen Leadership: https://www.wissen.com/company/leadership-team/
Click on Apply to know more.