Website:
hrfy.ai
Job details:
JOB TITLE: Senior Data Engineer
LOCATION: Pune
EMPLOYMENT TYPE: Full Time
EXPERIENCE REQUIRED: 3+ Years
ABOUT THE ROLE:
We are seeking a Senior Data Engineer with 3+ years of hands-on experience in building and optimizing large-scale data systems, with strong expertise in Databricks. The ideal candidate has deep experience in designing cloud-based data architectures, building high-performance data pipelines, and enabling analytics and machine learning use cases.
You will be responsible for architecting scalable data platforms, leading complex data initiatives, and collaborating with cross-functional teams to deliver reliable, secure, and production-ready data solutions.
KEY RESPONSIBILITIES:
• Design, build, and optimize scalable data pipelines using Databricks
• Develop and maintain Spark and PySpark jobs for large-scale data processing
• Implement ETL/ELT workflows for structured and semi-structured data
• Architect modern data lakehouse solutions using Databricks
• Design data models to support analytics, BI, and ML use cases
• Integrate cloud storage solutions such as AWS S3 or Azure Data Lake
• Implement data orchestration using tools like Airflow or Databricks Workflows
• Ensure data quality, governance, security, and compliance standards
• Monitor performance and optimize jobs for cost and scalability
• Collaborate with analytics, product, and engineering teams
• Mentor junior engineers and participate in code reviews
SKILLS REQUIRED:
• Strong expertise in Databricks and Lakehouse architecture
• Hands-on experience with Apache Spark and PySpark
• Proficiency in SQL and advanced data modeling concepts
• Experience with cloud platforms such as AWS or Azure
• Experience building scalable ETL/ELT pipelines
• Understanding of Delta Lake and data versioning
• Knowledge of data warehousing concepts and performance tuning
• Experience with orchestration tools such as Airflow
• Strong problem-solving and debugging skills
• Ability to lead technical discussions and guide teams
PREFERRED QUALIFICATIONS:
• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
• Experience working with large datasets in distributed environments
• Exposure to CI/CD pipelines for data engineering
• Familiarity with data governance and security best practices
• Experience supporting ML or AI-driven data workloads
KEY ATTRIBUTES:
• Ownership mindset and accountability
• Strong communication and stakeholder management skills
• Attention to detail and quality focus
• Continuous learning attitude and adaptability
This role is ideal for a Data Engineer who wants to take ownership of scalable data platforms and drive high-impact data initiatives using Databricks.
Click on Apply to know more.