GyanSys Inc.
Website:
gyansys.com
Company:
https://www.linkedin.com/company/gyansys
Seniority: Mid-Senior level
Industries: IT Services and IT Consulting
Job details:
Databricks Engineer / Consultant
About GyanSys
GyanSys is a global systems integrator and technology consulting company that helps enterprises accelerate digital transformation through SAP, Cloud, Data & Analytics, AI, and Intelligent Automation solutions. We partner with leading technology providers to deliver innovative, scalable, and business-driven solutions across diverse industries worldwide.
Databricks Engineer / Consultant
Location: Bengaluru | Pune | Hyderabad
Employment Type: Full-Time
Job Summary
GyanSys is looking for skilled Databricks Engineers/Consultants to join our growing Data & Analytics practice. The ideal candidate will have hands-on experience in designing, developing, and optimizing scalable data engineering solutions using the Databricks Lakehouse Platform. You will work closely with solution architects, business stakeholders, and cross-functional teams to build robust data pipelines that support enterprise analytics, reporting, and AI initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and PySpark.
- Build and optimize data pipelines for structured, semi-structured, and unstructured data.
- Develop data transformation workflows using Databricks Notebooks, Spark SQL, and Delta Lake.
- Optimize Spark jobs and Databricks clusters for performance and cost efficiency.
- Integrate data from multiple enterprise sources, including databases, APIs, cloud storage, and ERP systems.
- Collaborate with data architects, business analysts, and data scientists to deliver business-focused data solutions.
- Ensure data quality, governance, security, and compliance across data platforms.
- Implement CI/CD best practices and support deployment of Databricks solutions.
- Troubleshoot production issues and continuously improve platform performance.
- Create technical documentation and support knowledge-sharing initiatives.
Required Technical Skills
- Hands-on experience with Databricks Lakehouse Platform
- Strong expertise in PySpark, Apache Spark, Spark SQL, and Python
- Experience with Delta Lake, Databricks Workflows, and Unity Catalog
- Strong understanding of ETL/ELT, Data Warehousing, and Data Modeling
- Experience with Azure, AWS, or GCP cloud platforms
- Knowledge of Git, Azure DevOps/GitHub, and CI/CD practices
- Experience working with SQL Server, Oracle, PostgreSQL, Snowflake, or similar databases
Preferred Skills
- Experience with Medallion Architecture and Lakehouse concepts
- Exposure to Kafka, Event Hubs, or other streaming technologies
- Knowledge of Power BI or Tableau
- Understanding of Agile/Scrum methodologies
- Exposure to Microsoft Fabric is an added advantage
Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Experience
- Domain Experience: 3–5 Years
- Relevant Experience: 0–8+ Years
Preferred Certifications
- Databricks Certified Data Engineer (Associate/Professional)
- Microsoft Azure Data Engineer Associate
- AWS Certified Data Analytics – Specialty
- Google Professional Data Engineer
Why Join GyanSys?
At GyanSys, you'll work on enterprise-scale digital transformation programs leveraging modern cloud and data technologies. We provide a collaborative environment, continuous learning opportunities, and exposure to global clients, enabling you to build innovative solutions while accelerating your professional growth.
Click on Apply to know more.
