Website:
bytenex.ai
Job details:
Client: Leading US-based Data Consulting Firm
Experience: 2–5 Years
Engagement: Contractual (6 Months, potential extension)
ByteNex is seeking a Databricks Developer to support a large-scale cloud data modernization program for a global consulting client. This role will focus on building scalable data pipelines, enabling advanced analytics, and contributing to enterprise data platform initiatives leveraging the Databricks Lakehouse architecture.
Key Responsibilities
- Design and develop scalable data pipelines using Databricks and Spark.
- Build and maintain ETL/ELT workflows to ingest, transform, and curate large datasets.
- Collaborate with data architects and stakeholders to implement robust data solutions aligned with business needs.
- Optimize workloads for performance, scalability, and cost efficiency within cloud environments.
- Implement data quality checks, monitoring, and logging frameworks.
- Support data integration across multiple sources including APIs, databases, and streaming platforms.
- Contribute to documentation, standards, and continuous improvement initiatives.
Required Qualifications
- 2–5 years of experience in data engineering or big data development.
- Hands-on experience with Databricks, Apache Spark (PySpark/Scala), and distributed data processing.
- Strong SQL skills and understanding of data modeling concepts.
- Experience working in cloud platforms such as AWS, Azure, or GCP.
- Familiarity with building batch and/or streaming data pipelines.
- Understanding of data governance and best practices in enterprise environments.
- Ability to work in agile delivery models with cross-functional teams.
Preferred Skills
- Experience with Delta Lake and Lakehouse architecture.
- Exposure to orchestration tools such as Airflow or Azure Data Factory.
- Knowledge of CI/CD pipelines and DevOps practices for data workflows.
- Experience with Python for data processing.
- Familiarity with BI tools like Power BI, Tableau, or Looker.
Why This Opportunity
- Work on enterprise data transformation initiatives with global impact.
- Exposure to modern big data and cloud technologies.
- Collaborative environment with strong technical mentorship.
- Opportunity for contract extension and long-term engagement.
#Databricks #DataEngineering #BigData #Hiring #ContractRole #ByteNex #Lakehouse
Click on Apply to know more.