Website:
tekgrove.com
Job details:
Cloud Data Engineer (Azure) – 2+ Years Experience
Experience: 2+ Years
Location: Hyderabad/Bangalore/Chennai/Pune (Hybrid/Remote as applicable)
Employment Type: Full-Time
Job Summary
We are seeking a highly motivated Cloud Data Engineer with 2+ years of experience in designing and developing modern cloud-based data solutions. The ideal candidate should have hands-on experience with Azure, Databricks, Snowflake, CI/CD, Terraform, Kafka, APIs, GraphQL, and exposure to Generative AI technologies. The candidate will be responsible for building scalable data pipelines, integrating enterprise applications, and supporting cloud-native data platforms.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Build and optimize ETL/ELT workflows for structured and semi-structured data.
- Develop and manage cloud data warehouses using Snowflake.
- Implement data ingestion pipelines using Kafka, REST APIs, and GraphQL APIs.
- Develop infrastructure as code (IaC) using Terraform.
- Configure and maintain CI/CD pipelines for automated deployments using Azure DevOps or GitHub Actions.
- Integrate multiple enterprise applications through RESTful APIs and GraphQL.
- Work with Azure cloud services such as Azure Data Factory, Azure Storage, Azure SQL, Key Vault, and Azure Functions.
- Optimize data processing jobs for performance, scalability, and cost.
- Collaborate with data scientists and application teams to enable AI/ML and Generative AI use cases.
- Implement data quality, governance, security, and monitoring best practices.
- Troubleshoot production issues and provide timely resolutions.
Required Skills
- 2+ years of experience as a Data Engineer or Cloud Data Engineer.
- Strong experience with Azure Cloud Services.
- Hands-on experience with Azure Databricks.
- Experience working with Snowflake Data Warehouse.
- Experience developing CI/CD pipelines using Azure DevOps or GitHub Actions.
- Hands-on experience with Terraform for infrastructure automation.
- Experience with Apache Kafka for real-time data streaming.
- Good understanding of REST APIs and GraphQL.
- Experience integrating cloud services through APIs.
- Knowledge of SQL and Python.
- Familiarity with Git version control.
Preferred Skills
- Exposure to Generative AI (Gen AI) services such as Azure OpenAI, OpenAI APIs, or LangChain.
- Experience with Vector Databases and Retrieval-Augmented Generation (RAG).
- Knowledge of Spark, Delta Lake, and Data Lake architecture.
- Experience with Docker and Kubernetes is an added advantage.
- Understanding of data governance and security best practices.
Technical Skills
- Cloud: Microsoft Azure
- Data Engineering: Azure Databricks, Snowflake
- Programming: Python, SQL
- Streaming: Apache Kafka
- Infrastructure as Code: Terraform
- CI/CD: Azure DevOps, GitHub Actions
- API Technologies: REST API, GraphQL
- Version Control: Git
- Generative AI: Azure OpenAI, OpenAI APIs, LangChain (preferred)
Educational Qualification
- Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
Nice to Have
- Azure Certifications (AZ-900, DP-203, AZ-204)
- Snowflake SnowPro Certification
- Experience with Agile/Scrum methodology
- Knowledge of monitoring tools such as Azure Monitor, Log Analytics, or Application Insights
Click on Apply to know more.