Flipped.ai - Transforming Talent Acquisition with AI
Website:
flipped.ai
Job details:
Job Description
Role : Senior Data Engineer (GCP)
Role Overview
We are seeking a highly skilled Senior Data Engineer with 5-10 years of experience to join our data engineering team. You will be responsible for designing, developing, and maintaining robust ETL frameworks and scalable data architectures on Google Cloud Platform (GCP). This role is a Hybrid position based in Pune, Chennai, Hyderabad, or Bangalore.
Key Details
Experience : 5 - 10 Years
Locations : Pune | Chennai | Hyderabad | Bangalore
Notice Period : Immediate to March joiners only
Interview Date : Face-to-Face (F2F) on 28th Feb
Key Responsibilities
- Pipeline Development : Design, develop, and deploy robust, scalable, and reusable ETL/ELT pipelines using the GCP framework.
- Data Architecture : Implement and manage Data Lake and Data Warehouse solutions, ensuring data integrity and high-performance querying.
- Cloud Engineering : Leverage the full spectrum of GCP services, including BigQuery, Dataproc, Dataflow, Cloud Fusion, Cloud Composer (Airflow), Pub/Sub, Cloud Functions, and Kubernetes (GKE).
- Data Transformation : Write complex, optimized BigQuery SQL and develop transformation logic using Python/PySpark.
- Optimization : Ensure efficient data modeling, partitioning, and clustering within BigQuery to optimize cost and performance.
- Collaboration : Act as a proactive team player, collaborating with cross-functional teams to deliver end-to-end data solutions.
Required Technical Skills
- GCP Core : Extensive hands-on experience with BigQuery architecture, different data types, and storage optimization.
- Programming : Strong proficiency in Python and PySpark.
- SQL : Expert-level knowledge of BigQuery SQL.
- Orchestration : Experience with Cloud Composer or Apache Airflow for workflow management.
- Streaming/Batch : Proficiency in Dataflow (Apache Beam) and Pub/Sub.
Preferred / Added Advantages
- Banking Domain : Previous experience working within the Banking or Financial Services sector.
- Modern Data Stack : Hands-on experience with DBT (Data Build Tool) and solutioning skills.
- DevOps : Familiarity with Jenkins CI/CD pipelines and Git repository management.
- Certification : Valid Google Professional Data Engineer certification.
Behavioral Competencies
- Excellent communication and interpersonal skills.
- Proactive approach to problem-solving and technical roadblocks.
- Ability to mentor junior engineers and contribute to team growth.
(ref:hirist.tech)
Click on Apply to know more.