Website:
thewhiteboard.co.in
Job details:
Data Engineer – GCP
- Experience: 6 - 8 years
- Primary Skills: GCP, BigQuery, Dataflow, Dataform, Airflow, Datastream, SQL, Python
- Notice Period: Immediate
- Location: Chennai
Job Description – Data Engineer (GCP)
Role: Data Engineer
Experience: 5 + Years
Location: Chennai / Bangalore / Pune / Coimbatore
Work Mode: Hybrid
About the Role
Infiligence is a Healthcare and Life Sciences data and platform-engineering firm. We design and build governed data platforms on Google Cloud that consolidate diverse clinical, operational, and real-world data into modern lakehouse architectures — powering analytics, reporting, and AI/ML for our clients. We are hiring a Data Engineer to design, build, and operate ELT pipelines and data-governance capabilities across our engagements.
What You’ll Do
• Design, build, and maintain ELT pipelines on GCP (ingestion through curated layers) using BigQuery, Dataform/Dataflow, and Cloud Composer.
• Ingest data from diverse sources — streaming (Pub/Sub), batch and file-based (Cloud Storage), and healthcare interoperability formats (FHIR/HL7 via the Healthcare API).
• Implement data-quality controls (schema validation, completeness, deduplication, referential integrity) and end-to-end data lineage.
• Apply data protection and governance — de-identification/tokenization (Cloud DLP with KMS/CMEK) and row- and column-level access controls.
• Model curated datasets (medallion / lakehouse and dimensional) for analytics, reporting, and downstream AI/ML.
• Build incremental and change-data-capture (CDC) loads and optimize for cost and performance (partitioning, clustering, query efficiency).
• Establish observability (monitoring, alerting) and CI/CD for data pipelines, and maintain metadata and catalog documentation.
• Collaborate with data architects, analysts, and stakeholders to translate requirements into reliable, well-documented data products.
Required Qualifications
• 4+ years of data-engineering experience with hands-on Google Cloud.
• Strong SQL and Python.
• GCP data stack: BigQuery (core), plus working experience with several of — Dataflow, Dataform, Pub/Sub, Cloud Storage, Cloud Composer/Airflow, Dataplex, and Cloud IAM.
• ELT/ETL pipeline design (batch; streaming a plus) and solid data modeling (medallion / lakehouse / dimensional).
• Data-quality and pipeline-reliability practices; proficiency with Git and CI/CD for data pipelines.
• Strong communication skills and the ability to work through ambiguity.
Nice to Have (A Plus)
• Other cloud/data stacks: AWS (Glue/Redshift/S3), Azure (Synapse/ADF), Databricks, or Snowflake.
Platform Engineering Company
• Transformation & IaC: dbt (in addition to Dataform); Terraform or other infrastructure-as-code.
• Healthcare/life-sciences data standards: CDISC SDTM/ADaM, FHIR/HL7, EDC/ePRO/CTMS, and real-world data/claims.
• Compliance exposure: HIPAA, 21 CFR Part 11, GxP, and de-identification/tokenization patterns.
• Security & governance: VPC Service Controls, CMEK, and Dataplex lineage/quality.
• BI & serving: Looker / LookML.
• AI/ML adjacency: Vertex AI, Feature Store, RAG/semantic layers, or AI-orchestrated (agentic) data pipelines.
Education
Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
Click on Apply to know more.
