ThreatXIntel
Website:
threatxintel.com
Job details:
Company Description
ThreatXIntel is a growing Cybersecurity, IT Staffing, and Consulting company delivering end-to-end technology and security solutions.
We are hiring for our corporate client. ThreatXIntel is the official hiring partner for this requirement.
Job Overview
We are looking for a Data Engineer with strong hands-on experience in GCP and Databricks, along with exposure to Azure data services.
The ideal candidate should be capable of building scalable data pipelines, data platforms, and cloud-based data solutions, and should be ready to join immediately (within 2 days).
Immediate joiners are mandatory (0–2 days only)
Key Responsibilities
Data Engineering & Development
- Build and maintain ETL/ELT pipelines on GCP and Databricks
- Work with BigQuery, Dataproc / Spark, and cloud storage systems
- Develop scalable data processing solutions using PySpark / SQL
Databricks & Lakehouse
- Design and implement Databricks-based data pipelines
- Work with Delta Lake and Lakehouse architecture concepts
Azure Exposure
- Work with Azure Data Services (ADF, Synapse, Data Lake – good to have)
Pipeline & Integration
- Integrate data from multiple sources into enterprise platforms
- Ensure data quality, performance, and scalability
Collaboration
- Work with cross-functional teams (analytics, engineering, business)
- Support production systems and troubleshoot pipeline issues
Required Skills (Mandatory)
- Strong experience in GCP Data Services (BigQuery, Dataproc / Spark)
- Hands-on experience with Databricks
- Strong programming skills in Python / PySpark / SQL
- Experience in ETL/ELT pipeline development
- Knowledge of data modeling and data warehousing concepts
Nice to Have
- Experience with Azure Data Factory / Synapse / Data Lake
- Exposure to real-time data processing (Pub/Sub, Kafka, etc.)
- Experience with CI/CD pipelines
Click on Apply to know more.