Varaha IT Solutions
Website:
varahaitsolutions.com
Job details:
Senior Data Platform Engineer
On-Premises Enterprise Data Platform | Riyadh, Saudi Arabia
Experience 8+ Years
Job Location Riyadh, Saudi Arabia – Onsite
Engagement Client Site
Stay & Travel Managed by Client
Role Focus Enterprise Data Platform Setup, Integration & Operational Readiness
Role Overview
We are looking for an experienced Senior Data Platform Engineer with 8+ years of experience in enterprise data
platform engineering, infrastructure setup, configuration, integration, security and operationalization. The candidate will
be responsible for the end-to-end setup and operational readiness of an enterprise on-premises data platform
across Development, UAT and Production environments.
The ideal candidate should have prior hands-on experience setting up enterprise-grade data platforms involving
multiple technologies, with strong understanding of on-prem infrastructure, security, networking, high availability,
monitoring, logging, performance tuning, backup/recovery and platform governance.
This is a hands-on engineering role requiring close collaboration with Infrastructure, Network, Security, Database,
Application, Data Engineering and client teams.
Key Responsibilities
1. Enterprise Data Platform Setup
• Lead technical setup and configuration across Development, UAT and Production.
• Perform installation, configuration, integration and validation on on-premises infrastructure.
• Work with infrastructure and security teams to define server, storage, network, firewall and connectivity requirements.
• Prepare platform architecture and environment topology with appropriate Dev/UAT/Production segregation.
• Define platform setup standards, repeatable installation procedures and configuration baselines.
2. Technology Configuration & Integration
• Hands-on experience configuring and integrating enterprise data technologies including Informatica, Apache Spark,
Apache Iceberg, MinIO and Denodo.
• Configure Informatica services, repositories, connectivity and runtime components.
• Configure Spark clusters, resource management, execution and performance parameters.
• Configure Iceberg catalogs, table management, schema evolution, partitioning and data lifecycle capabilities.
• Configure MinIO object storage, buckets, access policies and integrations.
• Configure Denodo virtualization, connectivity, security and platform integration.
• Ensure all platform components operate as an integrated enterprise data platform.
3. Security & Access Management
• Implement platform security in accordance with enterprise/client standards and least-privilege principles.
• Configure authentication, authorization, RBAC, service accounts and secure credential management.
• Coordinate firewall, network segmentation, TLS/SSL certificates, encryption and security hardening.
• Support vulnerability assessment, remediation and security clearance activities.
• Ensure Production access is appropriately restricted and controlled.
4. Environment & Configuration Management
• Establish consistent configurations across Dev, UAT and Production while maintaining environment-specific
parameters.
• Implement configuration and version control wherever applicable.
• Establish controlled promotion processes from Dev ® UAT ® Production.
• Maintain installation, configuration, deployment and change-management documentation.
5. Observability, Monitoring & Logging
• Implement infrastructure, application/platform, cluster, resource, job/workflow and service-health monitoring.
• Establish centralized logging, audit/security logging, dashboards, alerts, thresholds and notification mechanisms.
• Monitor CPU, memory, storage, network, service availability and platform SLAs.
• Define operational monitoring and alert response procedures for Production.
6. High Availability, Backup & Disaster Recovery
• Participate in HA architecture and availability planning.
• Define and configure backup/recovery for platform configuration, metadata, repositories, catalogs, object storage and
critical components.
• Support Disaster Recovery planning, restoration exercises and DR testing.
• Define and document RPO/RTO considerations.
7. Performance & Capacity Management
• Perform platform sizing and capacity planning for compute, memory, storage and network.
• Tune Spark and platform components for performance.
• Monitor utilization, identify bottlenecks and recommend improvements.
• Support performance testing and benchmarking.
8. Platform Integration
• Configure secure connectivity between platform components and enterprise systems.
• Work with database, API, storage, network and application teams for integration.
• Troubleshoot authentication, connectivity, network and platform integration issues.
9. Production Readiness
• Lead/support installation, configuration, security, connectivity and performance validation.
• Validate monitoring, alerting, backup/restore and failover capabilities.
• Prepare runbooks, support procedures and operational readiness documentation.
• Conduct knowledge transfer to operations/support teams.
10. Documentation & Knowledge Transfer
• Prepare architecture, environment topology, installation, configuration, infrastructure sizing and security documents.
• Maintain integration/connection details, operational runbooks, monitoring guides, backup/recovery procedures,
troubleshooting guides and DR procedures.
• Prepare Production deployment procedures and knowledge-transfer materials.
Required Technical Skills
Primary Skills – Mandatory
• 8+ years of experience in Data Platform, Platform Engineering or Infrastructure Engineering.
• Proven experience in enterprise data platform setup and implementation.
• Strong experience with on-premises platform deployment.
• Hands-on experience with enterprise data technologies such as Informatica, Apache Spark, Apache Iceberg, MinIO
and Denodo.
• Experience setting up multiple environments – Dev, UAT and Production.
• Strong understanding of Linux/Unix environments.
• Strong understanding of DNS, TCP/IP, firewall, load balancer, proxy, ports and TLS/SSL.
• Experience with security hardening and enterprise access management.
• Experience with platform monitoring, logging and observability.
• Experience with configuration/version control and Production deployment.
• Strong troubleshooting and root-cause-analysis skills.
Secondary / Good-to-Have Skills
• Kubernetes / OpenShift; Docker / containerization.
• Git / GitLab / Bitbucket; CI/CD pipelines.
• Ansible / Terraform or other infrastructure automation tools.
• Python / Shell scripting and Linux administration.
• Prometheus / Grafana; ELK / OpenSearch or equivalent centralized logging.
• HashiCorp Vault or enterprise secrets management.
• LDAP / Active Directory; Kerberos.
• Apache Ranger or equivalent data security/governance tools.
• Kafka; PostgreSQL / Oracle / SQL Server.
• Data governance and metadata platforms.
• Enterprise scheduler/workflow platforms.
• ITIL / ITSM processes, vulnerability management and security compliance.
• Backup and disaster recovery technologies.
Enterprise Platform Engineering Experience
Candidates should have demonstrated experience in at least one large-scale enterprise platform implementation
involving:
• Multiple environments and multiple technology components
• On-premises infrastructure
• Enterprise security controls and network/firewall integration
• High availability, monitoring and observability
• Production deployment and operational support
• Backup and disaster recovery
• Performance and capacity management
• Operational handover
Preferred Industry Experience
Experience working with large organizations, government entities, banking/financial services, telecom or other highly
regulated environments will be preferred.
Soft Skills
• Strong communication and stakeholder management skills
• Ability to work with distributed technical teams
• Ability to independently troubleshoot complex platform issues
• Strong documentation and client-facing communication skills
• Ability to collaborate with Infrastructure, Network, Security and Application teams
• Strong ownership and problem-solving mindset
• Comfortable working onsite in Riyadh
• Ability to work across multiple technology teams and vendors
• Ability to work under tight project timelines and Production delivery milestones
Education & Certifications
Bachelor's degree in Computer Science, Information Technology, Engineering or a related field. Relevant certifications
in Cloud, Data Engineering, Linux, Kubernetes, Informatica, Data Platform or Infrastructure Engineering are an
advantage.
Key Expected Deliverables
• 1. Dev environment setup and readiness
• 2. UAT environment setup and readiness
• 3. Production environment setup and readiness
• 4. Informatica platform installation and configuration
• 5. Spark platform setup and configuration
• 6. Iceberg platform/catalog configuration
• 7. MinIO object storage setup and configuration
• 8. Denodo platform setup and configuration
• 9. Platform-to-platform integration
• 10. Security hardening and access configuration
• 11. Monitoring and observability implementation
• 12. Centralized logging and alerting
• 13. Backup and recovery configuration
• 14. Performance and capacity validation
• 15. Production readiness assessment
• 16. Operational runbooks and technical documentation
• 17. Knowledge transfer to client/operations teams
Important Requirement
Candidates should have prior hands-on experience setting up and operationalizing enterprise-grade platforms in an on-premises environment. This is not a purely development or data engineering role. Strong platform/infrastructure engineering experience with hands-on installation, configuration, integration, security, monitoring and Production
Click on Apply to know more.
