Website:
scoutit.in
Job details:
We're looking for
Data Operations Engineers!
Responsibilities
- Collaborate with developers, data scientists, and DevOps engineers.
- Maintain up-to-date documentation on data architecture, procedures, and standards.
- Provide training or onboarding support for other teams on database tools.
- Design, implement, and maintain optimal database schemas for relational (MariaDB) and NoSQL (MongoDB) databases.
- Participate in data modeling efforts to support analytics in Databricks.
- Monitor and tune performance across all platforms to ensure optimal performance.
- Use profiling tools (e.g., query plans, system logs) to identify and resolve bottlenecks.
- Implement access controls, encryption, and database hardening techniques.
- Manage user roles and privileges across MariaDB, MongoDB, and Databricks.
- Ensure compliance with data governance policies (e.g., GDPR, HIPAA).
- Implement and maintain backup/recovery solutions for all database platforms.
- Periodically test restore procedures for business continuity.
- Support and optimize ETL pipelines between MongoDB, MariaDB, and Databricks.
- Work with data engineers to integrate data sources for analytics.
- Set up and monitor database alerts.
- Troubleshoot incidents, resolve outages, and perform root cause analysis.
- Administer MariaDB instances (standalone, replication, Galera Cluster).
- Optimize SQL queries and indexing strategies.
- Maintain stored procedures, functions, and triggers.
- Manage schema migrations and upgrades with minimal downtime.
- Ensure ACID compliance and transaction management.
- Manage replica sets and sharded clusters.
- Perform capacity planning for large document collections.
- Tune document models and access patterns for performance.
- Set up and monitor MongoDB Ops Manager / Atlas (if used).
- Automate backup and archival strategies for NoSQL data.
- Manage Databricks workspace permissions and clusters.
- Collaborate with data engineers to optimize Spark jobs and Delta Lake usage.
- Ensure proper data ingestion, storage, and transformation in Databricks.
- Support CI/CD deployment of notebooks and jobs.
- Integrate Databricks with external data sources (MariaDB, MongoDB, S3, ADLS)
Skills
- MariaDB Tools : MySQL dump, MySQL admin, Percona Toolkit
- MongoDB Tools : mongo dump, mongo top, mongo export, Atlas UI
- Databricks Tools : Jobs UI, Databricks CLI, REST API, SQL Analytics
- Scripting : Bash, Python, PowerShell
- Monitoring : Prometheus, Grafana, CloudWatch, Data Dog
- Version Control & CI/CD : Git, Jenkins, Terraform (for infrastructure-as-code)
- Preferred CLoud provider: AWS
(
*Note: This is a requirement for one of Scoutit's clients)
Skills: database,analytics,mongodb
Click on Apply to know more.