Flag job

Report

Data Engineer

Min Experience

2 years

Location

Pune (Maharashtra)

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

Why This Role Matters - Successful candidates will collaborate closely with various teams to transform data into essential information and knowledge. This will be used to make informed business decisions and improve business processes. You will gain a deep understanding of the cybersecurity industry and will be responsible for the upkeep and smooth operation of tools that process data from diverse platforms. This role will support our software developers, database architects, analytics engineers, business analysts, and data scientists on their data projects, ensuring consistent and optimal data delivery throughout ongoing work. You will also manage data integration between internal and external applications within our environment. Your Daily Tasks - Work with multiple developer teams. Develop complex SQL Queries, including performance tuning in Snowflake, Postgres, and SQL Server environments. Develop in Python using an object-oriented approach to efficiently create jobs for ingesting raw data, transforming it, and creating application integrations. Ingest raw data using Python with Snowflake, Postgres, MySQL, Elasticsearch, SQL Server, APIs, and various other sources and destinations. Create models in dbt (Data Build Tools). Create and optimize tables, indexes, stored procedures, views, and functions in Snowflake, Postgres, and SQL Server. Create Argo CRON Workflows for job orchestration. Contribute to multiple GitLab Repositories. Make basic GitLab CI/CD changes and modifications. Work with Docker containers for development and modify existing Dockerfiles. Work with internal tools deployed on Kubernetes (EKS) Pods. Be responsible for the design, development, implementation, and maintenance of Snowflake and Postgres databases. Develop and interpret database models. Identify, design, and implement internal process improvements, such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability. May need to work outside of regular hours to meet business objectives if required.

About the company

About ReliaQuest - ReliaQuest's purpose is to Make Security Possible, enabling security teams to find, contain, and respond to threats quickly - at any time and from any location. Our GreyMatter platform allows enterprise security teams to use their existing or future security technologies to gain better visibility and automation without needing to centralize data or standardize tools. With over a decade of experience, ReliaQuest is the only large-scale cybersecurity technology company at the enterprise level that offers choice and flexibility, effectively making the customer the platform. Our Global Reach - With more than 1,000 customers worldwide and a team of 1,200 across six global operating centers, ReliaQuest delivers security results for many of the world's most trusted enterprise brands.

Skills

sql
python
snowflake
postgres
sql server
dbt
gitlab
docker
kubernetes