Data Engineer

SID Global Solutions

Website: sidgs.com
Job details:
Job Title: Senior Data Engineer Job Summary We are seeking an experienced Senior Data Engineer to design, build, and maintain scalable data infrastructure and pipelines. This role requires close collaboration with data scientists, developers, and business stakeholders to ensure high data availability, quality, and reliability across the organization. Key Responsibilities Design, develop, and maintain scalable data pipelines to ingest, process, and store large volumes of data from multiple sources. Implement and manage ETL (Extract, Transform, Load) processes to convert raw data into structured, analytics-ready formats. Integrate data from diverse sources including databases, APIs, third-party systems, and data warehouses. Ensure data consistency, integrity, and reliability across various data platforms. Design, manage, and optimize databases, data warehouses, and data lakes. Write and optimize complex SQL queries, including joins across multiple databases and tables. Implement data quality checks, validation rules, and monitoring mechanisms. Troubleshoot and debug data pipeline issues to ensure uninterrupted data flow. Collaborate with data scientists, developers, and business stakeholders to gather requirements and deliver data solutions. Document data pipelines, workflows, and technical processes. Establish and enforce data engineering best practices, including coding standards, version control, and testing. Required Qualifications Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field (Master’s degree is a plus). 5+ years of experience in Data Engineering, Software Development, or related roles. Strong experience with data warehousing solutions such as: Amazon Redshift Google BigQuery Snowflake Azure Synapse Hands-on experience with ETL tools and frameworks such as: Apache Airflow Apache NiFi Talend Informatica Proficiency in SQL and relational databases (PostgreSQL, MySQL, SQL Server). Programming experience in Python, Java, or Scala. Familiarity with big data technologies like Hadoop, Spark, and Kafka. Strong understanding of data modeling and database design principles. Excellent problem-solving, analytical, and communication skills. Ability to manage multiple priorities in a fast-paced environment. Preferred Qualifications Consulting experience with reputed organizations. Experience with NoSQL databases (MongoDB, Cassandra). Knowledge of data visualization tools such as Tableau or Power BI. Exposure to cloud-based data platforms and modern data architectures. Click on Apply to know more.