NovusPlatform.io
Website:
novusplatform.io
Job details:
Company Description
- NovusPlatform.io is a service startup revolutionizing the traditional IT ecosystem with expertise in cutting-edge technologies.
- We are looking for Senior Platform Engineers who can actively support our platform engineering team.
Duties and Responsibilities:-
Must Do:-
- Showcase the ability to learn new technologies at a fast pace, as the technology stack in the Data team evolves very rapidly.
- You should be ready to move out of your comfort zone and face new challenges.
- While onboarding the new stack, think 365 degrees, and consider all scenarios in usage/reusability, scalability, deployment, integration, maintenance, and automation.
- Showcase strong proficiency in programming in 1 language (Python, Scala, Java, or any) and showcase the ability to learn new languages if required by a new technology stack.
- Showcase ability to build and maintain ETL pipelines and data-driven systems using any Data Tech example - Apache Spark, AWS Glue, Athena, Redshift, AWS Batch.
- Showcase a strong grip on writing complex SQL queries.
- Develop code on GitHub with end-to-end knowledge of advanced git operations, such as git-flow, rebasing, and squashing.
Should be able to learn and implement:-
- Should be able to implement Infra as code using Terraform
- Should be able to learn and use AWS Analytics and Data Services like Glue, S3, Lambda, AWS Batch, Athena, Redshift, Dynamo DB, Cloudwatch, Kinesis, SQS, SNS, and DMS
- Using Jenkins to implement deployment pipelines.
- Do requirements gathering and come up with estimated efforts for onboarding the new stack
- Design and Architect the various tools for ML, Data Governance, Deployment/Integration Automation, Data Analytics
Try to:-
Learn other AWS services like - ECS, ECR, EC2
Learn Data Modeling
Requirements:- Past Job Experience-
- A total of 5-9 years of experience in software development with at least 5 years of experience in building scalable and stable data pipelines in the AWS tech stack.
- Prior experience in building Data Pipelines in AWS Cloud. (In job experience or personal side projects)
Data and AWS Tools:-
Must have:
- Strong proficiency with any programming language (Python, Scala, Java)
- Strong proficiency with SQL
- Experience with 3 or more of the following AWS Analytics Ecosystem - Apache Airflow, Apache Spark, S3, Glue, Kafka, AWS Athena, Lambda, Redshift, Lake formation, AWS Batch, ECS - Fargate, Kinesis, Flink, DynamoDB, Sagemaker
- Should have experience in using IaC while deploying the Data Pipelines in AWS. Examples - Terraform, Cloudformation, etc.
Highly Desired:-
- Experience in Docker, Kubernetes, ECR, EC2, VPC, SNS, SQS, Cloudwatch
- Experience in building Jenkins deployment pipelines.
- Experience in collaboration tools like JIRA, Confluence, GitHub
Good to have:-
Exposure to NoSQL databases
Click on Apply to know more.
