Senior Software Engineer

Job Title: Senior Software Engineer

Location: Skillman, NJ 08558 Hybrid Role

Duration: 6-12+ Months Contract.

Interview process: Phone followed by Video Interview.

Work Authorization: US Citizen or Green Card Holder Only.

Independent Candidates Only (W2 / 1099 / Self-Corp.)

Job Description:-

On Call Notes

Migrating different feeds from scratch to BB Document Managing System (BDMS) to AWS then to Databricks and Data Lake. Python needed for this and Terraform (would be nice) the legacy system is in JAVA so having some JAVA is good. Design work will be needed as it is a Greenfield Effort and they anticipate most of the work will be re: Databricks and Data Lake.

Description & Requirements: -

Our Team

The Client's Government Cloud Solutions team designs and builds the Client's Government data platform as well as develops the tools that support it. We use AWS technologies like Lambda, S3 and Step Functions to create robust ingestion workflows as well as implementing our Databricks Lakehouse. You will be given the opportunity to display your creativity and deliver continuous end-user value in an Agile environment. We are self-motivated engineers who like to research, learn, and apply current technologies to build new product features that anticipate our customers' needs.

Project Description

Migration of legacy data ingestion pipelines to a shared data management system (BDMS). The work will involve:

• Datasets will be loaded into BDMD
• New tools will be created to allow data analysts to modify the datasets
• Analysts will validate and cleanse the data which will then be delivered to AWS S3
• Data will then be enriched using technologies like Databricks, AWS Lambda & Step Functions and Jupyter Notebooks/Workflows and loaded in Delta tables.
  
  

We'll Trust You To

• Work directly with product owners, engineers to build solutions
• Work with data analysts/scientists to collect insight on possible data collection efficiencies and identify automation potential for manual workflows.
• Develop infrastructure as code (IaC) and embrace DevOps principles
• Work with AWS cloud services to implement micro services using serverless technologies.
  
  

You'll Need To Have

• 4+ years of experience programming in Python or Java
• Solid understanding of database systems and SQL including Oracle and PostgreSQL
• A Degree in Computer Science, Engineering, Mathematics, similar field of study or equivalent work experience.
• AWS experience including services like S3, Lambda, CloudWatch
  
  

We'd Love To See

• Experience with data migrations from legacy to cloud.
• Knowledge of Spark, Databricks and IaC (Terraform/CloudFormation

The Client's Government Cloud Solutions team designs and builds the Client's Government data platform as well as develops the tools that support it. We use AWS technologies like Lambda, S3 and Step Functions to create robust ingestion workflows as well as implementing our Databricks Lakehouse. You will be given the opportunity to display your creativity and deliver continuous end-user value in an Agile environment. We are self-motivated engineers who like to research, learn, and apply current technologies to build new product features that anticipate our customers' needs.