Flag job

Report

Data Engineer

Salary

$150k - $160k

Min Experience

5 years

Location

Hybrid - US

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

Big Data Engineer (Hybrid position-In office Tuesday, Wednesday and Thursday) Job Summary As a Big Data Engineer at Throtle, you will be responsible for designing and developing complex software systems that integrate with Throtle big data processing solutions. You will work closely with cross-functional teams to architect scalable, secure, and maintainable software systems that meet the needs of our business. Duties/Responsibilities · Design and develop software architectures for large-scale data processing and analytics platforms · Collaborate with data engineers to design and implement data pipelines and transformations using big data technologies such as Hadoop, Spark, Kafka, and related ecosystems · Develop and maintain complex SQL queries for data extraction and reporting, and optimize query performance and scalability · Design and develop software components that integrate with our identity graphs, client data, and keying processes · Work with cross-functional teams to ensure software systems meet business requirements and are scalable for future growth · Develop and maintain technical documentation for software architectures and designs · Ensure data integrity and quality in development process · Position will require that the individual understands all regulations and laws applicable to their assigned roles and responsibilities. Additionally, the individual will be responsible for the development, implementation, and regular maintenance of policies and procedures that govern the work of assigned roles and responsibilities, including compliance with the security requirements of ePHI. Required Skill and Abilities · Strong understanding of software design patterns, architecture principles, and big data technologies · Proficiency in programming languages such as Java, Python, Scala, or similar languages · Experience with large-scale data processing and analytics platforms, including Hadoop, Spark, Kafka, and related ecosystems · Knowledge of distributed computing concepts and experience with cloud-based infrastructure (AWS) · Strong analytical and problem-solving skills to address complex software architecture challenges · Ability to work effectively with cross-functional teams and communicate technical designs and solutions to non-technical stakeholders Education and Experience · Bachelor's Degree in Computer Science, Engineering, or a related field · Master's Degree or certification in Software Architecture or a related field preferred but not required · 5+ years of professional experience in software development, architecture, or a related field · Bachelor's Degree in related field such as computer science, Engineering, or related field. · Experience in data modeling, relational and NoSQL databases, SQL and programming languages for building big data pipelines and transformations.

About the company

Throtle is a leading identity company trusted by the world's top brands and agencies located in Red Bank, NJ. At Throtle, we empower brands at scale with true individual-based marketing using a data-centric identity and onboarding approach. Throtle is a company that truly values its employees and their work-life balance. We offer a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being:

Skills

java
python
scala
hadoop
spark
kafka
aws
sql