Principal Data Engineer

Required Skills and Experience:

• 14+ years of experience in building highly scalable distributed data systems
• Proficiency in programming with Python, Java, or Golang
• Strong understanding of data structures and algorithms
• Demonstrated commitment to good development practices, including automated testing and code coverage measurement
• Experience with real-time stream processing systems using engines like Flink, Spark, or similar technologies
• Familiarity with distributed datastores such as Druid, MongoDB, Cassandra, BigQuery, or equivalents
• Excellent written and verbal communication skills
• Bonus points for any contributions to open-source projects!

Key Responsibilities:

• Develop and build the next generation of data pipelines to enable near real-time ingestion of security insights and intelligence data
• Architect scalable data pipelines and address real-time stream processing challenges at scale
• Collaborate closely with security, big data, product, and engineering experts to design and deliver innovative solutions for complex challenges on behalf of our customers
• Evaluate open-source technologies to identify the best fit for our needs and contribute to these projects where possible
• Support other teams in designing systems on top of the data platform and influence their architectural decisions