Data Engineering Content Writer (Spark/PySpark)

Website: sparkplayground.com
Job details:

Location: Remote

Type: Contract/Freelance

About Spark Playground

Spark Playground is an interactive platform designed to help data engineers master PySpark through hands-on practice and real-world interview preparation. We're building the go-to resource for professionals preparing for data engineering roles.

The Role

We're looking for an experienced Data Engineer with strong PySpark expertise and technical writing skills to create high-quality interview questions and solutions for our platform. You'll design problems that mirror real-world scenarios and help thousands of engineers level up their skills.

What You'll Do

• Research and create original PySpark interview questions across difficulty levels (beginner to advanced)
• Write detailed, easy-to-understand solutions with step-by-step explanations
• Develop scenario-based problems covering DataFrames, RDDs, transformations, actions, optimization techniques, and Spark architecture
• Create content on advanced topics like broadcast joins, shuffle operations, skewed data handling, and performance tuning
• Collaborate with our team to ensure content aligns with current industry interview trends
• Review and refine existing questions based on user feedback

Required Skills

• 3+ years of hands-on experience with PySpark in production environments
• Deep understanding of Spark architecture, execution model, and optimization strategies
• Strong technical writing ability with attention to clarity and detail
• Experience with real-world data engineering challenges: ETL pipelines, data modeling, distributed computing
• Ability to explain complex technical concepts in simple, accessible language

Preferred Qualifications

• Experience interviewing data engineering candidates or conducting technical assessments
• Familiarity with Databricks, Azure, or AWS EMR environments
• Previous technical content creation or educational content development
• Active participation in data engineering communities

Why Join Us?

• Help shape the future of data engineering education
• Flexible remote work arrangement
• Collaborate with passionate data engineering professionals
• See your content impact thousands of learners

Click on Apply to know more.