Data Engineering Manager - Porter
Salary
₹50 - 75 LPA
Min Experience
8 years
Location
Bengaluru
JobType
full-time
- Overview
About the role
About the Job
At Porter, we're not just passionate about improving productivity; we're on a vision to Moving a billion dreams one delivery at a time. We empower businesses, both large and small, to optimize their operations and unleash unprecedented growth in their core functions. Join us in pioneering the future of last-mile logistics, one that's poised to disrupt the industry and redefine the way we think about transportation.
Why Porter?
- Industry Leadership: As the fastest-growing leader in last-mile logistics, we have a pan-India and International presence with operations spanning multiple cities. With a fleet size exceeding 750k driver partners and 15 million customers. Porter is at the forefront of this dynamic and rapidly expanding sector.
- Cutting-Edge Technology: Our industry-best technology platform has garnered over $150 million in investments from renowned backers, including Sequoia Capital, Kae Capital, Mahindra Group, LGT Aspada, Tiger Global, and Vitruvian Partners. We leverage technology to drive efficiency, innovation, and unparalleled service.
- Ambitious: We're not just solving problems; we're addressing a massive challenge and going after a market with a valuation surpassing $50 billion USD. Our ambition extends beyond last-mile delivery; we aim to disrupt all facets of logistics, including warehousing and LTL transportation.
- Thriving Community: Join a community of passionate individuals who are committed to doing the best work of their lives. At Porter, we value the spirit of collaboration, innovation, and embracing challenges head-on.
Responsibilities
Data Strategy and Alignment
- Work closely with data analysts and business / product teams to understand requirements and provide data ready for analysis and reporting.
- Apply, help define, and champion data governance: data quality, testing, documentation, coding best practices and peer reviews.
- Continuously discover, transform, test, deploy, and document data sources and data models.
- Work closely with the Infrastructure team to build and improve our Data Infrastructure.
- Develop and execute data roadmap (and sprints) - with a keen eye on industry trends and direction.
Data Stores and System Development
- Design and implement high-performance, reusable, and scalable data models for our data warehouse to ensure our end-users get consistent and reliable answers when running their own analyses.
- Focus on test driven design and results for repeatable and maintainable processes and tools.
- Create and maintain optimal data pipeline architecture - and data flow logging framework.
- Build the data products, features, tools, and frameworks that enable and empower Data, and Analytics teams across Porter.
Project Management
- Drive project execution using effective prioritization and resource allocation.
- Resolve blockers through technical expertise, negotiation, and delegation.
- Strive for on-time complete solutions through stand-ups and course-correction.
Team Management
- Manage and elevate team of 5-8 members.
- Do regular one-on-ones with teammates to ensure resource welfare.
- Periodic assessment and actionable feedback for progress.
- Recruit new members with a view to long-term resource planning through effective collaboration with the hiring team.
Process design
- Set the bar for the quality of technical and data-based solutions the team ships.
- Enforce code quality standards and establish good code review practices - using this as a nurturing tool.
- Set up communication channels and feedback loops for knowledge sharing and stakeholder management.
- Explore the latest best practices and tools for constant up-skilling.
Data Engineering Stack
- Analytics: Python / R / SQL + Excel / PPT, Google Colab
- Database: PostgreSQL, Amazon Redshift, DynamoDB, Aerospike
- Warehouse: Snowflake, S3
- ETL: Airflow + DBT + Custom-made Python + Amundsen (Discovery)
- Business Intelligence / Visualization: Metabase + Google Data Studio
- Frameworks: Spark + Dash + StreamLit
- Collaboration: Git, Notion
Requirements
- Industry experience of minimum 9 years (5 years+ in data engineering role)
- Experience managing a team of at least 4 developers end-to-end
- Strong hands-on data modeling and data warehousing skills
- Strong technical background and ability to contribute to design and review
- Strong experience applying software engineering best practices to data and analytics scope (e.g. version control, testing, and CI/CD)
- Strong attention to detail to highlight and address data quality issues
- Excellent time management and proactive problem-solving skills to meet critical deadlines
- Familiarity (expertise preferred) with our current or a similar analytics stack
Skills
Python, R, SQL, Excel, PostgreSQL, Amazon Redshift, DynamoDB, Aerospike, Snowflake, S3, Airflow, DBT, Amundsen, Metabase, Google Data Studio, Spark, Dash, StreamLit