- Location
- Bengaluru, Karnataka, India
- Job type
- Full-time
Required skills
- Python
- data pipeline
- Git
- Lambda
- NumPy
- Pandas
About the role
Luxoft
Website:
luxoft.com
Job details:
- Mandatory Skills Description:
- • 10+ years of experience in data intensive Pyspark development ,Window Functions , Performance Optimization ,Spark Architecture,Salting ,Column Pruning
- • Must have experience in leading a Development Team
- • Proven experience as a Core Python developer
- • Good understanding of Gen AI
- • Experience developing Classes, OOPS, exception handling, parallel processing.
- • Strong knowledge of DB connectivity, data loading , transformation, calculation
- • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations
- • Lambda Functions, Decorators
- • Vector operations on Pandas dataframes /series
- • Application of apply map, apply, map functions
- • Concurrency and error handling data pipeline batch of size [1-10 gb]
- • Ability to understand business requirements and translate them into technical requirements
- • Ability to design architecture of data pipeline for concurrent data processing
- • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services
- • Debugging application
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.
