Python Pyspark Developer
Luxoft
- Location
- Bengaluru, Karnataka, India
- Job type
- Full-time
Required skills
- Python
- Airflow
- Apache
- Apache Airflow
- Atlassian
- backend
- compliance
- data pipeline
- Django
- Git
- Jira
- Lambda
- NumPy
- Pandas
- PostgreSQL
- RESTful
About the role
Luxoft
Website:
luxoft.com
Job details:
- Project Description:
- We need a Senior Pyspark Developer to work for a leading investment bank client in Trade Surveillance Team.
- Responsibilities:
- Develop software applications based on business requirements
- Maintain software applications and make enhancements according to project specifications
- Participate in requirement analysis, design, development, testing, and implementation activities
- Propose new techniques and technologies for software development.
- Perform unit testing and user acceptance testing to evaluate application functionality
- Ensure to complete the assigned development tasks within the deadlines
- Work in compliance with coding standards and best practices
- Provide assistance to Junior Developers when needed.
- Perform code reviews and recommend improvements.
- Review business requirements and recommend changes to develop reliable applications.
- Develop coding documentation and other technical specifications for assigned projects.
- Act as primary contact for development queries and concerns.
- Analyze and resolve development issues accurately.
- Mandatory Skills Description:
- 8+ years of experience in data intensive Pyspark development.
- Experience as a core Python developer.
- Basic experience in Gen/Agentic AI
- Experience developing Classes, OOPS, exception handling, parallel processing .
- Strong knowledge of DB connectivity, data loading , transformation, calculation.
- Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations.
- Lambda Functions, Decorators.
- Vector operations on Pandas dataframes /series.
- Application of applymap, apply, map functions.
- Concurrency and error handling data pipeline batch of size [1-10 gb].
- Ability to understand business requirements and translate them into technical requirements.
- Ability to design architecture of data pipeline for concurrent data processing.
- Familiar with creating/designing RESTful services and APIs.
- Familiar with application unit tests.
- Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services.
- Debugging application.
- Nice-to-Have Skills Description:
- Knowledge of web backend technology - Django, Python, PostgreSQL.
- Apache Airflow
- Atlassian Jira
- Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus
- Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.
