Accenture
Website:
accenture.com
Job details:
Project Role : Custom Software Engineer
Project Role Description : Design, build and configure applications to meet business process and application requirements.
Must have skills : Apache Spark
Good to have skills : NA
Minimum 3 Year(s) Of Experience Is Required
Educational Qualification : 15 years full time education
Job Description
Must have Skills : Apache Spark, Hive, Scala, PySpark,Azure Databricks
Good to Have Skills : Shell Scripting , Any Scheduler , ADLS, Hadoop, HBase, Apache Kafka
Key Responsibilities
a Lead the team and contribute to the design and build of code / recipes for data engineering pipelines
b Ensure commitments are delivered on time and with good quality
c Review work done by the team and ensure best practices and coding standards are adhered to
d Scale up pipelines to support massive wrt volume and velocity data processing
e Participation in agile rituals .
f Willing to work in 1 to 10 PM Shift timings.
Technical Experience
a Experience in optimal data extraction, data transformation, data loading from a wide variety of data sources using Spark/Hive/Databricks.
b Expertise in Spark Scala/Pyspark / Hive optimizations.
d Hands on experience in assessing ensuring data quality
e Experience in building solutions using cloud based architecture with scalable solutions
f Experience in deriving insights by analysing huge volume of data .
g Having Good experience in performance tuning of SQL/Spark / Azure Notebooks
Click on Apply to know more.