AS Technology Corporation
Website:
astechnologycorp.com
Job details:
We are looking for a skilled Big Data Developer with 4–6 years of experience in designing and building scalable data processing systems. The ideal candidate should have strong programming skills and hands-on experience with real-time data streaming technologies.
Key Responsibilities:
- Design, develop, and maintain scalable big data pipelines and processing systems
- Work with real-time data streaming using Kafka and Spark Streaming
- Develop robust and efficient applications using Java, Python, or Scala
- Process large datasets and ensure high performance, reliability, and scalability
- Integrate data from multiple sources and perform data transformation
- Collaborate with cross-functional teams including data engineers, analysts, and business stakeholders
- Monitor and troubleshoot data pipelines and streaming applications
Required Skills:
- Strong programming experience in Java, Python, or Scala
- Hands-on experience with Apache Kafka
- Experience in Spark Streaming / Apache Spark
- Good understanding of Big Data ecosystem
- Knowledge of data structures, algorithms, and distributed systems
- Experience with real-time and batch data processing
Good to Have:
- Experience with Databricks
- Knowledge of cloud platforms (AWS / Azure / GCP)
- Familiarity with data warehousing concepts
- Experience with CI/CD pipelines
Click on Apply to know more.