Notice Period – Immediate – 15 days
Key points :
- Candidates need to work from an office in Bangalore for 2-3 days a week.
- Initial screening hasto be done from partner before sending the profiles
- If a candidate clears the first round, they need to be ready for a F2F interview as per the requested time.
- 7+ years relevant experience is required
Job Description:
- Designing, creating, and maintaining Scala-based applications
- Participating in all architectural development tasks related to the application.
- Working as a member of a software development team to ensure that the program meets standards
- Application testing and debugging
- Collaborating with cross-functional teams
- Develop end to end data pipeline using Spark, Hive and Impala
- Write SPARK jobs to fetch large data volumes from source
- Understand business needs, analyze functional specifications and map those to development and designing Apache Spark programs and algorithms.
- Optimizing Spark code, Impala queries and Hive partitioning strategy for better scalability, reliability and performance.
- Work on hive performance optimizations like using distributed cache for small datasets, Partition, Bucketing in Hive and Map Side joins.
- Build Machine Learning Algorithms using Spark.
- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
- Knowledge in Sqoop, Flume preferred
- Experience with Spark and Spark SQL
- Must have hands on experience in Java, Spark, Scala, AKKA,Hive, Maven/SBT, Amazon S3,Lambda
- Experience in Kafka, ReST services is a plus.
Required Professional and Technical Expertise:
- 3+ years experience with Spark
- 3+ years experience with Scala
- 3+ years experience with Hadoop, Hive, Impala, HBase, and related technologies
- 3+ years experience with Lambda architectures
- 3+ years experience with MPP, shared nothing database systems, and NoSQL systems
- Knowledge of Bigdata/NoSQL databases.
Required Education:
Bachelor’s degree in Computer Science, Electrical/Electronic Engineering, Information Technology or another related field
Preferred Education:
Scala Certification,AWS, Hadoop,NoSQL