COVID-19: We are continuing to provide recruitment services to our customers & candidates and urge you to contact your relevant recruiter should you need any assistance.
  • +61 2 80678518 (Head Office)
  • +91 40-7960-9275 (Offshore Office)
Jobs in Australia, Sydney, Melbourne | Job Search Australia | Careers Australia | Job Opportunities | Spark (big data) Developer
Careers
LinkedIn Apply
Experience :  5 Years+
 Location :  sydney
Hiring Mode :  Permanent/contract
Contract :  6 Months+
Salary :  Open
Description : 

Experience in AWS environment, including AWS administration – must-have.

2. Hands-on experience in Cloudera (v 5.12) – development/build as well as support.

3. Experience in HDFS, MapReduce, Yarn, Hive, Pig, Sqoop, HBase.

4. Experience in Hive script, Pig scripts, Sqoop jobs, Spark, Scala, Oozie.

5. Experience in Kafka message broker configuration, Flume ingestion configuration.

6. Experience in performance fine-tuning of existing hive tables, hive scripts, pig scripts.

7. Experience in developing batch jobs and real time jobs using MapReduce

8. Experience in working on real time data ingestion using Spark streaming.

9. Experience in refreshing Analytics models, preferably using R.