| Experience : | 5 Years+ |
|---|---|
| Location : | sydney |
| Hiring Mode : | Permanent/contract |
| Contract : | 6 Months+ |
| Salary : | Open |
Experience in AWS environment, including AWS administration – must-have.
2. Hands-on experience in Cloudera (v 5.12) – development/build as well as support.
3. Experience in HDFS, MapReduce, Yarn, Hive, Pig, Sqoop, HBase.
4. Experience in Hive script, Pig scripts, Sqoop jobs, Spark, Scala, Oozie.
5. Experience in Kafka message broker configuration, Flume ingestion configuration.
6. Experience in performance fine-tuning of existing hive tables, hive scripts, pig scripts.
7. Experience in developing batch jobs and real time jobs using MapReduce
8. Experience in working on real time data ingestion using Spark streaming.
9. Experience in refreshing Analytics models, preferably using R.