COVID-19: We are continuing to provide recruitment services to our customers & candidates and urge you to contact your relevant recruiter should you need any assistance.
  • +61 2 80678518 (Head Office)
  • +91 40-7960-9275 (Offshore Office)
Rent Office Space in KPHB
Login / Register
Login / Register
Jobs in Australia, Sydney, Melbourne | Job Search Australia | Careers Australia | Job Opportunities | Data Engineer for – Analytics Squad
Careers
Home Careers
LinkedIn Apply
Experience :  8+ Years
 Location :  sydney
Hiring Mode :  Permanent/contract
Contract :  Full Time
Salary :  Not Disclosed
Description : 
  1. Hands-on experience in Cloudera (v 5.12) – development/build as well as design – must-have.
  2. Experience in HDFS, MapReduce, Yarn, Hive, Pig, Sqoop, Oozie, HBase – must-have.
  3. Experience in Hive script, Pig scripts, Sqoop jobs, Oozie.
  4. Experience in using Informatica BDM (big data manager) to ingest data – must-have.
  5. Experience in Kafka message broker configuration, Flume ingestion configuration – good to have.
  6. Experience in using Spark – must-have.
  7. Strong knowledge of Linux shell scripting.
  8. Experience in performance fine-tuning of existing hive tables, hive scripts, pig scripts.
  9. Experience in processing unstructured, semi structured and structured data.
  10. Experience in developing batch jobs and real time jobs using MapReduce
  11. Experience in working on real time data ingestion using Spark streaming.
  12. Experience in writing Scala/Python codes on top on Spark.
  13. Experience in script-based Hadoop ingestion.
  14. Overall 7-10-year experience.

Copyright© BMP Techn One Pty.Ltd. All Rights Reserved