Home  |  Contact  |  About Us
Register  |  Sign In        

Big Data Developer

col-narrow-left   

Location:

Johannesburg, Gauteng 

Suburb:

Roodepoort

Salary:

Market Related per month

Posted:

06-07-2018
col-narrow-right   

Job Type:

Permanent, Contract

Job Level:

Skilled

Employment Equity:

South African Citizens Only
col-wide   

Job Description:

PBT Group has an opportunity for a Big Data Developer with solid experience in Spark.
 
Duties:
  • Support and Administration of existing Big Data solution – this include production, development and DR environments
  • Analysis, Design, Development and maintenance of ETL processes – this will include development of NiFi flows for feed integration, Design of appropriate tables, development of Spark processes to load data and ongoing maintenance of these.
  • Development of Linux scripts to automate support and maintenance tasks
 
Skills Required:
  • 5+ years working in software development
  • 2+ years developing, deploying and maintaining high volume production big data solutions
  • 2+ years developing solutions in Spark using Scala & Python, Spark SQL, Spark Streaming
  • 2+ years’ experience programming in Java
  • Oozie workflow development and maintenance
  • Experience using Ambari to administer a Big Data environment
  • NiFi flow development, administration and maintenance
  • HBase administration and table design
  • Table design and DB administration in Apache Phoenix
  • Analytics with Hive
  • Security administration using Ranger
  • Development of Kafka producers and consumers
  • Strong database, SQL, ETL and data analysis skills
  • Ability to work within a team
  • Experience with basic Linux administration
 
Nice to have:
  • Experience maintaining a Hortonworks environment
  • HDP Certified Administrator qualification
  • Master's degree in Computer Science or equivalent.
  • Knowledge of EMC Isilon is an asset
  • Experience with Bash Scripting
 
Qualifications/ Certification:
  • Bachelor's degree in Computer Science or equivalent

Job Category:

Business Intelligence, Data Warehouse, IT Consultant
Company Info
PBT Group
Johannesburg, GP, South Africa

Please register to view contact info


Company Profile



Company Info


PBT Group
Johannesburg, GP, South Africa

Please register to view contact info


Big Data Developer

col-narrow-left   

Location:

Johannesburg, Gauteng 

Suburb:

Roodepoort

Salary:

Market Related per month

Posted:

06-07-2018
col-narrow-right   

Job Type:

Permanent, Contract

Job Level:

Skilled

Employment Equity:

South African Citizens Only
col-wide   

Job Description:

PBT Group has an opportunity for a Big Data Developer with solid experience in Spark.
 
Duties:
  • Support and Administration of existing Big Data solution – this include production, development and DR environments
  • Analysis, Design, Development and maintenance of ETL processes – this will include development of NiFi flows for feed integration, Design of appropriate tables, development of Spark processes to load data and ongoing maintenance of these.
  • Development of Linux scripts to automate support and maintenance tasks
 
Skills Required:
  • 5+ years working in software development
  • 2+ years developing, deploying and maintaining high volume production big data solutions
  • 2+ years developing solutions in Spark using Scala & Python, Spark SQL, Spark Streaming
  • 2+ years’ experience programming in Java
  • Oozie workflow development and maintenance
  • Experience using Ambari to administer a Big Data environment
  • NiFi flow development, administration and maintenance
  • HBase administration and table design
  • Table design and DB administration in Apache Phoenix
  • Analytics with Hive
  • Security administration using Ranger
  • Development of Kafka producers and consumers
  • Strong database, SQL, ETL and data analysis skills
  • Ability to work within a team
  • Experience with basic Linux administration
 
Nice to have:
  • Experience maintaining a Hortonworks environment
  • HDP Certified Administrator qualification
  • Master's degree in Computer Science or equivalent.
  • Knowledge of EMC Isilon is an asset
  • Experience with Bash Scripting
 
Qualifications/ Certification:
  • Bachelor's degree in Computer Science or equivalent

Job Category:

Business Intelligence, Data Warehouse, IT Consultant
We are the #1 job site for IT Jobs in South Africa. The CompuJobs job site is your all in one it recruitment solution. Whether you are a candidate seeking a new IT job or a recruiter looking to hire IT staff, we are here to help you achieve your objectives. CompuJobs has been serving the information technology employment sector in South Africa since 2007. Job seekers please register to submit your CV and apply to jobs. Employers and recruitment agencies please check out the Employer Pricing page for available job posting and recruitment services. This is South Africa's information technology recruitment and career website. Your IT job search starts here. Let's get working!

PayFast

CompuJobs IT Job Portal - Your #1 resource for IT jobs in South Africa.

Copyright © 2018 CompuJobs | All Rights Reserved