Home  |  Contact  |  About Us
Register  |  Sign In        

Hadoop Administrator

col-narrow-left   

Location:

Johannesburg, Gauteng 

Salary:

Market Related per month

Posted:

19-10-2018
col-narrow-right   

Job Type:

Permanent, Contract

Job Level:

Skilled

Employment Equity:

South African Citizens Only
col-wide   

Job Description:

PBT Group has an opportunity for a Hadoop Administrator to perform administration duties like Hadoop clusters management and taking care of other resources in the entire Hadoop ecosystem. The typical Hadoop administration jobs relate to installation and monitoring of Hadoop clusters.
 
As a Hadoop Administrator, you will responsible for supporting, configuring, upgrading, and maintaining multiple Hadoop clusters as well as contributing to building out additional clusters, adding nodes/capacity to existing clusters, and implementing open source projects.
 
Duties:
  • Installing Hadoop in Linux environment.
  • Deployment in a Hadoop cluster and its maintenance.
  • Health check of a Hadoop cluster monitoring whether it is up and running all the time.
  • Analyse the storage data volume and allocating the space in HDFS.
  • Resource management in a cluster environment. This involves new node creation and removal of unused ones.
  • Configuring NameNode to ensure its high availability
  • Implementing and administering Hadoop infrastructure on an ongoing basis.
  • Required hardware and software deployment in Hadoop environment. Furthermore to expanding of existing environments.
  • User creation in Linux for Hadoop and its components in the ecosystem. Moreover, setting up Kerberos principals is a part of Hadoop administration.
  • Performance tuning and running jobs in Hadoop clusters.
  • Capacity planning
  • Monitoring connectivity and security of Hadoop cluster
  • Managing and reviewing log files in Hadoop.
  • Management of HDFS file system and monitoring them.
  • Maintaining HDFS and providing necessary supports.
  • Backup and recovery tasks.
  • Communicating with other development, administrating and business teams. They include infrastructure, application, network, database, and business intelligence teams. Effective communication plays a key role in high quality and availability of data.
  • Coordinating with application teams. Installing the operating system and Hadoop related updates as and when required.
  • Working as a key person for Vendor escalation
  • Troubleshooting
 
Experience:
  • General operational excellence. This includes good troubleshooting skills, understanding of system’s capacity and bottlenecks. Furthermore, you also need a basic understanding of memory management areas.
  • Proper knowledge and hands-on experience in Hadoop ecosystem components.
  • Hadoop administration demands one’s deployment skill in Hadoop cluster. Moreover, the job needs adding and removing nodes. It may need tracking of jobs and monitor the important parts of the cluster.
  • Configuring high availability of name-node.
  • Scheduling and taking backups
  • Linux cron is the running platform of Hadoop. Hence, a good hands-on experience of Linux, its commands and scripting are a must.
  • Configuration management and deployment exposure in Open source environment.
  • Knowledge of Core Java is an added advantage in performing the job.
 
Qualifications/ Certification:
  • A degree in Computer Science / Information Systems / Business Administration / Commerce or equivalent

Job Category:

Installation Engineer, IT Consultant
Company Info
PBT Group
Johannesburg, GP, South Africa

Please register to view contact info


Company Profile



Company Info


PBT Group
Johannesburg, GP, South Africa

Please register to view contact info


Hadoop Administrator

col-narrow-left   

Location:

Johannesburg, Gauteng 

Salary:

Market Related per month

Posted:

19-10-2018
col-narrow-right   

Job Type:

Permanent, Contract

Job Level:

Skilled

Employment Equity:

South African Citizens Only
col-wide   

Job Description:

PBT Group has an opportunity for a Hadoop Administrator to perform administration duties like Hadoop clusters management and taking care of other resources in the entire Hadoop ecosystem. The typical Hadoop administration jobs relate to installation and monitoring of Hadoop clusters.
 
As a Hadoop Administrator, you will responsible for supporting, configuring, upgrading, and maintaining multiple Hadoop clusters as well as contributing to building out additional clusters, adding nodes/capacity to existing clusters, and implementing open source projects.
 
Duties:
  • Installing Hadoop in Linux environment.
  • Deployment in a Hadoop cluster and its maintenance.
  • Health check of a Hadoop cluster monitoring whether it is up and running all the time.
  • Analyse the storage data volume and allocating the space in HDFS.
  • Resource management in a cluster environment. This involves new node creation and removal of unused ones.
  • Configuring NameNode to ensure its high availability
  • Implementing and administering Hadoop infrastructure on an ongoing basis.
  • Required hardware and software deployment in Hadoop environment. Furthermore to expanding of existing environments.
  • User creation in Linux for Hadoop and its components in the ecosystem. Moreover, setting up Kerberos principals is a part of Hadoop administration.
  • Performance tuning and running jobs in Hadoop clusters.
  • Capacity planning
  • Monitoring connectivity and security of Hadoop cluster
  • Managing and reviewing log files in Hadoop.
  • Management of HDFS file system and monitoring them.
  • Maintaining HDFS and providing necessary supports.
  • Backup and recovery tasks.
  • Communicating with other development, administrating and business teams. They include infrastructure, application, network, database, and business intelligence teams. Effective communication plays a key role in high quality and availability of data.
  • Coordinating with application teams. Installing the operating system and Hadoop related updates as and when required.
  • Working as a key person for Vendor escalation
  • Troubleshooting
 
Experience:
  • General operational excellence. This includes good troubleshooting skills, understanding of system’s capacity and bottlenecks. Furthermore, you also need a basic understanding of memory management areas.
  • Proper knowledge and hands-on experience in Hadoop ecosystem components.
  • Hadoop administration demands one’s deployment skill in Hadoop cluster. Moreover, the job needs adding and removing nodes. It may need tracking of jobs and monitor the important parts of the cluster.
  • Configuring high availability of name-node.
  • Scheduling and taking backups
  • Linux cron is the running platform of Hadoop. Hence, a good hands-on experience of Linux, its commands and scripting are a must.
  • Configuration management and deployment exposure in Open source environment.
  • Knowledge of Core Java is an added advantage in performing the job.
 
Qualifications/ Certification:
  • A degree in Computer Science / Information Systems / Business Administration / Commerce or equivalent

Job Category:

Installation Engineer, IT Consultant
We are the #1 job site for IT Jobs in South Africa. The CompuJobs job site is your all in one it recruitment solution. Whether you are a candidate seeking a new IT job or a recruiter looking to hire IT staff, we are here to help you achieve your objectives. CompuJobs has been serving the information technology employment sector in South Africa since 2007. Job seekers please register to submit your CV and apply to jobs. Employers and recruitment agencies please check out the Employer Pricing page for available job posting and recruitment services. This is South Africa's information technology recruitment and career website. Your IT job search starts here. Let's get working!

PayFast

CompuJobs IT Job Portal - Your #1 resource for IT jobs in South Africa.

Copyright © 2018 CompuJobs | All Rights Reserved