Job Description
- Manage and maintain our Big Data infrastructure, including HBase, Elastic search, and Cloudera.
- Perform configuration, tuning, and ongoing optimization of big data infrastructure and applications.
- Develop and implement processes for data ingestion, processing, and storage.
- Work with other members of the DevOps team to troubleshoot and resolve issues related to Big Data systems.
- Work with data scientists and architects to understand their infrastructure and analytics needs and provide solutions.
- Collaborate with Data Engineers and Data Scientists to ensure data is available and accessible for analysis.
- Develop and maintain documentation related to Big Data systems and processes.
- Stay up to date with advances in big data technologies and tools. Research and recommend new solutions as needed.
- Educate and train junior DevOps team members on Big Data technologies and best practices.
Personal Skills
- Good command of English language.
- Excellent analytical skills.
- Excellent interpersonal skills.
- Excellent written and verbal communication skills.
- Ability to prioritize and organize multiple assignments/tasks.
- Strong problem-solving mindset.
- Ability to adapt to constantly changing environment.
Technical Skills
- Expertise in Hadoop ecosystem technologies such as HDFS, Hive, HBase, Spark, Kafka, Flink, and NiFi.
- Experience with Hadoop-based Ecosystems like Cloudera including its different compartments like CDP, CDF, and CML.
- Expertise in ELK Stack (Elastic Search, Kibana, LogStash) and administration of logging systems over them.
- Knowledge of distributed computing, cloud computing architectures and data processing frameworks, such as Apache Spark.
- Experience with data ingestion and processing tools, such as Kafka and Flume.
- Strong communication and collaboration skills.
- Ability to train and educate junior team members on Big Data technologies and best practices.
- Ability to work independently and as part of a team.
- Eperties in Teradata, PowerBI Server and Informatica as are a plus.
Education
B.Sc. of Engineering or Computer Science or relevant
Job Details
Job Location
Cairo, Egypt
Company Industry
Software Development
Company Type
Employer (Private Sector)
Job Role
Engineering
Employment Status
Full time
Employment Type
Employee
Job Division
COO Office
SW Engineering
SW Engineering
Preferred Candidate
Career Level
Mid Career
Years of Experience
Min: 5
Degree
Bachelor's degree
