
Big Data Engineer
- القاهرة
- دائم
- دوام كامل
- Proficient understanding of distributed systems and complex integrations.
- Management of Hadoop cluster, with all included services
- Ability to solve any ongoing issues with operating the cluster
- Proficiency with Hadoop-ecosystem including - but not limited to - HDFS, Yarn, Hive, Spark, Kafka, Nifi, Airflow and Grafana.
- Experience with securing and encrypting data in motion and in transit.
- Proficient in one or more scripting languages (Python, Shell scripting)
- Experience with Linux Operating System.
- Excellent Knowledge of DevOps tools such as Docker, Ansible, Jenkins, GIT.
- Experience with Cloud computing technology AWS, GCP and preferably Azure.
- Experience with implementing ELK cluster with Kibana and developing Use cases on ElasticSearch for reporting/monitoring purpose.
- Concrete knowledge with different database technologies (Oracle /SQL Server / PostgreSQL / MongoDB /MYSQL)
- Concrete knowledge with the following technologies:
- Docker, Kubernetes, Terraform, Airflow
- Splunk - Spark
- Kafka, HDFS, Hive, HBase
- Excellent communication, facilitation and customer facing skills.
- Excellent understanding of IT & networking fundamentals.
- Good understanding of ITIL service support processes.
- Very good understanding of project management.
- Very good technical reports writing skills.
- Fluent English speaking.
- Experience with NoSQL databases, such as Cassandra, MongoDB, Redis, Neo4j, Couchbase.
- Excellent Knowledge of DevOps tools such as Kubernetes and Openshift.
- Experience with administrating ECE (Elastic Cloud Enterprise)
- Experience with Cloud specifically with vCloud Director, Openstack.
- One relevant certification from ITIL, PMP, PRINCE2, Green Belt.
- Fluent French speaking
- Bachelor's or Master's degree in computer science or software engineering
- 5 years' experience in the Information Systems industry
- 2-4 years of strong experience in Big Data domain in managing Production support.
- Ability to possess logical and systematic approach to problem resolution across a broad spectrum of technologies in applications support environment.
- Good inter-personal skills, able to deal with all levels within an organization and relieve potential conflicts.