Data Engineer Specialist
- القاهرة
- دائم
- دوام كامل
- Implement methods to improve data reliability and quality.
- Combine raw data from different sources to create consistent and machine-readable formats.
- Develop and test data structure that enable data extraction and transformation for predictive or prescriptive modeling.
- Define and set development, test, release, update, and support processes for data engineering operations. Troubleshoot and fix code bugs.
- Develop big data models/use cases based on the data structure and prepare them for data operations end users.
- Create and execute queries on structured and unstructured data sources to identify process issues or perform mass updates.
- Develop and implement the feature zone with the required features/KPIs required by different stakeholders and that supports building robust machine learning models.
- Ensure that batch production scheduling and report distribution are accurate and timely.
- Perform ad hoc requests from users such as data research, file manipulation/transfer, and research of process issues.
- Performance Excellence
- Collab. & Creating Synergy
- Agility & Resilience
- People Centricity
- Basic to Intermediate knowledge in Java, C#, and Python for developing robust applications
- Basic to Moderate Experience with Cloudera or any Big data platform with the complementary service like Apache Hive, Apache Scala, BizSpark, Impala, Apache Spark, Data Security, Kafka, HBase, Sqoop, NiFi, Python for Programming, Python for Data Analysis & ML, …etc.
- Proficiency in handling and processing large datasets using distributed computing frameworks.
- Moderate knowledge of SQL for querying and managing relational databases.
- Understanding of data warehousing principles and best practices.
- Proficiency in handling and processing large datasets using distributed computing frameworks
- Moderate experience in data analysis and visualization tools
- Expertise in writing shell scripts using Bash, KornShell (ksh), or Bourne Shell (sh)
- Bachelor Degree in Computer Science/Engineering is preferred
- Master/ Certificate needed is preferred
- Banking experience is preferred