Senior Data Engineer

b_labs

القاهرة
دائم
دوام كامل

قبل 17 يوم
التقديم على الوظيفة بسهولة

b_labs is the transformation and digitization arm of B.TECH, on a mission to change the industry as we know it. We spearhead tech innovation at B.TECH, an organization that has been a cornerstone of the Egyptian retail industry. We are the engine powering B.TECH in achieving its goal of becoming the leading omni-channel platform for consumer electronics and appliances in Egypt. By joining b labs, you will get to benefit from a collaborative startup environment, while also enjoying the stability of working within a company that has achieved strong growth year after year. You will be part of a visionary, customer-focused team with an ambitious mission--to become a trailblazer for digital retail within the Middle East.Responsibilities

Design, develop, and maintain large-scale, reliable data pipelines using Python, SQL, and big data technologies such as Apache Spark and Kafka.
Build and optimize ETL/ELT processes for data transformation, loading, and integration from multiple sources.
Develop and maintain data storage solutions using both relational and NoSQL databases, including SQL Server, PostgreSQL, MySQL, and MongoDB.
Implement and manage CI/CD pipelines for data workflows, enabling automated deployments and version control.
Work with AWS services to build, deploy, and monitor cloud-based, scalable data solutions.
Leverage Apache Airflow for orchestrating workflows and PostHog for analytics tracking and event data.
Manage and enhance data warehousing solutions to support business intelligence and analytics needs.
Ensure data accuracy, consistency, and security across diverse systems and sources.
Troubleshoot and optimize data systems for performance, scalability, and cost efficiency.
Actively promote and contribute to a collaborative, innovative, and agile team

Requirements

5+ years of experience in data engineering, building and maintaining production-grade data pipelines and architectures.
Proficient in Python and SQL.
Hands-on with relational databases (SQL Server, PostgreSQL, MySQL) and NoSQL (MongoDB).
Experience with big data and stream processing tools (e.g., Apache Spark, Kafka).
Skilled in implementing CI/CD pipelines for data workflows.
Strong understanding of AWS services (S3, Redshift, Lambda, Glue).
Experience with Apache Airflow for workflow orchestration.
Familiarity with PostHog or Amplitude for analytics tracking and event management.
Comfortable with Docker, Kubernetes, and Linux shell scripting.
Solid grasp of data modeling, warehousing, scalability, and reliability best practices.
Proven ability to ensure data quality, governance, and security.
Strong communication skills and a collaborative mindset.
Passion for continuous learning and staying updated on emerging technologies.

BenefitsOffice environment: When you come to our b_labs office, you'll find creative workspaces and an open design to foster collaboration between teams.Flexibility: You know best whether you want to work from home or in the office.Equipment: From "Day 1" you will receive all the equipment you need be successful at work.

b_labs