Senior Lead Data Engineer
2 days ago
Job description
What you will be doing
- Design and develop pipelines using Python, PySpark, and SQL
- Use GitLab as the versioning control system
- Utilize S3 buckets for storing large volumes of raw and processed data
- Implement and manage complex data workflows using Apache Airflow (MWAA) to orchestrate tasks
- Utilize Apache Iceberg (or similar) for managing and organizing data in the data lake
- Create and maintain data catalogs using AWS Glue Catalog to organize metadata
- AWS Athena for interactive querying
- Familiarize with data modeling techniques to support analytics and reporting requirements, as well as knowledge of the data journey stages within a data lake (Medallion Architecture)
What we are looking for
- Ideally, a degree in Information Technology, Computer Science, or a related field
- Ideally, +5 years of experience within the Data Engineering landscape
- Strong expertise in Python, PySpark, SQL, and the overall AWS data ecosystem
- Strong problem-solving and analytical skills
- Ability to explain technical concepts to non-technical users
- Proficiency to work with GitHub
- Terraform and CICD pipelines are a great 'nice-to-have'
-
Lead Data Governance Engineer
4 days ago
Nairobi, Nairobi Area, Kenya Canonical - Jobs Full time $100,000 - $150,000 per yearCanonical is a leading provider of open-source software and operating systems for global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public cloud and silicon providers, and...
-
Systems Engineer Networks Security
2 days ago
Nairobi, Nairobi Area, Kenya NTT DATA, Inc. Full timeMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...
-
Ubuntu Engineering Lead
2 days ago
Nairobi, Nairobi Area, Kenya Canonical - Jobs Full time $120,000 - $180,000 per yearCanonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public cloud and silicon providers,...
-
Data Scientist
4 days ago
Nairobi, Nairobi Area, Kenya World Data Lab Full time $55,000 - $85,000 per yearABOUT THE TEAM World Data Lab (WDL) is a fast-growing data science B2B DaaS scaleup that takes strategic insights and data-driven decision-making to the next level by developing the most credible, global, and granular demographic and consumer spending forecasts. Our insights help governments, businesses, and organizations make better decisions - from...
-
Network Security Engineer
4 days ago
Nairobi, Nairobi Area, Kenya NTT DATA Full time $90,000 - $120,000 per yearContinue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive.Your career here...
-
Senior Data Scientist
4 days ago
Nairobi, Nairobi Area, Kenya Credable Group Full time $60,000 - $120,000 per yearWelcome to Credable We build embedded finance solutions that provide access to finance to people and places that previously were left in the dark. Picture not being able to store your earnings securely, transmit or receive money over great distances, acquire credit, or participate in the digital economy. This isn't a trivial inconvenience, it affects...
-
Full Stack Engineer
2 days ago
Nairobi, Nairobi Area, Kenya Skul-Data Full time 120,000 - 240,000 per yearFounding Full-Stack Engineer & Partner (Django + React)Company: Skul-Data — School Data Management & Operations PlatformLocation: Kenya-first, remote-friendly (EAT)Compensation: Partnership with fixed equity share (to be discussed further)________________________________About Skul-DataSkul-Data is a school database management and operations platform for...
-
Senior Data Scientist
2 days ago
Nairobi, Nairobi Area, Kenya SunCulture Kenya Limited Full time $60,000 - $120,000 per yearPosition: Senior Data ScientistLocation: Nairobi, KenyaType: Full-timeReporting to: Head of Data About SunCulture Founded in 2012, SunCulture's Vision is to build a world where people take control of their environment in rewarding and sustainable ways. SunCulture does this by developing and commercializing life changing technology that solves the...
-
Network Security Engineer
4 days ago
Nairobi, Nairobi Area, Kenya NTT DATA, Inc. Full time 1,200,000 - 2,400,000 per yearMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Network...
-
Rust Engineering Lead
4 days ago
Nairobi, Nairobi Area, Kenya Canonical - Jobs Full time 100,000 - 300,000 per yearCanonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation, and IoT. Our customers include the world's leading public cloud and silicon providers,...