Lead Data Engineer - Shoprite Group


ADVERTISEMENT - SCROLL DOWN ↓





Shoprite Group IT / Telecom Jobs in Cape Town


Thinking about applying?

Before you submit your application, take a moment to go through all the details carefully.

Scroll down to read the full job description, including responsibilities, requirements, and benefits — and see if it’s the right fit for you.



ADVERTISEMENT - JOB DESCRIPTION BELOW ↓





About the role    

  • We're looking for an experienced Lead Data Engineer to lead the design, development, and evolution of enterprise-scale data platforms that enable data-driven decision-making across the Group.
  • This role combines deep technical expertise with leadership responsibilities, overseeing advanced data engineering solutions, guiding engineering teams, and helping shape the future data strategy within a modern cloud and big data environment.
  • As a senior technical leader, you will drive architecture decisions, establish engineering best practices, mentor team members, and ensure the delivery of scalable, secure, and high-performing data solutions.

What you'll do    

Data Engineering & Architecture

  • Design, build, and optimise complex data engineering solutions and platforms.
  • Define and maintain data architecture standards and technical roadmaps.
  • Develop scalable data pipelines and big data solutions using modern cloud technologies.
  • Ensure technical documentation remains current, accurate, and aligned with architectural standards.
  • Drive innovation and continuous improvement across the data engineering landscape.


ADVERTISEMENT - CONTINUE READING BELOW ↓

CONTINUE BELOW ↓


Technical Leadership

  • Provide technical guidance and mentorship across data engineering teams.
  • Establish and enforce engineering standards, development patterns, and best practices.
  • Lead DevSecOps adoption and ensure quality engineering practices are consistently applied.
  • Share knowledge through communities of practice, technical presentations, and mentoring initiatives.
  • Stay current with emerging technologies, tools, and industry trends.

Agile Delivery & Stakeholder Engagement

  • Facilitate planning, backlog grooming, sprint reviews, and team alignment activities.
  • Translate business requirements into scalable technical solutions.
  • Partner with Business Analysts, product owners, architects, and stakeholders to drive successful outcomes.
  • Provide project, delivery, and incident updates to leadership and key stakeholders.
  • Maintain alignment between delivery plans and strategic objectives.

Team Development

  • Support performance management, development planning, and capability growth within the team.
  • Identify skills gaps and contribute to learning and development initiatives.
  • Promote collaboration, engagement, and a high-performance engineering culture.
  • Facilitate innovation initiatives, hackathons, and knowledge-sharing activities.

What you bring    

Qualifications

  • Degree or Diploma in Computer Science, Mathematics, Engineering, Information Systems, or a related field (NQF 6 or higher).
  • Postgraduate qualification in a relevant discipline would be advantageous.
  • Equivalent practical experience will be considered where formal qualifications are not held.

Experience

  • 5+ years' experience in Data Engineering, Software Development, BI, or a related data discipline.
  • Demonstrated experience leading or mentoring Data Engineering teams.
  • Proven experience delivering enterprise-scale data solutions.
  • Experience within retail, FMCG, or similarly complex environments is advantageous.


ADVERTISEMENT - CONTINUE READING BELOW ↓

CONTINUE BELOW ↓


Technical Skills

  • Advanced Python and PySpark development.
  • Strong SQL skills, particularly in large-scale data environments.
  • Big Data technologies including Hadoop and Spark.

AWS services such as:

  • EMR
  • S3
  • Athena
  • RDS
  • Lambda
  • API Gateway
  • Experience with Azure, GCP, and Snowflake.
  • Data warehouse and Business Intelligence concepts.
  • Solution architecture and technical design.
  • Software Development Life Cycle (SDLC).
  • DevOps and Infrastructure Management practices.

👉 STOP: Ready to Apply?

Don't miss out on this opportunity! Carefully review the job details one last time. Once you're ready, scroll down to the bottom of this page to access the How to apply button.

Hurry—applications for this cycle are closing soon!


← View More IT / Telecom Jobs

ADVERTISEMENT - APPLY BUTTON BELOW ↓

CONTINUE BELOW ↓





🔥 SIMILAR JOBS YOU MAY LIKE → APPLY


DSPA VACANCIES & GOVERNMENT JOBS IN SOUTH AFRICA TODAY

JobSearch South Africa is your most reliable website for latest jobs in South Africa today. If you are interested in getting genuine and reviewed job vacancies in South Africa from the best companies, then you are in the right place. Browse For DPSA vacancies, Government jobs & More. You can find LinkedIn jobs and Indeed jobs, here

LEARNERSHIPS, APPRENTICESHIPS, AND TRAINEESHIPS IN SOUTH AFRICA

Discover the latest learnerships, internships, apprenticeships, and graduate trainee programs across South Africa. Whether you're looking for opportunities in engineering, IT, finance, healthcare, HR, or government sectors, we connect job seekers with top training programs offered by SETA-accredited institutions and global companies. Get career development tips, CV writing help, and professional advice for workplace readiness.

Explore youth employment initiatives, workplace skills training, and certified NQF-based programs that help you earn while you learn. Start building your future with industry-relevant training in Johannesburg, Cape Town, Durban, and across South Africa.

APPLY FOR FULLY FUNDED SCHOLARSHIPS ON MYCOLLEGEMAG

MyCollegeMag is your most reliable website for latest fully funded Scholarships for african and international students to study abroad today. If you are interested in getting genuine and reviewed Scholarships from the top universities, then you are in the right place. Browse For Undergraduate and Postgraduate Scholarships, Government Scholarships & More. You can find top scholarship opportunities today on MyCollegeMag

JOB OPPORTUNITIES IN GHANA AND SOUTH AFRICA


Discover the latest job vacancies in Ghana and South Africa across top industries including finance, healthcare, IT, logistics, customer support, and remote work. Whether you're based in Accra, Johannesburg, Cape Town, or Kumasi, find trusted career listings, CV building resources, and cover letter writing tips to help you get hired faster. Our job board features opportunities in government, NGOs, internships, graduate programs, and international companies hiring in Africa.

EXPLORE REMOTE JOBS, ONLINE WORKS, AND FREELANCE OPPORTUNITIES

Work from anywhere with flexible remote jobs and freelance projects in tech, content writing, customer service, design, data entry, and virtual assistance. Whether you're in Ghana, South Africa, or abroad, start earning online with global companies hiring remote workers. Access guides for setting up your freelance profile, optimizing your CV for remote roles, and tips to get hired on platforms like Upwork, Fiverr, and Freelancer. Perfect for students, stay-at-home parents, and professionals looking to work from home. Discover online job opportunities that fit your skills and schedule — start your remote career today.

Receive daily job alerts, explore career development advice, and access tools that support job seekers, recruiters, and professionals at all stages of their careers.

BEST PERSONAL LOAN AND SALARY MANAGEMENT TIPS FOR PROFESSIONALS

Manage your salary wisely. From budgeting and savings to online loans, mobile money comparisons, tax filing, and personal insurance — get the financial knowledge you need to succeed in your new role. Our expert tips help job seekers and professionals across the world take control of their money and plan ahead.

🔗 Visit our Personal Finance Hub for career-driven financial advice.

TOP CAREER ARTICLES FROM EXPERTS

The job market in South Africa offers diverse opportunities, with high-paying roles available across sectors such as IT, finance, engineering, and healthcare. Many job seekers aim for government jobs, which provide stability, or pursue growing fields like data science and project management. With the rise of remote jobs in South Africa, professionals in accounting, legal, and medical fields can now work flexibly. In-demand positions also include teaching and nursing jobs, reflecting the need for skilled professionals. Mining, a key industry, consistently hires for various roles, while driver jobs remain popular, especially in logistics and delivery. These career options offer competitive pay and job security.

Need help creating a professional CV for jobs in South Africa? Learn the latest CV writing tips, how to write a compelling cover letter, and techniques for making your job application stand out. Our platform helps job seekers build strong resumes for banking jobs, NGO positions, public sector roles, and more.

We provide guidance on how to prepare for interviews, including common interview questions in South Africa, online interview tips, and proper dress code for formal job interviews. Whether you're applying for entry-level jobs, graduate internships, or technical positions, these tools will boost your chances of getting hired.

Discover how to apply for jobs online, track recruitment portals, and get updates on walk-in interviews, national service opportunities, and career development courses in South Africa. Let us help you land your dream job with the best CV and interview preparation.