Data Engineer (SAS to Databricks)

Join a leading finance and insurance company that’s modernizing its data landscape. We’re seeking a skilled Data Engineer to help us transition from legacy SAS environments to a scalable, cloud-native platform powered by Databricks.

Responsibilities:

• Migrate and modernize legacy SAS data pipelines to scalable, cloud-based solutions in Databricks
• Design and implement ETL workflows using PySpark, Delta Lake, and Azure/AWS
• Collaborate with data scientists, analysts, and other engineers to ensure smooth data delivery
• Optimize data performance and drive automation in our data infrastructure
• Collaborate with actuarial, underwriting, finance, and analytics teams to deliver trusted data solutions
• Apply best practices in data modeling, quality, and governance aligned with financial regulatory standards
• Support the buildout of a Data Lakehouse on AWS, leveraging Delta Lake and Unity Catalogue

Experience and qualifications:

• 3+ years of hands-on experience with SAS (Base, Macros, EG)
• Proven experience with Databricks, PySpark, and SQL
• Familiarity with cloud platforms like Azure, AWS, or GCP
• Strong understanding of data warehousing, ETL/ELT, and modern data lake architectures
• Passion for data modernization and continuous learning
• Experience with MLflow, Airflow, or dbt
• Knowledge of CI/CD and DevOps for data engineering

The reference number for this position is NG60438 which is a permanent Hybrid position based in Johannesburg offering a cost to company of R800k – R1mil per annum negotiable on experience and ability. Contact Nokuthula at e-merge.co.za or call her on 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? e-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 29 Apr 10:08, Closing date 28 Jun