AI & Data Engineer

Andile Mathe

I build data pipelines that bring data in, clean it and check it before it reaches a dashboard.

View projects
Portrait of Andile Mathe
  • Microsoft Certified Fabric Data Engineer Associate
  • Microsoft Certified Azure Data Fundamentals (DP-900)
  • Microsoft 365 Certified Copilot and Agent Administration Fundamentals (AB-900)

Work in progress

South African fuel prices and inflation

I’m comparing monthly South African fuel prices with Stats SA CPI in Power Query and Power BI, with an AI layer on top. I’m still building it, and I post each stage on LinkedIn as I finish it.

Follow the build

What I work with

Data engineering

I build data pipelines with Kafka, Azure Databricks and Azure Data Factory.

Microsoft Fabric, Azure Data Factory, Azure Databricks, Apache Spark, PySpark, Kafka, SQL, Python

Reporting

I check pipeline output in Power BI Desktop and Grafana dashboards before anyone relies on it.

Power BI, Power Query, DAX, Grafana

AI systems

I work with retrieval-augmented generation (RAG), where the quality of the source data decides whether the answers are any good. I also built an approval step, so a person signs off before an automated action changes anything.

RAG, LangChain, LangGraph

Engineering

At FNETT I led the backend migration from PHP to Node.js and Express.js, and confirmed the new system returned the same results as the old one.

Git and GitHub, Docker, Linux, REST APIs, testing and documentation