Matiwos Desalegn
Senior Data Engineer
Addis Ababa, Ethiopia
Summary
5+ years building with data and software (since 2021), including production data engineering at scale since 2024. I build governed medallion lakehouses, hourly exactly-once CDC and contract-tested warehouse models, orchestrated by Airflow on Kubernetes.
Experience
Senior Data Engineer, Kifiya Financial Technology PLC
Jul 2026 to present, Addis Ababa, Ethiopia
- Run 200+ tables in hourly CDC replication for a smart mobility partner, with exactly-once loads, using OLake, Apache Iceberg, dbt on Trino and Amazon Redshift.
- Built a 6M-row Gold masterview (~16-table join) with dbt on Trino over Apache Iceberg, tested on its grain and served to BI through Apache Superset.
- Built CI/CD for dbt with GitLab CI and Amazon EKS: automated promotion between environments and rollback when a release fails.
- Built the lakehouse governance layer: lineage with OpenLineage and Marquez, PII cataloguing with OpenMetadata, and column-level access control and masking with Apache Ranger and Trino.
- Operate 30+ production Airflow DAGs on EKS with retries, data-quality checks and alerting.
Data Engineer, Kifiya Financial Technology PLC
Oct 2024 to Jun 2026, Addis Ababa, Ethiopia
- Built the company's first lakehouse on Amazon S3 with Athena and the Glue Data Catalog: 300+ tables cataloged from multiple institutional partners. Moving its pipelines from Mage AI to Airflow on EKS led to ~60% fewer pipeline failures.
- Built the database restore pipeline: ~30M rows restored daily into Aurora PostgreSQL, later served from ClickHouse for self-service analytics.
- Resolved a production database performance incident: 30+ staggered pg_cron materialized views ended a 95% CPU incident.
- Designed the Amazon Redshift warehouse: ~39M rows/day across 30+ tables for multiple institutional partners, 146/146 data-quality assertions passing, and a near real-time warehouse integration that replaced batch jobs.
- Built cross-cloud mobile analytics pipelines from Firebase Analytics and BigQuery into Apache Iceberg on Amazon S3, queryable in Trino.
- Built the ML feature store and a low-latency credit decision API: 50+ engineered features in an ML feature store on Feast, served by FastAPI on EKS at <200ms p95. Later took a crop-finance pipeline to 13 Feast features end to end.
Software Developer, HST Consulting PLC
Nov 2023 to Oct 2024, Addis Ababa, Ethiopia
- Designed and built the frontend of the company's SaaS HR and payroll product.
- Worked with the backend team to integrate the frontend with their REST APIs.
- Worked in a small startup team building software for HR operations.
Selected work
- wb-cdc-analytics: PostgreSQL to ClickHouse CDC in one command
An independent reference implementation of a CDC analytics pipeline: a public REST API into PostgreSQL, Debezium into Redpanda, ClickHouse with dbt marts, Airflow, Prometheus and Grafana, started with one command.
Skills
- Orchestration and pipelines
- Apache Airflow, dbt, Mage AI, Apache Spark (PySpark), PyIceberg, ETL and ELT pipeline design, Airbyte
- Streaming and CDC
- Change data capture, Debezium, Apache Kafka, Redpanda, OLake, AWS DMS
- Lakehouse and storage
- Apache Iceberg, Medallion architecture, Amazon S3 and Parquet, Trino, Apache Polaris catalog, Athena and the Glue Data Catalog
- Warehousing and modelling
- Amazon Redshift, PostgreSQL, Aurora PostgreSQL, ClickHouse, Dimensional modelling, BigQuery, Apache Superset, Redis, MongoDB, MySQL
- Observability and governance
- Data contracts and quality gates, OpenLineage and Marquez, OpenMetadata, Apache Ranger, Prometheus and Grafana, Pipeline alerting and on-call hygiene
- Cloud and platform
- AWS data platform (S3, EKS, EMR Serverless, Lambda, EventBridge, Secrets Manager, IAM and IRSA), Kubernetes, Docker, GitLab CI/CD, GitHub Actions, Linux
- Languages
- Python, SQL, Bash, TypeScript and JavaScript, Kotlin and Java (Android)
- Learning
- Apache Flink, Snowflake, Terraform
Education and credentials
- Kifiya AI Mastery Training Program (KAIM): data engineering and machine learning intensive, 10 Academy, Jun 2024 to Aug 2024. Completed with distinction.
- BSc, Electrical and Computer Engineering, Wolaita Sodo University, Sep 2018 to Jul 2023. GPA 3.69/4.0. Led the Google Developer Student Clubs chapter in the final year.
- Associate Data Engineer in Snowflake (career track), DataCamp, Jul 2026
- Associate Data Engineer in SQL (career track), DataCamp, Jul 2026
- Associate Data Engineer in Databricks (career track), DataCamp, 2026
- Inclusive Open Source Community Orientation (LFC102), The Linux Foundation, Aug 2026
- Intermediate SQL, DataCamp, Jul 2026
- Apache Airflow Essential Training, LinkedIn Learning, Feb 2026
Writing
Community and teaching
- Google Developer Student Clubs Lead, Wolaita Sodo University, Aug 2022 to Jul 2023
- Google Crowdsource Influencer, Google Crowdsource, Sep 2022 to present
- Internal machine learning lectures, Kifiya Financial Technology (internal), Apr 2026 to Apr 2026
- Data-science to data-engineering handoff template, Kifiya Financial Technology (internal), May 2026 to present