HAMZA EL QADIRI
Data Engineer

Data Engineer with strong Data Science and Analytics foundations, holding a Bachelor's in Data Analytics and currently completing a Master's in Computer Software Engineering (Big Data specialization) at the University of Almería. I design and optimize data-driven solutions using Python, SQL, Apache Spark, and large-scale processing technologies, from raw ingestion to production-ready pipelines. My strength lies in turning messy data into clear, actionable insight through preprocessing, exploratory analysis, and applied machine learning.

Profile Picture

Selected Work

Featured Projects

A curated collection of data engineering, analytics, and AI/ML projects that demonstrate end-to-end problem solving.

More Projects
Network Intrusion Detection with PySpark MLlib & Spark Streaming
Real-Time Cyber Threat Detection with Kafka, Spark & XGBoost
IPP Video Codec from Scratch in Python (DCT & Motion Estimation)
Data Loading Benchmark: 6 Ingestion Strategies Compared
Real-Time Market Data Streaming with Kafka & Flink (Kappa Architecture)
Sales Performance Dashboards in Tableau (CRM + ERP)
Medallion Data Warehouse on SQL Server (ERP + CRM)
HR Analytics Dashboard in Tableau
Retail Sales & Customer Analytics in Tableau
Azure E-commerce Data Pipeline (Data Factory, Databricks, Synapse)
Data Engineer

Azure E-commerce Data Pipeline (Data Factory, Databricks, Synapse)

Automated e-commerce sales reporting with an Azure pipeline (Data Factory, ADLS Gen2, Databricks/PySpark, Synapse) that feeds Power BI dashboards and replaces slow manual data preparation.

Azure Data Lake Gen2 storageAzure Data FactoryAzure Databricks+3 more
View project
Coming Soon

Next Project in Progress

I'm always working on something new — from real-time ML pipelines to interactive data dashboards. Stay tuned, or reach out if you'd like to collaborate.

Let's Talk

Work Experience

Centro de Investigación en Energía Solar (CIESOL)

AI & Data Engineering Intern

Centro de Investigación en Energía Solar (CIESOL)

CurrentSep 2026 — Present

Developing a lightweight anomaly detection system for climate sensor data targeting Edge Computing. Built a data acquisition pipeline to collect sensor data from the greenhouse for analysis and anomaly detection. Analyzing sensor data quality, missing values, gaps, and temporal patterns. Investigating lightweight neural-network and autoencoder-based approaches for anomaly detection. Designing the workflow from data acquisition → preprocessing → anomaly detection → model evaluation → Edge deployment. Working toward deployment and testing on NVIDIA Jetson hardware.

Data Analyst & AI Integration

CapAlliance

Jul 2024 — Jul 2025

Built an end-to-end AI-powered real estate analytics platform, designing ETL pipelines to collect, clean, and process property listings for analytics and machine learning. Trained a property price prediction model achieving 12.3% normalized RMSE, and developed Streamlit dashboards for market analysis and geospatial visualization. Integrated a RAG-powered chatbot for intelligent property search and insights, and deployed the complete solution as a Django web application.

Data Analyst & AI Intern

CapAlliance

April 2024 — Jul 2024

Data Collection (Python code, Parsehub) Data Analysis and Visualization using the Streamlit library Mapping with Mapbox Implementation of machine learning models for price estimation and prediction Development of a Chatbot with Voiceflow Integration of these components into a website developed with Django

Education

University of Almería

MSc

Computer Software Engineering (Big Data specialization)

University of Almería

2025 — 2027
Faculty of Sciences and Techniques of Tangier

BSc

Data Analytics

Faculty of Sciences and Techniques of Tangier

2023 — 2024

Skills & Tools

Languages & Backend

PythonSQLReactFlaskREST APIsFastAPI

Ingestion

Batch & Streaming PipelinesWeb ScrapingETL / ELT

Processing

PySparkData CleaningHadoopApache Spark

Warehousing

SnowflakedbtData WarehousingDimensional Modeling

Orchestration

Apache Airflown8n

Cloud & DevOps

Azure / GCPGit / GitHubCI/CDDockerKubernetes

ML & AI

RAGLangChainscikit-learnMachine LearningPrompt EngineeringLLM APIsTensorFlow / Keras

Analytics & BI

Data VisualizationExcelData AnalysisPower BIStatisticsData Mining

Languages

Arabic

Native

English

Fluent

French

Professional Working

Spanish

Conversational

Certificates & Awards

Associate Data Engineer

Associate Data Engineer

DataCamp

20/06/2026
Introduction to Snowflake

Introduction to Snowflake

DataCamp

15/06/2026
SQL (Advanced) Certificate

SQL (Advanced) Certificate

HackerRank

11/06/2026
Database Design

Database Design

DataCamp

07/06/2026

Databricks Fundamentals

Databricks

29/04/2026
Python Programmer Bootcamp

Python Programmer Bootcamp

365 Data Science

16/11/2024
Introduction to Data and Data Science

Introduction to Data and Data Science

365 Data Science

07/11/2024
Advanced Learning Algorithms

Advanced Learning Algorithms

Coursera

21/10/2024
Supervised Machine Learning: Regression and Classification

Supervised Machine Learning: Regression and Classification

Coursera

17/09/2024
Career Essentials in Data Analysis

Career Essentials in Data Analysis

Microsoft and LinkedIn

23/08/2024
Python for Data Science, AI & Development

Python for Data Science, AI & Development

IBM

20/03/2024

Get In Touch