Title
AI generated template just for test
Projects
A selection of fictional projects demonstrating different areas of my technical experience.
DataFlow
Automated Data Pipeline
A production-style ETL pipeline that collects data from multiple sources, validates incoming records, transforms them, and loads the results into a PostgreSQL data warehouse.
Stack: Python · Polars · PostgreSQL · Celery · Docker
Highlights:
- Incremental data loading
- Data validation and deduplication
- Scheduled processing
- Error handling and retries
- Structured logging
InsightBoard
Interactive Analytics Dashboard
A web dashboard for exploring operational metrics and generating reports from processed datasets.
Stack: Python · Streamlit · Pandas · Plotly
Highlights:
- Interactive charts
- Filtering and aggregation
- CSV export
- Reusable visualization components
- Automated data refresh
ScrapeHub
Distributed Web Data Collector
A small distributed system for collecting structured information from multiple public web sources.
Stack: Python · Celery · Redis · PostgreSQL · Docker
Highlights:
- Parallel task execution
- Retry handling
- Rate limiting
- Persistent task state
- Data normalization
API Service
Internal Data API
A REST API providing access to processed datasets for internal applications and dashboards.
Stack: Python · FastAPI · Pydantic · SQLAlchemy · PostgreSQL
Highlights:
- Typed request and response models
- Database migrations
- Pagination and filtering
- Automated tests
- API documentation
Pipeline Monitor
Data Pipeline Monitoring Tool
A lightweight service for monitoring scheduled data-processing jobs and exposing their current status.
Stack: Python · FastAPI · PostgreSQL · Docker
Highlights:
- Job status tracking
- Execution history
- Failure notifications
- Health checks
- Simple monitoring UI
Tech Summary
| Area | Technologies |
|---|---|
| Languages | Python, SQL, Rust, Lua |
| Data | Pandas, Polars, Spark, PostgreSQL, DuckDB |
| Pipelines | Airflow, Celery, Kafka, dbt |
| Backend | FastAPI, SQLAlchemy, Pydantic |
| Visualization | Streamlit, Plotly, Dash |
| Infrastructure | Docker, Ansible, Pulumi, Linux |