← All work
Data Engineering & Pipelines
American Campus Communities
Migrating a national housing operator onto a modern Databricks lakehouse.
- Client
- American Campus Communities
- Role
- Data & Backend Engineer
- Year
- 2025
The work
Designed and built the pipelines and services to move American Campus Communities off on-prem systems and onto a modern Databricks lakehouse, structured on a Medallion architecture with dbt, along with the microservices that move data between systems.
What shipped
- On-prem → Databricks migration pipelines on a Medallion (bronze, silver, gold) architecture with dbt
- A data export workflow pulling from Snowflake and delivering CSVs to Azure Blob Storage
- Asynchronous microservices in FastAPI, Pydantic, and SQLAlchemy on Azure Service Bus and EventGrid
- A core connector API orchestrating workflows across services, part of a company-wide migration to Databricks
- Databricks
- dbt
- Snowflake
- FastAPI
- Azure
Next project
Implentio