← Return to Homepage
Experience Breakdown & System Architecture

ETL Engine & E-Commerce Data Automation

Union Lighting & Furnishings · Montreal, QC | Data Analyst & Full-Stack Automation Intern
Internship Photo

01. High-Performance C# ETL Engine & SqlBulkCopy

At Union Lighting & Furnishings, I architected a custom C# ETL (Extract, Transform, Load) engine to seamlessly bridge real-time product catalogs and transactional inventories across both U.S. and Canadian database clusters.

By shifting from conventional row-by-row ORM iterations to .NET's native SqlBulkCopy and optimized streaming DataReaders, the engine pushed ingestion throughput past 10,000+ records per second, drastically slashing daily synchronization windows from hours to minutes.

// SYSTEM ARCHITECTURE (C# ETL PIPELINE & MULTI-REGION DB)
ETL Pipeline Architecture
// MULTI-REGION DB CLUSTER
Database Architecture
// SHOPIFY MATRIXIFY AUTOMATION
Shopify Matrixify Pipeline

02. Python-Driven SQL ETL Pipelines & Automated Sales Intelligence

To automate multi-database lifecycle management and operational notifications, I built an end-to-end Python engine using pyodbc, smtplib, and SQL Server (T-SQL).

The pipeline handles transactional data purging by dynamically archiving expired sales and multi-stage price increases into a centralized SM_Past_Sales history table. Integrated with complex time-series logic (such as 14-day upcoming event windows and weekend deadline detectors), it automatically generates HTML-rendered operational alerts with conditional CSS highlighting—enabling cross-functional teams to proactively manage vendor price adjustments and order fulfillment.

// AUTOMATED SALES ALERT & DYNAMIC EMAIL RENDERING PIPELINE
Automated Sales Email Alert Pipeline
// DYNAMICS GP DATA MIGRATION
Dynamics GP Integration

04. Shopify Frontend Automation across 10,000+ SKUs

To scale frontend e-commerce operations, I automated product layout generation using custom Liquid templates integrated with Shopify's GraphQL/REST APIs.

This automated engine dynamically rendered detailed product specifications, variants, and localized pricing logic across a catalog of over 10,000+ SKUs, eliminating manual storefront maintenance and standardizing UI presentation.

// SHOPIFY LIQUID AUTOMATION & DYNAMIC SKU GENERATION
Shopify Liquid Automation
// SHOPIFY LIQUID AUTOMATION & DYNAMIC SKU GENERATION
Shopify Liquid Automation
← Back to Homepage