Skip to content
View lkv971's full-sized avatar
  • United States
  • 06:27 (UTC -04:00)

Block or report lkv971

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
lkv971/README.md

Hi, I'm Lee-roy 👋

Enterprise Data & Analytics Engineer

I design and build end-to-end data platforms across Microsoft Fabric and Azure Databricks, covering ingestion, medallion architecture, data quality, dimensional modeling, governance, orchestration, real-time analytics, semantic models, and CI/CD.

My work focuses on building production-style solutions that move from raw source data to governed analytical products and business-facing insights.


Core Stack

Data Engineering

  • Microsoft Fabric
  • Azure Databricks
  • Apache Spark / PySpark
  • Delta Lake
  • Lakeflow Jobs
  • Lakeflow Spark Declarative Pipelines
  • Fabric Data Factory Pipelines
  • Auto Loader
  • Medallion Architecture

Governance & Data Management

  • Unity Catalog
  • Row-Level Security
  • Dynamic Column Masking
  • Governed Tags & ABAC
  • Data Lineage
  • Audit / System Tables
  • OneLake
  • Delta Sharing

Analytics & BI

  • Power BI
  • Semantic Models
  • DAX
  • T-SQL
  • KQL
  • Fabric Warehouse
  • Eventhouse
  • Eventstream

DevOps

  • Git
  • GitHub Actions
  • Databricks Declarative Automation Bundles
  • OIDC / Workload Identity Federation
  • Fabric Git Integration
  • CI/CD

Certifications

  • Microsoft Certified: Fabric Analytics Engineer Associate — DP-600
  • Microsoft Certified: Fabric Data Engineer Associate — DP-700
  • Microsoft Certified: Azure Databricks Data Engineer Associate — DP-750

Currently expanding into AI engineering.


Featured Projects

Public, synthetic enterprise data-engineering implementation built on Azure Databricks.

Highlights:

  • Physical source files landed in ADLS Gen2
  • Incremental ingestion with Auto Loader and checkpoints
  • Bronze append history and Silver Delta MERGE processing
  • Schema evolution and data-quality quarantine
  • Lakeflow Job orchestration
  • Lakeflow Spark Declarative Pipeline
  • Gold dimensional model with facts and dimensions
  • Unity Catalog governance with RLS, masking, governed tags, and ABAC
  • Table and column lineage
  • Audit/system-table monitoring
  • Databricks Genie with benchmarked natural-language analytics
  • Bidirectional Microsoft Fabric ↔ Databricks interoperability
  • Declarative Automation Bundles
  • GitHub Actions CI/CD using OIDC workload federation

Synthetic public-sector analytics platform demonstrating enterprise Microsoft Fabric architecture while keeping commercial implementation and data private.

Highlights:

  • Bronze / Silver / Gold architecture
  • Fabric Lakehouse and Warehouse
  • Data pipelines and transformation workflows
  • Governance and analytical modeling
  • Public portfolio implementation using synthetic data

Medallion Lakehouse implementation for critical-minerals analytics.

Highlights:

  • CSV ingestion
  • PySpark transformations
  • Star-schema modeling
  • Power BI analytical reporting

End-to-end fleet analytics solution built with Microsoft Fabric.

Highlights:

  • SQL Server / CSV ingestion
  • Fabric pipelines
  • Dimensional modeling
  • Power BI reporting

Automated e-commerce supply-chain analytics pipeline.

Highlights:

  • Batch ingestion
  • Incremental processing
  • Dataflows
  • Semantic modeling
  • Power BI

Real-time operational analytics implementation using Microsoft Fabric.

Highlights:

  • Eventstream
  • Eventhouse
  • KQL
  • Delta Lakehouse
  • Real-time dashboards
  • Analytical reporting

Distribution analytics and forecasting platform.

Highlights:

  • Medallion architecture
  • Distribution KPIs
  • Time-series forecasting
  • Executive dashboards

Current Focus

I am currently expanding my engineering portfolio into:

  • Microsoft Foundry
  • Retrieval-Augmented Generation
  • AI agents
  • Document intelligence
  • Multi-agent systems
  • AI application evaluation and observability

Contact

Email: leeroyvaillant@outlook.com

Pinned Loading

  1. fabric-ecom-supplychain-analytics fabric-ecom-supplychain-analytics Public

    Open-source Supply Chain analytics on Microsoft Fabric: a scalable Bronze-Silver-Gold pipeline with automated CSV ingestion, Delta Lake transforms, semantic modeling (DAX & RLS) and interactive Pow…

    Python 2 1

  2. fabric-minerals-analytics fabric-minerals-analytics Public

    End-to-end Medallion Architecture on Microsoft Fabric for tracking the U.S. government’s 2020 critical minerals: automated pipeline ingests raw CSVs into Lakehouse, PySpark builds a star schema, a …

    Python 1

  3. fabric-realtime-flight-ops fabric-realtime-flight-ops Public

    End-to-end streaming flight data pipeline on Microsoft Fabric: real-time ingestion with Eventstream, dual sinks to Lakehouse & Eventhouse, star-schema transforms, incremental loads into Warehouse, …

    Python 1

  4. fabric-logistics-fleet-analytics fabric-logistics-fleet-analytics Public

    Medallion-architecture fleet analytics on Microsoft Fabric: ingestion from SSMS staging, cleansing & enrichment via Dataflow Gen2, storage as Delta tables in Lakehouse, curation through Fabric Ware…

    TSQL 2

  5. fabric-claims fabric-claims Public

    Production-ready Microsoft Fabric solution for healthcare claims. Ingests raw claims to Bronze, curates to Silver with PySpark notebooks, and publishes Gold to a Data Warehouse with upsert logic. I…

    Python