Skip to content
View TalhaYamin364's full-sized avatar

Block or report TalhaYamin364

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
talhayamin364/README.md

Hi, I'm Talha Yamin 👋

Analytics Engineer · pipelines, warehouses and streaming · Dhaka, Bangladesh

Nearly five years building the data infrastructure behind analytics, currently as a Senior Data Analyst (Analytics Engineering) at Optimizely. My day-to-day is production engineering: Python ingestion into Snowflake on Kubernetes, tested dbt marts, cost-controlled warehouses with Terraform, and CI that builds and diffs changes against production before review.

Right now: building an end-to-end streaming lakehouse for telecom usage records: Kafka into Spark Structured Streaming and Iceberg on HDFS/YARN, with idempotent writes, deduplication, late-arriving data handling and safe day-level backfills.

Tech I work with

Daily use

Snowflake dbt SQL Python Power BI Terraform Kubernetes GitHub Actions Google Cloud

Building now

Apache Hadoop Apache Spark Apache Kafka Apache Iceberg Docker

Also used

Apache Airflow Tableau

Selected work

  • Quote-to-revenue reconciliation: sole developer of a quarterly dbt build (17 models, 13 matching macros, primary-key tests across 20+ source tables) that reconciles multi-year quotes to signed-contract terms, raising the match rate from 61% to 92%.
  • Finance close: built the tested dbt suite behind the monthly close, cutting the manual rebuild from 4–5 days to about 1, and rewrote a 14M-row shared model with zero differences across 9.6M rows compared.
  • Warehouse cost control: designed the analyst Snowflake warehouse and its cost monitor in Terraform, shipped through GitHub Actions: auto-suspend, query timeout and a daily credit cap with alerts.
  • Safer changes: Python pre-push hooks that build each changed dbt model against production and diff row counts and nulls before review.

Featured projects

Project What it is Stack
telecom-lakehouse-streaming-platform A mobile operator's call, SMS and data records streamed through Kafka and Spark into an Iceberg lakehouse (bronze, silver, gold), run locally in Docker. Status: HDFS + YARN cluster and Spark-on-YARN verified; Kafka ingestion and the lakehouse layers are in build. Every change goes through an issue, a PR, CI and review. Hadoop, Spark, Kafka, Iceberg, Docker
dse-stock-screener Scrapes Dhaka Stock Exchange data, scores stocks on stability, and outputs a diversified allocation, with a step that re-checks live prices before acting. Python
Full-Stack-Expense-Tracker A CLI expense tracker rebuilt as a three-tier web app: FastAPI backend, Flask frontend, SQLAlchemy persistence. FastAPI, Flask, SQLAlchemy
Chicago-Taxi-Cab-Tableau-Analysis A Tableau story of the taxi business's decline, set against ridesharing and COVID-19. Tableau

Find me

LinkedIn YouTube

GitHub streak

Pinned Loading

  1. telecom-lakehouse-streaming-platform telecom-lakehouse-streaming-platform Public

    Telecom CDR lakehouse: Kafka, Spark Structured Streaming, Hadoop (HDFS/YARN) and Iceberg, run locally in Docker

    Shell 1

  2. Adept-Projects Adept-Projects Public

    A collection of projects for the Adept Mentor program

    Python

  3. Customer-Churn-Analysis Customer-Churn-Analysis Public

    Customer Churn Analysis on a dummy ecommerce platform dataset

  4. dse-stock-screener dse-stock-screener Public

    Data-driven stock screening tool for the Dhaka Stock Exchange. Scrapes DSE, scores on stability metrics, outputs diversified portfolio allocation.

    Python