Skip to content
View dbiswas55's full-sized avatar
1 follower · 0 following

Highlights

  • Pro

Block or report dbiswas55

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
dbiswas55/README.md

Hi, this is Dipayan Biswas 👋

My PhD research in Computer Science at the University of Houston focuses on multimodal AI, vision-language models, and computer vision for video understanding.

Lately, I’ve been building multimodal systems that make sense of long lecture videos: fusing speech, slide text, and visual frames with VLMs to generate chapter-level summaries, evaluated with LLM-as-judge methods and deployed on the NSF-funded VideoPoints platform.

This GitHub is where I share projects and tools across multimodal summarization, vision-language systems, object detection, and practical ML workflows.

If any of this sounds interesting, feel free to reach out: dipayan1109033@gmail.com

🌐 Website · LinkedIn · Email

Research Interests

Multimodal AI · Vision-Language Models · Computer Vision · Video Understanding · Multimodal Summarization · LLM Evaluation · Visual Grounding

Skills

Python · C++ · SQL · PyTorch · Transformers · OpenCV · vLLM · Ollama · FastAPI · Hydra · MLflow · DeepEval · LangChain · Git · AWS

GitHub Stuff

Pinned Loading

  1. vlmhub vlmhub Public

    A lightweight, config-driven framework for unified vision-language model inference across local and cloud backends, built on LiteLLM and Transformers.

    Python 1

  2. SOTA-Detection-Lab SOTA-Detection-Lab Public

    SOTA-Detection-Lab is a PyTorch-based framework for training, fine-tuning, and evaluating state-of-the-art object detection models on custom datasets. It supports Faster R-CNN, YOLO, CenterNet, Eff…

    Python 7

  3. edu-video-visual-detection edu-video-visual-detection Public

    Code and resources for the paper "Visual Content Detection in Educational Videos with Transfer Learning and Dataset Enrichment" (IEEE MIPR 2025).

    Python 2

  4. LearnMLOpsTools LearnMLOpsTools Public

    Hands-on MLOps tooling study: WandB vs MLflow side-by-side using PyTorch + FashionMNIST. Covers experiment tracking, metric logging, model artifacts, and visual analysis. More tools added as studied.

    Python 1

  5. retinaface-small-face-detection retinaface-small-face-detection Public

    Forked from biubug6/Pytorch_Retinaface

    Improved RetinaFace for long-distance face detection using an IoU-aware loss and auxiliary IoU head.

    Python 1

  6. LVVO_dataset LVVO_dataset Public

    A dataset of lecture video frames annotated with visual elements such as tables, charts, photographs, and illustrations, designed for visual content detection and educational video analysis.

    1