AmzadHossainrafis/BLLMC

A highly modular, extensible, and high-performance PyTorch library for training and deploying Bangla Language Models (LLMs) from scratch. Built with a focus on modern LLM innovations including Sliding Window Attention (SWA), Rotary Position Embeddings (RoPE), and Sparse Mixture of Experts (MoE).