Chapter 61
অ্যাডভান্সড প্রজেক্ট
Advanced Projects
🏔️ ৫টি Advanced প্রজেক্ট
এই level = full production system। Distributed training, vector DB scale, multi-agent, monitoring — recruiter/clients-এর কাছে "senior" signal।
Project #1
Multi-Agent Research Assistant
Stack: LangGraph, CrewAI, Tavily, Llama-3-70B, Postgres
লক্ষ্য: Planner-Researcher-Writer-Critic agent graph — input topic → cited report (PDF)।
- Tool spec — web search, scrape, summarize, cite।
- LangGraph দিয়ে stateful workflow (retry, branch)।
- Critic agent → quality loop (max 3 iter)।
- Postgres-এ trace, cost log।
- Streamlit/Next.js UI + PDF export।
Stretch: Human-in-the-loop approval before publish।
Project #2
Self-hosted ChatGPT-clone with RAG + Tools
Stack: vLLM, Llama-3-70B-AWQ, Qdrant, Next.js, Auth.js, Postgres
লক্ষ্য: OpenAI-substitute — multi-user, multi-conversation, tool-calling।
- vLLM serve (4×A10G বা 1×A100) — OpenAI-compatible API।
- Function calling — calculator, web search, code exec।
- RAG — user document upload → per-user collection।
- Auth, billing (Stripe), rate limit।
- Token streaming, message edit, export।
Stretch: Voice mode (Whisper + TTS)।
Project #3
End-to-end Medical Image Diagnosis
Stack: MONAI, ViT/Swin, FastAPI, MLflow, DICOM
লক্ষ্য: X-ray/CT-তে pathology detect + Grad-CAM heatmap + radiology report।
- Public dataset (ChestX-ray14, RSNA) preprocess।
- Swin-Transformer fine-tune — multi-label classification।
- Grad-CAM/Attention rollout heatmap overlay।
- BLIP-2 দিয়ে natural language report generate।
- DICOM upload UI, HIPAA-style PII redact।
Stretch: Active learning loop — radiologist feedback retrain।
Project #4
Real-time Recommendation System
Stack: Kafka, Flink, Feast, TorchServe, Redis
লক্ষ্য: Click stream → online feature update → low-latency personalized rec।
- Synthetic event generator → Kafka।
- Flink — sliding window aggregate → Feast online store।
- Two-tower model (user/item embedding)।
- TorchServe inference, <50 ms p95।
- A/B framework — model A vs B, lift report।
Stretch: Bandit-based exploration (LinUCB)।
Project #5
Train a Small LLM from Scratch
Stack: PyTorch, FSDP, FlashAttention, tiktoken, W&B
লক্ষ্য: 100M–350M param Transformer — Bangla+English corpus-এ pretrain।
- Corpus সংগ্রহ (Wikipedia BN/EN, CulturaX) → 5-10B token।
- BPE tokenizer train (vocab 32k)।
- GPT-style decoder — 12 layer, 768 dim, RoPE, FlashAttn।
- FSDP/DeepSpeed-এ 4-8 GPU training (RunPod/Lambda)।
- Eval — perplexity, downstream task (sentiment, NLI)।
- HuggingFace Hub-এ release + model card।
Stretch: Instruction-tune + DPO → chat model।
Engineering Standards
- Monorepo (Turbo/Nx) বা clean folder structure।
- Unit + integration test (pytest)।
- Terraform/Pulumi দিয়ে IaC।
- K8s manifest / Helm chart।
- Detailed README + architecture diagram।
- Cost report — train + monthly serving।
💡 একটি কেস স্টাডি বানান
এই ৫টির একটি বেছে নিয়ে — 'problem → architecture → result → lesson' style-এ ৮-১০ মিনিটের video বানান। এটাই senior interview-এ trump card।
সারসংক্ষেপ
✨ এই অধ্যায়ে যা শিখলাম
- Multi-agent, self-host LLM, medical AI, real-time rec, scratch LLM।
- Production engineering — IaC, K8s, test, cost analysis।
- Case study video = senior-level hiring signal।