Tools in Data Science

    • May 2026: Tools in Data Science

    Marks Dashboard

    Week 0: Bridge Course
    • 📋 Syllabus

    Day 1 — Setup Day

    • Complete Notes
    • Installation
    • File Structure (Windows vs Linux)
    • Path Reading
    • Quiz & Exercises

    Day 2 — Linux & Shell Essentials

    • Survival Toolkit (/Notes/)
    • Terminal Navigation
    • touch, mkdir, rm, cp, mv
    • Basic Script Writing
    • Quiz & Exercises

    Day 3 — VS Code + Python Project Setup with UV

    • VS Code Setup
    • Virtual Environments
    • UV Workflow
    • Quiz & Exercises

    Day 4 — HTTP, APIs, Chrome DevTools

    • HTTP Fundamentals
    • Chrome DevTools
    • API Testing with curl
    • Quiz & Exercises

    Day 5 — Git & GitHub Workflow

    • Git Basic Flow
    • Init, Add, Commit
    • GitHub SSH Login
    • Quiz & Exercises
    Week 1: Dev Environment & Tooling
    • VS Code — Basics
    • VS Code — Advanced
    • UV — Basics
    • UV — Advanced
    • Bash Scripting
    • Git & GitHub
    • SQLite
    • HTTP Clients
    • Requestly
    • Data Formats
    • GitHub Pages
    • LaTeX

    Lab: Publish a Python library to PyPI Lab: Web Traffic Debugging with Burp Suite

    Week 2: Deployment & API Engineering
    • FastAPI Fundamentals
    • CORS & Middleware
    • Google OAuth 2.0
    • Config Management
    • Docker & Compose
    • Deployment Platforms
    • Logging & Testing
    • Observability
    • Cloudflare Tunnels
    • Local LLMs — Basics
    • Local LLMs — LM Studio & Ollama
    • Local LLMs — llama.cpp & vLLM
    • Local LLMs — MLX Labs

    Lab: Deploying Private LLMs with vLLM & API Gateway Lab: WebSocket Chat with Redis & PostgreSQL

    Week 3: LLM Engineering
    • Prompt Engineering — Foundations
    • Prompt Engineering — Reliable Reasoning & Output Control
    • Prompt Engineering — Prompted Applications & Production Practice
    • Context Engineering
    • Prompt Caching
    • Structured Output
    • LLM Architecture Survey
    • Multimodal Inputs
    • Vector Embeddings
    • Similarity Search
    • LLM CLI Tools
    • AI Coding Assistants
    • LangSmith & LiteLLM

    Lab: YouTube → Subtitles → Topics pipeline Lab: Cost-tracking dashboard

    Week 4: RAG & Hybrid RAG
    • Vector Databases
    • Chunking Strategies
    • Late Chunking
    • Contextual Retrieval
    • Hybrid Search
    • Reranking
    • Query Augmentation
    • Semantic Caching
    • Multimodal Embeddings
    • GraphRAG
    • LLM Grounding & Citations
    • RAGAS Evaluation

    Lab: RAGAS evaluation dashboard Capstone: BS Degree Chatbot

    Project 1

    Week 5: Agentic AI
    • Agent Fundamentals
    • Tool / Function Calling
    • Agent Evaluation & Benchmarking
    • Agent Memory Systems
    • Loop Engineering
    • Multi-Agent Systems
    • Specialized Agents
    • Model Context Protocol (/MCP/)
    • Async & Parallelism
    • Sandboxing Agent Code

    Capstone: Autonomous Research Agent

    Week 6: Web Data Acquisition & OSINT
    • ⚖️ Legal & Ethical Scraping

    Get the data

    • Hidden JSON APIs
    • Sitemaps, RSS & Structured Data
    • Wayback Machine & Common Crawl
    • Playwright & Selenium
    • Playwright Advanced
    • Pagination & Infinite Scroll
    • Authenticated Scraping

    Do it reliably

    • Rate Limits, Retries & Caching
    • Change Detection & Dedup
    • Anti-bot Patterns
    • Cloudflare Bot Protection

    Turn it into data

    • HTML → Markdown for LLMs
    • DuckDB + Parquet
    • Document Parsing

    Beyond text

    • Vision Models for Scraping
    • Image Processing Pipeline
    • Speech AI
    • Video Understanding

    Find & automate

    • Google Dorking
    • OSINT — Infrastructure & Records
    • Scheduled Scraping

    Lab: Scheduled scraper with GitHub Actions Lab: Open-Source Organisation Dossier Capstone: Job Posting Scraper Capstone: AI Signature Detection Capstone: Live Multilingual Translator

    Week 7: CI/CD, Security & Cloud

    CI/CD & containers

    • GitHub Actions Advanced
    • Advanced Docker

    LLM security

    • LLM Security — Offensive
    • LLM Safety — Defensive
    • OWASP LLM Top 10

    Recon & defence

    • Cloudflare — Defender’s Side
    • Dorking for Recon & Exposure
    • Person & Social OSINT

    Cloud infrastructure

    • VMs & SSH
    • Serverless Functions
    • Terraform & IaC
    • Cost Alerting & Budgets
    • Pub/Sub & Event-Driven

    Lab: Red-team your own API Lab: Full CI/CD to Cloud Run

    Week 8: MLOps & Fine-Tuning
    • Cloud Storage for ML
    • BigQuery ML
    • MLflow
    • Fine-Tuning Strategy
    • HuggingFace Ecosystem
    • Fine-Tuning Techniques
    • Quantization
    • Gemma 4 Fine-Tuning
    • Model Publishing & Cards

    Milestone: Full GCP Walkthrough

    Project 2

    Reference
    • Tools Glossary
    • Command Cheatsheet
    • All Lab Assignments
    • All Capstone Projects

    02 Project 2

    Project 2 (After Week 6)#

    P2 is available at https://exam.sanand.workers.dev/tds-2026-05-p2