2025 09 20 Week 1 - Session 1 TDS Sep 2025#

Duration: 2h 52m

Here’s an FAQ based on the provided transcript, summarizing student questions and instructor answers in a conversational style:

Q1: Where can I find the recorded video sessions for Tools in Data Science (TDS)? I’ve checked the C Portal and couldn’t find them.

A1: The entire course content, including recorded videos, is not hosted on the C Portal. Instead, it’s available on a separate site. The C Portal usually provides a link to this external site. All content will be available only via this specific site.

Q2: Will the recording of this session be available on YouTube?

A2: Yes, this session’s recording will be available on YouTube, usually within about a day.

Q3: Why isn’t the content for this course on the C Portal like other subjects?

A3: Most subjects have fairly static course content, but for TDS, roughly 20% or more of the content changes every term because it’s a rapidly evolving field. We need a dynamic solution that allows us to quickly update content, which the C Portal doesn’t easily facilitate. By hosting it on our own cloud provider, we can iterate quickly and rectify issues faster. This also makes all past course content publicly available via a GitHub repo, offering you more granular access than the C Portal. Additionally, assignments in TDS are parameterized by your email, generating unique datasets for each student, which is cumbersome to achieve on the C Portal.

Q4: Where will graded assignments be released, and how do I access them?

A4: Graded assignments will first appear on our main course website. We will also provide a link from the C Portal, but the primary place to find them will be our site as soon as they are released.

Q5: What’s the difference between the “Check” button and the “Save” button on the assignment portal?

A5: The “Check” button gives you instant feedback on whether your answer is correct. It doesn’t save your progress. To actually save your answers, you must click the “Save” button, which is available at the top and bottom of the page. If you don’t save, your answers won’t be recorded, even if they show as 10/10 from checking.

Q6: How do I know if my answers have been successfully saved on your server?

A6: When you hit “Save,” look at the top of the page. It will show a “Recent Saves” section. If your submission doesn’t appear there, it means we haven’t received your score. Always confirm you see an entry there after saving.

Q7: Can I submit my assignments multiple times? Which submission will count?

A7: Yes, you can submit multiple times. However, only your most recent submission is considered the official score. So, even if you had a perfect score previously, your last submission, whatever its score, is what counts. This policy is consistent across all subjects in the program.

Q8: I’m a direct diploma student from a non-programming background (e.g., civil/mechanical engineering), and I don’t have much coding experience. Will this course accommodate students like me, especially with advanced topics like Mad 1 and Mad 2 prerequisites?

A8: This is a common question. We understand some students may lack prior programming experience. That’s why Machine Learning Practice (MLP) is a corequisite for TDS – to ensure you gain some foundational Python and library usage skills before starting this course. We’ve raised this concern with operations regarding admission messaging. We will provide as much support as possible, but if you lack prerequisite skills, you will likely need to dedicate more time to the course. It is doable, but expect to spend double the time compared to someone with prior experience.

Q9: What are the specific programming skills or concepts I should focus on to succeed in TDS? Are there any short courses you recommend for API and deployment?

A9: Our course website clearly outlines the expected knowledge by module. We’ve curated high-quality external videos and starter code directly within the course content to save you time. The most crucial foundational tools are covered in Module 1, including:

• Using UV and NPX.
• Browser developer tools.
• Understanding JSON.
• Terminal commands.
• Basic SQL queries.
• Git and GitHub. These will be used constantly throughout the course.

The two most challenging and crucial concepts, which strongly correlate with student performance, are APIs (specifically REST APIs and how to build server-side APIs) and deployment (how to deploy your solutions to the cloud for public access). If you master these two, you will excel. Think of APIs as the “plumbing” connecting different parts of a system.

We don’t specifically recommend external short courses because our internal course material, including curated videos and starter code, is designed to be comprehensive and sufficient. If you encounter difficulties, we’ll address them in live sessions. Don’t underestimate the starter code and provided resources; they are carefully selected to maximize your learning efficiently.

Q10: Are there exams, projects, or other assessments, and what is their weightage?

A10: Yes, there are two projects, which are group projects (though individual submission of your unique code is required). We encourage collaboration as it mimics real-world scenarios and fosters faster learning. The course is open book/open internet, allowing you to use any resource, including AI tools like GPT, friends, or expert developers, as long as you produce the final result. All assessments have a 20% weightage: Project 1, Project 2, Remote Online Exam, Final Term Exam, and Graded Assignments.

Q11: Will the projects be the same as previous terms, and will they become harder?

A11: Projects change every term and typically become harder. This is because AI tools like GPT are constantly improving, so we need to challenge you to think at a systems level, which GPTs haven’t yet mastered. Our goal is to make you job-ready. Mastering this course alone can make you highly employable. If you only aim for a good grade without focusing on deep learning, you’re doing yourself a disservice.

Q12: Is there a specific tool or framework for creating AI agents (like N8N for workflow automation)?

A12: Yes, you will be creating AI agents and connecting data pipelines. We primarily provide access to OpenAI’s GPT models via an AI pipe token. You can use any provider, but we give you an OpenAI key that allows you to experiment with it. We don’t typically focus on tools like N8N directly in the course content because they might not be industry-standard yet and are still evolving. However, our TAs might demonstrate such approaches. We will teach you the underlying concepts of constructing robust agents and connecting different components, giving you the skills to adapt to various tools.

Q13: I’m concerned about how challenging the projects will be. Will the TAs provide significant support?

A13: We select our TAs rigorously, ensuring they have the patience and deep knowledge to guide students through potentially basic and technical concepts. Our goal is not for students to fail, but to provide the best possible support within our time constraints. We have three dedicated TAs for this subject, along with the instructor, offering multiple viewpoints and comprehensive assistance. We’ve invested more resources to help you succeed, as some students naturally require more support.

Q14: What about the end-term exam?

A14: There is an end-term exam, but it is administered separately at the test center. All other assessments (assignments, projects, remote online exams) are handled through our custom portal.

Q15: How much time will we have for projects?

A15: We give you plenty of time. For instance, Project 1 was released on September 20th and is due on October 20th, giving you approximately a month. You also get a preview of the project beforehand.

Q16: Can I use my existing Ubuntu 22.04 WSL setup, or do I need to update it?

A16: If you already have an Ubuntu 22.04 WSL setup, that’s fine; you don’t need to update it.

Q17: If I use a Linux system directly, is there anything specific I need to do for this course?

A17: If you’re using Linux directly, you don’t need WSL. You’ll install Ubuntu, and we’ll cover basic Linux commands. We recommend learning some fundamental Linux commands beforehand.

Q18: What if I prefer to use Oracle VirtualBox for my Linux environment instead of WSL?

A18: Oracle VirtualBox is also acceptable. Any Linux distribution works. While WSL is generally easier, especially on Windows 11, VirtualBox is fine. You can even dual-boot if you prefer.

Q19: Can I complete this course entirely on a Linux system?

A19: Yes, you can complete the entire course using a Linux system.

Q20: Can I use drag-and-drop functionality for files in WSL, similar to a VM?

A20: Yes, with WSL, you can use your Windows File Explorer to drag and drop files directly into your Linux environment, which is typically more convenient than what some VMs offer.

Q21: You mentioned a token for OpenAI. Is that provided, and can I use it from now on?

A21: Yes, we provide an OpenAI token via an AI Pipe login. You sign in with your email on our platform (aipipe.org/login), get the token, and can use it immediately. It comes with a $1 per week allowance. If you prefer, you can also use free providers like Gemini.

Q22: Is it possible to install Ubuntu WSL on a drive other than C:?

A22: Yes, it is possible, but it’s a bit more complex. Microsoft’s website provides instructions on how to change the default installation location for WSL distributions. You’ll need to modify some configurations, but it can be done.

Q23: I noticed that module 1 and module 2 submissions are due on the same date. Will this be challenging?

A23: Module 1 and 2 submissions are indeed due on the same date, October 5th. However, today is September 20th, so you have plenty of time. Module 1 should take no more than a week to complete, and Module 2 will be released soon.

Q24: What does “LTS” stand for in the context of Ubuntu versions?

A24: LTS stands for “Long Term Support.” Ubuntu releases new versions every year, but LTS versions are the final, stable releases that receive extended support, making them preferable for stability.

Q25: What should I do after installing Ubuntu WSL?

A25: After installing Ubuntu, your first step is to update WSL by running sudo apt update and sudo apt upgrade in PowerShell. This ensures all packages are up-to-date, which is crucial for subsequent installations and functionalities.

Q26: I’m seeing a problem with automatic answers appearing in the GA portal on certain browsers. Is this something that can be fixed?

A26: Yes, your observation aligns with some known issues. We’ll discuss this with Professor Anand. Regarding “hacking,” while we don’t penalize you for finding alternative ways to get answers, we do log all activity. Just because you successfully “hack” it doesn’t mean we’re unaware. We encourage you to engage in such problem-solving, but we also want you to understand the underlying concepts. For instance, in the toughest exam (ROE), despite allowing all resources, some students still struggled, showing that deep understanding is key. We actively track how students approach challenges to improve our course.

Q27: What are these release dates mentioned next to each module/content, like “24.04”?

A27: These dates, such as 24.04, refer to the GA (General Availability) release dates of the specific content or module version. These versions are fixed, so once installed, they won’t automatically update. It’s a snapshot in time.

Q28: Will the tools used for time-stamping video lectures (to jump to specific topics) be publicly available?

A28: Yes, we developed an AI tool internally to time-stamp our video lectures, allowing you to jump directly to specific topics. We’ll be making that tool publicly available on GitHub. This saves you time by avoiding the need to watch entire videos for specific information.

Q29: Can you explain the difference between the YouTube playlist and the content on the main course website?

A29: The YouTube playlist primarily contains recordings from past terms. The main course website (TDS.s-anand.net) hosts all current course content, including curated videos, lecture notes, and assignments. To get the most up-to-date and curated information, you should focus on the main course website.

Q30: I’m worried about my background (e.g., Mechanical Engineering) and my lack of programming knowledge. How can I best prepare for this course, especially with advanced topics like AI agents?

A30: It’s understandable to feel apprehensive. The instructor and TAs are here to help you bridge that gap. We’ll cover all the necessary basics, from command-line tools to API development. Our approach is hands-on, with live sessions demonstrating concepts. We encourage you to utilize all available resources, including our comprehensive course content and the Discord community, for support. The key is active engagement and not hesitating to ask questions. While we won’t deep-dive into every tool like N8N, we’ll teach you the foundational principles that apply broadly to AI agent development and data pipeline construction.

Q31: Will there be official groups or forums for student collaboration?

A31: While there are no official pre-assigned groups, we highly encourage student-formed groups and actively promote interaction on our Discord server. Discord is a critical platform for quick help and peer learning. We monitor it closely, and faculty often participate, demonstrating our commitment to supporting you. It’s a space where you can ask questions, share insights, and get real-time assistance.

Q32: Is it possible to see the names of people who have successfully “hacked” the exam?

A32: Due to data privacy concerns, we cannot disclose the names of students who achieved full marks, even if through unconventional methods like “hacking.” However, we do internally track and analyze these approaches to learn and improve the course design.

Q33: Will we be learning about tools like N8N for workflow automation and AI agents?

A33: We provide the fundamental concepts for building AI agents and workflows. While we don’t specifically focus on N8N, we aim to teach you the underlying principles so you can adapt to various tools. The TAs might demonstrate certain tools as possible approaches.

Q34: How are the graded assignments structured, especially regarding the underlying code?

A34: The graded assignments include starter code and related content directly embedded with the questions. Our data indicates that many students often skip the content and jump straight to answering. To ensure learning, if you get stuck, the relevant content is conveniently placed right above the question. This allows you to learn as you go.

Q35: What’s the process for getting the OpenAI API token, and is it free?

A35: We provide an OpenAI token through an AI Pipe login. You can get an allowance, which is free ($1/week) for experimentation. We offer instructions on how to sign up for this service. You can also use other free providers like Gemini if you prefer.

Q36: Is WSL 11 required, or can I use WSL 10 for the course?

A36: WSL 11 is not strictly required. WSL 10 is perfectly fine for this course.

Q37: What about the syllabus or roadmap for the course? Where can I find that?

A37: All course content, including a detailed roadmap by module, is available upfront on our main course website. You can view it all from the beginning to understand what’s expected.

Q38: Is there a specific process to enroll in the Discord channel?

A38: Yes, we usually enroll students into the Discord channel. If you’re not yet on it, please send an email to our support team, and they will assist you.

Q39: My voice is garbled; can you still hear me?

A39: Yes, I can hear you clearly now.

Q40: My screen shows Ubuntu opening from PowerShell. How do I achieve that?

A40: To enable WSL and install Ubuntu, you need to open PowerShell as an administrator and follow specific commands. First, run a command to enable certain Windows features (like “Virtual Machine Platform,” “Windows Hypervisor Platform,” and “Windows Subsystem for Linux”). After enabling these features and restarting your computer, you can then install Ubuntu using a command in PowerShell. Once installed, you can simply search for “Ubuntu” in your Windows search bar, and it will open its terminal.

Q41: What if my Internet connection is not good, causing issues during live sessions?

A41: We understand that connectivity can be an issue. All our live sessions are recorded and made available on our calendar almost immediately after they conclude. These recordings are eventually uploaded to YouTube within a day. So, even if you miss parts of a live session, you can always catch up later at your convenience.

Q42: What about the specific commands for installing Ubuntu WSL, especially if I’m not familiar with command-line interfaces?

A42: We will provide detailed instructions for installing Ubuntu via WSL, including the necessary commands. We also plan to offer basic command-line instruction to familiarize you with the syntax and common commands, ensuring you understand why certain commands like sudo apt update are used. While we won’t conduct a full system commands course, we’ll equip you with the essential knowledge to navigate the Linux environment.

Q43: What’s the best way to get clarifications or ask questions if I’m having trouble understanding a topic?

A43: For clarifying doubts, the Discord server is your best friend. It allows for quick responses from TAs, instructors, and peers. We’ve seen that Discord helps many students get answers efficiently. You can also ask questions during the live sessions. For specific, private queries, you can email the support team.

Q44: What’s the expected attendance in live sessions, and how will they be structured?

A44: We expect active participation in live sessions, which will be very hands-on. Instead of long lectures, we’ll focus on practical demonstrations, coding, and problem-solving. This approach ensures you gain practical skills directly.

Q45: My other courses overlap with the TDS live sessions. Will the recordings be available quickly?

A45: Yes, recordings will be made available very quickly after the live sessions on the course calendar, and within approximately 24 hours on YouTube. This ensures you can catch up even if you have scheduling conflicts.

Q46: Is there an official link to the course materials and YouTube playlist?

A46: Yes, the official main course website (TDS.s-anand.net) contains all materials. The YouTube channel link is also shared there, and I’ve provided it in the chat. Just search “IITM TDS” on YouTube.

Q47: Is there a specific guide for setting up Oracle VM for this course?

A47: Yes, there’s a similar installation guide for Oracle VM. You can find it under the VM section, outlining how to install Ubuntu from an ISO image.

Q48: Will the specific AI tools, like the one used for time-stamping videos, be publicly available for us to use?

A48: Yes, we will eventually make the AI tool used for time-stamping videos publicly available on GitHub. It’s a tool designed to enhance your learning experience by allowing you to navigate specific topics within the lectures efficiently.

Q49: How can I access the course material quickly if I’m on the go?

A49: The course content is accessible online, and recordings are available shortly after live sessions. You can access them from any device with an internet connection.

Q50: Can I get my personal notes from the sessions?

A50: Yes, I will share my personal notes from the live sessions. These are not official notes but my own annotations, which will be shared in a format like PDF.

Q51: What if I have feedback or suggestions for the course?

A51: We welcome feedback and suggestions. You can share them on the Discord channel or email the support team. Your input helps us continuously improve the course.

Q52: Where can I find the official course portal?

A52: The official course portal is TDS.s-anand.net. Always refer to this site for all official course information.

Q53: How can I access the recorded sessions and learning materials efficiently?

A53: All recordings are available on the course calendar shortly after live sessions and are uploaded to YouTube within a day. All learning materials are organized on the official course portal. We’ve created tools, like time-stamped videos, to help you navigate content efficiently.

Q54: What if I’m using a Mac? Is there anything specific I need to know?

A54: For Mac users, WSL isn’t applicable as it’s a Windows feature. You can skip that part. However, you can still learn the basics of Linux. You can use your Mac’s terminal and learn fundamental Linux commands. There are many tutorials online for “Linux for beginners” that would be helpful.

Q55: What should I do if I can’t open Ubuntu from PowerShell after enabling WSL?

A55: If you’ve enabled the necessary Windows features and restarted your computer but still can’t open Ubuntu from PowerShell, please contact the support team. They will assist you with troubleshooting the issue.

Q56: Will there be any other special sessions apart from the scheduled ones?

A56: Yes, if we identify a particular topic or a project that students are struggling with, we are flexible and will add more sessions as needed. This often happens with projects, where we might schedule four or five additional sessions to provide comprehensive support. These additional sessions will also be recorded.

Q57: Can you remind me again about the details for getting the OpenAI API key?

A57: You can obtain an OpenAI API key by signing in to the aipipe.org/login portal with your email. This provides you with an API token and a free $1 allowance per week. You can then use this key to interact with OpenAI’s models for your projects.

Q58: What if I messed up my Ubuntu installation or did something wrong during setup?

A58: If you encounter any issues during the setup or installation of Ubuntu, it’s fixable. If you’ve made mistakes (e.g., your Ubuntu isn’t coming up), there are instructions to recover from it. You can always uninstall the previous distribution and reinstall it cleanly. If you’re stuck, reach out to the support team or your TAs.

Q59: My microphone is not working properly. Can you hear me now?

A59: Yes, I can hear you now. Please go ahead with your question.

Q60: What’s the difference between Bash and Zsh?

A60: Bash is the default shell on many Linux systems. Zsh (Z Shell) is an extended version of Bash, offering more features and customization options. While they are similar in functionality, Zsh provides an enhanced command-line experience. For this course, you’ll find they work almost identically for the commands we’ll be using.

Q61: My voice is cutting out. Is the audio clear now?

A61: Yes, your audio is clear now. Please continue.

Q62: I’m worried about the difficulty of the projects. Will we get help with understanding the problem statements?

A62: Yes, we will dedicate sessions to explaining project problem statements in detail. For instance, for Project 1, the problem statement is already available on the course portal, and we’ll clarify any ambiguities during our project-focused sessions. We’ll ensure you have a clear understanding of what’s expected.

Q63: What about the deadlines for the projects and graded assignments?

A63: All deadlines for projects and graded assignments are clearly mentioned on the course calendar available on our website. Project 1, for example, is due approximately a month after its release. We provide ample time for you to complete your work.

Q64: My voice is garbled. Is it clear now?

A64: Yes, it is clear now. Please go ahead.

Q65: What about the security aspect of AI tokens? Are they safe to use?

A65: We provide guidelines on how to manage your AI tokens securely. While we ensure the provision of tokens is secure, it’s important for you to follow best practices to keep your keys safe. We will cover this during the sessions.

Q66: Can you give me the Discord link again?

A66: Yes, I’ve shared the Discord link in the chat. Please use that to join the community.

Q67: My voice is breaking up. Is it fine now?

A67: Yes, I can hear you now. Please continue.

Q68: Will we be taught how to do version control with Git and GitHub?

A68: Yes, Git and GitHub are fundamental tools for this course. We will teach you how to use them for version control and collaboration. This is part of the basic skills covered in the initial modules.

Q69: What are the specific commands for installing Ubuntu?

A69: The commands for installing Ubuntu are wsl --install followed by sudo apt update and sudo apt upgrade. These are standard commands that we will walk you through.

Q70: How is the grading done for the projects since there is no viva?

A70: Project grading has two main components:

1. Code Evaluation: Your code will be evaluated using an LLM-based rubric. We provide specific criteria (e.g., code quality, robustness, error checking) that the LLM checks against. This makes the evaluation very objective and unbiased.
2. Functionality: We use test cases to assess how well your application functions. Your server will receive specific inputs, and if it responds correctly according to the defined template, you get marks. These include both deterministic and subjective tests.

Q71: Can you quickly summarize the key points we’ve discussed today?

A71: We’ve covered several important aspects today:

• Course content is on our custom portal (TDS.s-anand.net), not the C Portal.
• Assignments are released on our portal, requiring a “Save” button click to submit.
• Your last submission is the official score.
• The course involves advanced programming, APIs, and deployment, which are crucial and often challenging.
• We provide significant support, including TAs, curated content, and a responsive Discord community.
• Projects change every term and are designed to be challenging but doable, making you job-ready.
• We covered WSL setup, the OpenAI API token, and basic command-line usage.
• All sessions are recorded and made available quickly.

Q72: Will you continue to provide links to the YouTube recordings, and when will they be available?

A72: Yes, links to the YouTube recordings will always be provided. They are typically available within 24 hours after a session concludes.

Q73: My voice is echoing. Is it better now?

A73: Yes, the echo is gone. Please proceed.

Q74: Is there a way to get the attendance list for the sessions?

A74: Yes, attendance is automatically recorded. We will use this information.

Q75: What’s the purpose of AI tokens, and how are they used in this course?

A75: AI tokens, like those from OpenAI, allow your applications to interact with large language models (LLMs). You’ll use them to send requests to the LLM (e.g., asking it to generate text or code) and receive responses. This is fundamental for building AI agents and integrating AI capabilities into your projects.

Q76: Are we going to be building AI agents without frameworks, or using specific tools?

A76: You will be building AI agents, and while you can use various frameworks, the course focuses on teaching you the underlying principles. We may demonstrate how to use specific tools, but the emphasis is on understanding the core concepts of AI agent development.

Q77: What does the && operator mean in Linux commands?

A77: The && operator in Linux commands means that the second command will only execute if the first command completes successfully. It’s a way to chain commands together ensuring dependencies are met.

Q78: I’m concerned about the time commitment. How much time should I allocate for this course?

A78: This course is challenging, so time commitment is important. While we provide flexible resources, if you’re new to programming, you should realistically expect to spend more time than others. We recommend dedicating consistent effort throughout the term.

Q79: My voice is breaking up. Can you understand me?

A79: Your voice is breaking up, but I can get the gist of your question. Please try to rephrase if possible.

Q80: Is there any specific Linux distribution recommended for installation?

A80: For WSL, any Ubuntu LTS (Long Term Support) version is recommended, such as Ubuntu 22.04 or 24.04. LTS versions offer stability and long-term support.

Q81: What about the security of using custom tools and external platforms for a course like this?

A81: We prioritize security. The course is designed to teach you how to build robust and secure applications. While we encourage using custom tools and external platforms, we also emphasize understanding security best practices. The Professor ensures that the evaluation methods are robust and fair.

Q82: Is it possible for me to get a copy of the presentation slides?

A82: Yes, the presentation slides used during the sessions will be available. They are usually uploaded along with the session recordings.

Q83: Will there be any opportunities for networking or interacting with industry professionals through the course?

A83: While direct networking events aren’t a core part of the course, the skills you gain are highly sought after in the industry. By actively engaging and building a strong portfolio through the projects, you’ll be well-positioned to interact with industry professionals during job searches or internships.