313 pointsby sgiannopoulos3 hours ago13 comments
  • torben-friis25 minutes ago
    I've got a question. I'm having a bit of trouble phrasing it, so please don't assume I'm against learning for learning's sake, that's not the point.

    Whenever I've tried to learn about LLMs, machine learning, etc. I always come out with a bad feeling, compared to learning about software.

    Theoretical courses make me feel like it's all baby steps, unless you assume a level of commitment equivalent to a math degree. Practical/applied stuff seems to require levels of compute, training data, etc. that make it unapproachable for a home hacker for everything beyond basic exercises like a handwritten digit classifier.

    Now this feeling of "impracticality" is perfectly fine. It would be the expected outcome if I was taking a course on classic literature or modern art. But machine learning stuff feels like it could have room for learning-by-doing applications that aren't entirely pointless, so I wonder if there's some way to approach the topic I'm simply not finding.

    Did anyone have the same experience? any tips if so?

    • danielmarkbruce17 minutes ago
      Get Sebastian's book and build an LLM from scratch. The problem with most textbooks (on any subject, it's not unique to ML/AI) is they usually try to build the theoretical foundations first. In many cases things are better taught top down.
    • russli199310 minutes ago
      I feel the same. I feel machine learning is 1) you need strong math knowledge but also intuition. 2) You need actual production level data, a lot of the nuances of machine learning, applied scientists' roles are how to build strong models with real world, messy, inconvenient data. You need to apply various techniques and not just memorize a specific formula.

      Compared to software coding, you build websites, apps etc. The barrier to entry is much higher.

      I am trying to pivot into machine learning myself, so far my understanding is try to find a software engineer role where you deal with data, model infra, data pipeline, etc. Then within the same company, try to do more modeling work and build intuition and resume credentials in this area. Someone correct me if I am wrong.

  • darrelld2 hours ago
    I got his book Build Your Own LLM From Scratch and it's super readable and does a great job at holding your hand through the entire process...need to finish reading it though!
    • lucasoshiroan hour ago
      I don't like working with neural networks and I always found everything overcomplicated or oversimplified, sometimes both at the same time.

      But this book is almost perfect. Every new concept is well described and every is well founded. And every step moves you forward (if you know, you know)

    • fuddle28 minutes ago
      I read it the first time with a study group which was very helpful.
    • globular-toastan hour ago
      I like it too. Haven't got very far through it yet but just learning about how to use PyTorch and finally getting how back propagation works via autograd etc. was really fun and enlightening.
  • kavalg3 hours ago
    Highly recommended! Sebastian does a great job explaining complex AI topics in a very intuitive way.
    • artninja19883 hours ago
      Karpathy 2.0!
      • krosaenan hour ago
        They are contemporaries - cs231n and Sebastian's first ML book came out in 2015 - both excellent!
      • tomrod2 hours ago
        Other way around. Raschka's been doing this over a decade.
        • nxtfari42 minutes ago
          Karpathy also. CS231n first came out in 2015.
      • recroadan hour ago
        Karpathy might be Raschka 2.0
  • dan-gan hour ago
    I’ve read, worked through, and watched his LLM book as well as this one! Things finally clicked, can’t recommend both books enough—his pedagogy is great (at least for me).
  • gradus_ad17 minutes ago
    All of these build your own model guides are like someone putting out a build your own CPU guide 10 years ago. Interesting, but not of any practical use.
    • danielmarkbruce16 minutes ago
      You can take any open source model and continue training it. It's nothing like building a CPU.
  • abdiadem954an hour ago
    I just started reading his book, and he makes it easy to grasp difficult concepts. As a matter of fact, I have been working on platform where you can learn how AI models work in an interactive manner.
  • rvz21 minutes ago
    This is an essential resource and his book is a must read from this author. I have the upmost respect for Raschka for his research and detailed explanations in AI including him dissecting research papers.
  • an0malousan hour ago
    Do you not just say “do reasoning” and leave it an open “<reasoning>” tag?
  • misiti3780an hour ago
    I have read both and the are excellent
  • brcmthrowawayan hour ago
    saved
  • kettlecrisp992 hours ago
    [flagged]
  • GL262 hours ago
    someone's getting auction-poached at openai and anthropic
    • _12 hours ago
      he's a well known author on LLMs already.
  • hypfer2 hours ago
    I'm a bit confused as to who this is for - apart from learning how the tech works that is.

    If you're truly going to build your own model (and commit to the cost of that), then video tutorials will not cut it.

    And if you don't really, then I wonder if this is really the best style of conveying the information you'd be interested in?

    I mean I might be wrong and maybe this helps emerging players or something like that, but to me it is more likely that this is more of a monetisation strategy of a personal brand. Living off selling to people that think they _should_ but then in the end don't.

    • TheCowboyan hour ago
      You can follow his book and learn how to build an LLM from scratch. What is the issue?

      It's also not a bad foundation for people who want to understand how these things are trained and work.

    • lucasoshiro36 minutes ago
      Why teach people to play guitar once a week if they won't be a new Jimi Hendrix? Why teach people to run if they won't be a new Usain Bolt?

      Maybe because they don't want to be an "emerging player" or something, they only want to understand how a new technology that is changing the world works and prefer to learn by doing.

      If Sebastian is doing it by its personal brand, he really deserves it. I would trust him because I know he is a reference on his area of knowledge and I know he is because he shares his knowledge instead of only making fancy talks.

    • john_strinlaian hour ago
      >apart from learning how the tech works that is.

      some people enjoy learning how the tech works

      • ghurtado39 minutes ago
        "apart from learning how to make cookies at home, I really don't see the point of this cookie recipe"
      • hypferan hour ago
        Like me!
    • Lucasoatoan hour ago
      Let’s not be this negative, we might be going towards a new direction with technology that could allow small teams to build their own models. Maybe not frontier models. Maybe not close to the others in generalized benchmarks. But perhaps they could be really specialized into solving one particular problem better than the others.
    • siva7an hour ago
      You wrote so many words to say .. nothing of substance .. i still have no clue what you are criticizing.
      • hypferan hour ago
        I think you actually do and that is exactly what resulted in this style of reply.

        It's a critique of the people and the lack of substance. But not of the author. The author is highly capable.

    • CamperBob2an hour ago
      If you're truly going to build your own model (and commit to the cost of that), then video tutorials will not cut it.

      That makes no sense. It's like saying if you want an engineering degree, going to lectures will not cut it. Of course not, you have to do the homework and projects too.

      • hypferan hour ago
        Yeah but if it is not all that useful, why is it saying that it is "from scratch" and what is it doing on #1 of the front page?

        Something is off here. It indeed makes no sense

        • LoadbearingGunan hour ago
          Then you're not the target audience. This is intended for people who like learning things.
          • hypferan hour ago
            You're right about me not being the target audience, but you're wrong about the second sentence I think.

            The target audience of this is for people that like to _think_ they're doing stuff by paying for it, to then not do anything.

            It's a purchase of an identity, basically.

            Which.. I guess is fine as something to cover Sebastian's expenses to enable him to keep delivering this free stuff. If you want to take money from someone, taking from this group is likely the most ethical thing to do.

            • danielmarkbruce11 minutes ago
              You are completely off base. His initial book was released almost two years ago. I post train models, for work, and I learned more from his book on LLMs than any other source on LLMs. There is a lot more to it than that book, but you have to start somewhere, even if you have a decent theoretical foundation. There are a bunch of people who learned how to build them from his book.

              How do you think people learn to build/train models? It comes down from the sky?

            • ghurtado34 minutes ago
              "I know I'm not the target audience and I don't have any interest in how things work, but let me tell you how you're wrong by telling you who the actual target audience is"

              What's next? Are you going to give us your opinion of music genres you don't ever listen to? And tell us who should listen to them too, I suppose.

            • goobatroobaan hour ago
              It seems that the videos are free to access so I don't understand this comment. You think he's getting rich off selling the accompanying book?
              • hypferan hour ago
                No definitely not. You don't get rich with substance in this economy.

                He is covering expenses. Probably barely.

                • ghurtado32 minutes ago
                  You can't even stick by the same opinion from one comment to the next.

                  It seems that you want to oppose something really badly today, but you're struggling to find something that makes sense for more than 5 minutes.

                  • hypfer29 minutes ago
                    Is that so?
            • zaphar38 minutes ago
              You sound like you are projecting a bunch of motivations and assumptions about character onto other people. But you projecting such things onto another person is a terrible way to begin to understand something.

              There are genuinely people who enjoy learning how something works by doing smaller scale versions of it themselves. This site happens to have a much higher average percentage of them than most other places.