BookShared
  • MEMBER AREA    
  • Build a Large Language Model (From Scratch)

    (By Sebastian Raschka)

    Book Cover Watermark PDF Icon Read Ebook
    ×
    Size 25 MB (25,084 KB)
    Format PDF
    Downloaded 640 times
    Last checked 12 Hour ago!
    Author Sebastian Raschka
    “Book Descriptions: Learn how to create, train, and tweak large language models (LLMs) by building one from the ground up!

    In Build a Large Language Model (from Scratch), you’ll discover how LLMs work from the inside out. In this insightful book, bestselling author Sebastian Raschka guides you step by step through creating your own LLM, explaining each stage with clear text, diagrams, and examples. You’ll go from the initial design and creation to pretraining on a general corpus, all the way to finetuning for specific tasks.

    Build a Large Language Model (from Scratch) teaches you how to:

    - Plan and code all the parts of an LLM
    - Prepare a dataset suitable for LLM training
    - Finetune LLMs for text classification and with your own data
    - Use human feedback to ensure your LLM follows instructions
    - Load pretrained weights into an LLM

    The large language models (LLMs) that power cutting-edge AI tools like ChatGPT, Bard, and Copilot seem like a miracle, but they’re not magic. This book demystifies LLMs by helping you build your own from scratch. You’ll get a unique and valuable insight into how LLMs work, learn how to evaluate their quality, and pick up concrete techniques to finetune and improve them.

    The process you use to train and develop your own small-but-functional model in this book follows the same steps used to deliver huge-scale foundation models like GPT-4. Your small-scale LLM can be developed on an ordinary laptop, and you’ll be able to use it as your own personal assistant.
    about the book

    Build a Large Language Model (from Scratch) is a one-of-a-kind guide to building your own working LLM. In it, machine learning expert and author Sebastian Raschka reveals how LLMs work under the hood, tearing the lid off the Generative AI black box. The book is filled with practical insights into constructing LLMs, including building a data loading pipeline, assembling their internal building blocks, and finetuning techniques. As you go, you’ll gradually turn your base model into a text classifier tool, and a chatbot that follows your conversational instructions.”

    Google Drive Logo DRIVE
    Book 1

    Nexus: A Brief History of Information Networks from the Stone Age to AI

    ★★★★★

    Yuval Noah Harari

    Book 1

    Deep Learning with Python

    ★★★★★

    François Chollet

    Book 1

    Hands-On Machine Learning with Scikit-Learn and TensorFlow

    ★★★★★

    Aurélien Géron

    Book 1

    The Hundred-Page Machine Learning Book

    ★★★★★

    Andriy Burkov

    Book 1

    Escaping the Build Trap: How Effective Product Management Creates Real Value

    ★★★★★

    Melissa Perri

    Book 1

    Deep Learning

    ★★★★★

    Ian Goodfellow

    Book 1

    Deep Learning with PyTorch

    ★★★★★

    Eli Stevens

    Book 1

    Supercommunicators: How to Unlock the Secret Language of Connection

    ★★★★★

    Charles Duhigg

    Book 1

    Cobalt Red: How the Blood of the Congo Powers Our Lives

    ★★★★★

    Siddharth Kara

    Book 1

    Thinking, Fast and Slow

    ★★★★★

    Daniel Kahneman

    Book 1

    Reaper Man (Discworld, #11; Death, #2)

    ★★★★★

    Terry Pratchett

    Book 1

    "Surely You're Joking, Mr. Feynman!": Adventures of a Curious Character

    ★★★★★

    Richard P. Feynman

    Book 1

    Natural Language Processing with Transformers: Building Language Applications with Hugging Face

    ★★★★★

    Lewis Tunstall