Understanding Byte Pair Encoding (BPE) in Large Language Models
Understanding Byte Pair Encoding (BPE) in Large Language Models
3 viewsDec 25, 2024
substack.com
The Data Secret: Why Your AI is Only as Good as Your Text
4:39
The Data Secret: Why Your AI is Only as Good as Your Text
1 week ago
YouTubeAI Researcher
Byte Pair Encoding | CS336
0:44
Byte Pair Encoding | CS336
1 month ago
YouTubeaiconcept2reel
LLM Subword Tokenizer Explained: Byte-Pair Encoding (BPE) with HuggingFace and OpenAI
4:57
LLM Subword Tokenizer Explained: Byte-Pair Encoding (BPE) with HuggingFace and OpenAI
66 views3 weeks ago
YouTubeAI Simply Explained with Tiyasa
🔥 The Secret Behind ChatGPT: Tokenization & Embeddings Explained
12:27
🔥 The Secret Behind ChatGPT: Tokenization & Embeddings Explained
52 views2 months ago
YouTubeTechBull
AI Doesn’t Read Words 😳 | Tokenization Explained Simply #tokenization #llm #BytePairEncoding
2:58
AI Doesn’t Read Words 😳 | Tokenization Explained Simply #tokenization #llm #BytePairEncoding
319 views2 months ago
YouTubeSimplfyTech
Byte Pair Encoding (BPE) Explained: Solving the Rare Word Problem in NMT
6:23
Byte Pair Encoding (BPE) Explained: Solving the Rare Word Problem in NMT
6 views2 months ago
YouTubeWhite Paper Decoder
17:30
Tokenization Explained - The 2016 paper behind every LLM
39 views1 month ago
YouTubeThe Rabit Hole Dev
0:48
What is Tokenization?
17.5K views1 week ago
YouTubecodebasics
2:30:54
Cómo funciona el "cerebro" de ChatGPT: Guía de Tokenización y BPE
1 views2 weeks ago
YouTubePurrfectAI
1:44:17
**斯坦福这场2小时讲座的核心内容总结**（演讲者为斯坦福讲师，主要讲解大语言模型LLM的底层技术逻辑）：演讲者用非常硬核、系统的方式，把ChatGPT、Claude等主流大模型的“底层核心逻辑”彻底拆解，重点围绕**训练目标、Tokenizer、评估方法、数据**四个核心模块展开，全程干货密集，几乎没有废话。### 1. **核心训练机制（Loss函数）**- LLM的本质是**下一个token预测**（next token prediction）。- 使用**交叉熵损失（cross-entropy loss）**来训练，目标是**最大化文本的似然度（likelihood）**。- 简单说：模型每一步都在学习“给定前面内容，下一个最可能的词是什么”，通过不断最小化损失来实现。### 2. **Tokenizer（分词器）**- 为什么不用单词或字符直接分？因为**token要更通用、更高效**。- 主流方法是**Byte Pair Encoding (BPE)**： - 从大语料开始，先每个字符一个token； - 反复合并出现频率最高的相邻token对，形成常见子序列作为最终tok
789K views1 week ago
x.com渡边君
33:38
台大资讯 深度学习之应用 ｜ ADL 5.1： BPE (Byte-Pair Encoding) Tokenization 如何将字词切成小单元
24 views2 weeks ago
bilibili小尹不吱声
3:37
BPE Tokenization Algorithm | The Secret Behind GPT & Transformers 🚀| Arvind Sir
301 views8 months ago
YouTubeCOMPILE KARO
6:20
Encoder Decoder Network - Computerphile
157.1K viewsJun 13, 2018
YouTubeComputerphile
6:26
Sequencing - Turning sentences into data (NLP Zero to Hero - Part 2)
233.7K viewsFeb 25, 2020
YouTubeTensorFlow
1:00
Byte Pair Encoding (Subword Tokenization Method in NLP) #Shorts
3.8K viewsJun 22, 2021
YouTubeTechViz - The Data Science Guy
7:25
Bytes and Bytearray tutorial in Python 3
68.8K viewsSep 5, 2018
YouTubeDevDungeon
29:14
Text Classification Using BERT & Tensorflow | Deep Learning Tutorial 47 (Tensorflow, Keras & Python)
194.3K viewsAug 28, 2021
YouTubecodebasics
15:07
Lecture 3/12: Bits, Bytes and Words
158.3K viewsJan 12, 2015
YouTubehhp3
11:32
Converting words to numbers, Word Embeddings | Deep Learning Tutorial 39 (Tensorflow & Python)
131K viewsMar 13, 2021
YouTubecodebasics
10:46
NLP Lecture 6(a) - Encoder Decoder Networks
5K viewsOct 30, 2020
YouTubeProf. Ghassemi Lectures and Tutorials
14:45
NLP - Tokenization
1 views3 months ago
YouTubeNathan Rigoni
10:28
ChatGPT - Explained!
79.8K viewsDec 12, 2022
YouTubeCodeEmporium
3:50
WordPiece Tokenization
27.9K viewsNov 15, 2021
YouTubeHugging Face
3:28
WordPiece Tokenization in NLP
4.7K viewsJul 30, 2022
YouTubeTechViz - The Data Science Guy
50:05
Lec 06 | Tokenization
660 views7 months ago
YouTubeLCS2
23:07
L27: Byte pair encoding
7.4K viewsDec 26, 2024
YouTubeIIT Madras - B.S. Degree Programme
7:23
Word Piece And Byte Pair Encoding (Natural Language Processing at UT Austin)
2.2K viewsApr 7, 2022
YouTubeGreg Durrett
12:28
Byte Pair Encoding Word Segmentation
6.2K viewsMay 25, 2021
YouTubeAKAdemy
2:57
Byte Pair Encoding Tokenization in NLP
9.6K viewsJul 23, 2022
YouTubeTechViz - The Data Science Guy
See more