NLP第二阶段学习 从零开始训练GPT模型
NLP第二阶段学习 从零开始训练GPT模型
代码
# train_tiny_llm.py
import torch
import torch.nn as nn
import torch.nn.functional as F
from torch.utils.data import Dataset, DataLoader
from tokenizers import Tokenizer, models, trainers, pre_tokenizers
import json
…
2026/7/29 7:13:27