Models I've created as "extra credit" after finishing Sebastian Raschka's book
"[Build a Large Language Model (from Scratch)"
Giles Thomas
gpjt
AI & ML interests
Doing my best to speedrun 20 years of AI research. YMMV
Recent Activity
updated a model about 11 hours ago
gpjt/8xa100m40-baseline-3 published a model about 11 hours ago
gpjt/8xa100m40-baseline-3 updated a model about 11 hours ago
gpjt/8xa100m40-baseline-2Organizations
None yet
models 23
gpjt/8xa100m40-baseline-3
Text Generation • 0.2B • Updated • 109
gpjt/8xa100m40-baseline-2
Text Generation • 0.2B • Updated • 109
gpjt/8xa100m80-no-amp
Text Generation • 0.2B • Updated • 232
gpjt/8xa100m40-weight-decay-cerebras
Text Generation • 0.2B • Updated • 334
gpjt/8xa100m40-weight-decay-gpt2
Text Generation • 0.2B • Updated • 319
gpjt/8xa100m40-qkv-bias
Text Generation • 0.2B • Updated • 66
gpjt/8xa100m40-schedule-learning-rate
Text Generation • 0.2B • Updated • 98
gpjt/8xa100m40-remove-dropout
Text Generation • 0.2B • Updated • 72
gpjt/8xa100m40-baseline
Text Generation • 0.2B • Updated • 69
gpjt/1xrtx3090m24-fineweb-edu-2x
Text Generation • 0.2B • Updated • 61