A 70B model trained on far more data than usual. It showed that smaller models trained longer beat bigger under-trained ones, which shaped later LLMs.
Specs
More models from Google DeepMind
Questions about Gopher
What is Gopher?
DeepMind's 280B-parameter research model used to study what changes as language models get bigger.
How big is the context window of Gopher?
Gopher can read up to 2,048 tokens in one request, roughly 1,536 words.
Is Gopher open source?
Gopher does not have downloadable weights. You use it through Google DeepMind or an API provider.
Can I still use Gopher?
Gopher was a research model and was never offered as a public product. It is listed here for history and comparison.
What can Gopher take as input?
Gopher accepts text and produces text.
Latest AI models
MiniMax-M3.1-Flash is a multimodal model from MiniMax. Compared with M3, it delivers significant improvements across multiple benchmarks, particularly in complex agentic tasks, coding, and cybersecurity. It is built for complex,...
DeepSeek V4.1 Flash 1017 is the October 17, 2026 snapshot of DeepSeek V4.1 Flash, served by DeepSeek under the `deepseek-flash` API model name. V4.1 Flash is a sparse mixture-of-experts model...
Glimpse is a multimodal visual reasoning model from Elorian, built for visual understanding and complex visual reasoning in the physical world. It reasons directly over images and video rather than...
Xing4.0-29B-A4B is an open-weight mixture-of-experts language model from China Telecom's AI team (TeleAI) and the successor to the TeleChat series. It has 29B total parameters with 4B active per token...
Beam 1.0 is Reflection's open-weight reasoning model for coding and long-horizon agentic workflows. It uses a sparse mixture-of-experts architecture with 501B total and 23B active parameters per token, and a...
Mercury 3 is a diffusion-based language model from Inception, and the lab's most capable model to date. It is suited for agentic workflows and real-time applications where latency compounds, such...
Specs come from the provider's announcement and papers. Last checked 8 Dec 2021.