Jinpeng Zhang·Feb 15, 2025GPT Technical Evolutionary History (1)GPT stands for Generative Pre-Training Transformer, is a series of large-scale language models developed by OpenAI. In order to understand…
Jinpeng Zhang·Feb 4, 2025DeepSeek-R1 Technical Analysis: Incentivizing Reasoning Capability in LLMs via Reinforcement…In previous 5 blogs, I explained 5 key techniques DeepSeek model has used to reduce the training cost and improve model accuracy:
Jinpeng Zhang·Jan 30, 2025DeepSeek Technical Analysis — (3) Multi-Token PredictionBackgroundA response icon4A response icon4
Jinpeng Zhang·Jan 28, 2025Key Techniques Behind DeepSeek Model’s 10x Efficiency — (1) MoEBackgroundA response icon1A response icon1
Jinpeng Zhang·Jan 21, 2025Transformer Clear Explanation: Attention Is All You Need! — 2017Before Transformer, RNN(recurrent neural networks), LSTM(long short-term memory, a variant of RNN) and gated RNN have been firmly…
