What is GPT-4?
GPT-4 is the latest (as of May 2024) and largest LLM released by OpenAI. The number of parameters
Numerical values in an AI system that are modified during training to change the AI's performance.
GPT-4 developed a variety of capabilities, notably the ability to program and to give detailed responses to logical puzzles. Furthermore, it has shown some signs of having a theory of mind.
GPT-4 was trained using reinforcement learning from human feedback A method for training an AI to give desirable outputs by using human feedback as a training signal.
Different versions of GPT have “context windows” of different lengths. GPT-4 initially had multiple fine-tuned versions with context windows of up to 32,768 tokens, much longer than GPT-3.5’s 4,096 and GPT-3’s 2,048 tokens. Newer versions called GPT-4 Turbo and GPT-4o have a 128,000-token window.