Gemini Ultra and GPT-4 are the leading generative AI platforms worldwide, and they compare alike in the reasoning benchmarks. Gemini Ultra is slightly ahead of GPT-4, beating it in three out of four benchmark categories. The lead is not so significant as to consider GPT-4 a lackluster model.
Comparison of reasoning benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 2024
Source notes: "Big-Bench Hard = Diverse set of challenging tasks requiring multi-step reasoning, DROP = Reading comprehension (FI score), HellaSwag = Common sense reasoning for everyday tasks"
Source notes: "MMLU = Representation of questions in 57 subjects (incl. STEM, humanities, and others)"
Profit from the additional features of your individual account
Currently, you are using a shared account. To use individual functions (e.g., mark statistics as favourites, set
statistic alerts) please log in with your personal account.
If you are an admin, please authenticate by logging in again.
Learn more about how Statista can support your business.
Encord. (December 7, 2023). Comparison of reasoning benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 2024 [Graph]. In Statista. Retrieved October 31, 2024, from https://www.statista.com/statistics/1450833/benchmark-comparison-gemini-ultra-gpt-4/
Encord. "Comparison of reasoning benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 2024." Chart. December 7, 2023. Statista. Accessed October 31, 2024. https://www.statista.com/statistics/1450833/benchmark-comparison-gemini-ultra-gpt-4/
Encord. (2023). Comparison of reasoning benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 2024. Statista. Statista Inc.. Accessed: October 31, 2024. https://www.statista.com/statistics/1450833/benchmark-comparison-gemini-ultra-gpt-4/
Encord. "Comparison of Reasoning Benchmarks between Google's Gemini Ultra and Openai's Gpt-4 2024." Statista, Statista Inc., 7 Dec 2023, https://www.statista.com/statistics/1450833/benchmark-comparison-gemini-ultra-gpt-4/
Encord, Comparison of reasoning benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 2024 Statista, https://www.statista.com/statistics/1450833/benchmark-comparison-gemini-ultra-gpt-4/ (last visited October 31, 2024)
Comparison of reasoning benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 2024 [Graph], Encord, December 7, 2023. [Online]. Available: https://www.statista.com/statistics/1450833/benchmark-comparison-gemini-ultra-gpt-4/
