The Gemini family of models are considered multimodal because they are capable of processing information from multiple modalities, including images, videos, and text. For example, you can send a Gemini model a photo of a plate of cookies and ask it to give you a recipe for those cookies.
Prompt | Response |
Give me a recipe for these cookies. ![]() |
**INGREDIENTS** - 1 c. (2 sticks) unsalted butter, softened - 3/4 c. granulated sugar - 3/4 c. brown sugar, packed - 1 tsp . vanilla extract - 2 large eggs - 2 1/4 c. all-purpose flour - 1 tsp. baking soda - 1 tsp. salt ... |
You can interact with the Gemini family of models using the Gemini API provided by Vertex AI on Google Cloud. For mobile and web apps, you can use the Vertex AI in Firebase SDKs to call the Gemini API and interact with the Gemini models directly from your app.
This page provides the following information about the Gemini models:
High-level comparison of the use cases for the various Gemini models, including their supported input types.
Comparison of the details for each model, for example maximum input tokens or maximum length of video.
Description of how Gemini models are versioned, specifically their stable, auto-updated, and preview versions.
Lists of available model names to include in your code during initialization.
List of supported languages for the Gemini models.
Available models
You can use any of the following Gemini models with Vertex AI in Firebase:
Gemini 1.5 Flash
Multimodal model that supports the same input and output types as 1.5 Pro (as well as total token count), but 1.5 Flash is specifically designed for high-volume, cost-effective applications.Gemini 1.5 Pro
Multimodal model that supports adding image, audio, video, and PDF files in text or chat prompts for a text or code response. Also, it supports long-context understanding with up to 1 million tokens.Gemini 1.0 Pro Vision
Multimodal model designed to handle text plus images and video for a text or code response. Cannot be used for chat.Gemini 1.0 Pro
Model designed to handle natural language tasks, multiturn chat with text and code, and code generation.
Jump to model names to include in your code
Use cases and capabilities for each model
Each Gemini model has different capabilities to support various use cases. You can learn more in the Google Cloud documentation about each of the Gemini models.
Supported input and output for each model
Gemini 1.5 Flash | Gemini 1.5 Pro | Gemini 1.0 Pro Vision | Gemini 1.0 Pro | |
---|---|---|---|---|
Input types | ||||
Text | ||||
Code | ||||
Image | ||||
Video (frames only) | ||||
Video (frames and audio) | ||||
Audio | ||||
Output types | ||||
Text | ||||
Code |
To learn about supported file types, see Supported input files and requirements for the Vertex AI Gemini API.
Supported capabilities and general features for each model
Gemini 1.5 Flash | Gemini 1.5 Pro | Gemini 1.0 Pro Vision | Gemini 1.0 Pro | ||
---|---|---|---|---|---|
Text generation from text-only prompts | |||||
Text generation from multimodal prompts | |||||
JSON output (constrained schema mode) (coming soon to the Vertex AI in Firebase SDKs) |
|||||
Multi-turn chat | |||||
Function calling | |||||
Basic function calling | |||||
Parallel function calling | |||||
Function calling mode | |||||
Count tokens and billable characters | |||||
System instructions |
Detailed information about each model
Property |
Gemini 1.5 Flash / Gemini 1.5 Pro |
Gemini 1.0 Pro Vision | Gemini 1.0 Pro |
---|---|---|---|
Total token limit (combined input and output) * | 1 million tokens | 16,384 tokens | 32,760 tokens |
Output token limit * | 8,192 tokens | 2,048 tokens | 8,192 tokens |
Maximum number of images per request | 3,000 images | 16 images | N/A |
Max base64 encoded image size | 7 MB | 7 MB | N/A |
Maximum PDF size | 30 MB | 30 MB | N/A |
Maximum number of video files per request | 10 video files | 1 video file | N/A |
Maximum video length (frames only) | 60 minutes of video | 2 minutes | N/A |
Maximum video length (frames and audio) | ~45 minutes of video | N/A | N/A |
Maximum number of audio files per request | 1 audio file | N/A | N/A |
Maximum audio length | ~8.4 hours of audio | N/A | N/A |
* For all Gemini models, a token is equivalent to about 4 characters,
so 100 tokens are about 60-80 English words. You can determine the total count
of tokens in your requests using
countTokens
.
Here's where you can find even more detailed information about the models and input files:
Learn about the differences between the multimodal models in the Google Cloud documentation.
Learn about supported file types, how to specify MIME type, and how to make sure that your files and multimodal requests meet the requirements and follow best practices in Supported input files and requirements for the Vertex AI Gemini API.
Versioning of the models
The Gemini models are offered in stable, auto-updated, and preview versions.
Stable versions are considered Generally Available.
- Stable versions have model names appended with a
specific three digit version number, for example
.gemini-1.0-pro-001
- Stable versions have model names appended with a
specific three digit version number, for example
Auto-updated versions always point to the latest stable version of that model; if a new stable version is released, the auto-updated version automatically starts pointing to that new stable version.
- Auto-updated versions have model names with no
appendage, for example
.gemini-1.0-pro
- Auto-updated versions have model names with no
appendage, for example
Preview versions have new capabilities and are considered not stable. Note that preview versions always point to the latest preview version of that model; if a new preview version is released, any existing preview version automatically starts pointing to that new preview version.
- Preview versions have model names appended with
along with the model's initial release date (-preview
), for example-MMDD
(released on April 9, 2024).gemini-1.5-pro-preview-0409
- Preview versions have model names appended with
Learn more about the available Gemini model versions and their lifecycle in the Google Cloud documentation.
Available model names
Model names are the explicit values that you include in your code during initialization of the generative model (which is a required step to call the Gemini API). For initialization examples for your language, see the getting started guide.
Gemini 1.5 Flash model names
Model name | Description | Release stage | Initial release date | Discontinuation date |
---|---|---|---|---|
Stable versions | ||||
gemini-1.5-flash-001 |
Latest stable version of Gemini 1.5 Flash | General Availability | 2024-05-24 | No earlier than 2025-05-24 |
Auto-updated version | ||||
gemini-1.5-flash |
Points to the latest stable version of 1.5 Flash (currently gemini-1.5-flash-001 |
General Availability | 2024-05-24 | --- |
Preview versions | ||||
gemini-1.5-flash-preview-0514 |
Latest preview version of Gemini 1.5 Flash | Public Preview | 2024-05-14 | 2024-06-24 |
Gemini 1.5 Pro model names
Model name | Description | Release stage | Initial release date | Discontinuation date |
---|---|---|---|---|
Stable versions | ||||
gemini-1.5-pro-001 |
Latest stable version of Gemini 1.5 Pro | General Availability | 2024-05-24 | No earlier than 2025-05-24 |
Auto-updated version | ||||
gemini-1.5-pro |
Points to the latest stable version of 1.5 Pro (currently gemini-1.5-pro-001 |
General Availability | 2024-05-24 | --- |
Preview versions | ||||
gemini-1.5-pro-preview-0514 |
Latest preview version of Gemini 1.5 Pro | Public Preview | 2024-05-14 | 2024-06-24 |
gemini-1.5-pro-preview-0409 |
Points to gemini-1.5-pro-preview-0514 (which is the latest preview version) |
Public Preview | 2024-04-09 | 2024-06-14 |
Gemini 1.0 Pro Vision model names
Model name | Description | Release stage | Initial release date | Discontinuation date |
---|---|---|---|---|
Stable versions | ||||
gemini-1.0-pro-vision-001 |
Latest stable version of Gemini 1.0 Pro Vision | General Availability | 2024-02-15 | No earlier than 2025-02-15 |
Auto-updated version | ||||
gemini-1.0-pro-vision |
Points to the latest stable version of 1.5 Pro Vision (currently gemini-1.5-pro-vision-001 |
General Availability | 2024-01-04 | --- |
Gemini 1.0 Pro model names
Model name | Description | Release stage | Initial release date | Discontinuation date |
---|---|---|---|---|
Stable versions | ||||
gemini-1.0-pro-002 |
Latest stable version of Gemini 1.0 Pro | General Availability | 2024-04-09 | No earlier than 2025-04-09 |
gemini-1.0-pro-001 |
Stable version of Gemini 1.0 Pro | General Availability | 2024-02-15 | No earlier than 2025-02-15 |
Auto-updated version | ||||
gemini-1.0-pro |
Points to the latest stable version of 1.0 Pro (currently gemini-1.0-pro-002 |
General Availability | 2024-02-15 | --- |
Supported languages
All the Gemini models can understand and respond in the following languages:
Arabic (ar), Bengali (bn), Bulgarian (bg), Chinese simplified and traditional (zh), Croatian (hr), Czech (cs), Danish (da), Dutch (nl), English (en), Estonian (et), Finnish (fi), French (fr), German (de), Greek (el), Hebrew (iw), Hindi (hi), Hungarian (hu), Indonesian (id), Italian (it), Japanese (ja), Korean (ko), Latvian (lv), Lithuanian (lt), Norwegian (no), Polish (pl), Portuguese (pt), Romanian (ro), Russian (ru), Serbian (sr), Slovak (sk), Slovenian (sl), Spanish (es), Swahili (sw), Swedish (sv), Thai (th), Turkish (tr), Ukrainian (uk), Vietnamese (vi)
Gemini 1.5 Pro and Gemini 1.5 Flash models can understand and respond in the following additional languages:
Afrikaans (af), Amharic (am), Assamese (as), Azerbaijani (az), Belarusian (be), Bosnian (bs), Catalan (ca), Cebuano (ceb), Corsican (co), Welsh (cy), Dhivehi (dv), Esperanto (eo), Basque (eu), Persian (fa), Filipino (Tagalog) (fil), Frisian (fy), Irish (ga), Scots Gaelic (gd), Galician (gl), Gujarati (gu), Hausa (ha), Hawaiian (haw), Hmong (hmn), Haitian Creole (ht), Armenian (hy), Igbo (ig), Icelandic (is), Javanese (jv), Georgian (ka), Kazakh (kk), Khmer (km), Kannada (kn), Krio (kri), Kurdish (ku), Kyrgyz (ky), Latin (la), Luxembourgish (lb), Lao (lo), Malagasy (mg), Maori (mi), Macedonian (mk), Malayalam (ml), Mongolian (mn), Meiteilon (Manipuri) (mni-Mtei), Marathi (mr), Malay (ms), Maltese (mt), Myanmar (Burmese) (my), Nepali (ne), Nyanja (Chichewa) (ny), Odia (Oriya) (or), Punjabi (pa), Pashto (ps), Sindhi (sd), Sinhala (Sinhalese) (si), Samoan (sm), Shona (sn), Somali (so), Albanian (sq), Sesotho (st), Sundanese (su), Tamil (ta), Telugu (te), Tajik (tg), Uyghur (ug), Urdu (ur), Uzbek (uz), Xhosa (xh), Yiddish (yi), Yoruba (yo), Zulu (zu)
Next steps
Try out the capabilities of the Gemini API
- Build multi-turn conversations (chat).
- Generate text from text-only prompts.
- Generate text from multimodal prompts (including text, images, PDFs, video, and audio).
- Use function calling to connect generative models to external systems and information.