In short
Gemini can answer in French, but a French answer does not establish that a brand has the same visibility as it does in English. Our public toy-sector study contains inspectable French responses, not a matched bilingual experiment. It lets us examine named brands and displayed references. Establishing a measured language bias would require an English comparison collected under comparable conditions.
What does “Gemini in French” actually mean?
Are you looking for Gemini in French to understand an answer, research a purchase or find out whether a brand appears for French-speaking users? Those are different needs. Getting French output is a language question. Being suggested as a solution to a need expressed in French is a visibility question. One test cannot stand in for the other.
A model may describe a company when you supply its name, then omit it when you ask an open recommendation question. It may also name a brand while getting a product detail wrong. Fluent French is not evidence that the commercial information is accurate. To understand an observation, retain the exact question, intended market, complete answer and any references displayed alongside it.
This article takes a narrower angle than a general Gemini guide: how should language, market and visibility be separated in a French-English comparison? Our Gemini audit guide covers the broader measurement scope. Here, the focus is on what our French evidence supports and what it leaves unresolved. We will not manufacture an English control group to make the story more conclusive.
What the French study really contains
The children’s toy study, published on 29 October 2026, covers the French market. Its export reports 20 active questions, 80 analysed answers and 49 ranked brands. The original questions were asked in French. Four model identifiers are declared, including a Gemini identifier. These labels describe that archived collection, not a permanent statement about Google’s model catalogue.
The downloadable source document (in French) also identifies web search as the response mode. It warns that model outputs are not verified facts about the brands. That qualification matters: seeing a claim in a Gemini response documents what the system said. It does not validate the claim.
| Published field | Observation | Interpretation limit |
|---|---|---|
| Active questions | 20, in French | No matched English arm in this export |
| Analysed answers | 80 across all models | Not 80 Gemini answers |
| Ranked brands | 49 | Not a census of the market |
| Declared mode | Web search | Not evidence about responses without web search |
The first useful distinction is between denominators. A study-wide answer count must not quietly become a Gemini-specific sample size. The second is between question types. Even within a single French corpus, not every brand appearance measures spontaneous visibility. The wording determines what opportunity the model had to name a brand without assistance.
Two French answers reveal different kinds of visibility
Question 12 asks for construction-toy brands that are good alternatives to Lego. In the archived Gemini response, CaDA and Mould King appear under technical vehicles, while COBI appears under historical vehicles. These are observations of the published text. They are not our endorsement of those products or confirmation of the characteristics listed by the model.
Question 13 directly compares Lego and Playmobil for a six-year-old. Gemini’s archived response distinguishes building from imaginative role play, and the export associates both brands with that answer. But both names were already supplied in the question. Treating their appearance as an unprompted discovery would inflate the result. The model was responding to a choice put in front of it.
That difference deserves attention before any language switch. An alternatives request and a named-brand comparison do not express the same intent. Comparing them carelessly can produce a false language effect. If the French prompt includes a brand name and the English one does not, the experiment has changed more than its language.
An English translation of a study is not an English experiment
The publication states that translations do not change its rankings or percentages. It also says the complete model responses remain in the original language of the questions. An English presentation of French findings therefore does not supply responses generated from English prompts. A translated table is still the same evidence.
This publication consequently provides no matched French-English Gemini difference. It cannot support a percentage advantage for English. Reporting one would mean inventing an experiment. A headline promising “measured language bias” needs another piece of evidence: paired questions and the original responses collected in both languages under comparable conditions.
Our view is straightforward. A limited result that readers can inspect is more useful than a bilingual ranking created by translating a report. That standard also protects business decisions. Otherwise, a team could translate an entire website because of a supposed English advantage that nobody actually observed.
How to design a fair French-English comparison
The following is a proposed protocol, not a completed test. First, fix a market such as France. Then write French and English questions that express the same underlying need. Preserve the age, budget, availability requirements and intended audience. A literal translation is not enough if it changes how a natural reader would understand the request.
For example, ask which construction-toy brands someone would recommend for a six-year-old in France. The French version should preserve that same age and country. This is an illustrative prompt pair only: we have not collected or presented an English answer to it here. Keeping that distinction visible prevents a method example from being mistaken for experimental evidence.
- Use the same identifiable model and search mode for both members of a pair.
- Start independent sessions without a conversation history that already supplies the brand.
- Archive dates, exact prompts and complete outputs, including refusals or missing answers.
- Keep open questions separate from prompts containing the target brand’s name.
- Repeat observations and do not count technical failures as brand omissions.
Record the conditions you cannot control, too. A consumer interface and an API are not automatically equivalent test environments. If an exact model version, location setting or parameter is unknown, mark it as unknown. Replacing missing configuration information with an assumption creates precision on paper, not a reliable comparison.
Which response differences should be measured?
Start with spontaneous presence: does the answer name the brand when the question does not? Measure recommendation separately: is the brand actually proposed as a suitable option? Then assess factual accuracy and references. A response can perform well on one dimension and poorly on another. Combining them too early conceals the difference.
Keep the denominator attached to each metric. A presence rate concerns usable responses within a stated scope; a technical error is not a negative answer. A reference metric may concern links or answers, depending on its definition. Mixing those units makes a comparison fragile even when the resulting table looks impressively precise.
Compare pairs as well as averages. For each underlying need, record whether the brand appears in both languages, only one or neither. Keep the named competitors, too. This makes recurring differences easier to distinguish from isolated examples. It still does not identify Gemini’s internal selection mechanism or establish why a particular answer changed.
An English source is not proof of English-language bias
The French study’s Gemini responses display Google grounding redirect links among their references. A redirect URL alone does not tell you the language or country of the final page. Qualifying a source would require following the link, recording the destination and reading the relevant passage. Its visible hostname cannot replace that work.
Even a confirmed English destination would not, on its own, demonstrate systematic preference. The page might contain information relevant to the question. Conversely, a French page does not guarantee locally appropriate advice or accurate claims. The useful question is which statement the source supports and whether that support fits the intended market.
What should a brand serving French customers do?
Check the facts your own website makes accessible: what the company does, which countries it serves, offer limitations, supporting references and information that may have changed. French content should answer a French-market need rather than merely reproduce English wording. When product availability or service conditions differ by country, explain the difference explicitly.
AI Labs Audit’s product documentation distinguishes market-localised scenarios from straightforward translation. It describes simultaneous multilingual audits covering up to seven markets on Agency+, with a cross-market language-by-model view. That capability helps organise evidence collection. It is not evidence that Gemini favours a particular language or that an observed gap has a linguistic cause.
The same documentation describes crawler-fidelity checks comparing GPTBot-style access without a language preference against localised human access. Such a check can reveal that a site serves an unexpected default language. It does not simulate Gemini, and it does not demonstrate how Gemini selects sources. A site-delivery issue and a response-selection effect need different evidence.
Response counts and invented URLs measure different things
Reading the export of the 29 October 2026 study lets us count 20 response blocks labelled google/gemini-3.7-flash. Readers can reproduce this count in the document. It clarifies Gemini’s contribution to the corpus of 80 responses, but adds no English answers. It is not a test of every Gemini version or a measurement of how frequently real users ask these questions.
A separate indicator in our AI Visibility Observatory, consulted on 12 November 2026, concerns invented links. Its table attributes a 0.12% invented-URL rate to Google Gemini 2.5 Flash. The aggregate across all models covers 26,435 verified URLs, including 70 invented ones. Those totals are not Gemini’s own denominator, and this publication provides no French versus English breakdown.
Why insist on the distinction? A low invented-link rate establishes neither strong visibility for French brands nor the absence of language bias. The two publications also identify different Gemini models. We do not merge them into a single performance claim. Before deciding what to fix, identify whether the problem is an omitted brand, an inaccurate claim or a nonexistent link. Those observations call for different evidence and different remedies.
The verdict: French visibility observed, language bias unresolved
The published corpus establishes that Gemini responses to French questions were archived and contain identifiable brands. Those are specific examples readers can inspect. The evidence does not establish either a French advantage or a French disadvantage relative to English. It also does not turn an individual brand appearance into a stable market-wide visibility rate.
The missing piece is not another composite score. It is a matched French-English corpus with original answers, recorded collection conditions and stable metric definitions. Until that evidence exists, the defensible description is observed French visibility and a comparison still to be performed. It is not measured language bias.
When your brand is absent from an AI answer, a competitor takes its place 37% of the time. AI Labs Audit data: sub-sample of our 3,002-answer study.