New Robots Tag: Indexing If Embedded

January 21, 2022

Today, Google is introducing a new robots tag - indexifembedded - that gives users more control over when their content is indexed. With the indexifembedded tag, users can tell Google that they would still like their content indexed even when it is embedded through iframes or similar HTML tags on other pages, even when the content page has the noindex tag.

The indexifembedded addresses a common issue that especially affects media publishers - while they may want their content indexed when it is embedded on third-party pages, they don't necessarily want their media pages indexed on their own. Because they don't want the media pages indexed, they currently use a noindex tag in such pages. However, the noindex tag also prevents embedding the content in other pages during indexing.

The new robots tag, indexifembedded, works in combination with the noindex tag only when the page with noindex is embedded into another page through an iframe or similar HTML tag, like object. For example, if podcast.host.example/playpage?podcast=12345 has both the noindex and indexifembedded tags, it means Google can embed the content hosted on that page in recipe.site.example/my-recipes.html during indexing.

To ensure that your content is only indexed when it is embedded on other pages, be sure to use the indexifembedded tag in combination with the noindex tag. For example:

<meta name="googlebot" content="noindex" />
<meta name="googlebot" content="indexifembedded" />
<!-- OR -->
<meta name="googlebot" content="noindex,indexifembedded" />;

Alternatively, you can specify the tag in the HTTP header:

X-Robots-Tag: googlebot:noindex
X-Robots-Tag: googlebot:indexifembedded

... OR …

X-Robots-Tag: googlebot:noindex,indexifembedded

At present, only Google supports the indexifembedded tag.

Product Reviews Update: How it Affects Your Site
Back in April 2021, Google shared an update on product reviews designed to promote high quality content. They are now rolling out a new update, the first major update since April, that may change how...
Read More
Welcome to the new Search Console URL Inspection API!
Today Google is launching the new Google Search Console URL Inspection API, which gives programmatic access to URL-level data for properties that are managed in Search Console. The Search Console APIs...
Read More