{"id":9684,"date":"2026-10-30T20:42:36","date_gmt":"2026-10-30T20:42:36","guid":{"rendered":"https:\/\/silvybrand.com\/?p=9684"},"modified":"2026-10-30T20:42:36","modified_gmt":"2026-10-30T20:42:36","slug":"openai-google-microsoft-ai-scraping-standard-opt-out","status":"publish","type":"post","link":"https:\/\/silvybrand.com\/?p=9684","title":{"rendered":"The biggest names in AI are backing a new way to opt out of scraping"},"content":{"rendered":"<p><br \/>\n<\/p>\n<figure>\n<p><img decoding=\"async\" alt=\"Photo illustration of a brain on a circuit board in red.\" data-caption=\"\" data-portal-copyright=\"Illustration by Cath Virginia \/ The Verge | Photos from Getty Images\" data-has-syndication-rights=\"1\" src=\"https:\/\/platform.theverge.com\/wp-content\/uploads\/sites\/2\/chorus\/uploads\/chorus_asset\/file\/25330660\/STK414_AI_CHATBOT_H.jpg?quality=90&amp;strip=all&amp;crop=0,0,100,100\" \/><figcaption>\n\t\t<\/figcaption><\/figure>\n<p class=\"wp-block-paragraph\">OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as <a href=\"https:\/\/www.seroundtable.com\/google-ai-training-control-42430.html\">reported earlier by <em>Search Engine Roundtable<\/em><\/a>. With this control, publishers can apply their AI training preferences across multiple AI companies, instead of setting them individually.<\/p>\n<p class=\"wp-block-paragraph\">The <a href=\"https:\/\/datatracker.ietf.org\/doc\/draft-kelley-aipref-training-preference-signal\/\">shared &#8220;policy token&#8221; signal<\/a> is proposed by Kevin Kelley, a technical lead for standards at Anthropic, as part of the Internet Engineering Task Force (IETF). It will live within a website&#8217;s <a href=\"https:\/\/www.theverge.com\/24067997\/robots-txt-ai-text-file-web-crawlers-spiders\">robots.txt file<\/a>, which has long signaled which web crawlers can and can&#8217;t scrape a site &#8211; whether for search indexing, archiving, or \u2026<\/p>\n<p><a href=\"https:\/\/www.theverge.com\/tech\/1023763\/openai-google-microsoft-ai-scraping-standard-opt-out\">Read the full story at The Verge.<\/a><\/p>\n<p><br \/>\n<br \/><a href=\"https:\/\/www.theverge.com\/tech\/1023763\/openai-google-microsoft-ai-scraping-standard-opt-out\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI, as reported earlier by Search Engine Roundtable. With this control, publishers can apply their AI training preferences across multiple AI companies, instead of setting them individually. The shared &#8220;policy token&#8221; signal [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":9685,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9],"tags":[31,175,32,158,46,34],"class_list":["post-9684","post","type-post","status-publish","format-standard","has-post-thumbnail","category-gadgets","tag-ai","tag-anthropic","tag-google","tag-microsoft","tag-news","tag-tech"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>The biggest names in AI are backing a new way to opt out of scraping - Silvybrand Lifestyle Blog<\/title>\n<meta name=\"description\" content=\"OpenAI, Google, and Microsoft are planning to adopt a new standard that will allow websites to apply their AI training preferences across multiple AI companies, instead of setting them individually.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/silvybrand.com\/?p=9684\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The biggest names in AI are backing a new way to opt out of scraping - Silvybrand Lifestyle Blog\" \/>\n<meta property=\"og:description\" content=\"OpenAI, Google, and Microsoft are planning to adopt a new standard that will allow websites to apply their AI training preferences across multiple AI companies, instead of setting them individually.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/silvybrand.com\/?p=9684\" \/>\n<meta property=\"og:site_name\" content=\"Silvybrand Lifestyle Blog\" \/>\n<meta property=\"article:published_time\" content=\"2026-10-30T20:42:36+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/silvybrand.com\/wp-content\/uploads\/2026\/10\/STK414_AI_CHATBOT_H.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"624\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"SILVYBRAND\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"SILVYBRAND\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684\"},\"author\":{\"name\":\"SILVYBRAND\",\"@id\":\"https:\\\/\\\/silvybrand.com\\\/#\\\/schema\\\/person\\\/8bdc6818a5b6ef5b9745e468818e37f3\"},\"headline\":\"The biggest names in AI are backing a new way to opt out of scraping\",\"datePublished\":\"2026-10-30T20:42:36+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684\"},\"wordCount\":133,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/silvybrand.com\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/STK414_AI_CHATBOT_H.jpg\",\"keywords\":[\"AI\",\"anthropic\",\"Google\",\"Microsoft\",\"News\",\"Tech\"],\"articleSection\":[\"Gadgets\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/silvybrand.com\\\/?p=9684#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684\",\"url\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684\",\"name\":\"The biggest names in AI are backing a new way to opt out of scraping - Silvybrand Lifestyle Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/silvybrand.com\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/STK414_AI_CHATBOT_H.jpg\",\"datePublished\":\"2026-10-30T20:42:36+00:00\",\"description\":\"OpenAI, Google, and Microsoft are planning to adopt a new standard that will allow websites to apply their AI training preferences across multiple AI companies, instead of setting them individually.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/silvybrand.com\\\/?p=9684\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684#primaryimage\",\"url\":\"https:\\\/\\\/silvybrand.com\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/STK414_AI_CHATBOT_H.jpg\",\"contentUrl\":\"https:\\\/\\\/silvybrand.com\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/STK414_AI_CHATBOT_H.jpg\",\"width\":1200,\"height\":624},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/silvybrand.com\\\/?p=9684#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/silvybrand.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The biggest names in AI are backing a new way to opt out of scraping\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/silvybrand.com\\\/#website\",\"url\":\"https:\\\/\\\/silvybrand.com\\\/\",\"name\":\"Silvybrand Lifestyle Blog\",\"description\":\"Your daily dose of lifestyle, fashion, travel, beauty, and inspiration \u2014 living boldly, stylishly, and confidently.\",\"publisher\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/silvybrand.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/silvybrand.com\\\/#organization\",\"name\":\"Silvybrand Lifestyle Blog\",\"url\":\"https:\\\/\\\/silvybrand.com\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/silvybrand.com\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/silvybrand.com\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/SILVYBRAND-LOGO.jpg\",\"contentUrl\":\"https:\\\/\\\/silvybrand.com\\\/wp-content\\\/uploads\\\/2026\\\/05\\\/SILVYBRAND-LOGO.jpg\",\"width\":1115,\"height\":522,\"caption\":\"Silvybrand Lifestyle Blog\"},\"image\":{\"@id\":\"https:\\\/\\\/silvybrand.com\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/silvybrand.com\\\/#\\\/schema\\\/person\\\/8bdc6818a5b6ef5b9745e468818e37f3\",\"name\":\"SILVYBRAND\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e7db54afd7d090e59e1a481fd3e6812d467eb2a3b81e7a3092023acfc59a496b?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e7db54afd7d090e59e1a481fd3e6812d467eb2a3b81e7a3092023acfc59a496b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/e7db54afd7d090e59e1a481fd3e6812d467eb2a3b81e7a3092023acfc59a496b?s=96&d=mm&r=g\",\"caption\":\"SILVYBRAND\"},\"sameAs\":[\"https:\\\/\\\/silvybrand.com\"],\"url\":\"https:\\\/\\\/silvybrand.com\\\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The biggest names in AI are backing a new way to opt out of scraping - Silvybrand Lifestyle Blog","description":"OpenAI, Google, and Microsoft are planning to adopt a new standard that will allow websites to apply their AI training preferences across multiple AI companies, instead of setting them individually.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/silvybrand.com\/?p=9684","og_locale":"en_US","og_type":"article","og_title":"The biggest names in AI are backing a new way to opt out of scraping - Silvybrand Lifestyle Blog","og_description":"OpenAI, Google, and Microsoft are planning to adopt a new standard that will allow websites to apply their AI training preferences across multiple AI companies, instead of setting them individually.","og_url":"https:\/\/silvybrand.com\/?p=9684","og_site_name":"Silvybrand Lifestyle Blog","article_published_time":"2026-10-30T20:42:36+00:00","og_image":[{"width":1200,"height":624,"url":"https:\/\/silvybrand.com\/wp-content\/uploads\/2026\/10\/STK414_AI_CHATBOT_H.jpg","type":"image\/jpeg"}],"author":"SILVYBRAND","twitter_card":"summary_large_image","twitter_misc":{"Written by":"SILVYBRAND","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/silvybrand.com\/?p=9684#article","isPartOf":{"@id":"https:\/\/silvybrand.com\/?p=9684"},"author":{"name":"SILVYBRAND","@id":"https:\/\/silvybrand.com\/#\/schema\/person\/8bdc6818a5b6ef5b9745e468818e37f3"},"headline":"The biggest names in AI are backing a new way to opt out of scraping","datePublished":"2026-10-30T20:42:36+00:00","mainEntityOfPage":{"@id":"https:\/\/silvybrand.com\/?p=9684"},"wordCount":133,"commentCount":0,"publisher":{"@id":"https:\/\/silvybrand.com\/#organization"},"image":{"@id":"https:\/\/silvybrand.com\/?p=9684#primaryimage"},"thumbnailUrl":"https:\/\/silvybrand.com\/wp-content\/uploads\/2026\/10\/STK414_AI_CHATBOT_H.jpg","keywords":["AI","anthropic","Google","Microsoft","News","Tech"],"articleSection":["Gadgets"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/silvybrand.com\/?p=9684#respond"]}]},{"@type":"WebPage","@id":"https:\/\/silvybrand.com\/?p=9684","url":"https:\/\/silvybrand.com\/?p=9684","name":"The biggest names in AI are backing a new way to opt out of scraping - Silvybrand Lifestyle Blog","isPartOf":{"@id":"https:\/\/silvybrand.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/silvybrand.com\/?p=9684#primaryimage"},"image":{"@id":"https:\/\/silvybrand.com\/?p=9684#primaryimage"},"thumbnailUrl":"https:\/\/silvybrand.com\/wp-content\/uploads\/2026\/10\/STK414_AI_CHATBOT_H.jpg","datePublished":"2026-10-30T20:42:36+00:00","description":"OpenAI, Google, and Microsoft are planning to adopt a new standard that will allow websites to apply their AI training preferences across multiple AI companies, instead of setting them individually.","breadcrumb":{"@id":"https:\/\/silvybrand.com\/?p=9684#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/silvybrand.com\/?p=9684"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/silvybrand.com\/?p=9684#primaryimage","url":"https:\/\/silvybrand.com\/wp-content\/uploads\/2026\/10\/STK414_AI_CHATBOT_H.jpg","contentUrl":"https:\/\/silvybrand.com\/wp-content\/uploads\/2026\/10\/STK414_AI_CHATBOT_H.jpg","width":1200,"height":624},{"@type":"BreadcrumbList","@id":"https:\/\/silvybrand.com\/?p=9684#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/silvybrand.com\/"},{"@type":"ListItem","position":2,"name":"The biggest names in AI are backing a new way to opt out of scraping"}]},{"@type":"WebSite","@id":"https:\/\/silvybrand.com\/#website","url":"https:\/\/silvybrand.com\/","name":"Silvybrand Lifestyle Blog","description":"Your daily dose of lifestyle, fashion, travel, beauty, and inspiration \u2014 living boldly, stylishly, and confidently.","publisher":{"@id":"https:\/\/silvybrand.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/silvybrand.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/silvybrand.com\/#organization","name":"Silvybrand Lifestyle Blog","url":"https:\/\/silvybrand.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/silvybrand.com\/#\/schema\/logo\/image\/","url":"https:\/\/silvybrand.com\/wp-content\/uploads\/2026\/05\/SILVYBRAND-LOGO.jpg","contentUrl":"https:\/\/silvybrand.com\/wp-content\/uploads\/2026\/05\/SILVYBRAND-LOGO.jpg","width":1115,"height":522,"caption":"Silvybrand Lifestyle Blog"},"image":{"@id":"https:\/\/silvybrand.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/silvybrand.com\/#\/schema\/person\/8bdc6818a5b6ef5b9745e468818e37f3","name":"SILVYBRAND","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/e7db54afd7d090e59e1a481fd3e6812d467eb2a3b81e7a3092023acfc59a496b?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/e7db54afd7d090e59e1a481fd3e6812d467eb2a3b81e7a3092023acfc59a496b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e7db54afd7d090e59e1a481fd3e6812d467eb2a3b81e7a3092023acfc59a496b?s=96&d=mm&r=g","caption":"SILVYBRAND"},"sameAs":["https:\/\/silvybrand.com"],"url":"https:\/\/silvybrand.com\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/silvybrand.com\/index.php?rest_route=\/wp\/v2\/posts\/9684","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/silvybrand.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/silvybrand.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/silvybrand.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/silvybrand.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=9684"}],"version-history":[{"count":0,"href":"https:\/\/silvybrand.com\/index.php?rest_route=\/wp\/v2\/posts\/9684\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/silvybrand.com\/index.php?rest_route=\/wp\/v2\/media\/9685"}],"wp:attachment":[{"href":"https:\/\/silvybrand.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=9684"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/silvybrand.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=9684"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/silvybrand.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=9684"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}