AI agents and access to company data: do you need written permission?

A company updates its terms of service and, from November 11, 2025, any AI software that accesses its site without written authorization is in breach. It's not science fiction: it's what United Airlines did, and the model is spreading fast.

What did United Airlines actually do, and why does it matter for your company?

United Airlines has updated its terms of service to prohibit any autonomous AI software from accessing its site or app without prior written permission. The move isn't just about airlines: it sets a model that any company with proprietary data online can follow, and maybe should.

On November 11, 2025, United Airlines updated its terms of service and drew a clear line: traditional search engines can index the site's public pages, but any AI agent — that is, software that acts autonomously to search, book or buy — must first get written permission from the company.

CEO Scott Kirby explained the reasoning plainly: "I don't want to create another middleman." In other words, the company doesn't want third parties using its fare, availability and pricing data to train AI models or to operate as unauthorized booking agents.

If you run an e-commerce store, a B2B portal or any site with proprietary data, the question is immediate: is my data already accessible to AI software I haven't authorized?

Your situationWorth acting?why
You have an e-commerce store with real-time prices and availabilityYesYour data is an asset: a competitor's AI agent can use it to make comparisons or train models
You run a B2B portal with restricted price listsYesUnauthorized access can breach commercial agreements and confidentiality regulations
You have a corporate website with generic public contentPartlyThe risk is lower, but your content can be used to train AI models without consent
You already use an updated robots.txtIt's not enough30% of AI bots ignore it: you need explicit legal terms and additional technical protections
You're an SME with no sensitive data onlineNo, for nowLow priority, but it's worth monitoring how Italian regulation evolves
Decision table: when it makes sense to build a policy for AI access to your data.

What exactly does United Airlines' policy say?

United's terms define an 'Automated Agent' as any software — including AI assistants, bots, browser extensions and features built into browsers — that acts autonomously on the site or app. None of these can operate without written permission, and using the data to train AI models is explicitly prohibited.

The definition is deliberately broad. An Automated Agent includes any software that, with full or partial autonomy, searches, books, buys or manages items on the site, or extracts or copies data. This category covers AI assistants, bots, web scrapers (programs that collect data automatically), browser extensions and even the AI features built into modern browsers.

The rule applies even if a person supervises the agent's actions. United reserves the right to block any agent at any time, regardless of who operates it.

What's allowedWhat's prohibited
Search engines indexing public pagesAI agents that book or purchase without written permission
Assistive technologies for people with disabilitiesBrowser extensions with autonomous AI features
Standard browsers used by a personUsing data to train, fine-tune or evaluate AI models
Researching and planning trips with AI (without accessing the site)Travel agencies using third-party AI agents without authorization
Bookings made before November 11, 2025New bookings through unauthorized AI agents
Source: United Airlines terms of service, updated November 11, 2025.

One important technical detail: these rules don't depend on the robots.txt file — the document that traditionally tells bots what they can and can't do on a site. United chose to rely on legal terms, not just technical instructions. As of November 14, 2025, United's robots.txt didn't name any specific AI crawler.

This isn't an isolated case. Amazon blocked Meta's Muse AI agent based on its own conditions of use. eBay added "buy-for-me agents" to its list of automated tools that require explicit permission.

Why is robots.txt alone no longer enough?

Robots.txt files are technical instructions that bots are supposed to follow, but they have no legal force. The data shows a growing share of AI bots systematically ignore them.

Robots.txt was created in the 1990s to tell search engines which pages not to index. It worked well when bots were few and well-behaved. Today the landscape has changed.

According to TollBit network data, in the fourth quarter of 2025 about 30% of AI bots ignored robots.txt permissions, up from 13% in the first quarter of the same year. In just one year, the share more than doubled.

Websites responded quickly. According to TechnologyChecker.io, blocking responses to AI bots rose from 3.63% of requests in the second quarter of 2025 to 8.56% in the second quarter of 2026. But technical blocking isn't enough without a legal basis to back it up.

To learn more about how autonomous AI agents work and the risks they bring, the article on autonomous AI models and corporate compliance offers a complete overview.

30%AI bots ignoring robots.txt in Q4 2025TollBit
8,56%Blocking responses to AI bots in Q2 2026 (it was 3.63% a year earlier)TechnologyChecker.io
<5%Legal compliance rate of AI agents on sites with an explicit banScrapeBench / arXiv 2026
79%Large news sites blocking at least one AI training bot via robots.txtBuzzStream 2025

What does an Italian company without an AI policy really risk?

The risk isn't just theoretical: the Italian data protection authority (Garante Privacy) has made AI one of its inspection priorities for 2026, and the data shows AI agents violate terms of service in almost all of the cases analyzed.

A study published on arXiv in November 2026 — the ScrapeBench benchmark — analyzed the leading autonomous AI agents across 1,626 sites that explicitly prohibit data collection. The legal compliance rate was below 5%. The agents violated the terms mainly through misinterpretation, not malicious intent. But from a legal standpoint, the distinction matters little.

On the Italian regulatory front, the Garante per la protezione dei dati personali has put the use of AI among its 2026 inspection priorities (Provvedimento 797 of December 30, 2025), with a specific focus on data breaches, big data and corporate AI. In 2025 it already carried out 130 inspections and handled 4,288 complaints with a response.

Type of riskDescriptionWho's most exposed
Unauthorized use of dataAn AI agent collects prices, catalog or customer data without permissionE-commerce, B2B portals, SaaS platforms
Training of competing modelsYour content is used to train a competitor's AICompanies with proprietary content, professional firms
Regulatory violationThe lack of an AI policy may amount to a violation of the GDPR or Garante guidelinesAll companies with personal data online
Unauthorized purchases or changesAn AI agent makes transactions on a customer's behalf without human oversightE-commerce, subscription services, travel
Loss of control over proprietary dataPrice list or availability data used by third parties for automated comparisonsManufacturers, distributors, agencies
Main risks for Italian companies without an AI access policy.

Three Real-World Scenarios: What Changes for Different Italian Companies?

The problem looks different depending on the industry. Here are three illustrative examples to show what's at stake.

Illustrative examples: the numbers and situations are meant to show the reasoning, they are not real customer data.

Company typeData at riskScenario without a policyScenario with a policy
Clothing e-commerce store (500 SKUs)Real-time prices, availability and discountsA comparison site's AI agent collects prices every hour and uses them to steer customers toward competitorsThe terms prohibit automated access; the technical block is backed by a legal basis
Tax consulting firmTraining content, guides, proprietary FAQsThe content is used to train a competitor's chatbot without consentAn explicit policy prohibits using the content for AI training; the site includes a clause in its terms
Manufacturing company with a B2B catalogConfidential price lists, warehouse availability, technical specificationsA customer's AI agent accesses the portal and downloads the price lists to automatically compare them with other suppliersPortal access requires authentication, and the terms prohibit unauthorized automated use
Illustrative examples: typical scenarios for Italian companies with and without an AI access policy.

What tools exist to protect company data from AI agents?

Effective protection combines three layers: legal terms, technical rules and active monitoring. None of the three is enough on its own.

ToolWhat it doesLimitsRecommended for
Updated robots.txtTells bots what not to index30% of AI bots ignore it; no legal forceMinimum baseline for all sites
Explicit terms of serviceLegally defines what AI agents are not allowed to doNeeds periodic updates and legal adviceCompanies with valuable proprietary data
Authentication and rate limitingBlocks automated access to restricted pagesDoesn't protect public pagesB2B portals, e-commerce with confidential price lists
WAF (Web Application Firewall)Filters abnormal traffic and blocks known botsNeeds configuration and continuous updatesHigh-traffic sites or sites with sensitive data
Bot traffic monitoringIdentifies suspicious automated access patternsNeeds dedicated tools and analytical skillsCompanies that want to know who is accessing their data
Comparison of tools for protecting against AI bots: none is enough on its own.

The United model shows that the most robust approach is to combine clear legal terms with technical protections. Legal terms give you a basis to act in case of a violation; technical protections reduce the risk that a violation happens. As we saw when looking at AI search agents and their ambiguities, the problem is often not bad faith but the lack of clear rules that agents can interpret correctly.

Why is this being discussed now: is the AI market in Italy accelerating?

Yes. The Italian AI market reached €1.8 billion in 2025, growing 50% in a year. But adoption among SMEs is still very low, which means many companies are exposed without adequate tools.

According to the Artificial Intelligence Observatory of Politecnico di Milano, the Italian AI market reached €1.8 billion in 2025, up 50% from 2024. Adoption, however, is very uneven.

The gap is stark: 71% of large Italian companies have launched at least one AI project, compared with just 8% of SMEs. And according to the 2026 data from the Osservatorio Innovazione Digitale nelle PMI, 76% of Italian SMEs have neither invested nor plan to invest in AI, and only 7% have started structured training programs.

This means many SMEs find themselves in a paradoxical position: their data is already accessible to third-party AI agents, but they don't yet have the tools to see it or protect themselves. The issue of AI agents amplifying incorrect data shows clearly how a lack of governance can create cascading problems.

How to build an AI access policy: the concrete steps

You don't have to start from scratch: the United model offers a practical reference point. The steps are sequential and require input from whoever manages the site, your legal team and your IT team.

  1. 1 · IT / Web TeamMap your exposed dataIdentify which pages contain proprietary data: prices, availability, restricted content, customer data. These are the areas to protect first.
  2. 2 · Legal / ConsultantUpdate your terms of serviceAdd an explicit definition of "AI automated agent" and prohibit access without written permission. Also specify the bans on using data for AI training.
  3. 3 · IT / Web TeamUpdate your robots.txtAdd specific rules for the main known AI crawlers. It isn't enough on its own, but it reduces unauthorized traffic and strengthens your legal position.
  4. 4 · IT / Security TeamImplement technical protectionsSet up rate limiting (a cap on the number of requests per IP), authentication for restricted areas and a WAF to filter abnormal traffic.
  5. 5 · Marketing / IT TeamMonitor bot trafficTurn on automated traffic monitoring. Look for unusual patterns: many requests in a short time, visits to catalog or price pages at odd hours.
  6. 6 · ManagementDefine the authorization processDecide who can grant written permission to third-party AI agents and under what conditions. For now, United has chosen not to authorize anyone.
A 6-step process for building an AI access policy for company data.

What mistakes are made most often when tackling this topic?

The most common mistake is thinking the problem only affects large companies, or that an updated robots.txt is enough. It isn't.

Working with companies across different industries, we've seen the same mistakes repeat. Here they are, in order of frequency.

  • Leaving everything to robots.txt. It's a starting point, not the solution. Without explicit legal terms, you have no tools to act in case of a violation.
  • Thinking the problem only affects those with sensitive data. Editorial content, technical guides and product catalogs are assets too, and they can be used to train competing AI models.
  • Not updating your terms of service for years. Most Italian terms of service don't mention AI agents. They're documents written before these tools existed.
  • Ignoring your supply contracts with agencies. United also updated its contract with travel agencies. If you work with partners who access your systems, they must be bound by the policy too.
  • Not monitoring traffic. Without data, you don't know if you're already suffering unauthorized access. Monitoring is the first step to understanding the scale of the problem.
Company server room with illuminated racks: AI agent access policy to protect proprietary company data
Protecting company data from AI agents takes technical and legal rules working together. AI-generated image for illustrative purposes.

How do I know if my AI policy is working?

An effective policy is measured on three levels: reduced anomalous bot traffic, no detected violations, and alignment between technical rules and legal terms.

IndicatorHow it is measuredPositive signal
Bot traffic on the siteAnalytics + server logsFewer abnormal requests after the terms update
403 responses to AI crawlersWAF or server logsMore block responses to known bots
robots.txt / legal terms consistencyPeriodic review of documentsRobots.txt and terms prohibit the same categories of agents
Permission requests receivedEmail / dedicated formFormal requests coming from third parties
Reports of unauthorized useWeb monitoring / alertsNo mentions of your data in unauthorized contexts
Indicators for assessing the effectiveness of an AI access policy for company data.

It's worth remembering that a policy isn't a static document. United has said it will update its FAQs as the AI agent landscape evolves. The same approach applies to any company: a twice-yearly review of your terms and technical protections is the reasonable minimum in a field that changes this fast. If you manage complex data flows, tools like those described in the article on Google Data Manager for audit and targeting with AI agents can help you better understand what's moving through your systems.

RJ45 network connector plugged into a server port: AI agent access control to company data and governance
Controlling AI access starts with the technical infrastructure, but it also needs a solid legal foundation. AI-generated image for illustrative purposes.

So, is it worth building an AI policy for your company?

Worth it if you have proprietary data online (prices, catalog, restricted content, customer data) and don't want third-party AI software collecting or using it without consent. Even an SME with an active e-commerce store or a B2B portal has every reason to act.

Somewhere in between: your site has generic public content, but you're growing or introducing restricted areas. It's worth updating your terms of service now, before the problem becomes urgent.

Not yet if your site is purely corporate, with no significant proprietary data and no restricted areas. Keep an eye on how Italian regulation evolves, but it's not an immediate priority.

How we see it at SHM

For us, the issue of AI agents and access to company data is a perfect example of how innovation should be analyzed before it's chased — or endured. United Airlines didn't block AI: it chose to govern it, setting clear rules on who can access its data and under what conditions. It's exactly the approach we recommend to our clients.

We believe AI should be integrated to free companies from routine, not to create new unmanaged risks. And that works both ways: when a company adopts AI tools, but also when it needs to protect itself from third-party AI agents.

We've worked with companies that managed catalogs with thousands of SKUs across multiple markets, where control over who accesses the data and how they use it was a concrete operational priority. In those contexts, data governance wasn't an abstract legal topic: it was the difference between a reliable catalog and one exposed to outside manipulation.

If you're evaluating how to structure AI governance in your company, we can help you start with strategic AI integration, a review of your systems with a data processing and business intelligence approach, or AI training for your team. You'll find all our in-depth articles on the topic in the AI and process automation section.

The point isn't to block AI. It's to set the rules of the game yourself, before others set them for you.

Frequently Asked Questions

The real question isn't whether to block AI agents, but who decides the rules for accessing your data: you, or anyone with a bot fast enough.

Related articles

Discover more articles exploring similar topics, selected to offer you a more complete and stimulating perspective. Each piece of content is carefully chosen to enrich your experience.

The interior of an industrial facility showcases large metal pipes, tanks, and catwalks. A reflective surface shines in the foreground under bright lighting, a setting where SHM Web Agency could accurately deploy a website.

Super-amortization 2026 and the end of Transition 5.0: a guide for businesses

Discover more
GEO for e-commerce marketing

E-commerce marketing and GEO: how to get cited in Google AI Overviews

Discover more
brand positioning

Brand positioning in the AI era: how to stay visible in generative search engines

Discover more
strategic digital consulting

Strategic digital consulting for SMEs: complete guide 2026

Discover more
privacy and artificial intelligence

Privacy and artificial intelligence: a practical guide for SMEs

Discover more
AI marketing tools

AI marketing 2026: the best tools for automation, content and advertising

Discover more
Generative engine optimization

Generative Engine Optimization: the 2026 guide to getting cited by AI

Discover more
Custom AI chatbots

Custom AI chatbots: a complete guide for SMEs and businesses

Discover more
Google Workspace Intelligence: AI automation for B2B business

B2B LinkedIn Ads campaigns: when it beats Meta and Google

Discover more
google ads campaigns

Google Ads campaigns for SMEs: when it's really worth investing

Discover more
website creation

Building a website with AI: real pros, cons and benefits

Discover more
AI marketing

AI marketing: artificial intelligence in your company's strategy

Discover more
AI-powered presentations

AI-powered presentations: from paper to ready-made slides

Discover more
technology experts in Milan

Tech Experts in Milan: The Best IT Choices for AI

Discover more
Illustration on artificial intelligence for SMEs and 2026 digital tools

Artificial Intelligence for SMEs: the 15 most useful tools in 2026

Discover more
best ai consultants milan

The best AI consultants in Milan specialized for startups: the strategic selection of 2026

Discover more
Startup launch in Milan

Startups in Milan: the complete checklist for launching in 2026

Discover more
Artificial intelligence for startups

Artificial intelligence for startups: 10 mistakes to avoid in 2026

Discover more
Best web agencies in Milan in 2026

The best web agencies in Milan in 2026: updated guide for SMEs and companies

Discover more
A single LED light bulb with a silver screw base by SHM Studio is placed on a simple white surface, embodying the precision needed to effectively position a website.

AI SEO: the 10 best tools in 2026 to climb the SERP

Discover more
Marketing agency Milan

Marketing agency in Milan: a complete guide to choosing well

Discover more
Illustration of a digital marketing agency in Milan and the required professional roles

Marketing communications agency in Milan: the most in-demand roles

Discover more
Illustration on artificial intelligence startups in Milan and technological innovation

Artificial Intelligence in Milan: the best startups to know

Discover more
Illustration on artificial intelligence startups in Milan and technological innovation

Artificial intelligence companies: the future of work between innovation and automation

Discover more
Illustration on artificial intelligence in companies, customer experience, and chatbots

Artificial intelligence in companies between customer experience and chatbots

Discover more
Illustration with social communication strategies for companies in 2026 and digital platforms

Social Communication: 20 Strategies for 2026

Discover more
Local SEO

The 13 winning techniques for Local SEO in 2026

Discover more
The bright azure swimming pool, reminiscent of a well-conceived SEO strategy, features a yellow bridge and a metal ladder on the right.

SEO strategy: the importance of media, video, and images

Discover more
web agency Milan

The best Web Agencies in Milan in 2025

Discover more
A solitary tree stands on a snowy landscape under an overcast sky, like a distinctive icon meticulously positioned by a web agency for optimal visibility.

Optimize your website: the best tools for 2026

Discover more
WordPress consulting

WordPress consulting: when a web agency is necessary

Discover more
SHM Studio: blog on digital marketing and AI

Storytelling in digital communication

Discover more
marketing agency

Marketing and AI agency: a practical guide to the tools

Discover more
SHM Studio: blog on web, SEO, and AI marketing

SEO consulting in Milan: the best choices of 2025

Discover more
web agency Rome

Rome web agency: the best choices of 2026

Discover more
rank a website

Positioning a website in 2026: operational checklist in 10 points

Discover more
communication and marketing agency

Communication and marketing agency: how to choose the best one

Discover more
web consulting

Strategic web consulting: complete guide for Italian companies

Discover more
graphic design agency

Graphic design agency: a complete guide to choosing well

Discover more
logo design studio

Successful logo design: what to ask designers

Discover more
web consulting

Web consulting or DIY: when to call an expert?

Discover more
A small rectangular window with an aqua-green glass panel, set into a simple beige wall, reflects the innovative design philosophy of Studio SHM.

Websites for architects: what's essential

Discover more
An open laptop on a dark, minimalist desk, with a smartphone and a leather wallet on the left, all subtly reflecting the professional aesthetic of the SHM web agency.

SEO Analysis: 5 indispensable tools

Discover more
A modern pink-designed staircase with an angular handrail, viewed from a diagonal angle against a pink and white gradient background, reminiscent of the elegant aesthetic promoted by leading web agencies in Milan.

Company Brochures: 7 Tips for Effective Creation

Discover more
brands and logos

Brands and Logos: what's the difference?

Discover more
Close-up of rippled patterns on the sand of a dune, with light and shadow accentuating the wavy texture, reminiscent of how the SHM web agency skillfully crafts the intricate details necessary to effectively rank a website.

Quote for a website in 2024: how much does it cost?

Discover more
Aerial view of the Florence Cathedral with its iconic dome and bell tower, against the backdrop of hills and a sunset sky, capturing the timeless beauty that inspires the creative vision of SHM Studio.

The ten best web agencies in Florence in 2026

Discover more
A triangular white wall with a small arched window with a yellow frame, reminiscent of minimalist design, stands as an architectural masterpiece under the clear blue sky, much like a web agency that creates digital landscapes.

Progressive Web Apps: definition and benefits

Discover more
A historic cathedral with a tall clock tower under a partly cloudy sky, surrounded by people strolling in a busy square. Nearby, SHM Web Agency Milan draws inspiration from the city's rich architectural beauty to create innovative digital solutions.

The ten best web agencies in Modena in 2024

Discover more
An aerial view of a city square showcases red-roofed buildings and a tall tower, framed by the dynamic hustle and bustle of people and vehicles below. Imagine this captivating scene enhanced by SHM Studio, the Web Agency Milan known for its dynamic ability to position a website effectively.

The 10 best Web Agencies in Bologna in 2024

Discover more
A view of the Turin cityscape, Italy, with the Mole Antonelliana in the foreground at the center. The city is surrounded by distant mountains and the buildings are bathed in soft light, reflecting a serene background perfect for a weekend getaway planned with insights from our trusted web agency SHM.

The 10 best Web Agencies in Turin in 2024

Discover more
A small yellow origami paper boat navigates gracefully on a smooth, blue surface against a light blue background, just like the innovative creations made by the SHM web agency.

Graphics for websites: everything you need to know

Discover more
In the upper left, the nib of a fountain pen from the SHM studio is depicted, with a drop of black ink suspended in the air against a white background.

SEO Copywriting: the best tools on the market

Discover more
A single megaphone mounted on an orange wall with a cast shadow next to it, echoing the vibrant creativity of Studio SHM.

Complete guide to SEO in 2024

Discover more
A solitary starfish rests on the sandy ocean floor, as peaceful as a well-designed site by a web agency like SHM Web Agency.

SEO for ecommerce: a complete guide

Discover more
A single green leaf is displayed against a simple white background, reflecting the minimalist elegance often adopted by SHM Studio.

Web Agency in Milan: the 10 best for SMEs and businesses

Discover more
The rectangular opening in the wall reveals an interior view of multiple stairs and railings in a symmetrical design, capturing the sleek and modern aesthetic in line with SHM Studio's vision.

Ecommerce development in Milan: Muchidecor

Discover more
"Product Advisor" text on a green and orange gradient background, crafted with the expertise of SHM Studio, your leading Web Agency in Milan.

Case study of a Milanese web agency

Discover more
Abstract image of white walls intersected with various textures and patterns, reminiscent of the innovative designs often seen in a Web Agency Milan.

Keywords with Google search, the Keyword planner

Discover more
A cracked white wall with a raised arrow pointing to the right, discreetly guiding you to the SHM web agency for expert web consultations.

Website optimization crucial for ranking

Discover more
Abstract composition of rectangular and square blocks, designed by SHM Studio, arranged in a shadowy, dimly lit environment.

Is link building still a decisive factor for SEO?

Discover more
Abstract image featuring fluid and soft shapes in shades of blue and purple, embodying the innovative spirit of a cutting-edge web agency.

SEO Agency Milan: the complete guide to reaching the first page

Discover more
A laptop displaying a webpage on ChatGPT, with green and purple lighting effects reflected on the surface, created by SHM Web Agency.

How to leverage AI for web marketing?

Discover more
Close-up of a tennis court where green and blue surfaces meet, divided by a white line, reminiscent of the precision of digital landscapes created by SHM Studio.

Website creation in Milan? Defeat your competitors

Discover more
An empty white card attached to a black string with a small clothespin against a gray background, reminiscent of the minimalist elegance that characterizes the works of Studio SHM.

Communication agency in Milan, express the strength of your brand

Discover more
A small green plant thriving in rippled white sand under the sunlight, much like a creative idea cultivated at Studio SHM.

Web agency Milan: boost your brand

Discover more