Name
LLM Crawlers: How to Detect, Manage, and Decide When to Block
Date & Time
Wednesday, March 11, 2026, 1:50 PM - 2:30 PM
Description

Large Language Models are changing how search results are built — but before they generate answers, they need to crawl your site. The problem: most marketers don’t know when or how these models are accessing their content. In this session, Amanda will explain the current state of LLM crawling, show how to check for activity in your bot logs, and outline what your hosting provider may be doing — for example, firewalling agentic AI — that you need to consider. You’ll also get clear recommendations on crawling management: when blocking might be the right choice, and how to allow useful access while safeguarding performance and data.

Host
Amanda King,
Room
Saal 1