The past, present, and future of robots.txt
Dec 21, 2021 ·
53m
Download and listen anywhere
Download your favorite episodes and enjoy them, wherever you are! Sign up or log in now to access offline listening.
Description
In this episode of Search Off the Record, Gary, Lizzi, and Martin from the Google Search team are joined by special guest David Price, a Product Counsel for Google. They...
show more
In this episode of Search Off the Record, Gary, Lizzi, and Martin from the Google Search team are joined by special guest David Price, a Product Counsel for Google. They discuss human initiated crawl requests vs. bot initiated crawl requests, the robots.txt file, and more! Episode transcript → https://goo.gle/sotr028-transcript Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.
show less
Information
| Author | Musonera Jean Claude |
| Organization | Musonera Jean Claude |
| Website | - |
| Tags |
Copyright 2024 - Spreaker Inc. an iHeartMedia Company
