.Google.com's Gary Illyes discloses Googlebot accumulates hyperlinks rather than "following" all of them, contradicting official records.Googlebot gathers web links as opposed to observing all of them in real-time.Gary Illyes discussed this relevant information in Google.com's 'Browse Off The Document' podcast.Google's documentation opposes the genuine spider habits.