.Google.com's Gary Illyes shows Googlebot gathers web links instead of "following" them, negating formal documentation.Googlebot accumulates web links as opposed to following all of them in real-time.Gary Illyes discussed this details in Google.com's 'Explore Off The Record' podcast.Google's records opposes the genuine spider behavior.