Googlebot is one client of a centralized crawling platform. The crawing platform is shared by Google Shopping, AdSense, and other products. When a page exceeds 2 MB, Googlebot stops fetching at the ...