Does a web crawler have to download an entire page if it only needs to check if the product is in stock on a page? Or if it just needs to search for one match of a certain word on a page?