We understand that Home Depot may return different results in their data depending on where the proxy IP that is connecting to the site is located. For instance, if our proxy IP is in Los Angeles, California, that may return different product results than if the proxy IP is located in Atlanta, Georgia. Because we have such a diverse pool of proxy IP addresses that our system rotates through, results can vary from scrape to scrape. Our team will look to implement a way that we can allow you to search by store on Home Depot to guarantee your results are what you need.
I want to look at specific lumber prices across the US - Using Home Depot as base for pricing. I want to repeat this on a regular basis. Does your scrapping have the ability to look at each store on command?
Hello and thanks for writing in! This feature will do exactly as you described - it will allow you to choose which store you'd like to get the lumber prices for on command. There will be a dropdown box added to the current module that allows for you to select the target store that you need prices for.
You can submit these scraping jobs as often as you'd like through the dashboard module, or we could work to build you a custom project that would allow you to scrape all stores on a frequency you would set. If you're interested in the custom project route, please let me know and we can work on a quote for that!
Otherwise, this functionality is set to hit the production servers early next week and we couldn't be more excited for it!