Marketing research tools or techniques

[denvercardonations]

Might there be an app, web tool, or niche search engine that can gather articles , PDFs, and Docs from across the web? Thahe amount of time doing this just by searching on Google, might take a long time, because there are portions of the internet that are "noindex"and "nofollow" that search engines don't index.