Ask HN: Any search engine creating expert here to answer my questions for $?
I will pay you for your time through Google Helpouts..
Please send me private message quoting your fees per minute. testingbackupsoftwares gmail
I am a student so I think I can pay for some of your lunches and may be even dinners.
Thanks a million.
........My questions are:
Is it possible to build a stealth search engine (web crawling not web scraping) to target just one website online, without them knowing, and how i.e. coding skills and anonymity required?
The website I am keeping tabs on has a new web page for each new product promotion , and each new page has a dynamic url (i.e. the URL contains a query with '?')
So I wonder if it is at all possible to build a search engine / web crawler to keep up to date with it.
In other words, I want to collect the subdomain URLs on a given website, and only those URLs that contain a certain word/phrase
Please advise on how to stay in stealth mode.
Please enlighten.
Thanks a million.
4 comments
[ 3.9 ms ] story [ 23.8 ms ] threadWhat is so illegal about these questions?
Oh, I forgot, I work for NSA/CIA/FBI/.....
Beware.
http://www.quora.com/Web-Crawling/Is-it-possible-to-build-a-...
I want to thank you.