on the login put a check box (with a CAPTCHA) they must fill out every
time they log in that says 'i agree with the terms and conditions' one
of which is no screen scrapers. use a variety of detection methods.
when detection occurs, disable the account for breach of terms and
conditions.
also, another way - generate the entire interface programatically with
something like Dojo. make every Ajax request (which like, gets the
JSON code to generate the interface, so it's entirely necessary) send
the information as to whether a scraper is detected. if so, as well as
logging for the above breach of terms and conditions, send them a
tight javascript loop that eats 100% CPU for lets say, a minute.
make all this code obfuscated, (take dojo into production mode and
it's pretty obfuscated already) and generate and rotate key method
names in the javascript.
On 15/07/2009, at 06:11 , Mica Cooper wrote:
> David,
> My understanding is that the client runs an Activex plugin in Internet
> Explorer that creates a parent frame for their software and a child
> frame
> for ours. So no, the IP's will be ever changing...I'm so
> disappointed that
> you have such a low opinion of my skills... ;) This is their 'legal'
> argument, that they are not doing this but the client. I will tell
> you that
> it is not legal as our client agreement expressly forbids this.
> Mica
>
> -----Original Message-----
> From: straight_talking_java@yahoogroups.com
> [mailto:straight_talking_java@yahoogroups.com]On Behalf Of David
> Rosenstrauch
> Sent: Tuesday, July 14, 2009 3:05 PM
> To: straight_talking_java@yahoogroups.com
> Subject: Re: [ST-J] Help with Scrapers
>
>
>
>
>
> Mica Cooper wrote:
>> Guys,
>>
>> I put in some javascript ajax to detect the scrapers :
>>
>> if (top != self) {
>> sendAjaxMsg("some message");
>> }
>>
>> I got the first one...then nothing for almost a week. I think they
> somehow
>> detected the script and are actually FILTERING OUR WEBSITE code. This
> really
>> really upsets me and yes, I know its highly illegal if they are.
>>
>> Does anyone have any ideas for detecting this? Remember, only like
>> 1 in
> 100
>> users are using their deal so putting in a detector for every login
>> will
> not
>> tell me anything.
>>
>> Mica
>
> Will the requests always come from a fixed set of IP addresses?
>
> DR
>
>
>
>
>
> [Non-text portions of this message have been removed]
>
>
>
> ------------------------------------
>
> _______________________________________________________
> ST-J Wiki: http://tarasis.net/STWiki/
> ST-J Members Map: http://www.frappr.com/stj
>
>
>
> .Yahoo! Groups Links
>
>
>
--
scot.mcphee@...
http://crazymcphee.net/