PDA

View Full Version : Data Scrapping Problem



round
01-26-2013, 09:17 AM
Hello,

We are using one script to get the contents from a website that is data scrapping.
But the thing is in that site they are providing short description & we need to get whole description but whole description comes by clicking More link.
When we click on more link the page is not getting refreshed but one more div is generated with full description.

So my question is how can I get that full description?
I am using PHP Script so I put the question here in this forum.

Any Idea?
Any Help?

Thanks
Kaushal

WriterIvStoev
02-03-2013, 09:25 AM
Firebug can help You to find div content.
In any case, nothing to say without example.

traq
02-03-2013, 05:56 PM
We are using one script to get the contents from a website that is data scrapping
[...]
So my question is how can I get that full description?
First off, do the Terms of Service on the website in question allow you to harvest their content?

If they do, then there is likely an API which would allow you do get the content with much less effort.

If they do not, then the answer is that you need to stop.
Asking for help with activities that are illegal or which deliberately violate a site's TOS are not permitted on DynamicDrive.

Please clarify.