jarek108
07-25-2008, 08:28 AM
i want to
1. go through a certain web pages
2. get simple data
(already have js code in greasemonkey that does walking and data retrival)
3. have a way to store this data in a simple DB
4. have a way for my "crawler" to check this DB contents while it's web travels
5. would be nice if it is created as a one simlpe tool, i do not want to spend my time trynig to make my DB work than to make it communicate with the crawling code etc.
solutions? how would you do it?
1. go through a certain web pages
2. get simple data
(already have js code in greasemonkey that does walking and data retrival)
3. have a way to store this data in a simple DB
4. have a way for my "crawler" to check this DB contents while it's web travels
5. would be nice if it is created as a one simlpe tool, i do not want to spend my time trynig to make my DB work than to make it communicate with the crawling code etc.
solutions? how would you do it?