persistence - Best way to store data for Greasemonkey based crawler? -

I want to crawl a site with Greasemonkey and it is surprising that if temporarily store values ​​from GM_setValue Better way

I crawl your contacts in a social network and remove the Twitter URL from their profile pages. What are your requirements?

My current plan is to open each profile in the tab itself, so that it looks more like a normal browsing person (css, scripts, and images will be loaded by the browser). Then store the Twitter URL with GM_setValue Once all the profile pages have been crawled, create a page using stored values.

I am not very happy with storage options, however, maybe there is a better way?

I have considered inserting user profiles in the current page so that I can process them all with the same script example, but I'm not sure if the XMLHttpRequest looks indistignuishable from the normal user I am starting request

I have taken a similar project where I needed to get a whole lot of ( Invoice line data) and export it to an accounting database.

You can create an .aspx (or PHP etc.) back end which processes the postal data and stores it in the database.

Any data you want that can be stored in a form from a single page (if you want to hide using style properties), to identify the data field name or Using the id. After that all you need to do is create farm action by creating an .aspx page and submit the form using javascript.

(Alternatively, you can add a submit button to submit the page, so you can check the prices of the form before submitting. In the database).