Avatar

Untitled

@daveymames

Avatar
Reblogged
Anonymous asked:

Could I setup a site to automatically monitor Twitter accounts with over 10,000 followers or so & automatically backup new Tweets from those accounts? My website will use your site to make a backup of a Tweet as normal on your site then my site will have a page with a link to all that person's archived Tweets. I want to do this to catch politicians out who say bad things then try to delete their Tweets to erase the evidence. Is that only possible with AP access & does your site have API access?

Twitter will likely ban us. We often receive “429 Too many requests” answers from Twitter.

AFAIK, some library (Library of Congress?) does save all tweets in realtime, so you might use them.

Avatar

The Library of Congress only backup selective Tweets.

How many requests need to be made at the same time to get the “too many requests” error? Is there any way to prevent getting that error?

Doesn’t seem like they would ban you because instead they just temporarily block your site from making requests?

Avatar
Reblogged
Anonymous asked:

You said that before you die of old age you would implement a download zip of your whole site. That's fine but links to archived pages will still be broken if you die if you don't have someone to follow in your footsteps to maintain the site because the site will go offline or somebody will buy your expired domain name using it for another purpose. Do you have plans for someone to take over your site? I have thousands of archived pages, don't want that work to go to waste.

I do not think there are many people willing to maintain such a project, which is also unprofitable. All 4½ projects over there - (IA, Archive.today, Megalodon.jp, half-suspensed WebCite, and paid Pinboard.in) look running on energy and money of a single person each and likely will be greatly changed or shutdown by the heirs.

I could only advise to save everything locally to sync your documents with your own lifespan. Do not rely on clouds.

Avatar

You don’t need many people mate, just a small amount of people is all that’s required. I for example would be willing to accept a passing of the torch. I would fund it with my own money and allow people to donate. I’m planning a site similar to Archive.org of my own that allows uploading via torrents so you can upload big files which is hard to do on archive.org and it bans people who don’t keep 1TB of stuff permanently seeded. This way I don’t need to waste money on storage. 

How much does hosting cost you per month at the moment?