Organize an Event

The BEST thing you can do is get in touch with your community -especially your library- and organize an event. If that's not an option, see these four other ways to help build DataRefuge on your own. 

work on asynchronous "uncrawlables"

Some data can't be seeded into the Internet Archive because, for one of several reasons, the IA webcrawler cannot reach them. We call these "uncrawlables" and they are a harder to get. So far these have only been saved in a reference-quality way at DataRescue events but a workflow for saving these data is being developed. There are several roles to take in this process, all of which are decribed in detail on our Workflow page - two examples are researchers, who inspect the "uncrawlable" list to confirm that seeders' assessments were correct (that is, that the URL/dataset is indeed uncrawlable), and harvesters, take the "uncrawlable" data and try to figure out how to capture it. This is a complex task which can require substantial technical expertise, and which requires different techniques for different tasks. Harvesters should see the Harvesting Toolkit (coming soon) for more details and tools. We'd love to hear from people with data and web archiving and/or metadata experience for the other roles from this piece - please email for more information!

write a story

Why and to whom does this data matter? How does this data matter to you and your community? In what ways do you imagine this data being used in the future? 

A diverse group of people-not just climate scientists-benefit from this information in a number of ways. From archaeologists and city planners, to indigenous communities and local citizens that inhabit coastal towns, this data is valuable to a variety of stakeholders. We welcome you to write a story about who and which local communities, organizations, and institutions currently use specific datasets, and how. 

How might this climate and environmental data serve your community or research in the future? As Etienne Benson remarked in DataRescue Philly's teach-in, the greatest value of public data is in its potential for future use. Thus, we are also calling for contributions that imagine more generic ways that this data might be put to use. 

If you would like to write a story, contact 

Seed data to the end of term harvest 2016 

If you know of government URLs to programs and/or downloadable data that is vulnerable and valuable, please let the End of Term Harvest (EOT) Team know about it. Their team will make sure it’s archived in a trustworthy manner, and will end up in the Internet Archive. Refer to the EOT team, and the Internet Archives Wayback Machine for more information on their sites. There are several ways to do contribute to this effort:

  1. Use the online nomination form.

  2. Install the Chrome bookmarklet that allows you to nominate URLs with one click. Instructions for installing the tool are at the bottom of this EOT page

  3. If nominating many URLs, use the Chrome Extension available at the Chrome Extensions Store (created by EDGI) to nominate pages using a spreadsheet. Check out "How to Seed the EoT Web Crawler" in the EDGI Toolkit for more

  4. Send an email to Lauren Ko ( at the End of Term Harvest with a list of web addresses (preferably as a .csv file) where valuable and vulnerable data live.


In conjunction with DataRefuge and EDGI, Climate Mirror is working to mirror and back up climate and federal data in many locations around the world. If you have server space and want to start mirroring data, get involved with Climate Mirror.