Yahoo Pipes – discontents http://discontents.com.au working for the triumph of content over form, ideas over control, people over systems Mon, 13 Sep 2021 04:34:08 +0000 en-US hourly 1 https://wordpress.org/?v=4.8.17 https://creativecommons.org/licenses/by/4.0/ 90077936 Playing with pipes http://discontents.com.au/playing-with-pipes/ http://discontents.com.au/playing-with-pipes/#comments Thu, 10 Sep 2009 08:38:25 +0000 http://discontents.com.au/?p=699

The ever-informative Twitter alerted me recently to the History Trust of South Australia’s object of the month. It made me think that it would be nice if there was some way of bringing together all those objects, photos and documents featured by our cultural institutions. Some sort of combined RSS feed perhaps?

Something like this…

Well, yes… I couldn’t resist having a go. My tool of choice for this was Yahoo Pipes which has various modules for manipulating and creating RSS feeds. Check out my script on the Yahoo Pipes site to create a badge like this, play some more or inspect its innards. If you’re feeling adventurous you can even clone the script and tinker away yourself – it’s the best way to learn.

At the moment the script aggregrates content from the Flickr photostreams of:

  • National Archives of Australia
  • State Records NSW
  • State Library of NSW
  • State Library of Queensland
  • State Library of South Australia
  • Australian War Memorial
  • Powerhouse Museum

These are mixed up with the contents of the Powerhouse’s ‘Object of the week‘ blog and the NAA’s ‘Find of the Month‘. I’m happy to add more sources – leave your suggestions below.

Most of it was ridiculously easy. I just added the RSS feeds from Flickr and the Powerhouse blog, then fed them through a module to sort them into date order. ‘Find of the month’ was trickier because there was no existing RSS feed – time for some screen-scraping! First I scraped a list of the urls for 2009, then for each month I pulled out the title and date, as well as the first paragraph to act as a description, and the first image. Then I turned all these bits and pieces into an RSS feed and joined it up with the rest.

Yahoo Pipes makes this sort of thing simple, even for non-coders. Interestingly, too, it’s not just a matter of creating an RSS feed – as you can see Yahoo Pipes emits the data in a variety of formats. You can subscribe to the RSS feed, create a badge or slurp up the data in JSON to power some new application.

]]>
http://discontents.com.au/playing-with-pipes/feed/ 7 https://creativecommons.org/licenses/by/4.0/ 699