PuSH Feed Type

From Creative Commons
Revision as of 15:49, 7 September 2010 by Paulproteus (talk | contribs)
Jump to: navigation, search
Contact Contact::Asheesh Laroia
Project ,|project_name|Project Driver::project_name}}
Status Status::Draft

The people who run a DiscoverEd instance may wish to be updated nearly-immediately when there are new resources published by a curator.

Right now, DiscoverEd instances aggregate feeds and crawl every once in a while, often manually at the behest of the search engine operator. PubSubHubBub provides a way for the DiscoverEd instance to subscribe feeds and receive automatic, nearly-instantaneous notification of new information in the feed.

This can be built on top of existing Atom/RSS feeds that curators already publish.

This feature was defined and developed during the fun DC meeting thing. (Nathan, did that meeting have a name?)

Requirements

A complete implementation of this specification would provide the following things.

  • DiscoverEd can discover a PuSH hub mentioned in a feed.
  • DiscoverEd can register itself as a subscriber to that feed on that hub. (To do that, it has to provide a URL on the DiscoverEd instance that, when the feed is updated, the hub should POST to.)
  • When the hub pings DiscoverEd to say there is an update to that feed, it re-aggregates data from that feed, does a crawl, and merges the index.

Status

  • This draft document has been written. That's all.
  • NSDL is interested in trying this with us.

Questions

  • Can we make things as simple as this:
    • OER Africa adds <link rel="hub"...>
    • They do nothing else.
    • The chosen hub polls the feed, and when there are updates, pings us.
    • Then we get real-time updates with basically no effort from OER Africa.