DiscoverEd Metadata - Revision history

Akozak at 18:10, 9 June 2010

2010-06-09T18:10:52Z

Akozak: /* Resource Metadata */

2010-06-09T18:09:38Z

‎Resource Metadata

Akozak at 18:09, 9 June 2010

2010-06-09T18:09:05Z

Akozak at 18:07, 9 June 2010

2010-06-09T18:07:59Z

Akozak at 18:06, 9 June 2010

2010-06-09T18:06:30Z

Akozak at 18:06, 9 June 2010

2010-06-09T18:06:06Z

Nathan Yergler at 15:58, 28 May 2010

2010-05-28T15:58:17Z

Nathan Yergler: moved CcLearn Search Metadata to DiscoverEd Metadata

2010-05-28T15:57:47Z

moved CcLearn Search Metadata to DiscoverEd Metadata

Ahrash: /* [X]HTML + RDFa */

2009-06-10T23:07:58Z

‎[X]HTML + RDFa

Ahrash: /* Overview */

2009-06-10T23:06:14Z

‎Overview

@@ Line 29: / Line 29: @@
 *Language
 *Subject
 '''Title''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-title DCT:title]</code>)<br />
@@ Line 60: / Line 56: @@
 '''Subject''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-subject DCT:subject]</code>)<br />
 The subject(s) of the resource; e.g., mathematics. The subject refers to the actual content in the resource; i.e., what the resource is about. For many resources, more than one subject will be necessary; in these cases, simply specify multiple subject elements. Ideally you should try to limit the contents of the subject to only those subjects that are objectively reflective of the entire resource. Other types of categories (opinions, metrics, etc.) may have other vocabularies available which are more appropriate.
 == Examples ==

@@ Line 41: / Line 41: @@
 '''License''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-license DCT:license]</code>, <code>[http://creativecommons.org/ns cc:license]</code>, <code>[http://www.w3.org/1999/xhtml/ xhtml:license]</code>)<br />
-The stable URL of the work's license; e.g., http://creativecommons.org/licenses/by/3.0/. If you are using Creative Commons licenses, we also recommend following the [[C REL]] specification for identifying further CC license metadata.
+The stable URL of the work's license; e.g., http://creativecommons.org/licenses/by/3.0/. If you are using Creative Commons licenses, we also recommend following the [[CC REL]] specification for identifying further CC license metadata.
 See the [[Syndication|CC with syndication formats]] documentation for more information on including this in a bootstrap feed.

@@ Line 45: / Line 45: @@
 See the [[Syndication|CC with syndication formats]] documentation for more information on including this in a bootstrap feed.
- '''Education level''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-educationLevel DCT:educationLevel]</code>)<br />
+'''Education level''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-educationLevel DCT:educationLevel]</code>)<br />
 What grade(s) or age-level(s) this material is suitable for. The education level should indicate all levels (student ages) for which the resource is deemed appropriate. Though we accept any descriptions that seem appropriate to you, please consider using one of the following schemas:

← Older revision		Revision as of 18:07, 9 June 2010
Line 1:		Line 1:
		+	{{Infobox\|'''This is a basic guide to increasing the discoverability of online educational resources by preparing them for inclusion into search engines that utilize structured data, like [http://discovered.creativecommons.org/search/ DiscoverEd]. This guide contains technical language and sample XHTML and RDFa.'''}}
		+
	[http://discovered.creativecommons.org/search/ DiscoverEd] is an experimental project from Creative Commons intended to explore how [[Structured Data\|structured data]] may be used to enhance the search experience. Metadata about the resources, including the license and subject information available, are exposed in the search result set. We are particularly interested in open educational resources (OER) and are collaborating with other open education projects to improve search and discovery capabilities for OER, using DiscoverEd and other available tools. For in-depth details, read the [http://learn.creativecommons.org/wp-content/uploads/2009/07/discovered-paper-17-july-2009.pdf white paper] that describes the goals and design of DiscoverEd.		[http://discovered.creativecommons.org/search/ DiscoverEd] is an experimental project from Creative Commons intended to explore how [[Structured Data\|structured data]] may be used to enhance the search experience. Metadata about the resources, including the license and subject information available, are exposed in the search result set. We are particularly interested in open educational resources (OER) and are collaborating with other open education projects to improve search and discovery capabilities for OER, using DiscoverEd and other available tools. For in-depth details, read the [http://learn.creativecommons.org/wp-content/uploads/2009/07/discovered-paper-17-july-2009.pdf white paper] that describes the goals and design of DiscoverEd.

← Older revision		Revision as of 18:06, 9 June 2010
Line 1:		Line 1:
−	[http://discovered.creativecommons.org/search/ DiscoverEd] is an experimental project from Creative Commons intended to explore how [[structured data]] may be used to enhance the search experience. Metadata about the resources, including the license and subject information available, are exposed in the search result set. We are particularly interested in open educational resources (OER) and are collaborating with other open education projects to improve search and discovery capabilities for OER, using DiscoverEd and other available tools. For in-depth details, read the [http://learn.creativecommons.org/wp-content/uploads/2009/07/discovered-paper-17-july-2009.pdf white paper] that describes the goals and design of DiscoverEd.	+	[http://discovered.creativecommons.org/search/ DiscoverEd] is an experimental project from Creative Commons intended to explore how [[Structured Data\|structured data]] may be used to enhance the search experience. Metadata about the resources, including the license and subject information available, are exposed in the search result set. We are particularly interested in open educational resources (OER) and are collaborating with other open education projects to improve search and discovery capabilities for OER, using DiscoverEd and other available tools. For in-depth details, read the [http://learn.creativecommons.org/wp-content/uploads/2009/07/discovered-paper-17-july-2009.pdf white paper] that describes the goals and design of DiscoverEd.

	This page is meant to be a quick checklist for maximizing the discoverability of your resources in DiscoverEd and similarly designed search engines. Not all of these steps are necessary for inclusion into DiscoverEd. For example, structured data are not technically required for resources to be included in search results, but without them users of the search engine will be provided with very little information about your resources.		This page is meant to be a quick checklist for maximizing the discoverability of your resources in DiscoverEd and similarly designed search engines. Not all of these steps are necessary for inclusion into DiscoverEd. For example, structured data are not technically required for resources to be included in search results, but without them users of the search engine will be provided with very little information about your resources.

@@ Line 1: / Line 1: @@
-== Overview ==
+[http://discovered.creativecommons.org/search/ DiscoverEd] is an experimental project from Creative Commons intended to explore how [[structured data]] may be used to enhance the search experience. Metadata about the resources, including the license and subject information available, are exposed in the search result set. We are particularly interested in open educational resources (OER) and are collaborating with other open education projects to improve search and discovery capabilities for OER, using DiscoverEd and other available tools. For in-depth details, read the [http://learn.creativecommons.org/wp-content/uploads/2009/07/discovered-paper-17-july-2009.pdf white paper] that describes the goals and design of DiscoverEd.
-This document outlines some of the metadata utilized by [[DiscoverEd]].  These metadata are collected from embedded [[RDFa]] at crawl time.  We also look for these metadata in feeds (RSS, Atom) and OAI-PMH harvests, although these are considered as a way to bootstrap the metadata corpus.  While the metadata store may include additional information from resources, these fields are exposed by default in the search results.
+This page is meant to be a quick checklist for maximizing the discoverability of your resources in DiscoverEd and similarly designed search engines. Not all of these steps are necessary for inclusion into DiscoverEd. For example, structured data are not technically required for resources to be included in search results, but without them users of the search engine will be provided with very little information about your resources.
-* '''Title''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-title DCT:title]</code>): A brief descriptive title for the resource.
+== Resource Feed ==
-'''Our preferred and suggested metadata encoding/transport is XHTML+[[RDFa]].  We believe this has the broadest possible exposure for current and future software agents.'''
+DiscoverEd uses resource feeds to direct its resource crawl. In order to index your educational resources, DiscoverEd will need the URL to an RSS or Atom feed that is limited to your educational resources. It is not likely that a site is composed entirely of educational materials, instead consisting of "About" pages, links to staff profiles, and so on, in addition to the educational resources. An index of educational resources should be composed of only actual educational materials, thereby reducing or eliminating clutter that typically accompanies web-scale queries.
-__TOC__
+DiscoverEd consumes the feeds for each site that has been listed for inclusion. Your feed essentially provides a URL "road map" of your resources, which can then be used to run a directed crawl of the resources you curate. In other words, the crawler knows where the relevant resources are located because you, the curator, have pointed at them directly using the feed.
-== Vocabulary ==
+Many curatorial sites already have feed functionality (RSS or Atom) or support the Open Archive Initiative's Protocol for Metadata Harvesting (OAI-PMH). The MIT Open CourseWare site, for example, allows you to subscribe to a feed of the courses, which means that you can get an update every time a course is added, deleted, or changed. This type of feed also usually contains a list of the URLs for every course already on the site. Both feeds and OAI-PMH also provide a convenient method of polling, allowing the system to periodically check for new resources. Once a feed is set up, the DiscoverEd system can be kept up to date with minimal oversight.
-=== Specifying Subject ===
+== Resource Metadata ==
-The subject refers to the actual content in the resource; i.e., what is this resource ''about''? For many resources, more than one subject will be necessary; in this case, specify multiple subject elements.  We ask that you try to limit the contents of the subject to only those subjects that are objectively reflective of the entire resource. Other types of categories (opinions, metrics, etc) may have other vocabularies available which are more appropriate.
+Once you have located the URL to a feed that is limited to your educational resources, a good next step to increasing their discoverability would be to provide metadata about those resources. We recommend XHTML+[[RDFa]] for metadata encoding and transport.
-=== Specifying Education level ===
+As a curator, you have certain goals for the resources you curate. Generally, you want curated resources to be as easy to find as possible. Core to this goal is enabling machines to detect and interpret metadata about the resources, such as title, language, or licensing terms, in a way that is interoperable with as many detection and interpretation methods as possible. Interoperability here means not only that different programs can read particular metadata properties, but also that the vocabularies themselves, which are sets of related properties, can evolve and be extended. It is also important that potential extensions be backward compatible: existing tools should not be disrupted when new properties are added. If possible, existing tools should even be able to handle basic aspects of new properties. This is precisely the kind of "interoperability of meaning" that [http://en.wikipedia.org/wiki/Resource_Description_Framework RDF] is designed to support.
-The education level should indicate all levels (student ages) for which the resource is deemed appropriate. The education level should be labeled using the [http://dublincore.org/documents/dcmi-terms/#terms-educationLevel DCT:educationLevel] term.
+For this and other reasons, the ideal method for metadata encoding/transport is XHTML+[[RDFa]]. We believe this has the broadest possible exposure for current and future software agents. For more information as to why we recommend and require [[RDFa]] for metadata transport, see the [[CC REL]] W3C specification and our [http://learn.creativecommons.org/wp-content/uploads/2009/07/discovered-paper-17-july-2009.pdf white paper]. For technical information on XHTML and RDFa, see the [http://www.w3.org/TR/xhtml-rdfa-primer/ W3C RDFa Primer].
-Though we will accept any descriptions that seem appropriate to you, please consider using one of the following schemas:
+This section outlines some of the [[RDFa]] metadata Creative Commons is collecting for the DiscoverEd project and gives some examples of using RDFa in XHTML documents. These metadata are extracted from the document at crawl time. While our metadata store may include additional metadata information from resources, these fields are exposed by default in the search results:
-* primary, secondary, tertiary, adult;
+*Title
-* K,1,2,3,...,20 (where the number refers to the actual grade-level).
+*Summary
-You may include equivalent terms as well by specifying more than one value for <code>DCT:educationLevel</code>.  For example, you might include a <code>DCT:educationLevel</code> for <code>9</code>, <code>10</code>, and <code>secondary</code>.
+{{Infobox|'''Note about RDFa Vocabularies'''
-=== Specifying Language ===
+Notice that each metadata label is preceded by a prefix of either dc or xhtml. In the RDFa specification, these are indicators of which vocabulary defines the properties, or metadata terms. We recommend the [http://purl.org/dc/terms/ Dublin Core] vocabulary for the majority of properties because of its widespread adoption. For license, we recommend using the xhtml namespace because it’s built in to the XHTML specification and is equivalent to other definitions of the property.}}
-When specifying the language for a resource, the value should be specified as described by [http://www.ietf.org/rfc/rfc4646.txt RFC-4646].  For example, <code>en</code> for English.  To distinguish English (United States) from English (United Kindgom), the language would be specified as <code>en-US</code> and <code>en-GB</code>, respectively.
+'''Title''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-title DCT:title]</code>)<br />
-In an Atom 1.0 feed, the language is specified as the <code>xml:lang</code> attribute of the <code>content</code> element.  Multiple languages in a single entry is not supported.
+'''Summary''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-description DCT:description]</code>)<br />
-=== Embedding license data ===
+'''Language''' (<code>[http://www.w3.org/XML/1998/namespace xml:lang]</code>, <code>[http://dublincore.org/documents/dcmi-terms/#terms-language DCT:language]</code>)<br />
-The resource license should be communicated using the stable URL of the license.  For example, http://creativecommons.org/licenses/by/3.0/.
+In an Atom 1.0 feed, the language is specified as the <code>xml:lang</code> attribute of the <code>content</code> element.  Multiple languages in a single entry is not supported.
-See the [[Syndication|CC with syndication formats]] documentation for more information on including this is a bootstrap feed.
+'''Subject''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-subject DCT:subject]</code>)<br />
 == Examples ==

← Older revision	Revision as of 15:57, 28 May 2010
(No difference)

@@ Line 49: / Line 49: @@
 === [X]HTML + [[RDFa]] ===
-The following is an example of how a resource at http://ocw.example.org/math/101 could be annotated with machine readable metadata, including license and attribution information.  This is our preferred manner for encoding this information as it exposes the metadata to a much wider range of clients.
+The following is an example of how a resource at http://ocw.example.org/math/101 could be annotated with machine-readable metadata, including license and attribution information.  This is our preferred manner for encoding this information as it exposes the metadata to a much wider range of clients.
 <pre>
@@ Line 75: / Line 75: @@
 </pre>
-If a site aggregates resources such that the metadata appears on a page other than the actual resource, the <code>about</code> attribute can be used to indicate that the metadata is about a different resource.  For example, the following page could be published at <code>'''http://commons.oer.example.org/math/101'''</code> and still refer to the same resource as the previous example:
+If a site aggregates resources such that the metadata appear on a page other than the actual resource, the <code>about</code> attribute can be used to indicate that the metadata are about a different resource.  For example, the following page could be published at <code>'''http://commons.oer.example.org/math/101'''</code> and still refer to the same resource as the previous example:
 <pre>

@@ Line 3: / Line 3: @@
 == Overview ==
-This document outlines some of the metadata ccLearn is utilizing for the [[DiscoverEd]] project.  This metadata is collected from embedded [[RDFa]] at crawl time.  We also look for this metadata in feeds (RSS, Atom) and OAI-PMH harvests, although these are considered as a way to bootstrap the metadata corpus.  While the metadata store may include additional information from resources, these fields are exposed by default in the search results.
+This document outlines some of the metadata ccLearn is utilizing for the [[DiscoverEd]] project.  These metadata are collected from embedded [[RDFa]] at crawl time.  We also look for these metadata in feeds (RSS, Atom) and OAI-PMH harvests, although these are considered as a way to bootstrap the metadata corpus.  While the metadata store may include additional information from resources, these fields are exposed by default in the search results.
 * '''Title''' (<code>[http://dublincore.org/documents/dcmi-terms/#terms-title DCT:title]</code>): A brief descriptive title for the resource.