Difference between revisions of "Case Studies/Evaluation"

From Creative Commons
Jump to: navigation, search
(note inspiration)
 
(75 intermediate revisions by 3 users not shown)
Line 1: Line 1:
 
It's important for Creative Commons to be able to talk about the impact that our licenses have on the web. Part of this involves collecting use cases from different domains and aggregating some useful metrics. The Case Studies database aims to enable that in addition to providing a way for our community to search and discover interesting uses. But in order for a database like this to be useful, it has to have good solid information.
 
It's important for Creative Commons to be able to talk about the impact that our licenses have on the web. Part of this involves collecting use cases from different domains and aggregating some useful metrics. The Case Studies database aims to enable that in addition to providing a way for our community to search and discover interesting uses. But in order for a database like this to be useful, it has to have good solid information.
  
−
==Evaluation Guide==
+
See the [[#Needs_Evaluation|Needs Evaluation]] section to see how you can help evaluate Case Studies, or the [[#Evaluation_Guide|Evaluation Guide]] section for information on how to help improve the Case Studies.
−
There are only two axes for evaluating a Case Study on this wiki: Quality and Importance.
 
  
−
===Quality===
+
Note this scheme is inspired largely by [http://en.wikimedia.org/wiki/Wikipedia:WikiProject_Council/Assessment_FAQ WikiProject article assessents on English Wikipedia].
  
−
* Quality should be re-assessed following any substantial edits to a Case Study.
+
{{Evaluation Summary}}
  
−
{| cellpadding="5" class="wikitable" style="width:100%;"
+
==Evaluation Guide==
 +
===Quality===
 +
{| cellpadding="7" class="wikitable" style="width:100%;"
 
! style="width:10%;" |Class
 
! style="width:10%;" |Class
−
! style="width:40%;" |Criteria
+
! style="width:35%;" |Description
−
! style="width:30%;" |Suggested Edits
+
! style="width:35%;" |Suggested Edits
 
! style="width:20%;" |Examples
 
! style="width:20%;" |Examples
 
|-
 
|-
Line 23: Line 24:
 
* No edits should be necessary unless new information becomes available.
 
* No edits should be necessary unless new information becomes available.
 
|
 
|
−
* Example
+
{{#if: {{#ask: [[Category:Casestudy]][[Has quality::A-Class]]|searchlabel=}}|{{#ask: [[Category:Casestudy]][[Has quality::A-Class]]|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as A-Class.}}
 
|-
 
|-
 
! B-Class
 
! B-Class
 
|
 
|
−
* Contains good, complete descriptions of the use.
+
* Contains good, complete descriptions of the use, both short and full.
−
* Has an image and short description, but might be missing one or two data fields.
+
* Might be missing one or two fields.
−
* May need small improvements writing style, gammar, spelling, etc.
+
* May need small improvements writing style, grammar, spelling, etc.
 +
* Image might be missing attribution information.
 +
* Latest info may need updating.
 
|
 
|
 
* Fill in missing or incomplete metadata.
 
* Fill in missing or incomplete metadata.
 
* Fix any minor issues with writing style.
 
* Fix any minor issues with writing style.
 +
* Fill in relevant updates.
 
|
 
|
 +
{{#if: {{#ask: [[Category:Casestudy]][[Has quality::B-Class]]|searchlabel=}}|{{#ask: [[Category:Casestudy]][[Has quality::B-Class]]|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as B-Class.}}
 
|-
 
|-
 
! C-Class
 
! C-Class
 
|
 
|
−
* Contains an adequate description (both short and full) of the use.
+
* Contains an adequate full description of the use.
 
* Some missing image, quote, or metadata.
 
* Some missing image, quote, or metadata.
 +
* Might be missing a short description.
 
* May contain unclear language or obviously incorrect grammar.
 
* May contain unclear language or obviously incorrect grammar.
 
|
 
|
−
* Fill in missing or incomplete metadata, description, image, quote, etc.
+
* Fill in missing or incomplete metadata, short description, image, quote, etc.
 
* Improve prose of the Case Study. The Wikipedia [http://en.wikipedia.org/wiki/Wikipedia:Manual_of_Style Manual of Style] is a good guide.
 
* Improve prose of the Case Study. The Wikipedia [http://en.wikipedia.org/wiki/Wikipedia:Manual_of_Style Manual of Style] is a good guide.
 
|
 
|
 +
{{#if: {{#ask: [[Category:Casestudy]][[Has quality::C-Class]]|searchlabel=}}|{{#ask: [[Category:Casestudy]][[Has quality::C-Class]]|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as C-Class.}}
 
|-
 
|-
 
! Start
 
! Start
 
|
 
|
−
* Has the beginnings of a descriptions of the use.
+
* Has the beginnings of descriptions about the use-case.
 
* Substantial information missing, such as a short description, image, or metadata.
 
* Substantial information missing, such as a short description, image, or metadata.
 +
* Could contain some metadata, but is mostly incomplete.
 
|
 
|
 +
* Begin or complete the short or full descriptions of the Case Study.
 +
* Fill in missing or incomplete metadata.
 +
* Find and upload an appropriate image and quote (with proper licensing and attribution information).
 
|
 
|
 +
{{#if: {{#ask: [[Category:Casestudy]][[Has quality::Start]]|searchlabel=}}|{{#ask: [[Category:Casestudy]][[Has quality::Start]]|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as Start.}}
 
|-
 
|-
 
! Stub
 
! Stub
 
|
 
|
 
* Has no description.
 
* Has no description.
−
* Missing large chunks of data.
+
* Doesn't have more than one or two data fields.
 
|
 
|
 +
* Begin or complete the short and full descriptions of the Case Study.
 +
* Fill in missing or incomplete metadata.
 +
* Find and upload an appropriate image and quote (with proper licensing and attribution information).
 
|
 
|
 +
{{#if: {{#ask: [[Category:Casestudy]][[Has quality::Stub]]|searchlabel=}}|{{#ask: [[Category:Casestudy]][[Has quality::Stub]]|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as Stub.}}
 
|-
 
|-
 
|}
 
|}
 +
<small>'''Note: The above data might not be up to date. The Example column is generated randomly from pages tagged in each class.'''</small>
  
−
===Importance===
+
'''Guidelines:'''
 +
* Quality should be re-assessed following any substantial edits to a Case Study.
 +
 
 +
===Importance as a Case Study===
  
 
{| cellpadding="5" class="wikitable" style="width:100%;"
 
{| cellpadding="5" class="wikitable" style="width:100%;"
 
! style="width:10%;" |Importance
 
! style="width:10%;" |Importance
−
! style="width:70%;" |Criteria
+
! style="width:70%;" |Description
 
! style="width:20%;" |Examples
 
! style="width:20%;" |Examples
 
|-
 
|-
 
! High
 
! High
 
|
 
|
−
*
+
* The Case Study represents a highly successful and novel use case which illustrates the power of CC licensing.
 +
* The site or platform using CC licensing is highly trafficked.
 +
* The Case Study was an early adopter of CC licensing.
 +
* The work or site under CC is of a form or produced in an industry that isn't typically associated with permissive licenses, and illustrates the compatability of Creative Commons with traditional media.
 +
* For platforms or sites, the Case Study reports a very large volume of work or a community of users.
 +
* Is a Case Study of a very recognizable brand.
 
|
 
|
−
* Example
+
{{#if: {{#ask: [[Category:Casestudy]][[Has importance::High]]|searchlabel=}}|{{#ask: [[Category:Casestudy]][[Has importance::High]]|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as having High importance.}}
 
|-
 
|-
 
! Medium
 
! Medium
 
|
 
|
−
*
+
* The Case Study is from a region with few CC licensed works and/or is an early adopter for a specific region, culture, or language.
 +
* The Case Study has developed a moderate community of users.
 
|
 
|
−
*
+
{{#if: {{#ask: [[Category:Casestudy]][[Has importance::Medium]]|searchlabel=}}|{{#ask: [[Category:Casestudy]][[Has importance::Medium]]|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as having Medium importance.}} 
 
|-
 
|-
−
!Low
+
! Low
 
|
 
|
−
*
+
* The Case Study is an example of a platform or artist using Creative Commons, but has not yet developed a community of users or significant interest.
 +
* For platforms or sites, the volume of work represented by the Case Study is low.
 +
* There are many CC use-cases or Case Studies similar to this Case Study.
 +
* The Case Study no longer exists or has not been active in a while.
 
|
 
|
−
*
+
{{#if: {{#ask: [[Category:Casestudy]][[Has importance::Low]]|searchlabel=}}|{{#ask: [[Category:Casestudy]][[Has importance::Low]]|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as having Low importance.}}
 
|-
 
|-
 
|}
 
|}
  
 
==Needs Evaluation==
 
==Needs Evaluation==
 +
===Needs Full Evaluation===
 +
{{#ask: [[Category:Casestudy]][[Has review status::Needs full evaluation]]|?Case study title|format=template|template=CS Eval NoUL|link=none|limit=50}}
  
−
{| class="wikitable"
+
===Only Needs Importance Evaluation===
−
! rowspan="2" |
+
{{#ask: [[Category:Casestudy]][[Has review status::Needs importance evaluation]]|?Case study title|format=template|template=CS Eval NoUL|link=none|limit=100}}
−
! colspan="5" align="center" | Importance
+
 
−
|-
+
===Only Needs Quality Evaluation===
−
!style="width:5%;"|
+
{{#ask: [[Category:Casestudy]][[Has review status::Needs quality evaluation]]|?Case study title|format=template|template=CS Eval NoUL|link=none|limit=100}}
−
!style="width:5%;"|High
+
 
−
!style="width:5%;"|Medium
+
{{Translations
−
!style="width:5%;"|Low
+
| articles = Pt:Casos de Estudo/Avaliação
−
!style="width:5%;"|None
+
}}
−
|-
 
−
! rowspan="6" style="width:5%;" |Quality
 
−
!A-Class
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::A-Class]][[Has importance::High]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::A-Class]][[Has importance::Medium]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::A-Class]][[Has importance::Low]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::A-Class]][[Has review status::Needs importance review]]|format=count}}
 
−
|-
 
−
!B-Class
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::B-Class]][[Has importance::High]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::B-Class]][[Has importance::Medium]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::B-Class]][[Has importance::Low]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::B-Class]][[Has review status::Needs importance review]]|format=count}}
 
−
|-
 
−
!C-Class
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::C-Class]][[Has importance::High]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::C-Class]][[Has importance::Medium]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::C-Class]][[Has importance::Low]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::C-Class]][[Has review status::Needs importance review]]|format=count}}
 
−
|-
 
−
!Start
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::Start]][[Has importance::High]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::Start]][[Has importance::Medium]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::Start]][[Has importance::Low]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::Start]][[Has review status::Needs importance review]]|format=count}}
 
−
|-
 
−
!Stub
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::Stub]][[Has importance::High]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::Stub]][[Has importance::Medium]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::Stub]][[Has importance::Low]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has quality::Stub]][[Has review status::Needs importance review]]|format=count}}
 
−
|-
 
−
!None
 
−
|{{#ask: [[Category:Casestudy]][[Has review status::Needs quality evaluation]][[Has importance::High]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has review status::Needs quality evaluation]][[Has importance::Medium]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has review status::Needs quality evaluation]][[Has importance::Low]]|format=count}}
 
−
|{{#ask: [[Category:Casestudy]][[Has review status::Needs full evaluation]]|format=count}}
 
−
|-
 
−
|}
 

Latest revision as of 18:28, 17 June 2011

It's important for Creative Commons to be able to talk about the impact that our licenses have on the web. Part of this involves collecting use cases from different domains and aggregating some useful metrics. The Case Studies database aims to enable that in addition to providing a way for our community to search and discover interesting uses. But in order for a database like this to be useful, it has to have good solid information.

See the Needs Evaluation section to see how you can help evaluate Case Studies, or the Evaluation Guide section for information on how to help improve the Case Studies.

Note this scheme is inspired largely by WikiProject article assessents on English Wikipedia.

Importance
High Medium Low None
Quality A-Class {{#ask:Has quality::A-ClassHas importance::High|format=count}} {{#ask:Has quality::A-ClassHas importance::Medium|format=count}} {{#ask:Has quality::A-ClassHas importance::Low|format=count}} {{#ask:Has quality::A-ClassHas review status::Needs importance review|format=count}}
B-Class {{#ask:Has quality::B-ClassHas importance::High|format=count}} {{#ask:Has quality::B-ClassHas importance::Medium|format=count}} {{#ask:Has quality::B-ClassHas importance::Low|format=count}} {{#ask:Has quality::B-ClassHas review status::Needs importance review|format=count}}
C-Class {{#ask:Has quality::C-ClassHas importance::High|format=count}} {{#ask:Has quality::C-ClassHas importance::Medium|format=count}} {{#ask:Has quality::C-ClassHas importance::Low|format=count}} {{#ask:Has quality::C-ClassHas review status::Needs importance review|format=count}}
Start {{#ask:Has quality::StartHas importance::High|format=count}} {{#ask:Has quality::StartHas importance::Medium|format=count}} {{#ask:Has quality::StartHas importance::Low|format=count}} {{#ask:Has quality::StartHas review status::Needs importance review|format=count}}
Stub {{#ask:Has quality::StubHas importance::High|format=count}} {{#ask:Has quality::StubHas importance::Medium|format=count}} {{#ask:Has quality::StubHas importance::Low|format=count}} {{#ask:Has quality::StubHas review status::Needs importance review|format=count}}
None {{#ask:Has review status::Needs quality evaluationHas importance::High|format=count}} {{#ask:Has review status::Needs quality evaluationHas importance::Medium|format=count}} {{#ask:Has review status::Needs quality evaluationHas importance::Low|format=count}} {{#ask:Has review status::Needs full evaluation|format=count}}

Evaluation Guide

Quality

Class Description Suggested Edits Examples
A-Class
  • Contains a concise and complete description of the use in well-written prose.
  • Explains the novelty or importance of the use-case.
  • Has complete information, including: an accompanying image with attribution information, quote, short description, and licensing metadata.
  • Would be worthy of being featured elsewhere on the web.
  • No edits should be necessary unless new information becomes available.

{{#if: {{#ask:Has quality::A-Class|searchlabel=}}|{{#ask:Has quality::A-Class|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as A-Class.}}
B-Class
  • Contains good, complete descriptions of the use, both short and full.
  • Might be missing one or two fields.
  • May need small improvements writing style, grammar, spelling, etc.
  • Image might be missing attribution information.
  • Latest info may need updating.
  • Fill in missing or incomplete metadata.
  • Fix any minor issues with writing style.
  • Fill in relevant updates.

{{#if: {{#ask:Has quality::B-Class|searchlabel=}}|{{#ask:Has quality::B-Class|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as B-Class.}}
C-Class
  • Contains an adequate full description of the use.
  • Some missing image, quote, or metadata.
  • Might be missing a short description.
  • May contain unclear language or obviously incorrect grammar.
  • Fill in missing or incomplete metadata, short description, image, quote, etc.
  • Improve prose of the Case Study. The Wikipedia Manual of Style is a good guide.

{{#if: {{#ask:Has quality::C-Class|searchlabel=}}|{{#ask:Has quality::C-Class|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as C-Class.}}
Start
  • Has the beginnings of descriptions about the use-case.
  • Substantial information missing, such as a short description, image, or metadata.
  • Could contain some metadata, but is mostly incomplete.
  • Begin or complete the short or full descriptions of the Case Study.
  • Fill in missing or incomplete metadata.
  • Find and upload an appropriate image and quote (with proper licensing and attribution information).

{{#if: {{#ask:Has quality::Start|searchlabel=}}|{{#ask:Has quality::Start|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as Start.}}
Stub
  • Has no description.
  • Doesn't have more than one or two data fields.
  • Begin or complete the short and full descriptions of the Case Study.
  • Fill in missing or incomplete metadata.
  • Find and upload an appropriate image and quote (with proper licensing and attribution information).

{{#if: {{#ask:Has quality::Stub|searchlabel=}}|{{#ask:Has quality::Stub|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as Stub.}}

Note: The above data might not be up to date. The Example column is generated randomly from pages tagged in each class.

Guidelines:

  • Quality should be re-assessed following any substantial edits to a Case Study.

Importance as a Case Study

Importance Description Examples
High
  • The Case Study represents a highly successful and novel use case which illustrates the power of CC licensing.
  • The site or platform using CC licensing is highly trafficked.
  • The Case Study was an early adopter of CC licensing.
  • The work or site under CC is of a form or produced in an industry that isn't typically associated with permissive licenses, and illustrates the compatability of Creative Commons with traditional media.
  • For platforms or sites, the Case Study reports a very large volume of work or a community of users.
  • Is a Case Study of a very recognizable brand.

{{#if: {{#ask:Has importance::High|searchlabel=}}|{{#ask:Has importance::High|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as having High importance.}}
Medium
  • The Case Study is from a region with few CC licensed works and/or is an early adopter for a specific region, culture, or language.
  • The Case Study has developed a moderate community of users.

{{#if: {{#ask:Has importance::Medium|searchlabel=}}|{{#ask:Has importance::Medium|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as having Medium importance.}}
Low
  • The Case Study is an example of a platform or artist using Creative Commons, but has not yet developed a community of users or significant interest.
  • For platforms or sites, the volume of work represented by the Case Study is low.
  • There are many CC use-cases or Case Studies similar to this Case Study.
  • The Case Study no longer exists or has not been active in a while.

{{#if: {{#ask:Has importance::Low|searchlabel=}}|{{#ask:Has importance::Low|?Case study title=|format=template|template=CS_Eval|limit=2|link=none|order=random|searchlabel=}}|* No Case Studies have been marked as having Low importance.}}

Needs Evaluation

Needs Full Evaluation

{{#ask:Has review status::Needs full evaluation|?Case study title|format=template|template=CS Eval NoUL|link=none|limit=50}}

Only Needs Importance Evaluation

{{#ask:Has review status::Needs importance evaluation|?Case study title|format=template|template=CS Eval NoUL|link=none|limit=100}}

Only Needs Quality Evaluation

{{#ask:Has review status::Needs quality evaluation|?Case study title|format=template|template=CS Eval NoUL|link=none|limit=100}}


Retrieved from "https://wiki.creativecommons.org/index.php?title=Case_Studies/Evaluation&oldid=50868"