DiscoverEd/Install manually - Revision history

Paulproteus: /* Switching to MySQL */

2010-09-07T14:38:47Z

‎Switching to MySQL

Nathan Yergler at 02:10, 24 August 2010

2010-08-24T02:10:08Z

Nathan Yergler: /* Run the web application */

2010-08-24T02:01:12Z

‎Run the web application

Paulproteus at 19:27, 20 August 2010

2010-08-20T19:27:35Z

Nathan Yergler: /* Run the web server */

2010-06-11T06:43:21Z

‎Run the web server

Dithyramble: +cat +stub

2010-05-07T18:46:41Z

+cat +stub

Dithyramble: This text was moved from DiscoverEd Quickstart

2010-05-07T18:45:51Z

This text was moved from DiscoverEd Quickstart

New page

=== Check out and build the source code ===
<pre>
$ git clone git://gitorious.org/discovered/repo.git discovered
$ cd discovered
$ ant
</pre>

=== Add a curator and a feed ===

DiscoverEd uses feeds to help identify resources to crawl. Feeds are provided by curators, who can also provide metadata about resources.

<pre>
$ ./bin/feeds addcurator "ND OCW" http://ocw.nd.edu/
$ ./bin/feeds addfeed rss http://ocw.nd.edu/front-page/courselist/rss http://ocw.nd.edu/
</pre>

=== Aggregate and crawl resources ===

<pre>
$ ./bin/feeds aggregate
$ mkdir seed
$ ./bin/feeds seed > seed/urls.txt
$ ant -f dedbuild.xml crawl
</pre>

=== Run the web server ===

← Older revision		Revision as of 14:38, 7 September 2010
Line 69:		Line 69:

	</pre>		</pre>
		+
		+	== Known issues ==
		+
		+	=== Derby and OAI:PMH aren't compatible ===
		+
		+	If you use the default backend, OAI:PMH crawls won't work. Instead, you'll get SQL syntax errors from the code. We haven't fully diagnosed the problem; instead, if you get a problem like that, we suggest you switch to MySQL as per the "Switching to MySQL" section.

@@ Line 1: / Line 1: @@
 [[Category:DiscoverEd]]
 {{Stub}}
 === Check out and build the source code ===
 <pre>
 $ git clone git://gitorious.org/discovered/repo.git discovered

@@ Line 31: / Line 31: @@
 Edit conf/nutch-site.xml to point to your crawl location.
-<code>
+<pre>
 $ ant war
 $ [copy the war file to your J2EE container]
-</code>
+</pre>
 === Switching to MySQL ===

← Older revision		Revision as of 19:27, 20 August 2010
Line 35:		Line 35:
	$ [copy the war file to your J2EE container]		$ [copy the war file to your J2EE container]
	</code>		</code>
		+
		+	=== Switching to MySQL ===
		+
		+	By default, DiscoverEd (at least on the ''next'' branch) uses an on-disk database called Derby for storing resource metadata. You should use a different database, like MySQL, in production.
		+
		+	To do that, edit '''conf/discovered.xml''' and update the following sections as appropriate:
		+
		+	<pre>
		+	<property>
		+	<name>rdfstore.db.driver</name>
		+	<value>com.mysql.jdbc.Driver</value>
		+	</property>
		+
		+	<property>
		+	<name>rdfstore.db.url</name>
		+	<value>jdbc:mysql://localhost/discovered?autoReconnect=true</value>
		+	</property>
		+
		+	<property>
		+	<name>rdfstore.db.user</name>
		+	<value>discovered</value>
		+	</property>
		+
		+	<property>
		+	<name>rdfstore.db.password</name>
		+	<value></value>
		+	</property>
		+
		+	</pre>

← Older revision		Revision as of 06:43, 11 June 2010
Line 27:		Line 27:
	</pre>		</pre>

−	=== Run the web ~~server~~ ===	+	=== Run the web application ===
		+
		+	Edit conf/nutch-site.xml to point to your crawl location.
		+
		+	<code>
		+	$ ant war
		+	$ [copy the war file to your J2EE container]
		+	</code>

← Older revision		Revision as of 18:46, 7 May 2010
Line 1:		Line 1:
		+	[[Category:DiscoverEd]]
		+	{{Stub}}
		+
	=== Check out and build the source code ===		=== Check out and build the source code ===
	<pre>		<pre>