wmde / oerworldmap

OER World Map

Open Educational Resources (OER) World Map

For inital background information about this project please refer to the Request for Proposals.

Setup project

Get Source

$ git clone [e-mail]:hbz/oerworldmap.git

Create configuration

$ cp conf/application.example.conf conf/application.conf

Setup Elasticsearch

Download and install elasticsearch

$ cd third-party
$ wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.2.1.zip
$ unzip elasticsearch-6.2.1.zip
$ cd elasticsearch-6.2.1
$ bin/elasticsearch-plugin install analysis-icu
$ bin/elasticsearch

Check with curl -X GET http://localhost:9200/ if all is well.

Optionally, you may want to use the head plugin. This basically comes down to

$ cd .. # back to oerworldmap/third-party or choose any directory outside this project
$ git clone git://github.com/mobz/elasticsearch-head.git
$ cd elasticsearch-head
$ npm install
$ npm run start
$ open http://localhost:9100/

Configure elasticsearch

If you are in an environment where your instance of elasticsearch won't be the only one on the network, you might want to configure your cluster name to be different from the default elasticsearch. To do so, shut down elasticsearch and edit cluster.name in third-party/elasticsearch-2.4.1/config/elasticsearch.yml and es.cluster.name in conf/application.conf before restarting.

Create and configure oerworldmap index (as specified in es.index.app.name in conf/application.conf)

# from oerworldmap/ run
$ curl -H "Content-type: application/json" -X PUT http://localhost:9200/oerworldmap/ -d @conf/index-config.json

If you're caught with some kind of buggy index during development, simply delete the index and re-create:

$ curl -X DELETE http://localhost:9200/oerworldmap/
$ curl -X PUT http://localhost:9200/oerworldmap/ -d @conf/index-config.json

Create database histories

$ mkdir -p data/consents/objects
$ touch data/consents/history
$ mkdir -p data/commits/objects/
$ touch data/commits/history

Setup Play! Application

Download sbt (version 0.13.11), then

$ sbt clean stage; sbt run

Sbt on Ubuntu

If you are running bintray packages, make sure to install correct version:

$ sudo apt-get install sbt=0.13.11

Install UI

UI Components are available at https://github.com/hbz/oerworldmap-ui

Running services

• copy scripts/services/services.example.conf to scripts/services/services.conf and update vars
• copy scripts/services/*.service to /etc/systemd/system and update EnvironmentFile, User and Group in each service
• run sudo systemctl daemon-reload

Work with IDEs

Using activator, integration to Eclipse and IDEA IntelliJ is provided by running eclipse or idea from within activator. To run the OER World Map JUnit tests inside IntelliJ, it is necessary to set the test's working directory to the root directory of this project (i. e. oerworldmap):

Run | Edit configurations... | JUnit | <MyTest> | Configuration | Working directory:
<absolute/path/to/oerworldmap>

Troubleshooting

[ERROR] Failed to construct terminal; falling back to unsupported java.lang.NumberFormatException: For input string: "0x100"

Workaround for this is to export correct xterm (put it in your .bashrc or similar):

export TERM=xterm-color

[info] Loading project definition from /home/vagrant/oerworldmap/project
java.lang.NullPointerException

Make sure your sbt is correct version (0.13.11).

org.elasticsearch.ElasticsearchException: Unable to find a field mapper for field [link_count]. No 'missing' value defined.
	at org.elasticsearch.index.query.functionscore.FieldValueFactorFunctionBuilder.doToFunction(FieldValueFactorFunctionBuilder.java:151) ~[elasticsearch-6.2.1.jar:6.2.1]

Make sure that when you create and configure oerworldmap index, you do it from oerworldmap/ folder.

Loading data

# Reset elasticsearch index
curl -X DELETE http://localhost:9200/oerworldmap/
curl -H "Content-type: application/json" -X PUT http://localhost:9200/oerworldmap/ -d @conf/index-config.json

# Delete triple store
rm data/tdb/*

# Delete history
rm -r data/commits/

# Extract history from archive
tar -xzf commits.tar.gz -C data/

Afterwards, restart sbt and wait until it fully rebuilds triplestore and Elastic Search index. Once it's done, you can check if it's working correctly by running:

curl localhost:9000/resource.json

Updating vocabulary

When updating vocabulary definitions, you need to update triple store by running:

(example for publications.json)

curl -H "Content-type: application/json" http://localhost:9000/import/ -d @src/json/publications.json

Contribute

Coding conventions

Indent blocks by two spaces and wrap lines at 100 characters. For more details, refer to the Google Java Style Guide.

Bug reports

Please file bugs as an issue labeled "Bug" here. Include browser information and screenshot(s) when applicable.

Attributions

This product includes GeoLite2 data created by MaxMind, available from http://www.maxmind.com.