This project includes a number of classes for packaging and sending BagIt bags to
remote locations like APTrust. It also includes functionality for interacting with
the repository system Archivematica and one full integration process,
run_dark_blue.rb.
The following sections cover how to configure, install, use, and test the project.
Depending on the environment and configuration used with this project, you may need to install one or more of the following:
- Ruby 3.2
- An SFTP client like OpenSSH (usually included with operating systems)
- Docker Desktop
The project may work with earlier Ruby versions, but it has not been tested.
Interactions with others services such as Archivematica or an SFTP server may be IP address restricted, so ensure you have access to the proper network or VPN.
In all cases, you will need to set up a configuration file, which you can do by following these steps:
- Create a configuration YAML file based on the provided template.
cp config/config.example.yml config/config.yml
- Open
config/config.ymlusing your preferred text editor, and add values, using the comments to guide you.
For local development, you may need to set up an SSH key and add it to your ssh-agent
so the program can access remote file systems via an SFTP server without entering a password
or passphrase.
For local development, you can set up the neccessary dependencies and execute processes from this project either with Ruby directly on your machine or by using the provided Docker artifacts. The following sections cover each approach.
Note that the project can use a MariaDB database to store records about its runs.
The recommended approach is to use the database service
(defined in docker-compose.yml with the Docker approach described below.
However, it is possible -- though not explicitly supported -- to use a MariaDB or MySQL
database from a server running on your local machine or elsewhere.
The following sections will assume you are not using a database with Ruby alone.
gem install bundler # if you don't have it
bundle installThe primary job or process is run_dark_blue.rb.
ruby run_dark_blue.rbThe latest deposits to APTrust can be verified using verify_aptrust.rb.
ruby verify_aptrust.rbIf you're working on a new job or just want to try out the classes,
you can copy run_example.rb and modify it as necessary.
cp run_example.rb run_test.rb
# Tweak as necessary
ruby run_test.rbBuild the image for the dark-blue service.
docker compose build dark-blueStart up the database service by itself.
docker compose up databaseRun the migrations, if you configured the application to use a database:
docker compose run dark-blue rake db:migrateRun the dark-blue service to start run_dark_blue.rb.
docker compose up dark-blueTo use verify_aptrust.rb, override the entry command for the dark-blue service with run.
docker compose run dark-blue ruby verify_aptrust.rbYou can re-deliver previously delivered packages by passing a --packages option to run_dark_blue.rb
with a comma-separated list of package identifiers.
docker compose run dark-blue ruby run_dark_blue.rb --packages=some_id,some_other_idTo execute a typical workflow (the first three steps above), you can simply run the following command:
docker compose upminitest unit tests for classes are
located in the test directory.
To run all tests in one or more test files, use ruby -Ilib {file path} ..., e.g.
ruby -Ilib test/test_bag_adapter.rb test/test_bag_tag.rbNote that some test files will throw an error if a database configuration has not been set up.
With Docker, you can run the above command by adding it after docker compose run dark-blue.
You can also use a provided rake task to run all unit tests
(which, again, requires configuration of a database).
docker compose run dark-blue rake test