National Library of Australia

pandas4

Web archive workflow system

ai-scout-audio2

AI audio proof of concept #2 - read TEI transcripts, build SOLR index with nomic embeddings, exploratory search and delivery web interface

folio-pickslip-viewer

Callslip / pickslip request viewer

nla-blacklight

Discovery application for the National Library of Australia's catalogue

nla-arclight

Custom implementation of ArcLight for The National Library of Australia.

heimdall

A Selenium based web crawler (and archiver) that attempts to capture all resources of JS heavy pages by recursively clicking applicable DOM elements and responding to DOM modifications.

dnn-cli

A command-line interface for training DNN classifiers using deeplearning4j.

nla-blacklight_common

Common functionality for Blacklight and ArcLight applications

ai-scout-pictures

AI pictures proof of concept - crawl blacklight, build SOLR index with CLIP embeddings, exploratory web interface

odin

Web archiving domain harvest statistics web application prototype.

bamboo

Web archive collection manager

ai-scout-entireCanberraTimes

AI newspaper search proof of concept - all 3.1m CT articles 1926-94, build SOLR index with nomic embeddings, exploratory web interface with LLM summaries

bento_search

An abstraction/normalization layer for querying and displaying results for external search engines, in Ruby on Rails.

outbackcdx

Web archive index server based on RocksDB

heritrix3

Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

loki

A lightweight framework for running GWT based applications with DOM-style UI control.

thor

A simple library for server-side utilities. Provides a mechanism to store and retrieve Java objects on the file system without the use of a database, and a mechanism to run tasks through a thread-safety assurance service.

blacklight_range_limit

Range facet/limit/profile plugin for Blacklight

nla_staff_spreadsheet_importer

ArchivesSpace plugin for spreadsheet import

webarchive-odin

Prototype for displaying statistics from web archiving harvests.

marcgrep

A slow-moving search across MARC data

nla-pywb

pywb config overlay for the Australian Web Archive

httrack2warc

Converts HTTrack crawls to WARC files

flint

A modular and extendible file/format validation framework

pywb

Core Python Web Archiving Toolkit for replay and recording of web archives

jvmctl

Java app deployment tool

wombat

Wombat.js client-side rewriting library

dl-models

kafka-test-harness

readium-js

EPUB processing engine written in Javascript