MoJ Analytical Services

splink

Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

shinyGovstyle

Apply GOV.UK styled components and formats in shiny

etl_manager

A python package to create a database on the platform using our moj data warehousing framework

dataengineeringutils3

Fully unit tested utility functions for data engineering. Python 3 only.

user-guidance

User guidance for the MoJ Analytical Platform

pydbtools

Python version of dbtools

data-engineering-and-modelling-applicant-info

Information for potential applicants to MoJ Data Engineering, including links to our work and information about our teams.

mojap-arrow-pd-parser

Conforms pandas to "correct" datatypes to ensure data in/out using CSV, JSONL and Parquet is read the same (using arrow).

mojap-metadata

Schema definitions and management of our metadata used by the Data Engineering Team at MoJ

iam_builder

Little helper to write IAM policies

Rdbtools

Accessing Athena on the Analytical Platform

data-engineering-exports

Infrastructure to allow data from the Analytical Platform to be accessed by other services

intro_to_github_training

Rs3tools

airflow-de-intro-project

OPG

ap-tools-training

github-outside-collaborators

Manage outside collaborators on our Github repositories

gluejobutils

Python 2.7 utility functions to include with AWS glue jobs

knife_possession_sankey

A sankey diagram for knife possession statistics

tech-radar-demo

Visualizing our technology choices

airflow-de-intro-project-dami

airflow-matrix-scraper

scraper for matrixbooking api

data-and-analytics-engineering-tech-radar

Visualizing our technology choices

dmet-cfe

splink3_legacy_docs

splink_colab_links

Generate collab notebooks for the Splink demos and examples

stats-forward-look

tech-radar

Visualizing our technology choices

test_RSF