MarkusSagen/cruft

Trending Contributors

Read Latest Documentation - Browse GitHub Code Repository

cruft allows you to maintain all the necessary boilerplate for packaging and building projects separate from the code you intentionally write. Fully compatible with existing Cookiecutter templates.

Creating new projects from templates using cruft is easy:

And, so is updating them as the template changes overtime:

Many project template utilities exist that automate the copying and pasting of code to create new projects. This seems great! However, once created, most leave you with that copy-and-pasted code to manage through the life of your project.

cruft is different. It automates the creation of new projects like the others, but then it also helps you to manage the boilerplate through the life of the project. cruft makes sure your code stays in-sync with the template it came from for you.

Key Features

Cookiecutter Compatible: cruft utilizes Cookiecutter as its template expansion engine. Meaning it retains full compatibility with all existing Cookiecutter templates.
Template Validation: cruft can quickly validate whether or not a project is using the latest version of a template using cruft check. This check can easily be added to CI pipelines to ensure your projects stay in-sync.
Automatic Template Updates: cruft automates the process of updating code to match the latest version of a template, making it easy to utilize template improvements across many projects.

Installation

To get started - install cruft using a Python package manager:

pip3 install cruft

poetry add cruft

pipenv install cruft

Creating a New Project

To create a new project using cruft run cruft create PROJECT_URL from the command line.

For example:

    cruft create https://github.com/timothycrosley/cookiecutter-python/

cruft will then ask you any necessary questions to create your new project. It will use your answers to expand the provided template, and then return the directory it placed the expanded project. Behind the scenes, cruft uses Cookiecutter to do the project expansion. The only difference in the resulting output is a .cruft.json file that contains the git hash of the template used as well as the template variables specified.

Updating a Project

To update an existing project, that was created using cruft, run cruft update in the root of the project. If there are any updates, cruft will have you review them before applying. If you accept the changes cruft will apply them to your project and update the .cruft.json file for you.

!!! tip Sometimes certain files just aren't good fits for updating. Such as test cases or __init__ files. You can tell cruft to always skip updating these files on a project by generating project with --skip cruft/__init__.py --skip tests arguments or manually adding them to a skip section within your .cruft.json file:

    {
        "template": "https://github.com/timothycrosley/cookiecutter-python",
        "commit": "8a65a360d51250221193ed0ec5ed292e72b32b0b",
        "skip": [
            "cruft/__init__.py",
            "tests"
        ],
        ...
    }

Or, if you have toml installed, you can add skip files directly to a `tool.cruft` section of your `pyproject.toml` file:

    [tool.cruft]
    skip = ["cruft/__init__.py", "tests"]

Note that it is possible to use glob patterns for selecting the files to skip:
    {
        "skip": [
            "**/__init__.py",
            "tests/*"
        ],
        ...
    }

Updating Values of Template Variables

cruft can also be used to update a project to use new values of template variables; avoiding the need to regenerate the project from sratch using cookiecutter.

For example, imagine a project that was initially generated some while ago, and then later on, you want to change the values of some of the template variables, e.g. to change use_some_feature to "yes" or to change project_name to "new-project-name".

There are 2 ways this can be done, as described below.

Update Variables via the Command Line

You can perform the update directly via the command line if you have only a handful of simple variables.

This will change use_some_feature to "yes" while leaving all other variables unchanged:

cruft update --variables-to-update '{ "use_some_feature" : "yes" }'

This will change both use_some_feature to "yes" and project_name to "new-project-name" (and still leaving all other variables unchanged):

cruft update --variables-to-update '{ "use_some_feature" : "yes", "project_name" : "new-project-name" }'

The provided argument must be a valid JSON string (i.e. using double quotes, no trailing comma etc.).

Update Variables via a Cruft File

If you prefer to use and editor or you have many or complex variables, you can also perform the changes via providing an updated .cruft.json.

# copy the existing cruft file to a temporary location (outside of your repo)
cp .cruft.json ~/tmp/new-cruft.json

# edit the file using your faviourite editor
edit ~/tmp/new-cruft.json

# perform the update
# (this will also update your original .cruft.json automatically)
cruft update --variables-to-update-file ~/tmp/new-cruft.json

Checking a Project

Checking to see if a project is missing a template update is as easy as running cruft check. If the project is out-of-date an error and exit code 1 will be returned. cruft check can be added to CI pipelines to ensure projects don't unintentionally drift.

Linking an Existing Project

Have an existing project that you created from a template in the past using Cookiecutter directly? You can link it to the template that was used to create it using: cruft link TEMPLATE_REPOSITORY.

For example:

    cruft link https://github.com/timothycrosley/cookiecutter-python/

You can then specify the last commit of the template the project has been updated to be consistent with, or accept the default of using the latest commit from the template.

Compute the diff

With time, your boilerplate may end up being very different from the actual cookiecutter template. Cruft allows you to quickly see what changed in your local project compared to the template. It is as easy as running cruft diff. If any local file differs from the template, the diff will appear in your terminal in a similar fashion to git diff.

The cruft diff command optionally accepts an --exit-code flag that will make cruft exit with a non-0 code should any diff is found. You can combine this flag with the skip section of your .cruft.json to make stricter CI checks that ensures any improvement to the template is always submitted upstream.

Automating updates with GitHub Actions

If you have many repositories to manage, you can automate the change detection process with GitHub Actions. This example runs every Monday at 2am UTC and creates a new pull request if there are changes detected which a maintainer can accept or reject. It creates two PRs - one to pull in the new files to the repository and one to update the .cruft.json file only, which has the effect of rejecting the change from the upstream repository.

Since Jan 2022, registries/organisations must explicitly grant the authority to create a pull request. This can be enabled on a per-organisation level, or a per-registry level for personal projects. See GitHub for more details.

# /.github/workflows/cruft-update.yml
name: Update repository with Cruft
permissions:
  contents: write
  pull-requests: write
on:
  schedule:
    - cron: "0 2 * * 1" # Every Monday at 2am
jobs:
  update:
    runs-on: ubuntu-latest
    strategy:
      fail-fast: true
      matrix:
        include:
          - add-paths: .
            body: Use this to merge the changes to this repository.
            branch: cruft/update
            commit-message: "chore: accept new Cruft update"
            title: New updates detected with Cruft
          - add-paths: .cruft.json
            body: Use this to reject the changes in this repository.
            branch: cruft/reject
            commit-message: "chore: reject new Cruft update"
            title: Reject new updates detected with Cruft
    steps:
      - uses: actions/checkout@v3

      - uses: actions/setup-python@v4
        with:
          python-version: "3.10"

      - name: Install Cruft
        run: pip3 install cruft

      - name: Check if update is available
        continue-on-error: false
        id: check
        run: |
          CHANGES=0
          if [ -f .cruft.json ]; then
            if ! cruft check; then
              CHANGES=1
            fi
          else
            echo "No .cruft.json file"
          fi

          echo "has_changes=$CHANGES" >> "$GITHUB_OUTPUT"

      - name: Run update if available
        if: steps.check.outputs.has_changes == '1'
        run: |
          git config --global user.email "you@example.com"
          git config --global user.name "GitHub"

          cruft update --skip-apply-ask --refresh-private-variables
          git restore --staged .

      - name: Create pull request
        if: steps.check.outputs.has_changes == '1'
        uses: peter-evans/create-pull-request@v4
        with:
          token: ${{ secrets.GITHUB_TOKEN }}
          add-paths: ${{ matrix.add-paths }}
          commit-message: ${{ matrix.commit-message }}
          branch: ${{ matrix.branch }}
          delete-branch: true
          branch-suffix: timestamp
          title: ${{ matrix.title }}
          body: |
            This is an autogenerated PR. ${{ matrix.body }}

            [Cruft](https://cruft.github.io/cruft/) has detected updates from the Cookiecutter repository.

Why Create cruft?

Since I first saw videos of quickly being used to automate Ubuntu application creation, I've had a love/hate relationship with these kinds of tools. I've used them for many projects and certainly seen them lead to productivity improvements. However, I've always felt like they were a double-edged sword. Sure, they would automate away the copying and pasting many would do to create projects. However, by doing so, they encouraged more code to be copied and pasted! Then, over time, you could easily be left with hundreds of projects that contained copy-and-pasted code with no way to easy way to update them. I created cruft to be a tool that recognized that balance between project creation and maintenance and provided mechanisms to keep built projects up-to-date.

I hope you too find cruft useful!

~Timothy Crosley

MarkusSagen / cruft