This example repo shows how to use Fastify in place of Express in The Epic Stack.
Remix itself is loaded as a fastify plugin using remix-fastify. To add more plugins from the fastify ecosystem, you can drop them in the server/plugins directory and fastify-autoload will pick them up.
See The Epic Stack Getting Started README for how to setup and run the project.