Manage who can use a block pattern. Select a require capability for each block pattern. Disable individual block patterns completely.
Manage who can use a "remote" block pattern from the block pattern directory or disable the block pattern directory completely.