markshust/docker-magento
Table of contents
- Docker Hub
- Free Course
- Usage
- Prerequisites
- Setup
- Updates
- Custom CLI Commands
- Misc Info
- Credits
- License
Docker Hub
View Dockerfiles:
- markoshust/magento-nginx (Docker Hub)
- markoshust/magento-php (Docker Hub)
- 8.0 (available for alpha testing)
- 7.4
- 7.3
- markoshust/magento-elasticsearch (Docker Hub)
Free Course
This course is sponsored by M.academy, the simplest way to learn Magento.
A free screencast course is available, which details the basic usage of this project: Set Up a Magento 2 Development Environment with Docker
Course Curriculm
Project Setup
- Setup Docker for Mac & configure preferences
- Setup global Composer auth credentials
- Automated setup for new installs
Helper Scripts
Docker Filesystem & Volumes
Customize Server Configuration
- Customize the Nginx configuration
- Quickly switch PHP versions
- Install extensions & packages
- Run additional services as containers
- Configure multi-store instances
PHPStorm & Xdebug
- Setup PHPStorm for a Magento Docker project
- Generate XML URNs for a Magento Docker project
- Install Xdebug browser plugin
- Enable, disable, & check Xdebug
- Configure PHPStorm for Xdebug
- Trigger Xdebug breakpoints with PHPStorm
Manual Setup (Optional)
Usage
This configuration is intended to be used as a Docker-based development environment for Magento 2.
Folders:
images
: Docker images for nginx and phpcompose
: sample setups with Docker Compose
The Magento 1 version of this development environment has been deprecated and is no longer supported. PHP 5 was used as it's base, and that version has reached end-of-life. If you still wish to use this setup, please reference compose/magento-1 on tag 20.1.1, but please be aware these images are no longer maintained.
Prerequisites
This setup assumes you are running Docker on a computer with at least 6GB of RAM allocated to Docker, a dual-core, and an SSD hard drive. Download & Install Docker Desktop.
This configuration has been tested on Mac & Linux. Windows is supported through the use of Docker on WSL.
Setup
Automated Setup (New Project)
Run this automated one-liner from the directory you want to install your project.
curl -s https://raw.githubusercontent.com/markshust/docker-magento/master/lib/onelinesetup | bash -s -- magento.test 2.4.3-p1
The magento.test
above defines the hostname to use, and the 2.4.3-p1
defines the Magento version to install. Note that since we need a write to /etc/hosts
for DNS resolution, you will be prompted for your system password during setup.
After the one-liner above completes running, you should be able to access your site at https://magento.test
.
Install sample data
After the above installation is complete, run the following lines to install sample data:
bin/magento sampledata:deploy
bin/magento setup:upgrade
Manual Setup
Same result as the one-liner above. Just replace magento.test
references with the hostname that you wish to use.
New Projects
# Download the Docker Compose template:
curl -s https://raw.githubusercontent.com/markshust/docker-magento/master/lib/template | bash
# Download the version of Magento you want to use with:
bin/download 2.4.3-p1
# or for Magento core development:
# docker-compose -f docker-compose.yml up -d
# bin/setup-composer-auth
# bin/cli git clone git@github.com:magento/magento2.git .
# bin/cli git checkout 2.4-develop
# bin/composer install
# Run the setup installer for Magento:
bin/setup magento.test
open https://magento.test
Existing Projects
# Download the Docker Compose template:
curl -s https://raw.githubusercontent.com/markshust/docker-magento/master/lib/template | bash
# Replace with existing source code of your existing Magento instance:
cp -R ~/Sites/existing src
# or: git clone git@github.com:myrepo.git src
# Start some containers, copy files to them and then restart the containers:
docker-compose -f docker-compose.yml up -d
bin/copytocontainer --all ## Initial copy will take a few minutes...
# Import existing database:
bin/mysql < backups/magento.sql
# Update database connection details to use the above Docker MySQL credentials:
# Also note: creds for the MySQL server are defined at startup from env/db.env
# vi src/app/etc/env.php
# Import app-specific environment settings:
bin/magento app:config:import
# Create a DNS host entry and setup Magento base url
bin/setup-domain yoursite.test
bin/restart
open https://magento.test
For more details on how everything works, see the extended setup readme.
Updates
To update your project to the latest version of docker-magento
, run:
bin/update
We recommend keeping your docker config files in version control, so you can monitor the changes to files after updates. After reviewing the code updates and ensuring they updated as intended, run bin/restart
to restart your containers to have the new configuration take effect.
It is recommended to keep your root docker config files in one repository, and your Magento code setup in another. This ensures the Magento base path lives at the top of one specific repository, which makes automated build pipelines and deployments easy to manage, and maintains compatibility with projects such as Magento Cloud.
Custom CLI Commands
bin/bash
: Drop into the bash prompt of your Docker container. Thephpfpm
container should be mainly used to access the filesystem within Docker.bin/cache-clean
: Access the cache-clean CLI. Note the watcher is automatically started at startup inbin/start
. Ex.bin/cache-clean config full_page
bin/cli
: Run any CLI command without going into the bash prompt. Ex.bin/cli ls
bin/clinotty
: Run any CLI command with no TTY. Ex.bin/clinotty chmod u+x bin/magento
bin/cliq
: The same asbin/cli
, but pipes all output to/dev/null
. Useful for a quiet CLI, or implementing long-running processes.bin/composer
: Run the composer binary. Ex.bin/composer install
bin/copyfromcontainer
: Copy folders or files from container to host. Ex.bin/copyfromcontainer vendor
bin/copytocontainer
: Copy folders or files from host to container. Ex.bin/copytocontainer --all
bin/cron
: Start or stop the cron service. Ex.bin/cron start
bin/dev-urn-catalog-generate
: Generate URN's for PHPStorm and remap paths to local host. Restart PHPStorm after running this command.bin/devconsole
: Alias forbin/n98-magerun2 dev:console
bin/download
: Download specific Magento version from Composer to/var/www/html
directory within the container. Ex.bin/download 2.4.3-p1 community
bin/fixowns
: This will fix filesystem ownerships within the container.bin/fixperms
: This will fix filesystem permissions within the container.bin/grunt
: Run the grunt binary. Ex.bin/grunt exec
bin/magento
: Run the Magento CLI. Ex:bin/magento cache:flush
bin/mftf
: Run the Magento MFTF. Ex:bin/mftf build:project
bin/mysql
: Run the MySQL CLI with database config fromenv/db.env
. Ex.bin/mysql -e "EXPLAIN core_config_data"
orbin/mysql < backups/magento.sql
bin/mysqldump
: Backup the Magento database. Ex.bin/mysqldump > backups/magento.sql
bin/n98-magerun2
: Access the n98-magerun2 CLI. Ex:bin/n98-magerun2 dev:console
bin/node
: Run the node binary. Ex.bin/node --version
bin/npm
: Run the npm binary. Ex.bin/npm install
bin/pwa-studio
: (BETA) Start the PWA Studio server. Note that Chrome will throw SSL cert errors and not allow you to view the site, but Firefox will.bin/redis
: Run a command from the redis container. Ex.bin/redis redis-cli monitor
bin/remove
: Remove all containers.bin/removeall
: Remove all containers, networks, volumes, and images.bin/removevolumes
: Remove all volumes.bin/restart
: Stop and then start all containers.bin/root
: Run any CLI command as root without going into the bash prompt. Exbin/root apt-get install nano
bin/rootnotty
: Run any CLI command as root with no TTY. Exbin/rootnotty chown -R app:app /var/www/html
bin/setup
: Run the Magento setup process to install Magento from the source code, with optional domain name. Defaults tomagento.test
. Ex.bin/setup magento.test
bin/setup-composer-auth
: Setup authentication credentials for Composer.bin/setup-domain
: Setup Magento domain name. Ex:bin/setup-domain magento.test
bin/setup-grunt
: Install and configure Grunt JavaScript task runner to compile .less filesbin/setup-pwa-studio
: (BETA) Install PWA Studio (requires NodeJS and Yarn to be installed on the host machine). Pass in your base site domain, otherwise the defaultmaster-7rqtwti-mfwmkrjfqvbjk.us-4.magentosite.cloud
will be used. Ex:bin/setup-pwa-studio magento.test
bin/setup-ssl
: Generate an SSL certificate for one or more domains. Ex.bin/setup-ssl magento.test foo.test
bin/setup-ssl-ca
: Generate a certificate authority and copy it to the host.bin/start
: Start all containers, good practice to use this instead ofdocker-compose up -d
, as it may contain additional helpers.bin/status
: Check the container status.bin/stop
: Stop all containers.bin/update
: Update your project to the most recent version ofdocker-magento
.bin/xdebug
: Disable or enable Xdebug. Accepts paramsdisable
(default) orenable
. Ex.bin/xdebug enable
Misc Info
Caching
For an improved developer experience, caches are automatically refreshed when related files are updated, courtesy of cache-clean. This means you can keep all of the standard Magento caches enabled, and this script will only clear the specific caches needed, and only when necessary.
To disable this functionality, uncomment the last line in the bin/start
file to disable the watcher.
Database
The hostname of each service is the name of the service within the docker-compose.yml
file. So for example, MySQL's hostname is db
(not localhost
) when accessing it from within a Docker container. Elasticsearch's hostname is elasticsearch
.
To connect to the MySQL CLI tool of the Docker instance, run:
bin/mysql
You can use the bin/mysql
script to import a database, for example a file stored in your local host directory at backups/magento.sql
:
bin/mysql < backups/magento.sql
You also can use bin/mysqldump
to export the database. The file will appear in your local host directory at backups/magento.sql
:
bin/mysqldump > backups/magento.sql
Getting an "Access denied, you need (at least one of) the SUPER privilege(s) for this operation." message when running one of the above lines? Try running it as root with:
bin/clinotty mysql -hdb -uroot -pmagento magento < src/backup.sql
You can also remove the DEFINER lines from the MySQL backup file with:
sed 's/\sDEFINER=`[^`]*`@`[^`]*`//g' -i src/backup.sql
Composer Authentication
First setup Magento Marketplace authentication (details in the DevDocs).
Copy src/auth.json.sample
to src/auth.json
. Then, update the username and password values with your Magento public and private keys, respectively. Finally, copy the file to the container by running bin/copytocontainer auth.json
.
Email / Mailcatcher
View emails sent locally through Mailcatcher by visiting http://{yourdomain}:1080. During development, it's easiest to test emails using a third-party module such as [https://github.com/mageplaza/magento-2-smtp](Mageplaza's SMTP module). Set the mailserver host to mailcatcher
and port to 1080
.
Redis
Redis is now the default cache and session storage engine, and is automatically configured & enabled when running bin/setup
on new installs.
Use the following lines to enable Redis on existing installs:
Enable for Cache:
bin/magento config:set --cache-backend=redis --cache-backend-redis-server=redis --cache-backend-redis-db=0
Enable for Full Page Cache:
bin/magento config:set --page-cache=redis --page-cache-redis-server=redis --page-cache-redis-db=1
Enable for Session:
bin/magento config:set --session-save=redis --session-save-redis-host=redis --session-save-redis-log-level=4 --session-save-redis-db=2
You may also monitor Redis by running: bin/redis redis-cli monitor
For more information about Redis usage with Magento, see the DevDocs.
Xdebug & VS Code
Install and enable the PHP Debug extension from the Visual Studio Marketplace.
Otherwise, this project now automatically sets up Xdebug support with VS Code. If you wish to set this up manually, please see the .vscode/launch.json
file.
Xdebug & PHPStorm
-
First, install the Chrome Xdebug helper. After installed, right click on the Chrome icon for it and go to Options. Under IDE Key, select PHPStorm from the list and click Save.
-
Next, enable Xdebug in the PHP-FPM container by running:
bin/xdebug enable
, the restart the docker containers (CTRL+C thenbin/start
). -
Then, open
PHPStorm > Preferences > Languages & Frameworks > PHP
and configure:-
CLI Interpreter
- Create a new interpreter and specify
From Docker
, and name itmarkoshust/magento-php:7-2-fpm
. - Choose
Docker
, then select themarkoshust/magento-php:7-2-fpm
image name, and set thePHP Executable
tophp
.
- Create a new interpreter and specify
-
Path mappings
- Don't do anything here as the next
Docker container
step will automatically setup a path mapping from/var/www/html
to./src
.
- Don't do anything here as the next
-
Docker container
- Remove any pre-existing volume bindings.
- Ensure a volume binding has been setup for Container path of
/var/www/html
mapped to the Host path of./src
.
-
-
Open
PHPStorm > Preferences > Languages & Frameworks > PHP > Debug
and set Debug Port to9001,9003
. -
Open
PHPStorm > Preferences > Languages & Frameworks > PHP > DBGp Proxy
and set Port to9001
. -
Open
PHPStorm > Preferences > Languages & Frameworks > PHP > Servers
and create a new server:- Set Name and Host to your domain name (ex.
magento.test
) - Keep port set to
80
- Check the Path Mappings box and map
src
to the absolute path of/var/www/html
- Set Name and Host to your domain name (ex.
-
Go to
Run > Edit Configurations
and create a newPHP Remote Debug
configuration by clicking the plus sign and selecting it. Set the Name to your domain (ex.magento.test
). Check theFilter debug connection by IDE key
checkbox, select the server you just setup, and under IDE Key enterPHPSTORM
. This IDE Key should match the IDE Key set by the Chrome Xdebug Helper. Then click OK to finish setting up the remote debugger in PHPStorm. -
Open up
src/pub/index.php
, and set a breakpoint near the end of the file. Go toRun > Debug 'magento.test'
, and open up a web browser. Ensure the Chrome Xdebug helper is enabled by clicking on it > Debug. Navigate to your Magento store URL, and Xdebug within PHPStorm should now trigger the debugger and pause at the toggled breakpoint.
SSH
Since version 40.0.0
, this project supports connecting to Docker with SSH/SFTP. This means that if you solely use either PhpStorm or VSCode, you no longer need to selectively mount host volumes in order to gain bi-directional sync capabilities from host to container. This will enable full speed in the native filesystem, as all files will be stored directly in the appdata
container volume, rather than being synced from the host. This is especially useful if you'd like to sync larger directories such as generated
, pub
& vendor
.
Copy docker-compose.dev-ssh.yml
to docker-compose.dev.yml
before installing Magento to take advantage of this setup. Then, create an SFTP connection at Preferences -> Build, Execution, Deployment -> Deployment. Connect to localhost
and use app
for the username & password. You can set additional options for working with Magento in PhpStorm at Preferences -> Build, Execution, Deployment -> Deployment -> Options.
Note that you must use your IDE's SSH/SFTP functionality, otherwise changes will not be synced. To re-sync your host environment at any time, run:
bin/copyfromcontainer --all
Linux
Running Docker on Linux should be pretty straight-forward. Note that you need to run some post install commands as well as installing Docker Compose before continuing. These steps are taken care of automatically with Docker Desktop, but not on Linux.
Copy docker-compose.dev-linux.yml
to docker-compose.dev.yml
before installing Magento to take advantage of this setup.
The host.docker.internal
hostname is hard-coded in the php.ini file, but this hostname does not exist on Linux. To make this hostname resolve, within the extra_hosts
param of docker-compose.dev.yml
replace 172.17.0.1
with the result of:
docker run --rm alpine ip route | awk 'NR==1 {print $3}'
You may also have to increase a virtual memory map count on the host system. It is required by Elasticsearch.
Add the following line to the /etc/sysctl.conf
file on your host:
vm.max_map_count=262144
To enable Xdebug on Linux, you'll also need to open port 9001 on the firewall by running:
sudo iptables -A INPUT -p tcp --dport 9001 -j ACCEPT
Blackfire.io
These docker images have built-in support for Blackfire.io. To use it, first register your server ID and token with the Blackfire agent:
bin/root blackfire-agent --register --server-id={YOUR_SERVER_ID} --server-token={YOUR_SERVER_TOKEN}
Next, open up the bin/start
helper script and uncomment the line:
#bin/root /etc/init.d/blackfire-agent start
Finally, restart the containers with bin/restart
. After doing so, everything is now configured and you can use a browser extension to profile your Magento store with Blackfire.
MFTF
To work with MFTF you will need to first enable the selenium
image in the docker-compose.dev.yml
file. Then, you will need to run the following.
- Run mftf build process
bin/mftf build:project
. This should build the basic setup for mftf in your project. - Update the
extra_host
values to match your Magento URL and IP indocker-compose.dev.yml
. - Update the values in
src/dev/tests/acceptance/.env
, including adding the new lineSELENIUM_HOST=selenium
to define the host Codeception should connect to. - Run a sample test
bin/mftf run:test AdminLoginSuccessfulTest
. - Update your
nginx.conf
file to allow access to the dev section with the following, before the finaldeny all
section:
location ~* ^/dev/tests/acceptance/utils($|/) {
root $MAGE_ROOT;
location ~ ^/dev/tests/acceptance/utils/command.php {
fastcgi_pass fastcgi_backend;
fastcgi_index index.php;
fastcgi_param SCRIPT_FILENAME $document_root$fastcgi_script_name;
include fastcgi_params;
}
}
For debugging, you can connect to the selenium image using a VCN client.
- Connect with the VCN option and
127.0.0.1:5900
, (default password:secret
) - Run
bin/mftf doctor
to validate all sections are setup correctly.
Find more info here about mftf configuration.
Credits
M.academy
This course is sponsored by M.academy, the simplest way to learn Magento.
Mark Shust
My name is Mark Shust and I'm the creator of this repo. I'm a Zend Certified Engineer and Adobe Certified Magento Developer, and have been involved since the early days of Magento (0.8!). I'm no longer available for consulting, but am creating course content full-time at M.academy.
You can follow me on Twitter @MarkShust, connect with me on LinkedIn @MarkShust, read my blog at markshust.com, or contact me directly at mark@shust.com.