joanhey / PHP-Frameworks-Bench

A library to benchmark PHP Frameworks.

PHP Frameworks Bench

This project attempts to measure the minimum overhead (minimum bootstrap cost) of PHP frameworks in the real world.

So I think the minimum should not include:

• cost of template engine
• cost of database manipulation
• cost of debugging information

Benchmarking on components like template engines or ORM/Database libraries is out of the scope of this project.

• PHP Frameworks Bench
  • Benchmarks
    • Latest
    • OPCache
  • Benchmarking Policy
  • How to Benchmark
  • Commands
  • Donate
  • References
  • License

Benchmarks

Latest

Environment

• Ubuntu 22.04 LTS x86_64
  • PHP 8.2.5
  • OPCache Off
  • Apache 2.4.52
  • WRK 4.2.0
  • CPU Core i7-3770K@4.4Ghz
  • Memory 16G

Results (2023/5/15)

These are my benchmarks, not yours. I encourage you to run on your (production equivalent) environments.

framework	requests per second (rps)	relative (rps)	peak memory	relative (mem)
pure-php	27,379.94	282.4	0.42	1.0
fastroute-1.3	4,591.01	47.3	0.56	1.3
phroute-2.2	4,303.07	44.4	0.58	1.4
leaf-3.3	1,576.68	16.3	1.10	2.6
fatfree-3.8.1	1,512.30	15.6	1.67	4.0
siler-1.7.9	1,416.80	14.6	1.17	2.8
slim-3.12	1,061.05	10.9	1.40	3.3
frameworkx-dev	994.55	10.3	1.45	3.4
slim-4.11	805.51	8.3	1.57	3.7
ubiquity-2.4.x.dev	726.70	7.5	1.64	3.9
silex-2.3	558.07	5.8	2.16	5.1
yii-2.0-basic	508.32	5.2	2.57	6.1
fuelphp-1.9	450.65	4.6	2.51	6.0
lumen-10.0	352.94	3.6	3.49	8.3
codeigniter-4.3	324.27	3.3	3.50	8.3
symfony-5.4	319.55	3.3	3.82	9.1
symfony-6.2	314.21	3.2	3.89	9.2
laminas-2.0	309.30	3.2	3.50	8.3
cakephp-4.4	262.25	2.7	4.49	10.7
laravel-10.0	96.97	1.0	11.99	28.5

OPCache

Benchmarking Policy

This is for the main branch.

• Frameworks installed via composer according to their official documentation.
• Used the default configuration.
  • Considering the minimum changes on frameworks to run the benchmark.
  • Didn't remove any components/configurations even if there is no use for them.
• We have a controller class to get the Hello World for each, based on the default template of each framework.
• Turned off the debug mode and set the environment to production mode.
• Considered general optimization for the production environment, like --optimize-autoloader for the composer.

Some frameworks are optimized more than others, so some people may think using default configuration is not fair. The dept of optimizing a framework depends on the experiences of the developer too, so it's the rabbit hole and there is no point in it. I think the default configuration of frameworks is a good starting point to get ranking.

If you find something wrong in my code, feel free to send a PR. But please note optimizing for the "Hello World" is not acceptable! Building the fastest Hello World application is not the goal of this project.

How to Benchmark

If you want to have benchmarks on PHP extension frameworks like Phalcon, you need to install the extension first based on its own documentation.

1- Download & Setup:

# make sure to put it in the root of your web path
$ git clone https://github.com/myaaghubi/PHP-Frameworks-Bench.git

$ cd PHP-Frameworks-Bench

# optional
$ nano benchmark.config

# run the setup & follow the progress
$ yes | bash setup.sh

2- Make sure everything is ok:

$ bash check.sh
# bash check.sh -t pure-php
# /------- pure-php: checking... done.

3- Run benchmarks:

# bash check.sh -t pure-php
$ bash benchmark.sh

4- Check the results:

• web:

  http://localhost/PHP-Frameworks-Bench/

• terminal:

  bash show-table.sh
  

Commands

# run composer update for frameworks
$ bash update.sh

# to clean them all
# trouble? run it then
# you can use `bash setup.sh` again
$ bash clean.sh

# clear the cache of frameworks
$ bash clear-cache.sh

# show the results of the last benchmark
$ bash show-table.sh

To specify frameworks, put them with -t ... after each command:

# supported for `setup.sh`, `benchmark.sh`, `update.sh`, `clean.sh`, and `clear-cache.sh`
# bash benchmarks.sh --help -h
$ bash benchmark.sh -t laravel-10.0/ slim-4.11/ ...
...

🍔 Donate

Don't forget to donate if you find it useful ☕ 🍺 🍸 🍔

ETH: 0x0ADd51D6855d2DF11BB5F331A3fa345c67a863b2

References

Note: This project is based on php-framework-benchmark, thanks to Kenjis. It is very old and abandoned, so I decided to split it from the origin and update it separately.

For frameworks, I considered the official repos:

• CakePHP
• CodeIgniter
• FastRoute
• FatFree
• FrameworkX
• FuelPHP
• Laminas
• Laravel
• Leaf
• Lumen
• PhRoute
• Siler
• Silex
• Slim
• Symfony
• Ubiquity
• Yii

License

You are allowed to use this plugin/project under the terms of the GNU General Public License version 2.

Copyright (C) 2023 Mohammad Yaaghubi