mcomella / FNPRMS

"funperms": Fenix Nightly Performance Regression Measurement System used by the Android FE perf team to measure cold startup. Please file issues in perf-frontend-issues

Fenix Nightly Performance Regression Monitoring System

Scripts to automatically test the startup performance of Fenix's nightly variant of Fenix or manually test the startup performance of Fennec or Fenix.

Operation:

To use the system automatically, see test.sh, do_times.sh and plot.sh. To operate the system manually, see manual_test.sh, manual_do_times.sh and plot.sh.

Installation

Pre-run Customization:

1. common.sh:

• ADB: Change to the location of adb on the system.

For tests run under automation:

1. test.sh:

• log_dir: Change to the location to store test output logs.

1. do_times.sh:

• log_dir: Change to the location where test output logs can be found. This value should match log_dir specified in test.sh.

For tests run manaully:

1. manual_test.sh:

• log_dir: Change to the location to store test output logs.

1. manual_dotimes.sh:

• log_dir: Change to the location where test output logs can be found. This value should match log_dir specified in manual_test.sh.