yandex / yandex-tank

Load and performance benchmark tool

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Exit code yandex-tank

SergeyDavidenko opened this issue · comments

Issue:
In documentations exit codes Autostop "21" - "32". I have always 0
https://yandextank.readthedocs.io/en/latest/core_and_modules.html#exit-codes

Version:

 YandexTank/1.11.2

OS:

ubuntu 16.04 lts

Config:

phantom:
  address: 
  ssl: true
  headers:
    - "[Host: ]"
    - "[Cache-Control: no-cache]"
    - "[Referer: S2]"
  ammofile: s2_megaload.txt
  load_profile:
    load_type: rps 
    schedule: line(1, 12, 3m) const(12, 25m) 
console:
  enabled: true
  short_only: true

autostop:
  autostop:
    - time(1200ms,10s)
    - http(5xx,15%,10s) 
    - net(101,15,10) 
    - quantile(95,3000ms,10s)
telegraf:
    enabled: false
influx:
    enabled: true
    address: 
    username: 
    password: 
    database: loadtest
    tank_tag: S2
    grafana_root:

Run:

yandex-tank -c ${FILE}
echo $?

Return:

11:09:06 [INFO] ts:1553598543	RPS:16	avg:3848.10	min:561.55	max:11004.00	q95:11003.67	
11:09:07 [INFO] ts:1553598544	RPS:10	avg:5803.15	min:987.36	max:11013.15	q95:11008.96	
11:09:08 [WARNING] Autostop criterion requested test stop: time(1200ms,10s)
11:09:08 [INFO] ts:1553598545	RPS:14	avg:5248.61	min:660.50	max:11003.52	q95:11003.41	
11:09:08 [WARNING] Autostop criterion requested test stop: Average response time higher than 1200ms for 10s, since 1553598536
11:09:08 [INFO] Finishing test...
11:09:08 [INFO] Stopping load generator and aggregator
11:09:08 [INFO] Terminating phantom process with PID 19266
11:09:10 [INFO] ts:1553598546	RPS:10	avg:5760.76	min:1566.97	max:11003.83	q95:11003.70	
11:09:10 [INFO] ts:1553598547	RPS:10	avg:5151.60	min:2012.06	max:8452.32	q95:8401.39	
11:09:10 [INFO] Timestamps without stats:
11:09:10 [INFO] 1553598548
11:09:10 [INFO] ts:1553598548	RPS:5	avg:3618.37	min:159.74	max:11013.57	q95:9328.43	
11:09:10 [INFO] Stopping monitoring
11:09:10 [INFO] Post-processing test...
11:09:10 [INFO] Trying to clean up
11:09:10 [INFO] Cleaning up plugin plugin_phantom
11:09:10 [INFO] Cleaning up plugin plugin_autostop
11:09:10 [INFO] Cleaning up plugin plugin_shellexec
11:09:10 [INFO] Cleaning up plugin plugin_influx
11:09:10 [INFO] Cleaning up plugin plugin_console
11:09:10 [INFO] Cleaning up plugin plugin_rcassert
11:09:10 [INFO] Cleaning up plugin plugin_rcheck
11:09:10 [INFO] Cleaning up plugin plugin_json_report
11:09:10 [INFO] Releasing lock: /var/lock/lunapark_b_Lx0J.lock
11:09:10 [WARNING] Job number is not available yet
11:09:10 [WARNING] Job number is not available yet
+ echo 0
0
Finished: SUCCESS

https://github.com/yandex/yandex-tank/blob/develop/yandextank/core/cli.py#L136-L143

где-то тут раньше был sys.exit(retcode)

@fomars специально открутили это или потеряли пока рефакторили?

Вроде починили,
@SergeyDavidenko
20aafa1

```12:20:12 [WARNING] Autostop criterion requested test stop: time(900ms,10s)
12:20:12 [INFO] ts:1555071609    RPS:12    avg:4569.85    min:487.15    max:11004.09    q95:11003.68```
Build step 'Execute shell' marked build as failure
Finished: FAILURE

Спасибо работает.