Giters

redis / redis-benchmarks-specification

The Redis benchmarks specification describes the cross-language/tools requirements and expectations to foster performance and observability standards around redis related technologies. Members from both industry and academia, including organizations and individuals are encouraged to contribute.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[BUG]: ERROR The total numbers of keys in setup does not match the expected spec: 1!=0. Aborting...

zhoujie2022 opened this issue · comments

commented

Describe the bug
Run redis-benchmarks-spec-client-runner according to Readme.md failed
Is the step wrong?

To Reproduce
Steps to reproduce the behavior:

  1. Install redis-benchmarks-specification
    sudo apt install python3-pip -y
    sudo pip3 install --upgrade pip
    sudo apt install docker.io -y
    sudo apt install supervisor -y
    python3 -m pip install redis-benchmarks-specification --ignore-installed PyYAML
  2. Make redis
    git clone https://github.com/redis/redis.git
    cd redis
    make
  3. Run redis-server
    ./src/redis-server --port 6379 &
    18569:M 03 Feb 2023 01:24:08.003 * Ready to accept connections tcp
  4. Run redis-benchmarks-spec-client-runner
    redis-benchmarks-spec-client-runner --db_server_host localhost --db_server_port 6379 --client_aggregated_results_folder ./test

Expected behavior
redis-benchmarks-spec-client-runner output:
2023-02-03 01:24:59 INFO redis-benchmarks-spec-client-runner (solely client) 0.1.67
2023-02-03 01:24:59 INFO Using test-suites folder dir /usr/local/lib/python3.9/dist-packages/redis_benchmarks_specification/test-suites
2023-02-03 01:24:59 INFO Acception all test files. If you need further filter specify a regular expression via --tests-regexp
2023-02-03 01:24:59 INFO There are a total of 88 test-suites in folder /usr/local/lib/python3.9/dist-packages/redis_benchmarks_specification/test-suites
2023-02-03 01:24:59 INFO Running the benchmark specs.
2023-02-03 01:24:59 INFO Loading default specifications from file: /usr/local/lib/python3.9/dist-packages/redis_benchmarks_specification/test-suites/defaults.yml
2023-02-03 01:24:59 INFO Found RedisTimeSeries default metrics specification. Will include the following metrics on all benchmarks $."BEST RUN RESULTS".Totals."Ops/sec" $."BEST RUN RESULTS".Totals."Latency" $."BEST RUN RESULTS".Totals."Misses/sec" $."BEST RUN RESULTS".Totals."Percentile Latencies"."p50.00" $."WORST RUN RESULTS".Totals."Ops/sec" $."WORST RUN RESULTS".Totals."Latency" $."WORST RUN RESULTS".Totals."Misses/sec" $."WORST RUN RESULTS".Totals."Percentile Latencies"."p50.00" $."AGGREGATED AVERAGE RESULTS (3 runs)".Totals."Ops/sec" $."AGGREGATED AVERAGE RESULTS (3 runs)".Totals."Latency" $."AGGREGATED AVERAGE RESULTS (3 runs)".Totals."Misses/sec" $."AGGREGATED AVERAGE RESULTS (5 runs)".Totals."Percentile Latencies"."p50.00" $."ALL STATS".Totals."Ops/sec" $."ALL STATS".Totals."Latency" $."ALL STATS".Totals."Misses/sec" $."ALL STATS".Totals."Percentile Latencies"."p50.00"
2023-02-03 01:24:59 INFO Found RedisTimeSeries default time metric specification. Will use the following JSON path to retrieve the test time $."ALL STATS".Runtime."Start time"
2023-02-03 01:24:59 INFO Benchmark required memory: 1073741824 Bytes
2023-02-03 01:24:59 INFO Using total system memory as max 4122423296
2023-02-03 01:24:59 INFO Resetting commmandstats for shard 0
2023-02-03 01:24:59 INFO Test memtier_benchmark-1key-pfadd-4KB-values-pipeline-10 priority (61) is within the priority limit [0,100000]
2023-02-03 01:24:59 INFO Benchmark used memory at start of benchmark: 1g
2023-02-03 01:24:59 INFO Checking if there is a keyspace check being enforced
2023-02-03 01:24:59 INFO Ensuring keyspace length requirement = 1 is met.
2023-02-03 01:24:59 ERROR The total numbers of keys in setup does not match the expected spec: 1!=0. Aborting...
2023-02-03 01:24:59 CRITICAL Some unexpected exception was caught during local work. Failing test....
2023-02-03 01:24:59 CRITICAL <class 'Exception'>

Environment (please complete the following information):

  • OS: [Debian GNU/Linux 11]
  • PyPi version package [0.1.67]
  • Platfrom [x86_64]
commented

@zhoujie2022 This issue has been fixed in pull request: #213
Try the latest version now.

commented

Thanks for reply.

I have 2 questions.

  1. How can I install latest program form source code(https://github.com/redis/redis-benchmarks-specification.git)?
    "python3 -m pip install redis-benchmarks-specification --ignore-installed PyYAML" is in Readme.md section "### Installing Redis benchmarks specification"
    But this command seems install redis-benchmarks-specification-0.1.66.

  2. Is following step OK?
    I copy source code redis-benchmarks-specification/redis_benchmarks_specification to /usr/local/lib/python3.9/dist-packages/.
    no more "expected spec: 1!=0" error.

But still have following errors.
requests.exceptions.HTTPError: 400 Client Error: Bad Request for url: http+docker://localhost/v1.41/containers/create
docker.errors.APIError: 400 Client Error for http+docker://localhost/v1.41/containers/create: Bad Request ("Requested CPUs are not available - requested 0,1,2,3, available: 0-1")

Maybe this is my docker environment problem.