python / buildmaster-config

Configuration for buildbot.python.org

Home Page:https://buildbot.python.org/all/#/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Increase parallelization of PPC64 builds

aixtools opened this issue · comments

The server used for AIX PPC64 builds has 16 core (64 hardware threads) and can easily support more parallelization during the bot tests.

Thanks.

But is it working? The last run still shows -j2.

./python -E -c 'import sys ; from sysconfig import get_platform ; print("%s-%d.%d" % (get_platform(), *sys.version_info[:2]))' >platform
./python  ./Tools/scripts/run_tests.py -j 1 -u all -W --slowest --fail-env-changed --timeout=900 -j2 --junit-xml test-results.xml 
== CPython 3.9.0a5+ (heads/master:5cd2803, Apr 9 2020, 11:11:59) [GCC 7.2.0]
== AIX-2-00FA74164C00-powerpc-32bit big-endian
== cwd: /home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/build/test_python_8520020
== CPU count: 64
== encodings: locale=ISO8859-1, FS=iso8859-1

I think you misunderstood parallel_tests=10: that's the number of parallel buildbot jobs. Not the -j option passed to python -m test.

Hmm, no; parallel_tests should equate to the -j option to regrtest; parallel_builders would increase the number of buildbot jobs (builders) allowed to run at the same time.

The change didn't appear to have been deployed; I've reconfigured the master and started a build; we'll see what it does.

Other than a truly huge number of warnings in the compile step, the build seemed to go well.

The change didn't appear to have been deployed; I've reconfigured the master and started a build; we'll see what it does.

Strange. I deployed it manually.