redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

Home Page:https://redpanda.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

CI Failure (key symptom) in `ArchivalTest.test_all_partitions_leadership_transfer`

vbotbuildovich opened this issue · comments

https://buildkite.com/redpanda/vtools/builds/15023

Module: rptest.tests.archival_test
Class: ArchivalTest
Method: test_all_partitions_leadership_transfer
Arguments: {
    "cloud_storage_type": 1
}
test_id:    ArchivalTest.test_all_partitions_leadership_transfer
status:     FAIL
run time:   39.050 seconds

RemoteCommandError({'ssh_config': {'host': 'ip-172-31-4-124', 'hostname': '172.31.4.124', 'user': 'root', 'port': 22, 'password': None, 'identityfile': '/home/ubuntu/.ssh/id_rsa'}, 'hostname': 'ip-172-31-4-124', 'ssh_hostname': '172.31.4.124', 'user': 'root', 'externally_routable_ip': '35.89.115.3', '_logger': <Logger rptest.tests.archival_test.ArchivalTest.test_all_partitions_leadership_transfer.cloud_storage_type=CloudStorageType.S3-896 (DEBUG)>, 'os': 'linux', '_ssh_client': <paramiko.client.SSHClient object at 0x7f15d3ba51b0>, '_sftp_client': <paramiko.sftp_client.SFTPClient object at 0x7f15d3dc8280>, '_custom_ssh_exception_checks': None}, 'python3 /tmp/compute_storage.py --sizes --md5 --print-flat --data-dir /var/lib/redpanda/data', 1, b'')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/mark/_mark.py", line 535, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 105, in wrapped
    r = f(self, *args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/tests/archival_test.py", line 390, in test_all_partitions_leadership_transfer
    validate(self._cross_node_verify, self.logger, 90)
  File "/home/ubuntu/redpanda/tests/rptest/tests/archival_test.py", line 66, in validate
    fn()
  File "/home/ubuntu/redpanda/tests/rptest/tests/archival_test.py", line 577, in _cross_node_verify
    lst = self.segment_paths_from_checksums(node)
  File "/home/ubuntu/redpanda/tests/rptest/tests/archival_test.py", line 692, in segment_paths_from_checksums
    checksums = self._get_redpanda_log_segment_checksums(node)
  File "/home/ubuntu/redpanda/tests/rptest/tests/archival_test.py", line 797, in _get_redpanda_log_segment_checksums
    checksums = self.redpanda.data_checksum(node)
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 4304, in data_checksum
    lines = node.account.ssh_output(cmd, timeout_sec=120)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/cluster/remoteaccount.py", line 41, in wrapper
    return method(self, *args, **kwargs)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/cluster/remoteaccount.py", line 397, in ssh_output
    raise RemoteCommandError(self, cmd, exit_status, stderr.read())
ducktape.cluster.remoteaccount.RemoteCommandError: root@ip-172-31-4-124: Command 'python3 /tmp/compute_storage.py --sizes --md5 --print-flat --data-dir /var/lib/redpanda/data' returned non-zero exit status 1.

JIRA Link: CORE-4532

Fixed by: #20310