redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

Home Page:https://redpanda.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

CI Failure (key symptom) in `ArchivalTest.test_one_node_reconnect`

vbotbuildovich opened this issue · comments

https://buildkite.com/redpanda/vtools/builds/15023

Module: rptest.tests.archival_test
Class: ArchivalTest
Method: test_one_node_reconnect
Arguments: {
    "cloud_storage_type": 1
}
test_id:    ArchivalTest.test_one_node_reconnect
status:     FAIL
run time:   27.886 seconds

RemoteCommandError({'ssh_config': {'host': 'ip-172-31-1-22', 'hostname': '172.31.1.22', 'user': 'root', 'port': 22, 'password': None, 'identityfile': '/home/ubuntu/.ssh/id_rsa'}, 'hostname': 'ip-172-31-1-22', 'ssh_hostname': '172.31.1.22', 'user': 'root', 'externally_routable_ip': '35.165.118.2', '_logger': <Logger rptest.tests.archival_test.ArchivalTest.test_one_node_reconnect.cloud_storage_type=CloudStorageType.S3-900 (DEBUG)>, 'os': 'linux', '_ssh_client': <paramiko.client.SSHClient object at 0x7f15d3b0fd60>, '_sftp_client': <paramiko.sftp_client.SFTPClient object at 0x7f15d3b0d810>, '_custom_ssh_exception_checks': None}, 'python3 /tmp/compute_storage.py --sizes --md5 --print-flat --data-dir /var/lib/redpanda/data', 1, b'')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/mark/_mark.py", line 535, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 105, in wrapped
    r = f(self, *args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/tests/archival_test.py", line 326, in test_one_node_reconnect
    validate(self._quick_verify, self.logger, 90)
  File "/home/ubuntu/redpanda/tests/rptest/tests/archival_test.py", line 66, in validate
    fn()
  File "/home/ubuntu/redpanda/tests/rptest/tests/archival_test.py", line 710, in _quick_verify
    checksums = self._get_redpanda_log_segment_checksums(node)
  File "/home/ubuntu/redpanda/tests/rptest/tests/archival_test.py", line 797, in _get_redpanda_log_segment_checksums
    checksums = self.redpanda.data_checksum(node)
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 4304, in data_checksum
    lines = node.account.ssh_output(cmd, timeout_sec=120)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/cluster/remoteaccount.py", line 41, in wrapper
    return method(self, *args, **kwargs)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/cluster/remoteaccount.py", line 397, in ssh_output
    raise RemoteCommandError(self, cmd, exit_status, stderr.read())
ducktape.cluster.remoteaccount.RemoteCommandError: root@ip-172-31-1-22: Command 'python3 /tmp/compute_storage.py --sizes --md5 --print-flat --data-dir /var/lib/redpanda/data' returned non-zero exit status 1.

JIRA Link: CORE-4534

Fixed by: #20310