gofer client performs two OPEN calls (read and write) for a single write OPENAT call
thundergolfer opened this issue · comments
Description
Opening an issue in gVisor as directed by Ayush after originally opening an issue in awslabs/mountpoint-s3#862.
Steps to reproduce
runsc version
runsc version release-20230717.0-12-g0244c8c19fb7
spec: 1.1.0-rc.1docker version (if using docker)
Not using Docker in this case.
uname
Linux ip-10-1-1-198 5.15.0-1058-aws #64~20.04.1-Ubuntu SMP Tue Apr 9 11:12:27 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
kubectl (if using Kubernetes)
No response
repo state (if built from source)
No response
runsc debug logs (if available)
runsc.log.20240506-224844.585376.boot.txt
mountpoint-s3 debug logs
2024-05-03T01:41:27.236722Z DEBUG lookup{req=16 ino=1 name="synmon"}:list_objects{id=2 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=33.451751ms
2024-05-03T01:41:27.237142Z DEBUG fuser::request: FUSE( 18) ino 0x0000000000000002 OPENDIR flags 0x28800
2024-05-03T01:41:27.237215Z DEBUG fuser::request: FUSE( 20) ino 0x0000000000000002 LOOKUP name "test_file2.txt"
2024-05-03T01:41:27.238657Z DEBUG lookup{req=20 ino=2 name="test_file2.txt"}:head_object{id=3 bucket="modal-s3mount-test-bucket" key="synmon/test_file2.txt"}: mountpoint_s3_client::s3_crt_client::head_object: new request
2024-05-03T01:41:27.240146Z DEBUG lookup{req=20 ino=2 name="test_file2.txt"}:list_objects{id=4 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/test_file2.txt/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request
2024-05-03T01:41:27.250483Z DEBUG lookup{req=20 ino=2 name="test_file2.txt"}:head_object{id=3 bucket="modal-s3mount-test-bucket" key="synmon/test_file2.txt"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=11.75266ms ttfb=Some(11.564753ms) request_id=BW8YM2QQETXYRDX8
2024-05-03T01:41:27.250533Z DEBUG lookup{req=20 ino=2 name="test_file2.txt"}:head_object{id=3 bucket="modal-s3mount-test-bucket" key="synmon/test_file2.txt"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=11.862071ms
2024-05-03T01:41:27.267847Z DEBUG lookup{req=20 ino=2 name="test_file2.txt"}:list_objects{id=4 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/test_file2.txt/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=27.628343ms ttfb=Some(23.65653ms) request_id=BW8M0Z7SGZE66E76
2024-05-03T01:41:27.267885Z DEBUG lookup{req=20 ino=2 name="test_file2.txt"}:list_objects{id=4 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/test_file2.txt/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=27.726881ms
2024-05-03T01:41:27.268199Z DEBUG fuser::request: FUSE( 22) ino 0x0000000000000003 OPEN flags 0x28800
2024-05-03T01:41:27.269918Z DEBUG open{req=22 ino=3 pid=2201237 name="test_file2.txt"}:head_object{id=5 bucket="modal-s3mount-test-bucket" key="synmon/test_file2.txt"}: mountpoint_s3_client::s3_crt_client::head_object: new request
2024-05-03T01:41:27.271456Z DEBUG open{req=22 ino=3 pid=2201237 name="test_file2.txt"}:list_objects{id=6 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/test_file2.txt/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request
2024-05-03T01:41:27.280321Z DEBUG open{req=22 ino=3 pid=2201237 name="test_file2.txt"}:head_object{id=5 bucket="modal-s3mount-test-bucket" key="synmon/test_file2.txt"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=10.324378ms ttfb=Some(10.170868ms) request_id=BW8YG0JPWWGZJ2D5
2024-05-03T01:41:27.280360Z DEBUG open{req=22 ino=3 pid=2201237 name="test_file2.txt"}:head_object{id=5 bucket="modal-s3mount-test-bucket" key="synmon/test_file2.txt"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=10.422985ms
2024-05-03T01:41:27.283902Z DEBUG open{req=22 ino=3 pid=2201237 name="test_file2.txt"}:list_objects{id=6 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/test_file2.txt/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=12.393492ms ttfb=Some(11.423544ms) request_id=BW8QRFJM2X8SX9FG
2024-05-03T01:41:27.283927Z DEBUG open{req=22 ino=3 pid=2201237 name="test_file2.txt"}:list_objects{id=6 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/test_file2.txt/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=12.458821ms
2024-05-03T01:41:27.284211Z DEBUG open{req=22 ino=3 pid=2201237 name="test_file2.txt"}: mountpoint_s3::fs: new file handle created fh=5 ino=3
2024-05-03T01:41:27.284269Z DEBUG fuser::request: FUSE( 24) ino 0x0000000000000003 OPEN flags 0x28201
2024-05-03T01:41:27.285631Z DEBUG open{req=24 ino=3 pid=2201237 name="test_file2.txt"}:head_object{id=7 bucket="modal-s3mount-test-bucket" key="synmon/test_file2.txt"}: mountpoint_s3_client::s3_crt_client::head_object: new request
2024-05-03T01:41:27.287109Z DEBUG open{req=24 ino=3 pid=2201237 name="test_file2.txt"}:list_objects{id=8 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/test_file2.txt/"}: mountpoint_s3_client::s3_crt_client::list_objects: new request
2024-05-03T01:41:27.295750Z DEBUG open{req=24 ino=3 pid=2201237 name="test_file2.txt"}:head_object{id=7 bucket="modal-s3mount-test-bucket" key="synmon/test_file2.txt"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=10.053739ms ttfb=Some(9.878797ms) request_id=BW8WPBFQNQ4VJBNE
2024-05-03T01:41:27.295791Z DEBUG open{req=24 ino=3 pid=2201237 name="test_file2.txt"}:head_object{id=7 bucket="modal-s3mount-test-bucket" key="synmon/test_file2.txt"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=10.14902ms
2024-05-03T01:41:27.299245Z DEBUG open{req=24 ino=3 pid=2201237 name="test_file2.txt"}:list_objects{id=8 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/test_file2.txt/"}: mountpoint_s3_client::s3_crt_client: S3 request finished request_type=Default crt_error=None http_status=200 range=None duration=12.071358ms ttfb=Some(10.814732ms) request_id=BW8JR54B4ZNZMX2V
2024-05-03T01:41:27.299278Z DEBUG open{req=24 ino=3 pid=2201237 name="test_file2.txt"}:list_objects{id=8 bucket="modal-s3mount-test-bucket" continued=false delimiter="/" max_keys="1" prefix="synmon/test_file2.txt/"}: mountpoint_s3_client::s3_crt_client: meta request finished duration=12.157814ms
2024-05-03T01:41:27.299529Z WARN open{req=24 ino=3 pid=2201237 name="test_file2.txt"}: mountpoint_s3::fuse: open failed: inode error: inode 3 (full key "synmon/test_file2.txt") is not writable while being read
2024-05-03T01:41:27.299583Z DEBUG fuser::request: FUSE( 26) ino 0x0000000000000003 FLUSH fh FileHandle(5), lock owner LockOwner(2081044382602532771)
2024-05-03T01:41:27.299624Z DEBUG fuser::request: FUSE( 28) ino 0x0000000000000003 RELEASE fh FileHandle(5), flags 0x28800, flush false, lock owner None
2024-05-03T01:41:27.299688Z DEBUG fuser::request: FUSE( 30) ino 0x0000000000000002 RELEASEDIR fh FileHandle(4), flags 0x28800, flush false, lock owner None
Sorry I think we raced. I already had opened #10385 and posted some notes there. Forgot to update you or CC you on that.
Oh right I was too slow for you haha. All good I'll subscribe there.