seaweedfs / seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[volume] In parallel, we create a replica and save the file to disk

kmlebedev opened this issue · comments

Describe the bug

image From the metrics it is clearly visible that it takes 800 ms to put a chunk of 64 MB, where the chunk is sequentially saved to disk, and then 600 ms is transferred to a synchronous replica.

System Setup

weed 3.62

Expected behavior

I would like to optimize uploading time and memory consumption by performing write operations to the disk and to the replica in parallel.

before with gomemlimit 1g
image

image

before without limit

profile022