Web UI copy to another folder gives net/http timeout error for large files (i.e. 32GB)

Pydio Cells
1

Issue logged

2

Hi @erpadmin

Could you please provide more information about your storage:

  • Type: local / network mount ?
  • Disk format: xfs, ext4 … ?
3

local SSD attached to LSI MegaRAID 3108 using xfs.

4

I was able to reproduce this on a home pc with a local samsung ssd with ext4

steps i took

git checkout -b v4.4.15 v4.4.15

(mariadb running but only empty cells db and perms created)

go run . configure

go run . start

dd if=/dev/zero of=32gbfile.bin bs=1M count=32768

upload the file using webui (no problems)

create a test folder

copy file to the test folder, after around 60 seconds it gives timeout waiting for headers message

image
image398×194 20.9 KB

I have a hard time following the go code, maybe its because there are so many interfaces. If you tell me an area to breakpoint, etc when I get time I’ll pull more information. IMO, I seems like a default http timer or something that needs to be push out a bit.

5

Hi,

Interesting. I will try to reproduce this error too.

Will keep you posted

6

I traced the problem to /home/rlm/go/pkg/mod/github.com/minio/minio-go/v7@v7.0.65/api-compose-object.go line 265

	// Send upload-part-copy request
	resp, err := c.executeMethod(ctx, http.MethodPut, reqMetadata)
	defer closeResponse(resp)
	if err != nil {
		fmt.Println("Error in copyObjectDo:", err)  // this is my debug code
		return ObjectInfo{}, err
	}

Interestingly the func comment says 5GB worth of copy

// Low level implementation of CopyObject API, supports only upto 5GiB worth of copy.

func (c *Client) copyObjectDo(ctx context.Context, srcBucket, srcObject, destBucket, destObject string,

this is AI’s claim which sounds plausible, but i haven’t messed with trying to tweak timeouts.

  • The MinIO client uses an HTTP client internally.

  • If the server (your local MinIO or Cells gateway) does not respond with headers within the HTTP client’s timeout, you get net/http: timeout awaiting response headers.

  • The timeout is not set by your context (as you confirmed), but by the HTTP client inside the MinIO SDK.

7

@erpadmin amazing work

I’m able to reproduce this error

8

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.