Adding storage with CELLS_DEFAULT_DS_STRUCT: true

Describe your issue in detail

Multipart uploads failing, but only for additionally added storage. Default folder setup as structured datasources.

Using Portainer stack to setup docker install, with the environment variable CELLS_DEFAULT_DS_STRUCT: true and creating all required folders in Google Cloud Storage buckets.

Cells installs all ok, all buckets created in Google Cloud Storage ok. Cells services and Database stored in local folders ok.

Uploading a small and large file to the default “common-files” or “personal” workspaces (which are linked to Google Cloud Storage S3 buckets) works ok. 50MB file uploads in one go, 300MB file is chunked and uploads in parts ok.

New datasource
Adding new storage datasource (choosing “Import existing data” so that it’s a structured folder setup) and setting as a new S3 storage bucket (using same credentials as the initial cells setup) and using Pydio to create a new bucket in Google Cloud Storage.

This works ok, the bucket is created, a workspace can be setup to use this storage datasource, all ok so far.

Then uploading a small <100MB file works ok, uploads in structured format ok as a single upload. Folders can be created in this new workspace ok (can see the new folders and file in Google Cloud Storage browser).

What fails
Using this newly added datasource/workspace, uploading a large file >100MB which is chunked into a multipart upload - the initial multiparts are uploaded, but when the uploader then gets to the step where the next multiparts are to be uploaded, it fails with “Access Denied”.

PutObjectPart has failed - Put "https://pydiodebfldr-bucketname.storage.googleapis.com/subfolder/akl_gvs_day_skytower.mp4?partNumber=1&uploadId=ABPnzm5h1lYJzRKLPYaOQ_NgAymkqC7XbSMlxf_y6VoTdAazckP50JxftCBhYgoReSXy123-": context canceled

Error: Access denied. (minio.ErrorResponse)


2025-06-25T00:37:01.151Z ERROR pydio.gateway.data  Error: Unable to write all the data to client
Object not found: io/extrastructds/extrastructds/subfolder/akl_gvs_day_skytower.mp4 (*fmt.wrapError)

What version of Cells are you using?

Home 4.4.15

What is the server OS? Database name/version?

Debian Linux
Maria db
Google Cloud Storage S3 buckets

Ok, found the problem!

For my specific case, connecting to Google Cloud Storage S3 buckets (as Structured folder style, i.e. “Import Existing Data” when adding the datasource), the Signature Version in the Storage setup screen MUST be set to v4 in order for chunked / multipart uploads to work

1 Like

Thx for the details.