Upload failed: undefined

Hello,
I am trying to run Cells on Ubuntu 18.04.5. I’m accessing the server through SSH and have no physical access to it.
I’ve installed Cells and it’s running as a service. I see the UI from the browser and I can use it. When I try to upload a file from my computer I get

When I try to upload this line is added twice to the caddy_errors.log:
[ERROR 502 /io/common-files/Testfolder/Test_file.odt] dial tcp: lookup PENDING on x.x.x.53:53: server misbehaving (x=redacted). I thought that the DNS was giving me trouble (port 53 right?) so I switched to the google one. Any ideas?

Thanks,

Ben

Hi @benw

This indicates you have some “PENDING” directive in the caddy file that is dynamically generated to configure the internal gateway (see our glossary )

This usually means that one of the microservices cannot be found and that the internal gateway restarts in loop.

It does not give much hints about the root issue, (but most of the time this is linked to a lack of resources).

Could you give more details about your setup ?
Could you have a look at the main pydio log and tell us what you see there ?

Hi,
thanks for the response.
RE setup, this is the output of lscpu, as far as I know it should be strong enough. ulimit -n is set at 8192 both soft and hard:

Architektur:             x86_64
CPU Operationsmodus:     32-bit, 64-bit
Byte-Reihenfolge:        Little Endian
CPU(s):                  8
Liste der Online-CPU(s): 0-7
Thread(s) pro Kern:      1
Kern(e) pro Socket:      8
Sockel:                  1
Anbieterkennung:         GenuineIntel
Prozessorfamilie:        6
Modell:                  63
Modellname:              Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz
Stepping:                2
CPU MHz:                 1999.816
BogoMIPS:                4994.44
Virtualisierung:         VT-x
Hypervisor-Anbieter:     Parallels
Virtualisierungstyp:     Container
L1d Cache:               32K
L1i Cache:               32K
L2 Cache:                256K
L3 Cache:                30720K

As I wrote above it’s Ubuntu 18.04.5 LTS

I looked into the log and it looks like you’re right and it’s a caddy problem. What’s the best way to approach it? If it’s relevant, I’m having problem setting up SSL and the reverse proxy, I’ll tackle that once I have the basics.

{"level":"info","ts":"2021-02-15T11:34:11+01:00","logger":"pydio.gateway.proxy","msg":"Restart done"}

{"level":"info","ts":"2021-02-15T11:34:11+01:00","logger":"pydio.gateway.proxy","msg":"Restarting proxy","caddyfile":"\n\n\n\n\n\n\n0.0.0.0:8080 {\n\t\n\n\t\n\n\tproxy /a  xx.xxx.xxx.xx:36073 {\n\t\twit$

Thanks,

Ben

Hi @benw
Re-reading your thread, upload probably fails because of the Gateway not being able to forward the PUT request to the object service that is served by the datasource.
Can you screenshot your DataSource settings page ? Do you have any “service down” here ?
Otherwise, the best info you could provide would be your “start log” : stop cells, clean your command line, then start and wait for the “Restarting Proxy” log. Copy all the log until that line.
Charles

Hi,

all the data sources services are up, but pydio.gateway.proxy, pydio.gateway.data. pydio.gateway.grpc are down. The log says that it’s because there’s no private ip configured. I looked at the troubleshooting steps here and I have an interface configured under another name and with 127.0.0.1 but I still get the error. Should I configure the internal ip address somewhere? Maybe I made a mistake in the setup?
Is this the screenshot that you mean? (I cut the right column with my external ip)
Thanks again,

Ben

Hi,
I played around a bit more with the interface and understood what you meant, so here it is. I created the buvo datasource. I guess it doesn’t look very encouraging.

Here is the start log until the restart, I removed some lines showing hex addresses, it was too long for a comment:

Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
2021-02-19T10:10:48.394+0100	INFO	pydio.gateway.rest	started
2021-02-19T10:10:48.394+0100	INFO	pydio.grpc.update	started
2021-02-19T10:10:48.394+0100	INFO	pydio.grpc.data.objects	started
2021-02-19T10:10:48.394+0100	INFO	pydio.grpc.data.objects	Starting umbrella service pydio.grpc.data.objects. with sources	{"sources": ["local1"]}
2021-02-19T10:10:48.394+0100	ERROR	pydio.gateway.data	Could not run 	{"error": "No private IP address found, and explicit IP not provided"}
2021-02-19T10:10:48.413+0100	INFO	pydio.grpc.statics	started
2021-02-19T10:10:48.413+0100	INFO	pydio.grpc.data.sync	started
2021-02-19T10:10:48.413+0100	INFO	pydio.grpc.data.sync	Starting umbrella service pydio.grpc.data.sync. with sources	{"sources": ["buvo", "pydiods1", "personal", "cellsdata"]}
2021-02-19T10:10:48.414+0100	INFO	pydio.grpc.docstore	started
2021-02-19T10:10:48.436+0100	INFO	pydio.grpc.log	started
2021-02-19T10:10:48.438+0100	INFO	pydio.grpc.user-key	started
2021-02-19T10:10:48.450+0100	INFO	pydio.grpc.acl	started
2021-02-19T10:10:48.450+0100	INFO	pydio.grpc.meta	started
2021-02-19T10:10:48.451+0100	INFO	pydio.grpc.config	started
2021-02-19T10:10:48.452+0100	INFO	pydio.grpc.token	started
2021-02-19T10:10:48.456+0100	INFO	pydio.grpc.chat	started
2021-02-19T10:10:48.457+0100	INFO	pydio.grpc.policy	started
2021-02-19T10:10:48.462+0100	INFO	pydio.grpc.user-meta	started
2021-02-19T10:10:48.484+0100	INFO	pydio.grpc.oauth	started
Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
2021-02-19T10:10:48.676+0100	INFO	pydio.grpc.data.objects.local1	Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
2021-02-19T10:10:48.678+0100	INFO	pydio.grpc.data.sync.pydiods1	Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
2021-02-19T10:10:48.696+0100	INFO	pydio.grpc.data.sync.buvo	Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
2021-02-19T10:10:48.727+0100	INFO	pydio.grpc.data.objects.local1	started
2021-02-19T10:10:48.730+0100	INFO	pydio.grpc.data.sync.personal	Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
2021-02-19T10:10:48.730+0100	INFO	pydio.grpc.data.objects.local1	Starting local objects service local1 on /var/cells/data
2021-02-19T10:10:48.746+0100	INFO	pydio.grpc.jobs	started
2021-02-19T10:10:48.756+0100	INFO	pydio.grpc.jobs	Setting task 0a717535-e63a-4be2-8da8-9ab8c8a0d43f in error status as it was saved as running
2021-02-19T10:10:48.758+0100	INFO	pydio.grpc.data.sync.cellsdata	Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
2021-02-19T10:10:48.761+0100	INFO	pydio.grpc.data.sync.pydiods1	Sync pydiods1 - Try to contact Objects
2021-02-19T10:10:48.775+0100	INFO	pydio.grpc.data.sync.buvo	Sync buvo - Try to contact Objects
2021-02-19T10:10:48.779+0100	INFO	pydio.grpc.data.sync.personal	Sync personal - Try to contact Objects
2021-02-19T10:10:48.817+0100	INFO	pydio.grpc.data.sync.cellsdata	Sync cellsdata - Try to contact Objects
2021-02-19T10:10:48.865+0100	INFO	pydio.grpc.data.sync.pydiods1	Successfully listed objects from bucket pydiods1
2021-02-19T10:10:48.878+0100	INFO	pydio.grpc.data.sync.buvo	Successfully listed objects from bucket buvo
2021-02-19T10:10:48.882+0100	INFO	pydio.grpc.data.sync.personal	Successfully listed objects from bucket personal
2021-02-19T10:10:49.020+0100	INFO	pydio.grpc.data.sync.cellsdata	Successfully listed objects from bucket cellsdata
2021-02-19T10:10:49.319+0100	INFO	Activating privacy features... done.
2021-02-19T10:10:49.319+0100	INFO	https://<redacted ip>:8080
2021-02-19T10:10:49.320+0100	INFO	pydio.gateway.proxy	started
2021-02-19T10:10:50.393+0100	INFO	pydio.grpc.mailer	Starting mailer with queue 'boltdb'
2021-02-19T10:10:50.394+0100	INFO	pydio.grpc.mailer	Starting mailer with sender 'smtp'
2021-02-19T10:10:50.394+0100	INFO	pydio.grpc.mailer	started
2021-02-19T10:10:50.396+0100	INFO	pydio.grpc.tree	started
2021-02-19T10:10:50.397+0100	INFO	pydio.grpc.data-key	started
2021-02-19T10:10:50.397+0100	INFO	pydio.grpc.workspace	started
2021-02-19T10:10:50.399+0100	INFO	pydio.grpc.role	started
2021-02-19T10:10:50.417+0100	INFO	pydio.grpc.user	started
2021-02-19T10:10:50.502+0100	INFO	pydio.grpc.versions	started
2021-02-19T10:10:50.703+0100	INFO	pydio.gateway.websocket	started
2021-02-19T10:10:50.769+0100	INFO	pydio.grpc.search	started
2021-02-19T10:10:50.771+0100	INFO	pydio.grpc.tasks	started
2021-02-19T10:10:52.395+0100	INFO	pydio.grpc.activity	started
2021-02-19T10:10:52.396+0100	INFO	pydio.grpc.data.index	started
2021-02-19T10:10:52.397+0100	INFO	pydio.grpc.data.index	Starting umbrella service pydio.grpc.data.index. with sources	{"sources": ["buvo", "pydiods1", "personal", "cellsdata"]}
2021-02-19T10:10:52.398+0100	INFO	pydio.web.statics	started
2021-02-19T10:10:52.408+0100	INFO	pydio.test.objects	started
2021-02-19T10:10:52.408+0100	INFO	pydio.gateway.wopi	started
2021-02-19T10:10:52.411+0100	INFO	pydio.gateway.dav	started
2021-02-19T10:10:52.415+0100	INFO	pydio.grpc.timer	Registering Job	{"job": "actions.auth.prune.tokens"}
2021-02-19T10:10:52.416+0100	INFO	pydio.grpc.timer	Registering Job	{"job": "flush-mailer-queue"}
2021-02-19T10:10:52.416+0100	INFO	pydio.grpc.timer	Registering Job	{"job": "internal-prune-jobs"}
2021-02-19T10:10:52.416+0100	INFO	pydio.grpc.timer	Registering Job	{"job": "prune-versions-job"}
2021-02-19T10:10:52.416+0100	INFO	pydio.grpc.timer	Registering Job	{"job": "users-activity-digest"}
2021-02-19T10:10:52.417+0100	INFO	pydio.grpc.timer	started
2021-02-19T10:10:52.420+0100	INFO	pydio.web.oauth	started
2021-02-19T10:10:52.560+0100	INFO	pydio.rest.meta	started
2021-02-19T10:10:52.560+0100	INFO	pydio.rest.mailer	started
2021-02-19T10:10:52.560+0100	INFO	pydio.rest.update	started
2021-02-19T10:10:52.561+0100	INFO	pydio.rest.graph	started
2021-02-19T10:10:52.561+0100	INFO	pydio.rest.search	started
2021-02-19T10:10:52.561+0100	INFO	pydio.rest.role	started
2021-02-19T10:10:52.562+0100	INFO	pydio.rest.tree	started
2021-02-19T10:10:52.562+0100	INFO	pydio.rest.templates	started
2021-02-19T10:10:52.562+0100	INFO	pydio.rest.log	started
2021-02-19T10:10:52.563+0100	INFO	pydio.rest.share	started
2021-02-19T10:10:52.564+0100	INFO	pydio.rest.config	started
2021-02-19T10:10:52.564+0100	INFO	pydio.rest.user	started
2021-02-19T10:10:52.564+0100	INFO	pydio.rest.workspace	started
2021-02-19T10:10:52.565+0100	INFO	pydio.rest.user-meta	started
2021-02-19T10:10:52.565+0100	INFO	pydio.rest.jobs	started
2021-02-19T10:10:52.565+0100	INFO	pydio.rest.acl	started
2021-02-19T10:10:52.566+0100	INFO	pydio.rest.auth	started
2021-02-19T10:10:52.571+0100	INFO	pydio.rest.policy	started
2021-02-19T10:10:52.660+0100	ERROR	pydio.grpc.data.index.pydiods1	runtime/cgo: pthread_create failed: Resource temporarily unavailable
2021-02-19T10:10:52.661+0100	ERROR	pydio.grpc.data.index.personal	runtime/cgo: pthread_create failed: Resource temporarily unavailable
2021-02-19T10:10:52.663+0100	ERROR	pydio.grpc.data.index.personal	SIGABRT: abort
2021-02-19T10:10:52.665+0100	ERROR	pydio.grpc.data.index.personal	PC=0x7fed66694fb7 m=0 sigcode=18446744073709551610
2021-02-19T10:10:52.666+0100	ERROR	pydio.grpc.data.index.personal	
2021-02-19T10:10:52.666+0100	ERROR	pydio.grpc.data.index.personal	goroutine 0 [idle]:
2021-02-19T10:10:52.666+0100	ERROR	pydio.grpc.data.index.personal	runtime: unknown pc 0x7fed66694fb7
2021-02-19T10:10:52.666+0100	ERROR	pydio.grpc.data.index.personal	stack: frame={sp:0x7ffd01139610, fp:0x0} stack=[0x7ffd0093acb8,0x7ffd01139cf0)
<Error in personal with hex>
2021-02-19T10:10:52.669+0100	ERROR	pydio.grpc.data.index.personal	runtime: unknown pc 0x7fed66694fb7
2021-02-19T10:10:52.669+0100	ERROR	pydio.grpc.data.index.personal	stack: frame={sp:0x7ffd01139610, fp:0x0} stack=[0x7ffd0093acb8,0x7ffd01139cf0)
<Error in personal with hex>
2021-02-19T10:10:52.676+0100	ERROR	pydio.grpc.data.index.personal	
2021-02-19T10:10:52.676+0100	ERROR	pydio.grpc.data.index.personal	goroutine 1 [runnable, locked to thread]:
2021-02-19T10:10:52.676+0100	ERROR	pydio.grpc.data.index.personal	runtime.gopark(0x7d9cd18, 0xc0000560c8, 0x170e, 0x2)
2021-02-19T10:10:52.676+0100	ERROR	pydio.grpc.data.index.personal		runtime/proc.go:306 +0xe5
2021-02-19T10:10:52.677+0100	ERROR	pydio.grpc.data.index.personal	runtime.chanrecv(0xc000056070, 0x0, 0xc000000101, 0x1780101)
2021-02-19T10:10:52.677+0100	ERROR	pydio.grpc.data.index.personal		runtime
2021-02-19T10:10:52.677+0100	ERROR	pydio.grpc.data.index.pydiods1	SubProcess was not killed properly: exit status 2
2021-02-19T10:10:52.677+0100	ERROR	pydio.grpc.data.index.pydiods1	Restarting service in 3s...
2021-02-19T10:10:52.666+0100	ERROR	pydio.grpc.data.index.personal	SubProcess was not killed properly: exit status 2
2021-02-19T10:10:52.678+0100	ERROR	pydio.grpc.data.index.personal	Restarting service in 3s...
2021-02-19T10:10:52.671+0100	ERROR	pydio.grpc.data.index.pydiods1	SIGABRT: abort
2021-02-19T10:10:52.678+0100	ERROR	pydio.grpc.data.index.pydiods1	PC=0x7fec4cf1cfb7 m=5 sigcode=18446744073709551610
2021-02-19T10:10:52.678+0100	ERROR	pydio.grpc.data.index.pydiods1	
2021-02-19T10:10:52.679+0100	ERROR	pydio.grpc.data.index.pydiods1	goroutine 0 [idle]:
2021-02-19T10:10:52.679+0100	ERROR	pydio.grpc.data.index.pydiods1	runtime: unknown pc 0x7fec4cf1cfb7
2021-02-19T10:10:52.679+0100	ERROR	pydio.grpc.data.index.pydiods1	stack: frame={sp:0x7fec24bc87f0, fp:0x0} stack=[0x7fec243c9288,0x7fec24bc8e88)
2021-02-19T10:10:52.679+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc86f0:  00007fec24bc8b80  00007fecffffffff 
2021-02-19T10:10:52.679+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8700:  00000000017c2b29 <runtime.pcvalue+361>  0000000000000000 
2021-02-19T10:10:52.679+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8710:  00000000017ddac0 <runtime.goexit+0>  00000000013b496a 
<Error in pydios1 with hex>
2021-02-19T10:10:52.682+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8820:  00007fec24bc8af0  00000000017cacb5 <runtime.gentraceback+4501> 
2021-02-19T10:10:52.682+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8830:  00007fec24bc8a98  0000000000000000 
2021-02-19T10:10:52.682+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8840:  00000000017dda01 <runtime.memhash64+1>  00007fec24bc8910 
<Error in pydios1 with hex>
2021-02-19T10:10:52.683+0100	ERROR	pydio.grpc.data.index.pydiods1	runtime: unknown pc 0x7fec4cf1cfb7
2021-02-19T10:10:52.683+0100	ERROR	pydio.grpc.data.index.pydiods1	stack: frame={sp:0x7fec24bc87f0, fp:0x0} stack=[0x7fec243c9288,0x7fec24bc8e88)
2021-02-19T10:10:52.683+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc86f0:  00007fec24bc8b80  00007fecffffffff 
2021-02-19T10:10:52.683+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8700:  00000000017c2b29 <runtime.pcvalue+361>  0000000000000000 
2021-02-19T10:10:52.683+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8710:  00000000017ddac0 <runtime.goexit+0>  00000000013b496a 
<Error in pydios1 with hex>
2021-02-19T10:10:52.685+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8820:  00007fec24bc8af0  00000000017cacb5 <runtime.gentraceback+4501> 
2021-02-19T10:10:52.685+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8830:  00007fec24bc8a98  0000000000000000 
2021-02-19T10:10:52.685+0100	ERROR	pydio.grpc.data.index.pydiods1	00007fec24bc8840:  00000000017dda01 <runtime.memhash64+1>  00007fec24bc8910 
<Error in pydios1 with hex>
2021-02-19T10:10:52.687+0100	ERROR	pydio.grpc.data.index.pydiods1	goroutine
2021-02-19T10:10:52.690+0100	INFO	pydio.grpc.data.index.buvo	Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
2021-02-19T10:10:52.743+0100	INFO	pydio.grpc.data.index.buvo	started
2021-02-19T10:10:52.759+0100	INFO	pydio.grpc.data.index.cellsdata	Warning: no private IP detected for binding broker. Will bind to <redacted ip>, which may give public access to the broker.
2021-02-19T10:10:52.826+0100	INFO	pydio.grpc.data.index.cellsdata	started
2021-02-19T10:10:54.393+0100	INFO	pydio.rest.frontend	started
2021-02-19T10:10:54.395+0100	INFO	pydio.rest.activity	started
2021-02-19T10:10:55.121+0100	INFO	pydio.grpc.data.sync.cellsdata	started
2021-02-19T10:10:55.121+0100	INFO	pydio.grpc.tasks	Run Job resync-ds-cellsdata on demand
2021-02-19T10:10:55.180+0100	INFO	pydio.grpc.data.sync.buvo	started
2021-02-19T10:10:55.180+0100	INFO	pydio.grpc.tasks	Run Job resync-ds-buvo on demand
2021-02-19T10:10:55.228+0100	INFO	pydio.grpc.data.sync.cellsdata	Got Stats for s3://<redacted ip>:39628/cellsdata	{"stats": {"HasChildrenInfo":false,"HasSizeInfo":false,"Size":0,"Folders":0,"Files":0}}
2021-02-19T10:10:55.229+0100	INFO	pydio.grpc.data.sync.cellsdata	Got Stats for index://cellsdata	{"stats": {"HasChildrenInfo":false,"HasSizeInfo":false,"Size":0,"Folders":0,"Files":0}}
2021-02-19T10:10:55.229+0100	INFO	pydio.grpc.data.sync.cellsdata	Listing all S3 objects for path	{"bucket": "cellsdata", "path": ""}
2021-02-19T10:10:55.235+0100	INFO	pydio.grpc.data.sync.cellsdata	S3 Walk Operation + Stats took	{"d": "6.29557ms"}
2021-02-19T10:10:55.235+0100	INFO	pydio.grpc.data.sync.cellsdata	Diff Stats	{"s": {"EndpointLeft":"s3://<redacted ip>:39628/cellsdata","EndpointRight":"index://cellsdata","conflicts":0,"missingLeft":0,"missingRight":0}}
2021-02-19T10:10:55.235+0100	INFO	pydio.grpc.data.sync.cellsdata	Finished analyzing nodes	{"i": 14}
2021-02-19T10:10:55.236+0100	INFO	pydio.grpc.data.sync.cellsdata	Sending unidirectional patch	{"patch": {"Source":"s3://<redacted ip>:39628/cellsdata","Target":"index://cellsdata","Type":"TreePatch"}}
2021-02-19T10:10:55.236+0100	INFO	pydio.grpc.data.sync.cellsdata	Filtering TreePatch took 2.868µs	{"duration": "2.868µs", "source": "s3://<redacted ip>:39628/cellsdata", "target": "index://cellsdata"}
2021-02-19T10:10:55.237+0100	INFO	pydio.grpc.data.sync.cellsdata	Empty Patch : nothing to do
2021-02-19T10:10:55.327+0100	INFO	pydio.grpc.data.sync.buvo	Got Stats for index://buvo	{"stats": {"HasChildrenInfo":false,"HasSizeInfo":false,"Size":0,"Folders":0,"Files":0}}
2021-02-19T10:10:55.328+0100	INFO	pydio.grpc.data.sync.buvo	Create Hidden File for folder	{"path": ".pydio"}
2021-02-19T10:10:55.893+0100	ERROR	pydio.grpc.data.index.personal	runtime/cgo: pthread_create failed: Resource temporarily unavailable
2021-02-19T10:10:55.894+0100	ERROR	pydio.grpc.data.index.pydiods1	runtime/cgo: pthread_create failed: Resource temporarily unavailable
2021-02-19T10:10:55.895+0100	ERROR	pydio.grpc.data.index.personal	SIGABRT: abort
2021-02-19T10:10:55.896+0100	ERROR	pydio.grpc.data.index.personal	PC=0x7f465ef40fb7 m=0 sigcode=18446744073709551610
2021-02-19T10:10:55.896+0100	ERROR	pydio.grpc.data.index.personal	
2021-02-19T10:10:55.896+0100	ERROR	pydio.grpc.data.index.personal	goroutine 0 [idle]:
2021-02-19T10:10:55.896+0100	ERROR	pydio.grpc.data.index.personal	runtime: unknown pc 0x7f465ef40fb7
2021-02-19T10:10:55.896+0100	ERROR	pydio.grpc.data.index.personal	stack: frame={sp:0x7fff778044c0, fp:0x0} stack=[0x7fff77005a58,0x7fff77804a90)
2021-02-19T10:10:55.896+0100	ERROR	pydio.grpc.data.index.personal	00007fff778043c0:  00007fff77804438  00000000017df85e <runtime.callCgoMmap+62> 
<Error in personal service with hex>
2021-02-19T10:10:55.899+0100	ERROR	pydio.grpc.data.index.personal	00007fff778044f0:  000000000179714d <runtime.(*pageAlloc).update+621>  00007f465f854c00 
<Error in personal service with hex>
2021-02-19T10:10:55.899+0100	ERROR	pydio.grpc.data.index.personal	00007fff77804530:  000000000179714d <runtime.(*pageAlloc).update+621>  0000000000000012 
<Error in personal service with hex>
2021-02-19T10:10:55.897+0100	ERROR	pydio.grpc.data.index.personal	SubProcess was not killed properly: exit status 2
2021-02-19T10:10:55.900+0100	ERROR	pydio.grpc.data.index.personal	Restarting service in 3s...
<Error in personal service with hex> 
2021-02-19T10:10:55.901+0100	ERROR	pydio.grpc.data.index.personal	runtime: unknown pc 0x7f465ef40fb7
2021-02-19T10:10:55.901+0100	ERROR	pydio.grpc.data.index.personal	stack: frame={sp:0x7fff778044c0, fp:0x0} stack=[0x7fff77005a58,0x7fff77804a90)
2021-02-19T10:10:55.901+0100	ERROR	pydio.grpc.data.index.personal	00007fff778043c0:  00007fff77804438  00000000017df85e <runtime.callCgoMmap+62> 
<Error in personal service with hex>
2021-02-19T10:10:55.904+0100	ERROR	pydio.grpc.data.index.personal	00007fff778044e0:  00007fff778045a8  00007fff778045b0 
2021-02-19T10:10:55.904+0100	ERROR	pydio.grpc.data.index.personal	00007fff778044f0:  000000000179714d <runtime.(*pageAlloc).update+621>  00007f465f854c00 
<Error in personal service with hex>
2021-02-19T10:10:55.905+0100	ERROR	pydio.grpc.data.index.personal	00007fff77804530:  000000000179714d <runtime.(*pageAlloc).update+621>  0000000000000012 
<Error in personal service with hex>
2021-02-19T10:10:55.907+0100	ERROR	pydio.grpc.data.index.personal	
2021-02-19T10:10:55.907+0100	ERROR	pydio.grpc.data.index.personal	gorou
2021-02-19T10:10:55.903+0100	ERROR	pydio.grpc.data.index.pydiods1	SIGABRT: abort
2021-02-19T10:10:55.907+0100	ERROR	pydio.grpc.data.index.pydiods1	PC=0x7fe8e8cecfb7 m=0 sigcode=18446744073709551610
2021-02-19T10:10:55.907+0100	ERROR	pydio.grpc.data.index.pydiods1	
2021-02-19T10:10:55.908+0100	ERROR	pydio.grpc.data.index.pydiods1	goroutine 0 [idle]:
2021-02-19T10:10:55.908+0100	ERROR	pydio.grpc.data.index.pydiods1	runtime: unknown pc 0x7fe8e8cecfb7
2021-02-19T10:10:55.908+0100	ERROR	pydio.grpc.data.index.pydiods1	stack: frame={sp:0x7ffc8674f3f0, fp:0x0} stack=[0x7ffc85f50988,0x7ffc8674f9c0)
2021-02-19T10:10:55.908+0100	ERROR	pydio.grpc.data.index.pydiods1	00007ffc8674f2f0:  00007ffc8674f368  00000000017df85e <runtime.callCgoMmap+62> 
<Error in pydios1 service with hex>
2021-02-19T10:10:55.912+0100	ERROR	pydio.grpc.data.index.pydiods1	SubProcess was not killed properly: exit status 2
2021-02-19T10:10:55.914+0100	ERROR	pydio.grpc.data.index.pydiods1	Restarting service in 3s...
2021-02-19T10:10:58.925+0100	INFO	pydio.gateway.proxy	Restarting proxy	{"caddyfile": "\n\n\n\n\n\n\n<redacted ip>:8080 {\n\t\n\n\t\n\n\tproxy /a  <redacted ip>:39999 {\n\t\twithout /a\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\tproxy /oidc <redacted ip>:44706 {\n\t\tinsecure_skip_verify\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\tproxy /io   PENDING {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Content-Security-Policy \"script-src 'none'\"\n\t\theader_downstream X-Content-Security-Policy \"sandbox\"\n\t}\n\tproxy /data PENDING {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Content-Security-Policy \"script-src 'none'\"\n\t\theader_downstream X-Content-Security-Policy \"sandbox\"\n\t}\n\tproxy /ws   <redacted ip>:35384 {\n\t\twebsocket\n\t\twithout /ws\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\tproxy /dav <redacted ip>:41823 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Content-Security-Policy \"script-src 'none'\"\n\t\theader_downstream X-Content-Security-Policy \"sandbox\"\n\t}\n\t\n\n\tproxy /plug/ <redacted ip>:34057 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Cache-Control \"public, max-age=31536000\"\n\t}\n\tproxy /public/ <redacted ip>:34057 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\tproxy /public/plug/ <redacted ip>:34057 {\n\t\twithout /public\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Cache-Control \"public, max-age=31536000\"\n\t}\n\tproxy /user/reset-password/ <redacted ip>:34057 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\t\n\tproxy /robots.txt <redacted ip>:34057 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\t\n\tproxy /login <redacted ip>:34057/gui {\n\t\twithout /login\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\n\n\tproxy /grpc https://PENDING {\n\t\twithout /grpc\n\t\tinsecure_skip_verify\n\t}\n\t\n\trewrite {\n\t\tif {>Content-type} has \"application/grpc\"\n\t\tto /grpc/{path}\n\t}\n\n\n\tredir 302 {\n\t\tif {>Content-type} not_has \"application/grpc\"\n\t\tif {path} is /\n\t\t/ /login\n\t}\n\t\n\t\n\t\n        proxy /wopi/ <redacted ip>:44018 {\n            transparent\n\t\t\theader_upstream Host {host}\n\t\t\theader_upstream X-Real-IP {remote}\n\t\t\theader_upstream X-Forwarded-Proto {scheme}\n        }\n\n        proxy /loleaflet/ https://localhost:9980/loleaflet {\n            transparent\n            insecure_skip_verify\n            without /loleaflet/\n        }\n\n        proxy /hosting/discovery https://localhost:9980/hosting/discovery {\n            transparent\n            insecure_skip_verify\n            without /hosting/discovery\n        }\n\n        proxy /lool/ https://localhost:9980/lool/ {\n            transparent\n            insecure_skip_verify\n            websocket\n            without /lool/\n        }\n    \n\t\n\t\n\trewrite {\n\t\tif {path} not_starts_with \"/a/\"\n\t\tif {path} not_starts_with \"/oidc/\"\n\t\tif {path} not_starts_with \"/io\"\n\t\tif {path} not_starts_with \"/data\"\n\t\tif {path} not_starts_with \"/ws/\"\n\t\tif {path} not_starts_with \"/plug/\"\n\t\tif {path} not_starts_with \"/dav\"\n\t\t\n\t\tif {path} not_starts_with \"/wopi/\"\n\t\t\n\t\tif {path} not_starts_with \"/loleaflet/\"\n\t\t\n\t\tif {path} not_starts_with \"/hosting/discovery\"\n\t\t\n\t\tif {path} not_starts_with \"/lool/\"\n\t\t\n\t\tif {path} not_starts_with \"/public/\"\n\t\tif {path} not_starts_with \"/user/reset-password\"\n\t\tif {path} not_starts_with \"/robots.txt\"\n\t\tto {path} {path}/ /login\n\t}\n\n\troot \"/2c669532-d4ec-4fa6-9ca9-dcce68693cc7\"\n\n\t\n\ttls \"/var/cells/certs/59d712d4f41dd1273062d6068134f939.pem\" \"/var/cells/certs/59d712d4f41dd1273062d6068134f939-key.pem\"\n\terrors \"/var/cells/logs/caddy_errors.log\"\n}\n\n\n\n\n\t"}

Thanks a lot,

Ben

Hello,
I solved the binding broker problem, I realised that the 172.0.0.1 network is configured with 255.255.255.255 mask so it makes sense that it didn’t get an address. I configured a 10.0.0.1 virtual network on the same interface with the right mask and it binds to it.
This error pops up when I’m in the data source section:
image .
My UFW is not active so I don’t see what could block the connection.

Now the services related to the storage fail. I’ll post the errors from the log here (they repeat themselves several times):

2021-02-22T13:47:56.892+0100	INFO	pydio.grpc.data.sync.cellsdata	Sync cellsdata - Try to contact Objects
2021-02-22T13:47:56.937+0100	INFO	pydio.grpc.data.sync.pydiods1	Sync pydiods1 - Try to contact Objects
2021-02-22T13:47:56.960+0100	INFO	pydio.grpc.data.objects.local1	started
2021-02-22T13:47:56.962+0100	INFO	pydio.grpc.data.objects.local1	Starting local objects service local1 on /var/cells/data
2021-02-22T13:47:56.964+0100	INFO	pydio.grpc.jobs	started
2021-02-22T13:47:56.968+0100	INFO	[pydio.grpc.log] Cannot open bleve index /var/cells/services/pydio.grpc.jobs/tasklogs.bleve cannot create new index, path already exists
2021-02-22T13:47:57.016+0100	INFO	pydio.grpc.data.sync.buvo	Sync buvo - Try to contact Objects
2021-02-22T13:47:57.085+0100	INFO	pydio.grpc.data.sync.personal	Sync personal - Try to contact Objects
2021-02-22T13:47:57.220+0100	WARN	pydio.grpc.data.sync.buvo	Cannot contact s3 service (bucket buvo), will retry in 4s	{"error": "Server not initialized, please try again."}
2021-02-22T13:47:57.222+0100	WARN	pydio.grpc.data.sync.personal	Cannot contact s3 service (bucket personal), will retry in 4s	{"error": "Server not initialized, please try again."}
2021-02-22T13:47:57.550+0100	INFO	Activating privacy features... done.
2021-02-22T13:47:57.551+0100	INFO	https://0.0.0.0:8080
...
2021-02-22T13:48:05.095+0100	WARN	pydio.grpc.data.sync.cellsdata	Cannot contact s3 service (bucket cellsdata), will retry in 4s	{"error": "Server not initialized, please try again."}
2021-02-22T13:48:05.139+0100	INFO	pydio.grpc.data.sync.pydiods1	Sync pydiods1 - Try to contact Objects
2021-02-22T13:48:05.141+0100	WARN	pydio.grpc.data.sync.pydiods1	Cannot contact s3 service (bucket pydiods1), will retry in 4s	{"error": "Server not initialized, please try again."}
2021-02-22T13:48:05.220+0100	INFO	pydio.grpc.data.sync.buvo	Sync buvo - Try to contact Objects
2021-02-22T13:48:05.222+0100	WARN	pydio.grpc.data.sync.buvo	Cannot contact s3 service (bucket buvo), will retry in 4s	{"error": "Server not initialized, please try again."}
2021-02-22T13:48:05.222+0100	INFO	pydio.grpc.data.sync.personal	Sync personal - Try to contact Objects
2021-02-22T13:48:05.228+0100	WARN	pydio.grpc.data.sync.personal	Cannot contact s3 service (bucket personal), will retry in 4s	{"error": "Server not initialized, please try again."}
...
2021-02-22T13:48:08.315+0100	ERROR	pydio.grpc.data.index.pydiods1	goroutine 1 [chan receive, locked to thread]:
2021-02-22T13:48:08.315+0100	ERROR	pydio.grpc.data.index.pydiods1	text/template/parse.(*lexer).nextItem(...)
2021-02-22T13:48:08.315+0100	ERROR	pydio.grpc.data.index.pydiods1		text/template/parse/lex.go:195
2021-02-22T13:48:08.315+0100	ERROR	pydio.grpc.data.index.pydiods1	t
....
2021-02-22T13:48:08.315+0100	ERROR	pydio.grpc.data.index.pydiods1	goroutine 1 [chan receive, locked to thread]:
2021-02-22T13:48:08.315+0100	ERROR	pydio.grpc.data.index.pydiods1	text/template/parse.(*lexer).nextItem(...)
2021-02-22T13:48:08.315+0100	ERROR	pydio.grpc.data.index.pydiods1		text/template/parse/lex.go:195
2021-02-22T13:48:08.315+0100	ERROR	pydio.grpc.data.index.pydiods1	t
...
2021-02-22T13:48:08.827+0100	ERROR	pydio.grpc.data.index.cellsdata	SubProcess was not killed properly: exit status 2
2021-02-22T13:48:08.832+0100	ERROR	pydio.grpc.data.index.cellsdata	Restarting service in 3s...
2021-02-22T13:48:09.092+0100	INFO	pydio.grpc.data.sync.cellsdata	Sync cellsdata - Try to contact Objects
2021-02-22T13:48:09.094+0100	WARN	pydio.grpc.data.sync.cellsdata	Cannot contact s3 service (bucket cellsdata), will retry in 4s	{"error": "Server not initialized, please try again."}
2021-02-22T13:48:09.139+0100	INFO	pydio.grpc.data.sync.pydiods1	Sync pydiods1 - Try to contact Objects
2021-02-22T13:48:09.141+0100	WARN	pydio.grpc.data.sync.pydiods1	Cannot contact s3 service (bucket pydiods1), will retry in 4s	{"error": "Server not initialized, please try again."}
2021-02-22T13:48:09.220+0100	INFO	pydio.grpc.data.sync.buvo	Sync buvo - Try to contact Objects
2021-02-22T13:48:09.222+0100	WARN	pydio.grpc.data.sync.buvo	Cannot contact s3 service (bucket buvo), will retry in 4s	{"error": "Server not initialized, please try again."}
2021-02-22T13:48:09.222+0100	INFO	pydio.grpc.data.sync.personal	Sync personal - Try to contact Objects
2021-02-22T13:48:09.224+0100	WARN	pydio.grpc.data.sync.personal	Cannot contact s3 service (bucket personal), will retry in 4s	{"error": "Server not initialized, please try again."}
2021-02-22T13:48:09.254+0100	INFO	pydio.gateway.proxy	Restarting proxy	{"caddyfile": "\n\n\n\n\n\n\n0.0.0.0:8080 {\n\t\n\n\t\n\n\tproxy /a  10.0.0.1:38106 {\n\t\twithout /a\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\tproxy /oidc 10.0.0.1:33300 {\n\t\tinsecure_skip_verify\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\tproxy /io   10.0.0.1:45840 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Content-Security-Policy \"script-src 'none'\"\n\t\theader_downstream X-Content-Security-Policy \"sandbox\"\n\t}\n\tproxy /data 10.0.0.1:45840 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Content-Security-Policy \"script-src 'none'\"\n\t\theader_downstream X-Content-Security-Policy \"sandbox\"\n\t}\n\tproxy /ws   10.0.0.1:44757 {\n\t\twebsocket\n\t\twithout /ws\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\tproxy /dav 10.0.0.1:38401 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Content-Security-Policy \"script-src 'none'\"\n\t\theader_downstream X-Content-Security-Policy \"sandbox\"\n\t}\n\t\n\n\tproxy /plug/ 10.0.0.1:40817 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Cache-Control \"public, max-age=31536000\"\n\t}\n\tproxy /public/ 10.0.0.1:40817 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\tproxy /public/plug/ 10.0.0.1:40817 {\n\t\twithout /public\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t\theader_downstream Cache-Control \"public, max-age=31536000\"\n\t}\n\tproxy /user/reset-password/ 10.0.0.1:40817 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\t\n\tproxy /robots.txt 10.0.0.1:40817 {\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\t\n\tproxy /login 10.0.0.1:40817/gui {\n\t\twithout /login\n\t\theader_upstream Host {host}\n\t\theader_upstream X-Real-IP {remote}\n\t\theader_upstream X-Forwarded-Proto {scheme}\n\t}\n\n\n\tproxy /grpc https://10.0.0.1:45495 {\n\t\twithout /grpc\n\t\tinsecure_skip_verify\n\t}\n\t\n\trewrite {\n\t\tif {>Content-type} has \"application/grpc\"\n\t\tto /grpc/{path}\n\t}\n\n\n\tredir 302 {\n\t\tif {>Content-type} not_has \"application/grpc\"\n\t\tif {path} is /\n\t\t/ /login\n\t}\n\t\n\t\n\t\n        proxy /wopi/ 10.0.0.1:45404 {\n            transparent\n\t\t\theader_upstream Host {host}\n\t\t\theader_upstream X-Real-IP {remote}\n\t\t\theader_upstream X-Forwarded-Proto {scheme}\n        }\n\n        proxy /loleaflet/ https://localhost:9980/loleaflet {\n            transparent\n            insecure_skip_verify\n            without /loleaflet/\n        }\n\n        proxy /hosting/discovery https://localhost:9980/hosting/discovery {\n            transparent\n            insecure_skip_verify\n            without /hosting/discovery\n        }\n\n        proxy /lool/ https://localhost:9980/lool/ {\n            transparent\n            insecure_skip_verify\n            websocket\n            without /lool/\n        }\n    \n\t\n\t\n\trewrite {\n\t\tif {path} not_starts_with \"/a/\"\n\t\tif {path} not_starts_with \"/oidc/\"\n\t\tif {path} not_starts_with \"/io\"\n\t\tif {path} not_starts_with \"/data\"\n\t\tif {path} not_starts_with \"/ws/\"\n\t\tif {path} not_starts_with \"/plug/\"\n\t\tif {path} not_starts_with \"/dav\"\n\t\t\n\t\tif {path} not_starts_with \"/wopi/\"\n\t\t\n\t\tif {path} not_starts_with \"/loleaflet/\"\n\t\t\n\t\tif {path} not_starts_with \"/hosting/discovery\"\n\t\t\n\t\tif {path} not_starts_with \"/lool/\"\n\t\t\n\t\tif {path} not_starts_with \"/public/\"\n\t\tif {path} not_starts_with \"/user/reset-password\"\n\t\tif {path} not_starts_with \"/robots.txt\"\n\t\tto {path} {path}/ /login\n\t}\n\n\troot \"/646fbc6a-36d1-44df-aef0-b0bc96d54e8b\"\n\n\t\n\ttls \"/var/cells/certs/bdb498058625f90d79c2562d22fe9918.pem\" \"/var/cells/certs/bdb498058625f90d79c2562d22fe9918-key.pem\"\n\terrors \"/var/cells/logs/caddy_errors.log\"\n}\n\n\n\n\n\t"}
2021-02-22T13:48:09.756+0100	INFO	pydio.gateway.proxy	Restart done
2021-02-22T13:48:11.564+0100	ERROR	pydio.grpc.data.index.pydiods1	runtime/cgo: pthread_create failed: Resource temporarily unavailable
2021-02-22T13:48:11.572+0100	ERROR	pydio.grpc.data.index.pydiods1	SIGABRT: abort

Thanks,

Ben

Hey @benw

We had another look at your thread, we still miss some pieces of information:

  • How much RAM do you have (pb we are speaking about are often triggered by lack of RAM, and you only gave info about your proc)?
  • Did you build the binary by yourself or retrieve it from the dowload server? Could you give the out put of the ./cells version command ?
  • Could you confirm, you made a “direct to disk” install (not via docker or so)?
  • Are you sure you don’t have some zombie processes (ps -aux | grep cells) before you start Cells.

Thus said:

I played around a bit more with the interface and understood what you meant, so here it is. I created the buvo datasource. I guess it doesn’t look very encouraging.

I don’t understand why you say “it is not encouraging”: in the screenshot list the buvo DS seems to be OK. Could you create a workspace in it and perform an upload ?

After you defined you additional private IP address, when you restarted your server, did you see some additionnal:

Warning: no private IP detected for binding broker. 
Will bind to <redacted ip>, which may give public access to the broker.

errors in your log when you restarted your server ?

If you are still stuck, could you provide your pydio.json so that we can have a look ?

@bsinou,

  • I have 32GB of RAM
  • I retrieved cells from the download server, the output of cells version is:
 Version: 	2.2.0
 Built: 	28 Jan 21 08:48 +0000
 Git commit: 	5435dca7487e314483e2c6e2e3cf9ae7f6bf24be
 OS/Arch: 	linux/amd64
 Go version: 	go1.15.5
  • I am using a virtual server from Strato, is this considered on-disk? I followed the installation instructions from the Pydio website.
  • I get this right after boot from the dedicated pydio user:
$ ps -aux | grep cells
pydio      708  0.0  0.0  13488  1020 pts/1    S+   18:33   0:00 grep cells
  • I say it’s not encouraging because most services are down and I’m just generally pessimistic. Now that I’ve restarted, the buvo DS is down (Index down - Sync down) but cellsdata is up and I can upload to it. I tried to restart cells to check (Exited it with ctrl+c and waited for it to shut down) and now I get from the dedicated user:
$ ps -aux | grep cells
pydio      753  0.3  0.2 1765308 81828 pts/1   Sl   18:37   0:01 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.tasks
pydio      754  0.3  0.2 1765308 85172 pts/1   Sl   18:37   0:01 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.gateway.websocket
pydio      765  0.4  0.2 1765564 85976 pts/1   Sl   18:37   0:01 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.data.sync.cellsdata
pydio      766  0.2  0.2 1691832 79956 pts/1   Sl   18:37   0:00 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.data.sync.buvo
pydio      808  0.3  0.2 1765820 81988 pts/1   Sl   18:37   0:01 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.data.objects.local1
pydio      809  0.2  0.2 1765052 79704 pts/1   Sl   18:37   0:00 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.data.sync.pydiods1
pydio      824  0.2  0.2 1765496 78144 pts/1   Sl   18:37   0:00 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.search
pydio      893  0.2  0.2 1691064 76200 pts/1   Sl   18:37   0:00 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.data.index.pydiods1
pydio      894  0.3  0.2 1765820 82796 pts/1   Sl   18:37   0:01 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.data.index.cellsdata
pydio      896  0.2  0.2 1765308 75964 pts/1   Sl   18:37   0:00 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.data.index.personal
pydio     1889  1.9  0.2 1617844 70960 pts/1   Sl   18:42   0:00 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.gateway.websocket
pydio     2144  1.8  0.2 1691320 70908 pts/1   Sl   18:43   0:00 cells start --fork --registry nats --registry_address :4222 --registry_cluster_address  --registry_cluster_routes  --broker nats --broker_address :4222 pydio.grpc.data.sync.buvo
pydio     2292  0.0  0.0  13488  1096 pts/1    S+   18:43   0:00 grep cells

I restarted the server with sudo shutdown -r 0 and tried to run cells again and got the beginning of the starting commands. After he tries to start pydio.grpc.data.index.pydios1 he gives a runtime/cgo: pthread_create failed: Resource temporarily unavailable I did pkill -9 cells and pkill -9 pydio and then I could start cells again.

  • No, after I defined the private IP address I did not get the broker error.

Here is the pydio.json:

{
  "databases": {
    "b458266e855a652b4bc781f3de0a58e8b3117bf6": {
      "driver": "mysql",
      "dsn": "pydio:B!53qLXBiN6QSmNZ2@tcp(localhost:3306)/cells?parseTime=true"
    },
    "pydio.grpc.activity": {
      "driver": "boltdb",
      "dsn": "/var/cells/services/pydio.grpc.activity/activities.db"
    },
    "pydio.grpc.chat": {
      "driver": "boltdb",
      "dsn": "/var/cells/services/pydio.grpc.chat/chat.db"
    }
  },
  "defaults": {
    "database": {
      "$ref": "#/databases/b458266e855a652b4bc781f3de0a58e8b3117bf6"
    },
    "datasource": "pydiods1",
    "personalTokens": {
      "secureKey": "<redacted>"
    },
    "sites": [
      {
        "Binds": [
          "0.0.0.0:8080"
        ],
        "TLSConfig": {
          "SelfSigned": {}
        }
      }
    ],
    "update": {
      "publicKey": "-----BEGIN PUBLIC KEY-----\n<redacted>\n-----END PUBLIC KEY-----",
      "updateUrl": "https://updatecells.pydio.com/"
    }
  },
  "frontend": {
    "plugin": {
      "core.pydio": {
        "APPLICATION_TITLE": "Pydio Cells",
        "DEFAULT_LANGUAGE": "en"
      },
      "editor.libreoffice": {
        "LIBREOFFICE_HOST": "localhost",
        "LIBREOFFICE_PORT": "9980",
        "LIBREOFFICE_SSL": true
      }
    },
    "secureHeaders": {
      "X-XSS-Protection": "1; mode=block"
    },
    "session": {
      "secureKey": "<redacted>"
    },
    "versionSeed": "d87b6591-960f-425f-b483-c7e910d2e2c4"
  },
  "ports": {
    "nats": 4222,
    "pydio.gateway.rest": 39319
  },
  "services": {
    "pydio.docstore-binaries": {
      "bucket": "binaries",
      "datasource": "default"
    },
    "pydio.grpc.acl": {
      "dsn": "default"
    },
    "pydio.grpc.changes": {
      "dsn": "default"
    },
    "pydio.grpc.config": {
      "dsn": "default"
    },
    "pydio.grpc.data-key": {
      "dsn": "default"
    },
    "pydio.grpc.data.index": {
      "sources": [
        "cellsdata",
        "pydiods1",
        "personal",
        "buvo",
        "updated:1613995538"
      ]
    },
    "pydio.grpc.data.index.buvo": {
      "dsn": "default",
      "tables": {
        "commits": "data_buvo_commits",
        "nodes": "data_buvo_nodes",
        "tree": "data_buvo_tree"
      }
    },
    "pydio.grpc.data.index.cellsdata": {
      "dsn": "default",
      "tables": {
        "commits": "data_cellsdata_commits",
        "nodes": "data_cellsdata_nodes",
        "tree": "data_cellsdata_tree"
      }
    },
    "pydio.grpc.data.index.personal": {
      "dsn": "default",
      "tables": {
        "commits": "data_personal_commits",
        "nodes": "data_personal_nodes",
        "tree": "data_personal_tree"
      }
    },
    "pydio.grpc.data.index.pydiods1": {
      "dsn": "default",
      "tables": {
        "commits": "data_pydiods1_commits",
        "nodes": "data_pydiods1_nodes",
        "tree": "data_pydiods1_tree"
      }
    },
    "pydio.grpc.data.objects": {
      "sources": [
        "local1",
        "updated:1613995538"
      ]
    },
    "pydio.grpc.data.objects.local1": {
      "ApiKey": "<redacted>",
      "ApiSecret": "<redacted>",
      "LocalFolder": "/var/cells/data",
      "Name": "local1",
      "RunningPort": 35805
    },
    "pydio.grpc.data.sync": {
      "sources": [
        "cellsdata",
        "pydiods1",
        "personal",
        "buvo",
        "updated:1613995538"
      ]
    },
    "pydio.grpc.data.sync.buvo": {
      "ApiKey": "<redacted>",
      "ApiSecret": "<redacted>",
      "Name": "buvo",
      "ObjectsBucket": "buvo",
      "ObjectsServiceName": "local1",
      "StorageConfiguration": {
        "folder": "/var/cells/data/buvo",
        "normalize": "false"
      }
    },
    "pydio.grpc.data.sync.cellsdata": {
      "ApiKey": "<redacted>",
      "ApiSecret": "<redacted>",
      "Name": "cellsdata",
      "ObjectsBucket": "cellsdata",
      "ObjectsPort": 35805,
      "ObjectsServiceName": "local1",
      "StorageConfiguration": {
        "folder": "/var/cells/data/cellsdata",
        "normalize": "false"
      }
    },
    "pydio.grpc.data.sync.personal": {
      "ApiKey": "<redacted>",
      "ApiSecret": "<redacted>",
      "Name": "personal",
      "ObjectsBucket": "personal",
      "ObjectsPort": 35805,
      "ObjectsServiceName": "local1",
      "StorageConfiguration": {
        "folder": "/var/cells/data/personal",
        "normalize": "false"
      }
    },
    "pydio.grpc.data.sync.pydiods1": {
      "ApiKey": "<redacted>",
      "ApiSecret": "<redacted>",
      "Name": "pydiods1",
      "ObjectsBucket": "pydiods1",
      "ObjectsPort": 35805,
      "ObjectsServiceName": "local1",
      "StorageConfiguration": {
        "folder": "/var/cells/data/pydiods1",
        "normalize": "false"
      }
    },
    "pydio.grpc.mailer": {
      "queue": {
        "@value": "boltdb"
      },
      "sender": {
        "@value": "smtp",
        "host": "my.smtp.server",
        "password": "",
        "port": 465,
        "user": "name"
      }
    },
    "pydio.grpc.meta": {
      "dsn": "default"
    },
    "pydio.grpc.policy": {
      "dsn": "databaseParseTime"
    },
    "pydio.grpc.role": {
      "dsn": "default"
    },
    "pydio.grpc.search": {
      "basenameAnalyzer": "standard",
      "contentAnalyzer": "en",
      "indexContent": false
    },
    "pydio.grpc.tasks": {
      "fork": true
    },
    "pydio.grpc.tree": {
      "dsn": "default"
    },
    "pydio.grpc.update": {
      "channel": "stable"
    },
    "pydio.grpc.user": {
      "dsn": "default",
      "tables": {
        "attributes": "idm_user_attributes",
        "nodes": "idm_user_nodes",
        "roles": "idm_user_roles",
        "tree": "idm_user_tree"
      }
    },
    "pydio.grpc.user-key": {
      "dsn": "default"
    },
    "pydio.grpc.user-meta": {
      "dsn": "default"
    },
    "pydio.grpc.workspace": {
      "dsn": "default"
    },
    "pydio.thumbs_store": {
      "bucket": "thumbs",
      "datasource": "default"
    },
    "pydio.versions-store": {
      "bucket": "versions",
      "datasource": "default"
    },
    "pydio.web.oauth": {
      "connectors": [
        {
          "id": "pydio",
          "name": "Pydio Cells",
          "type": "pydio"
        }
      ],
      "cors": {
        "public": {
          "allowedOrigins": "*"
        }
      },
      "insecureRedirects": [
        "#insecure_binds...#/auth/callback"
      ],
      "secret": "<redacted>",
      "staticClients": [
        {
          "client_id": "cells-frontend",
          "client_name": "CellsFrontend Application",
          "grant_types": [
            "authorization_code",
            "refresh_token"
          ],
          "post_logout_redirect_uris": [
            "#default_bind#/auth/logout"
          ],
          "redirect_uris": [
            "#default_bind#/auth/callback"
          ],
          "response_types": [
            "code",
            "token",
            "id_token"
          ],
          "revokeRefreshTokenAfterInactivity": "2h",
          "scope": "openid email profile pydio offline"
        },
        {
          "client_id": "cells-sync",
          "client_name": "CellsSync Application",
          "grant_types": [
            "authorization_code",
            "refresh_token"
          ],
          "redirect_uris": [
            "http://localhost:3000/servers/callback",
            "http://localhost:[3636-3666]/servers/callback"
          ],
          "response_types": [
            "code",
            "token",
            "id_token"
          ],
          "scope": "openid email profile pydio offline"
        },
        {
          "client_id": "cells-client",
          "client_name": "Cells Client CLI Tool",
          "grant_types": [
            "authorization_code",
            "refresh_token"
          ],
          "redirect_uris": [
            "http://localhost:3000/servers/callback",
            "#binds...#/oauth2/oob"
          ],
          "response_types": [
            "code",
            "token",
            "id_token"
          ],
          "scope": "openid email profile pydio offline"
        },
        {
          "client_id": "cells-mobile",
          "client_name": "Mobile Applications",
          "grant_types": [
            "authorization_code",
            "refresh_token"
          ],
          "redirect_uris": [
            "cellsauth://callback"
          ],
          "response_types": [
            "code",
            "token",
            "id_token"
          ],
          "scope": "openid email profile pydio offline"
        }
      ]
    }
  },
  "version": "2.2.0"
}

Thank you,

Ben

@benw

  • I have 32GB of RAM

8 CPU and 32 GB RAM are more than enough to run Cells (that is, if you have a reasonable number of users and if Cells does not share the host with many other apps)

No, after I defined the private IP address I did not get the broker error.
Here is the pydio.json :

Pydio.json seems OK and we can consider that the broker error is out of the way.

  • I am using a virtual server from Strato, is this considered on-disk?

We usually call “on-disk” when you directly use the binary (that is, not using a docker image)
Thus said, we have no specific experience with the VM from Strato and suspect they might have a specific configuration that triggers the issue.

The problem you describe might look similar to this (this post gathers hints to further diagnose):

or How to resolve Resource Temporarily Unavailable errors due to TaskMax setting

Do you start Cells with systemd ? Could you post the result of systemctl status cells | grep Tasks

Hi @bsinou ,

So first the good news, I can upload files to the workspaces that are running and download them back.
Now to the less good news, I cannot delete files and the service still restarts every few minutes. I’ve followed the posts that you’ve recommended:
ulimit -a from the dedicated user now looks like this, it’s high enough (if not too high) as far as I can tell:

time(seconds)        unlimited
file(blocks)         unlimited
data(kbytes)         unlimited
stack(kbytes)        32768
coredump(blocks)     0
memory(kbytes)       unlimited
locked memory(kbytes) 65536
process              125974
nofiles              16384
vmemory(kbytes)      unlimited
locks                unlimited
rtprio               0

systemctl status cells | grep Tasks seems closer to the problem. It returned Tasks: 159 (limit: 165).
I have now raised it to Unlimited and now it returns:

systemctl status cells | grep Tasks
           └─50-TasksMax.conf
    Tasks: 180

I’m not sure where the └─50-TasksMax.conf is coming from.
Some of the storage services are starting but some aren’t. Sometimes when I restart the cells service all of them will start but that’s usually not the case

During start I get the following error:

Ts : 1614599636
Level : error
Msg : SubProcess finished with error: trying to restart now
SpanUuid : span-2

After I let it run for a few minutes I get:

Ts : 1614599729
Level : error
Logger : pydio.grpc.tasks
Msg : Streamer PutTaskStream - {"id":"go.micro.client","code":500,"detail":"Error creating stream: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = \"transport: Error while dialing dial tcp 10.0.0.1:41709: connect: connection refused\"","status":"Internal Server Error"}
SpanUuid : span-0

When I try to delete a file also: (it tries multiple times)

Ts : 1614599757
Level : error
Logger : pydio.rest.jobs
Msg : Rest Error 500 - {"id":"go.micro.client","code":500,"detail":"Error creating stream: rpc error: code = Unavailable desc = all SubConns are in TransientFailure, latest connection error: connection error: desc = \"transport: Error while dialing dial tcp 10.0.0.1:41062: connect: connection refused\"","status":"Internal Server Error"}
UserName : admin
UserUuid : 6ad95f34-aae1-49b3-911d-8d5da9b9eb2b
GroupPath : /
RemoteAddress : <...>
UserAgent : Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:86.0) Gecko/20100101 Firefox/86.0
HttpProtocol : HTTP/1.1
SpanUuid : 0f2bbe94-7a85-11eb-8833-58fda068e837

I hope this information helps.

Thanks a lot!

Ben

Hi,

I’ve noticed another problem, I’m not sure whether it’s related (I need to fix it anyway and I’ve googled quite a lot already, I can make a new thread if it’s not related). After I added the virtual IP it doesn’t resolve names anymore. I can’t apt-get update or ping an address. The /etc/network/interface starts with:

# This configuration file is auto-generated.
# WARNING: Do not edit this file, otherwise your changes will be lost.
# Please edit template /etc/network/interfaces.template instead.

So like a good boy I added the new configuration to the interfaces.template file with the interface name venet0:1 (my main interface is venet0). The content of interfaces.template is added to the beginning of interfaces , so before the config of venet0. After adding to the interfaces.template and restarting, my /etc/network/interfaces file looks like this:

# This configuration file is auto-generated.
# WARNING: Do not edit this file, otherwise your changes will be lost.
# Please edit template /etc/network/interfaces.template instead.

auto venet0:1
iface venet0:1 inet static
address 10.0.0.1
netmask 255.255.255.0
network 10.0.0.0
broadcast 10.0.0.255
up route add default dev venet0
auto lo
iface lo inet loopback

# Auto generated venet0 interfaces
auto venet0
iface venet0 inet static
        address 127.0.0.1
        netmask 255.255.255.255
        broadcast 0.0.0.0
        up route add default dev venet0

iface venet0 inet6 static
        address ::2
        netmask 128
        up ip -6 r a default dev venet0
auto venet0:0
iface venet0:0 inet static
        address <redacted IP>
        netmask 255.255.255.255

The interfaces.template file that I created looks like this:

auto venet0:1
iface venet0:1 inet static
address 10.0.0.1
netmask 255.255.255.0
network 10.0.0.0
broadcast 10.0.0.255

ip addr gives this back:

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: venet0: <BROADCAST,POINTOPOINT,NOARP,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default 
    link/void 
    inet 127.0.0.1/32 scope host venet0
       valid_lft forever preferred_lft forever
    inet 10.0.0.1/24 brd 10.0.0.255 scope global venet0:1
       valid_lft forever preferred_lft forever
    inet <redacted ip>/32 brd <redacted ip> scope global venet0:0
       valid_lft forever preferred_lft forever

Thank you,

Ben

Hey @benw

about your additional virtual address could you try to only add a local IPv4 address, i’ve done this recently on a testing debian-like server with no issue:

# virtual IP on eno1
auto eno1:0
iface eno1:0 inet static
address 10.0.0.1
netmask 255.255.255.0
network 10.0.0.0
broadcast 10.0.0.255

About the other problem, could you try to directly start the app via the command line as user pydio to put systemd out of the way and see what happens ?

# as pydio user
./cells start

Hi @bsinou ,
I added the virtual IP on eno1 like you suggested, I don’t see the eno1 interface when I run ip addr or ifconfig -a, but names are resolved. Is it correct that I currently bind cells to 0.0.0.0? I don’t have my reverse proxy set up yet (that’ll be my next step).
I tried to disable the systemd service and start cells manually through cells start. I got the same errors as before and the services didn’t start. I added the line TasksMax=infinity to the cells.service file and now when I run it through sytemd, 9 out of 10 times all the services start!
Now when I try to delete a file through the front end I still get this error:
image
and in the log:

Level : error
Logger : pydio.rest.jobs
Msg : Rest Error 503 - {"id":"go.micro.client","code":503,"detail":"none available","status":"Internal Server Error"}```
Level : error
Msg : Streamer PutTaskStream - {"id":"go.micro.client","code":500,"detail":"none available","status":"Internal Server Error"}

Thanks for all the help,

Ben

Well, I would personally not bind Cells to 0.0.0.0 — I only get errors that way.

Instead, try binding to 1.0.0.1. After all, you did configure that ‘virtual’ interface (or interface alias) quite correctly IMHO — so this ought to work!

Are you using nginx or Apache os something else as a reverse proxy in front of everything? If so, you will most likely need to add the environment variable CELLS_GRPC_EXTERNAL=33060 before launching Cells; if you’re starting everything from systemd, then you should have at the bottom of the [Service] section the following line:

Environment=CELLS_GRPC_EXTERNAL=33060

Also see the Finalisation section in the general configurations KB page.

Oh, just to clear things up, you are still using interfaces venet0 and venet0:1 as per your earliest comments, right? Because eno1 or eno1:0 are very likely not the ‘correct’ names for the Ethernet interface(s) on a virtualised Linux running on the x86_64 architecture. It’s just that it gets a little confusing later on this topic when you suddenly start to talk about eno1 — which you shouldn’t be seeing in your configuration (so no wonder that ip addr or ipconfig -a do not show that interface — these commands will only show the virtualised Ethernet interfaces venet0 and venet0:1).

Hi,
I added the Enviornment variable to the service and tried to bind it to 1.0.0.1 (did you mean 10.0.0.1 by any chance? I tried that too and modifying the caddy file) and setting up a reverse proxy through caddy, this is my Caddyfile (when cells is bound to 1.0.0.1):

<My domain name> {

  tls <Email address>

  reverse_proxy 1.0.0.1:8080 {
    # Use https with a self signed cert between Caddy and Cells
    transport http {
      tls
      tls_insecure_skip_verify
    }
  }
}

# You might also want to redirect HTTP traffic toward HTTPS  
http://<My domain name> {
  redir http://<My domain name>
}

When I try to access Pydio through my domain name I get:
421 Site <My domain> is not served on this interface
Yeah sorry the venet0 / eneo1 was confusing for me as well, I set it up as venet0:1.

I think I found a possible reason that deleting files isn’t possible, when I do cells ps I see that pydio.grpc.jobs [ ] is not active, what can I do about it?

Thanks,

Ben

Hi,

Just a quick update, when binding cells to 0.0.0.0 I was able to run it through Caddy as a reverse proxy and a generated ssl certificate. 10.0.0.1 doesn’t work. I stil can’t delete files.

@bsinou ,
The lines:

auto lo
iface lo
inet loopback

are automatically added after the contents of the interfaces.template file. I did not find a way to get rid of it. I still cannot resolve names, so neither apt-get update nor ping google.com . It works if I remove the virtual IP

Thanks,

Ben

Hi @GwynethLlewelyn , any ideas how I could troubleshoot (or even solve!) the binding to 10.0.0.1? I have a feeling that it’s close to the actual problem. When I bind Cells to 10.0.0.1:8080 and my Caddy file for the reverse Proxy is:

https://<My domain> {

  tls <My Email>

  reverse_proxy 10.0.0.1:8080 {
    # Use https with a self signed cert between Caddy and Cells
    transport http {
      tls
      tls_insecure_skip_verify
    }
  }
}

# You might also want to redirect HTTP traffic toward HTTPS  
http://<My domain> {
  redir <My domain>
}

this is what cells ps looks like:

GENERIC SERVICES                          
 # data                                    
 pydio.test.objects             [ ]        
 # gateway                                 
 pydio.gateway.data             [X]        
 pydio.gateway.dav              [ ]        
 pydio.gateway.grpc             [ ]        
 pydio.gateway.proxy            [X]        
 pydio.gateway.rest             [X]        
 pydio.gateway.websocket        [X]        
 pydio.gateway.wopi             [ ]        
                                           
 GRPC SERVICES                             
 # broker                                  
 pydio.grpc.activity            [ ]        
 pydio.grpc.chat                [X]        
 pydio.grpc.log                 [X]        
 pydio.grpc.mailer              [X]        
 # data                                    
 pydio.grpc.data-key            [ ]        
 pydio.grpc.docstore            [X]        
 pydio.grpc.meta                [ ]        
 pydio.grpc.search              [ ]        
 pydio.grpc.tree                [ ]        
 pydio.grpc.versions            [ ]        
 # datasource                              
 pydio.grpc.data.index          [ ]        
 pydio.grpc.data.objects        [X]        
 pydio.grpc.data.sync           [X]        
 # discovery                               
 pydio.grpc.config              [ ]        
 pydio.grpc.healthcheck         [ ]        
 pydio.grpc.update              [X]        
 # frontend                                
 pydio.grpc.statics             [X]        
 # idm                                     
 pydio.grpc.acl                 [ ]        
 pydio.grpc.oauth               [ ]        
 pydio.grpc.policy              [ ]        
 pydio.grpc.role                [ ]        
 pydio.grpc.token               [ ]        
 pydio.grpc.user                [ ]        
 pydio.grpc.user-key            [ ]        
 pydio.grpc.user-meta           [ ]        
 pydio.grpc.workspace           [ ]        
 # scheduler                               
 pydio.grpc.jobs                [ ]        
 pydio.grpc.tasks               [X]        
 pydio.grpc.timer               [X]        
                                           
 REST SERVICES                             
 # broker                                  
 pydio.rest.activity            [ ]        
 pydio.rest.log                 [ ]        
 pydio.rest.mailer              [ ]        
 # data                                    
 pydio.rest.meta                [ ]        
 pydio.rest.search              [ ]        
 pydio.rest.templates           [ ]        
 pydio.rest.tree                [ ]        
 # discovery                               
 pydio.rest.config              [ ]        
 pydio.rest.update              [ ]        
 # frontend                                
 pydio.rest.frontend            [ ]        
 pydio.web.statics              [ ]        
 # idm                                     
 pydio.rest.acl                 [ ]        
 pydio.rest.auth                [ ]        
 pydio.rest.graph               [ ]        
 pydio.rest.policy              [ ]        
 pydio.rest.role                [ ]        
 pydio.rest.share               [ ]        
 pydio.rest.user                [ ]        
 pydio.rest.user-meta           [ ]        
 pydio.rest.workspace           [ ]        
 pydio.web.oauth                [ ]        
 # scheduler                               
 pydio.rest.jobs                [ ]       

any ideas? It’s really driving me mad

Thanks,

Ben

1 Like

I can confirm a fix for this “upload failed: undefined”

Symptoms:

  • uploads fail
  • lots of “proxy restart” messages in the app output
  • in the “services” panel, the “pydio.gateway.data” and “pydio.gateway.gprc” and “pydio.gateway.proxy” status is red

Solution:

  • add a local ip address to one of the ethernet devices
  • in my case
    ip a a 10.0.0.1/24 dev ens3

After a restart of Cells, all the above symptoms disappeared.

1 Like