Unable to login after 1 week

I’ve deployed Pydio Cells as a pod to the Kubernetes cluster with a MariaDB database and connected it to S3 as backend storage. After one week had passed since installation, I could no longer log in to it and got an Unauthorized error. I just found the following logs in the pod:

2026-05-10T11:31:30.336Z	DEBUG	pydio.rest.frontend	End List Adjacents, start ApplyHTTPIncoming	{"tag": "frontend"}
2026-05-10T11:31:30.336Z	DEBUG	pydio.rest.frontend	End ApplyHTTPIncoming	{"tag": "frontend"}
2026-05-10T11:31:30.341Z	WARN	pydio.rest.frontend	cannot find site from context while trying to resolve route api	{"tag": "frontend"}
2026-05-10T11:31:30.341Z	DEBUG	pydio.rest.frontend	JWTHttpHandler: Checking JWT	{"tag": "frontend"}
2026-05-10T11:31:30.342Z	DEBUG	pydio.rest.frontend	No Claims Found	{"ctx": "context.Background.WithCancel.WithValue(net/http context value http-server, *http.Server).WithValue(net/http context value local-addr, 127.0.0.1:8032).WithCancel.WithCancel.WithValue(registry.registryKey, *registry.FuncWrapper).WithValue(config.configKey, *openurl.Pool[github.com/pydio/cells/v5/common/config.Store]).WithValue(config.configKey, *openurl.Pool[github.com/pydio/cells/v5/common/config.Store]).WithValue(keyring.keyringKey, *keyring.autoCreateKeyring).WithValue(manager.managerKey, *manager.manager).WithValue(runtime.contextType, <nil>).WithValue(propagator.metadataKey, propagator.Metadata).WithValue(runtime.contextType, <nil>).WithValue(otelhttp.labelerContextKeyType, *otelhttp.Labeler).WithValue(trace.traceContextKeyType, global.nonRecordingSpan).WithValue(routing.ctxResolvedRouteURI, /a).WithValue(trace.traceContextKeyType, global.nonRecordingSpan).WithValue(registry.registryKey, *registry.FuncWrapper).WithValue(runtime.serviceNameKey, pydio.rest.frontend).WithValue(config.configKey, *openurl.Pool[github.com/pydio/cells/v5/common/config.Store]).WithValue(config.configKey, *openurl.Pool[github.com/pydio/cells/v5/common/config.Store]).WithValue(keyring.keyringKey, *keyring.autoCreateKeyring).WithValue(service.serviceKey, *service.service).WithValue(manager.managerKey, *manager.manager).WithValue(runtime.serviceNameKey, pydio.rest.frontend).WithValue(middleware.detectedLanguagesKey, []string).WithValue(sessions.contextKey, *sessions.Registry)", "tag": "frontend"}
2026-05-10T11:31:30.348Z	DEBUG	pydio.grpc.policy	Policies.IsAllowed - checking with Memory Manager from cache	{"tag": "idm"}
2026-05-10T11:31:30.351Z	DEBUG	pydio.rest.frontend	PolicyHttpHandlerWrapper denied access	{"request": "Resource:\"rest:/frontend/session\"  Action:\"POST\"  Subjects:\"profile:anon\"  Context:{key:\"ClientTime\"  value:\"2026-05-10T11:31+0000\"}  Context:{key:\"ContentType\"  value:\"application/json\"}  Context:{key:\"HttpProtocol\"  value:\"HTTP/1.1\"}  Context:{key:\"RemoteAddress\"  value:\"10.0.0.66\"}  Context:{key:\"RequestHost\"  value:\"drive.dev.tosan-digital.ir\"}  Context:{key:\"ServerTime\"  value:\"2026-05-10T11:31+0000\"}  Context:{key:\"UserAgent\"  value:\"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/145.0.0.0 Safari/537.36\"}", "tag": "frontend"}
2026-05-10T11:31:30.352Z	ERROR	pydio.rest.frontend	Policies blocked POST request at /a/frontend/session. Response: DefaultDeny:true	{"tag": "frontend"}

What version of Cells are you using?

4.9.94-alpha02

What is the server OS? Database name/version? Browser name or mobile device description (if issue appears client-side)?

ubuntu - mariadb 12.2.2

Hi @AliReza-Sagha

Could you please try to get cells’ logs for more info?

You may use this command: kubectl logs cells-pod

Hi @c12simple ,
I’m the co-worker of @AliReza-Sagha , We faced this problem in the dev and prod environments. I could not upload the full log file here, so instead I’ve uploaded it to a GitHub gist:

Hi,

I seems that in your log, you have problem with sql connection starting from 2026-05-30T00:54:08.286Z

2026-05-30T00:50:21.986Z	DEBUG	pydio.grpc.jobs	Quick store of this task as it is new or finished	{"Task": {"ID": "e448d510-72b1-4f86-8aba-ceb1e8023954", "Status": "Running", "StatusMessage": "Starting...", "TriggerOwner": "pydio.system.user", "JobID": "flush-mailer-queue", "StartTime": "2026-05-30T00:50:21.000Z", "CanStop": true}, "tag": "scheduler", "OperationUuid": "flush-mailer-queue-6efe582c"}
2026-05-30T00:50:22.012Z	DEBUG	pydio.grpc.jobs	Quick store of this task as it is new or finished	{"Task": {"ID": "e448d510-72b1-4f86-8aba-ceb1e8023954", "Status": "Finished", "StatusMessage": "Complete", "TriggerOwner": "pydio.system.user", "JobID": "flush-mailer-queue", "StartTime": "2026-05-30T00:50:21.000Z", "EndTime": "2026-05-30T00:50:22.000Z", "CanStop": true}, "tag": "scheduler", "OperationUuid": "flush-mailer-queue-6efe582c"}
2026-05-30T00:54:08.286Z	INFO	pydio.rest.frontend	[SQL] dial tcp 10.43.156.40:3306: connect: connection refused [363.533ms] [rows:0] DELETE FROM `idm_sessions` WHERE `expires_on` < '2026-05-30 00:54:07.92'	{"file": "github.com/pydio/cells/v5/common/storage/sql/logger.go:82", "layer": "sql", "tag": "frontend"}
2026-05-30T00:54:08.287Z	ERROR	pydio.rest.frontend	Error while running deleteExpired	{"error": "dial tcp 10.43.156.40:3306: connect: connection refused", "tag": "frontend"}
2026-05-30T00:55:18.423Z	DEBUG	pydio.grpc.timer	Sending Timer Event	{"event": "JobID:\"users-activity-digest\"  Schedule:{Iso8601Schedule:\"R/2012-06-04T19:25:16.828696-07:00/PT15M\"}", "tag": "scheduler", "Contextualizer": "default"}
2026-05-30T00:55:18.588Z	DEBUG	pydio.grpc.tasks	Fan out topic.pydio.meta.timer.event event to default	{"fromQueue": false, "tag": "scheduler"}
2026-05-30T00:55:18.588Z	INFO	pydio.grpc.tasks	Run Job users-activity-digest on timer event Iso8601Schedule:"R/2012-06-04T19:25:16.828696-07:00/PT15M"	{"tag": "scheduler"}
2026-05-30T00:55:18.588Z	DEBUG	pydio.grpc.tasks	Found dispatcher for job users-activity-digest in cache	{"tag": "scheduler"}
2026-05-30T00:55:18.922Z	DEBUG	pydio.grpc.tasks	NewTaskFromEvent users-activity-digest	{"tag": "scheduler"}
2026-05-30T00:55:18.925Z	DEBUG	pydio.grpc.jobs	Quick store of this task as it is new or finished	{"Task": {"ID": "9b009000-3371-4564-938f-1b1c3c7f981d", "Status": "Running", "StatusMessage": "Starting...", "TriggerOwner": "pydio.system.user", "JobID": "users-activity-digest", "StartTime": "2026-05-30T00:55:18.000Z", "CanStop": true}, "tag": "scheduler", "OperationUuid": "flush-mailer-queue-6efe582c"}
2026-05-30T00:55:18.937Z	INFO	pydio.grpc.role	[SQL] dial tcp 10.43.156.40:3306: connect: connection refused [4.324ms] [rows:0] SELECT * FROM `idm_roles` WHERE `idm_roles`.`auto_applies` <> ''	{"file": "github.com/pydio/cells/v5/common/storage/sql/logger.go:82", "layer": "sql", "tag": "idm", "OperationUuid": "users-activity-digest-9b009000"}
2026-05-30T00:55:18.939Z	ERROR	pydio.grpc.role	[GRPC]/idm.RoleService/SearchRole dial tcp 10.43.156.40:3306: connect: connection refused	{"errorId": "e41eaa24-a642", "ClientCaller": "github.com/pydio/cells/v5/idm/user/grpc/handler.go:593:grpc.(*Handler).loadAutoAppliesRoles()", "error": "dial tcp 10.43.156.40:3306: connect: connection refused", "tag": "idm", "OperationUuid": "users-activity-digest-9b009000"}
2026-05-30T00:55:19.236Z	INFO	pydio.grpc.user	[SQL] dial tcp 10.43.156.40:3306: connect: connection refused [5.774ms] [rows:0] SELECT * FROM `idm_user_idx_tree` WHERE `idm_user_idx_tree`.`leaf` = 1 AND NOT EXISTS (SELECT `idm_user_attributes`.`name` FROM `idm_user_attributes` WHERE `idm_user_attributes`.`name` = 'hidden' AND `idm_user_attributes`.`uuid` = `idm_user_idx_tree`.`uuid`) ORDER BY name ASC	{"file": "github.com/pydio/cells/v5/common/storage/sql/logger.go:82", "layer": "sql", "tag": "idm", "tag": "users", "OperationUuid": "users-activity-digest-9b009000"}
2026-05-30T00:55:19.263Z	ERROR	pydio.grpc.user	[GRPC]/idm.UserService/SearchUser dial tcp 10.43.156.40:3306: connect: connection refused || sql-users	{"errorId": "a8b93cf8-3e12", "ClientCaller": "github.com/pydio/cells/v5/common/proto/jobs/users-selector.go:81:jobs.(*UsersSelector).Select()", "jsonErr": "{\"error\":\"dial tcp 10.43.156.40:3306: connect: connection refused\\nsql-users\",\"errors\":[{\"error\":\"dial tcp 10.43.156.40:3306: connect: connection refused\"},{\"error\":\"sql-users\"}],\"stack\":[{\"name\":\"github.com/pydio/cells/v5/common/errors.Tag\",\"file\":\"github.com/pydio/cells/v5/common/errors/lib.go\",\"line\":102},{\"name\":\"github.com/pydio/cells/v5/idm/user/dao/sql.wrap\",\"file\":\"github.com/pydio/cells/v5/idm/user/dao/sql/sql.go\",\"line\":74},{\"name\":\"github.com/pydio/cells/v5/idm/user/dao/sql.(*sqlimpl).Search\",\"file\":\"github.com/pydio/cells/v5/idm/user/dao/sql/sql.go\",\"line\":453},{\"name\":\"github.com/pydio/cells/v5/idm/user/grpc.(*Handler).SearchUser\",\"file\":\"github.com/pydio/cells/v5/idm/user/grpc/handler.go\",\"line\":413},{\"name\":\"github.com/pydio/cells/v5/common/proto/idm._UserService_SearchUser_Handler\",\"file\":\"github.com/pydio/cells/v5/common/proto/idm/cells-idm_grpc.pb.go\",\"line\":568},{\"name\":\"google.golang.org/grpc/stats/opentelemetry.(*serverMetricsHandler).streamInterceptor\",\"file\":\"google.golang.org/grpc@v1.79.3/stats/opentelemetry/server_metrics.go\",\"line\":163},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1.getChainStreamHandler.1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/server/grpc.(*Server).prepareInternalOptions.func3\",\"file\":\"github.com/pydio/cells/v5/common/server/grpc/grpc.go\",\"line\":345},{\"name\":\"github.com/pydio/cells/v5/common/server/grpc.(*Server).prepareInternalOptions.HandlerStreamInterceptor.func8\",\"file\":\"github.com/pydio/cells/v5/common/server/grpc/interceptor.go\",\"line\":32},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/server/grpc.(*Server).prepareInternalOptions.streamEndpointInterceptor.func7\",\"file\":\"github.com/pydio/cells/v5/common/server/grpc/grpc-endpoint.go\",\"line\":92},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1.getChainStreamHandler.1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/middleware.ErrorFormatStreamInterceptor\",\"file\":\"github.com/pydio/cells/v5/common/middleware/errors-grpc.go\",\"line\":85},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/middleware.GrpcStreamServerInterceptors.ContextStreamServerInterceptor.func10\",\"file\":\"github.com/pydio/cells/v5/common/utils/propagator/grpc.go\",\"line\":59},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1.getChainStreamHandler.1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/middleware.GrpcStreamServerInterceptors.ContextStreamServerInterceptor.func10\",\"file\":\"github.com/pydio/cells/v5/common/utils/propagator/grpc.go\",\"line\":59},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/middleware.GrpcStreamServerInterceptors.ContextStreamServerInterceptor.func9\",\"file\":\"github.com/pydio/cells/v5/common/utils/propagator/grpc.go\",\"line\":57},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1.getChainStreamHandler.1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/middleware.GrpcStreamServerInterceptors.ContextStreamServerInterceptor.func7\",\"file\":\"github.com/pydio/cells/v5/common/utils/propagator/grpc.go\",\"line\":57},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/middleware.GrpcStreamServerInterceptors.ContextStreamServerInterceptor.func5\",\"file\":\"github.com/pydio/cells/v5/common/utils/propagator/grpc.go\",\"line\":57},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1.getChainStreamHandler.1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/grpc-ecosystem/go-grpc-middleware/recovery.StreamServerInterceptor.func1\",\"file\":\"github.com/grpc-ecosystem/go-grpc-middleware@v1.4.0/recovery/interceptors.go\",\"line\":51},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/middleware.GrpcStreamServerInterceptors.ContextStreamServerInterceptor.func4\",\"file\":\"github.com/pydio/cells/v5/common/utils/propagator/grpc.go\",\"line\":57},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1.getChainStreamHandler.1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/middleware.GrpcStreamServerInterceptors.ContextStreamServerInterceptor.func2\",\"file\":\"github.com/pydio/cells/v5/common/utils/propagator/grpc.go\",\"line\":57},{\"name\":\"google.golang.org/grpc.getChainStreamHandler.func1\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1572},{\"name\":\"github.com/pydio/cells/v5/common/middleware.GrpcStreamServerInterceptors.MetricsStreamServerInterceptor.func1\",\"file\":\"github.com/pydio/cells/v5/common/middleware/metrics.go\",\"line\":75},{\"name\":\"google.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2\",\"file\":\"google.golang.org/grpc@v1.79.3/server.go\",\"line\":1563}]}", "tag": "idm", "tag": "users", "OperationUuid": "users-activity-digest-9b009000"}
2026-05-30T00:55:19.269Z	DEBUG	pydio.grpc.jobs	Quick store of this task as it is new or finished	{"Task": {"ID": "9b009000-3371-4564-938f-1b1c3c7f981d", "Status": "Finished", "StatusMessage": "Complete", "TriggerOwner": "pydio.system.user", "JobID": "users-activity-digest", "StartTime": "2026-05-30T00:55:18.000Z", "EndTime": "2026-05-30T00:55:19.000Z", "CanStop": true}, "tag": "scheduler", "OperationUuid": "flush-mailer-queue-6efe582c"}
2026-05-30T00:55:21.531Z	DEBUG	pydio.grpc.timer