Cells Version 5 update issue

[Amanuel_Elhanan]

For first post, please answer the questions below!

Describe your issue in detail

I downloaded the latest binary and followed all steps documented for RHEL based linux distros. The database and /var/cells is restored from backup. I took a backup on the previous stable version of Cells version. The issue is, on first launch it didn’t worked, I think the upgrade part took time, on restarting the cells service, the login page appeared and logged in fine, but it was too slow and some feature like opening shared cells weren’t working… and I restarted the cells service again and this time it is not allowing me to login with the correct username and password, showing this error: “Login failed: could not recognise your username or password”
here is the log of cells service.

This is caddy definition I have used,

cells.home {
  tls internal

  reverse_proxy localhost:8080 {
    header_up X-Real-IP {remote_host}
    header_up X-Forwarded-For {remote_host}
    header_up X-Forwarded-Proto {scheme}
    header_up Host {host}

    transport http {
      tls
      tls_insecure_skip_verify
    }
  }
}

https://paste.centos.org/view/7f340689

What version of Cells are you using?

Version 5.0.0

What is the server OS? Database name/version? Browser name or mobile device description (if issue appears client-side)?

Fedora Server 43, Mariadb 15.1, Firefox 150.0.1 (64-bit)

What steps have you taken to resolve this issue already?

Restarted Cells.service and Caddy (Which I am using as reverse proxy)

[ghecquet]

Hi,

Can you give us the full logs after restarting the application please ? That would help us debugging. And also, can you provide a bit more information about your system (db versions, …) ?

Thanks,

Greg

[ghecquet]

Just saw your db version But the logs would be nice !

[Amanuel_Elhanan]

I have shared the log too, have you checked the paste bin link I have shared?

[ghecquet]

The link you gave is returning a 404.

[Amanuel_Elhanan]

Here is a full log, this time when I reload, at least it logged in successfully but it is so slow and some functionalities are not working as intended.

Log file

[ghecquet]

Would it please be possible to return the following :

SELECT 
  TABLE_SCHEMA AS database_name,
  TABLE_NAME AS table_name,
  TABLE_ROWS AS estimated_rows 
FROM information_schema.TABLES
WHERE TABLE_SCHEMA NOT IN ( 
  'information_schema', 
  'mysql', 
  'performance_schema', 
  'sys')
ORDER BY TABLE_ROWS DESC;

And also to enable the slow query logs to see if there is anything obvious ?

SET GLOBAL slow_query_log = 'ON';
SET GLOBAL long_query_time = 1;
SET GLOBAL log_queries_not_using_indexes = 'ON';
SET GLOBAL slow_query_log_file = '/var/log/mysql/mariadb-slow.log';

Finally, we have done some changes to the way the connection pool is handled in the v5. By default we set up 10 connections for the home edition. It could be that it is too low for your setup - could you try changing it please ? In the pydio.json, you can add a parameter maxConnection to the database connection url to increase the number of connections ?

...
"dsn": "mysql://root:secret@tcp(127.0.0.1:3308)/cells?parseTime=true&prefix={{.Meta.prefix}}&policies={{.Meta.policies}}&singular={{.Meta.singular}}&maxConnections=40" 
...

Thanks,

Greg

[Amanuel_Elhanan]

@ghecquet

SELECT 
  TABLE_SCHEMA AS database_name,
  TABLE_NAME AS table_name,
  TABLE_ROWS AS estimated_rows 
FROM information_schema.TABLES
WHERE TABLE_SCHEMA NOT IN ( 
  'information_schema', 
  'mysql', 
  'performance_schema', 
  'sys')
ORDER BY TABLE_ROWS DESC;

Here is the output of the first mysql query,

+---------------+------------------------------------------------+----------------+
| database_name | table_name                                     | estimated_rows |
+---------------+------------------------------------------------+----------------+
| cells         | data_meta                                      |         125369 |
| cells         | hydra_oauth2_authentication_session            |          20850 |
| cells         | data_index_cellsdata_idx_tree                  |          19474 |
| cells         | hydra_oauth2_consent_request_handled           |          14159 |
| cells         | hydra_oauth2_consent_request                   |          14030 |
| cells         | hydra_oauth2_code                              |          12990 |
| cells         | hydra_oauth2_oidc                              |          12852 |
| cells         | hydra_oauth2_authentication_request_handled    |          11524 |
| cells         | hydra_oauth2_authentication_request            |          11378 |
| cells         | data_index_personal_idx_tree                   |          10409 |
| cells         | data_index_thumbnails_idx_tree                 |           6962 |
| cells         | idm_workspace_policies                         |           4677 |
| cells         | hydra_oauth2_refresh                           |           4590 |
| cells         | idm_acls                                       |           3780 |
| cells         | hydra_oauth2_logout_request                    |           2709 |
| cells         | idm_user_attributes                            |            975 |
| cells         | idm_role_policies                              |            801 |
| cells         | idm_acl_nodes                                  |            776 |
| cells         | idm_user_policies                              |            774 |
| cells         | idm_acl_workspaces                             |            679 |
| cells         | idm_workspaces                                 |            673 |
| cells         | idm_roles                                      |            243 |
| cells         | idm_user_idx_tree                              |            235 |
| cells         | idm_acl_roles                                  |            188 |
| cells         | idm_usr_meta_policies                          |            186 |
| cells         | data_index_pydiods1_idx_tree                   |            108 |
| cells         | gorp_migrations                                |             70 |
| cells         | schema_migration                               |             55 |
| cells         | idm_ladon_policy_resource_rel                  |             51 |
| cells         | idm_ladon_policy_resource                      |             48 |
| cells         | idm_usr_meta                                   |             41 |
| cells         | idm_user_roles                                 |             34 |
| cells         | idm_ladon_policy_action_rel                    |             29 |
| cells         | idm_ladon_policy_subject_rel                   |             21 |
| cells         | idm_ladon_policy_rel                           |             14 |
| cells         | idm_ladon_policy                               |             14 |
| cells         | oauth2_refresh                                 |              7 |
| cells         | idm_ladon_policy_subject                       |              7 |
| cells         | oauth2_code                                    |              7 |
| cells         | oauth2_oidc                                    |              7 |
| cells         | idm_personal_tokens                            |              6 |
| cells         | idm_ladon_policy_action                        |              6 |
| cells         | idm_usr_meta_ns                                |              5 |
| cells         | ladon_migrations                               |              4 |
| cells         | idm_ladon_policy_group                         |              4 |
| cells         | hydra_client                                   |              4 |
| cells         | idm_sessions                                   |              4 |
| cells         | oauth2_flow                                    |              2 |
| cells         | oauth2_access                                  |              2 |
| cells         | hydra_jwk                                      |              2 |
| cells         | hydra_oauth2_access                            |              0 |
| cells         | idm_usr_meta_values_rel                        |              0 |
| cells         | enc_nodes                                      |              0 |
| cells         | hydra_oauth2_jti_blacklist                     |              0 |
| cells         | ladon_policy_permission                        |              0 |
| cells         | hydra_oauth2_obfuscated_authentication_session |              0 |
| cells         | enc_node_blocks                                |              0 |
| cells         | idm_user_keys                                  |              0 |
| cells         | enc_legacy_nodes                               |              0 |
| cells         | data_index_versions_idx_tree                   |              0 |
| cells         | idm_usr_meta_entities                          |              0 |
| cells         | hydra_oauth2_trusted_jwt_bearer_issuer         |              0 |
| cells         | hydra_oauth2_pkce                              |              0 |
| cells         | oauth2_jwk                                     |              0 |
| cells         | oauth2_pkce                                    |              0 |
| cells         | idm_usr_meta_entity_values                     |              0 |
| cells         | enc_node_keys                                  |              0 |
+---------------+------------------------------------------------+----------------+
67 rows in set (1.448 sec)

I also tried enabling slow query log, but I get this error on the last query,

ERROR 1231 (42000): Variable ‘slow_query_log_file’ can’t be set to the value of ‘/var/log/mysql/mariadb-slow.log’

I also edited the pydio.json to add maxConnections well I restarted cells.service after setting those.. The loading time is relatively good now but not perfect as previous Cells Versions. The login failure is also resolved.

Here is problems that are still exist after upgrade to V5

1. Admin User Profile Pic is not showing up
2. Server log is not showing anything
   
   
3. Collabora online and pdf viewer doesn’t show files
   
   

Note: I have upgraded to the latest stable version

• Another thing to mention here is, I am already using Caddy as reverse proxy, but I checked that Cells V5 have it’s own Caddy implementation, maybe that could be the reason for the slow response

Log cells log