Players taking hours download files

[ksainc]

Evening Everyone,

I have an odd issue happening when our android players are syncing content from server, they seem to take a long time (hours) to fully download all the files and turn green in the GUI.

After watching the logs for a while I noticed that the getFile command randomly returns 0 size files, this can happen every other request or every 10th request or every 20th request, there seems to be no pattern.

Here is a few lines from the logs where the returned data was 0 on every other request. (Yes this is all from one client)

[08/Feb/2023:21:28:14 -0500] “POST /xmds.php?v=6&method=getFile HTTP/2.0” 200 1015600 “-” “ksoap2-android/2.6.0+;version=3.6.4”
[08/Feb/2023:21:28:14 -0500] “POST /xmds.php?v=6&method=getFile HTTP/2.0” 200 0 “-” “ksoap2-android/2.6.0+;version=3.6.4”
[08/Feb/2023:21:28:15 -0500] “POST /xmds.php?v=6&method=getFile HTTP/2.0” 200 1064744 “-” “ksoap2-android/2.6.0+;version=3.6.4”
[08/Feb/2023:21:28:15 -0500] “POST /xmds.php?v=6&method=getFile HTTP/2.0” 200 0 “-” “ksoap2-android/2.6.0+;version=3.6.4”
[08/Feb/2023:21:28:15 -0500] “POST /xmds.php?v=6&method=getFile HTTP/2.0” 200 1048368 “-” “ksoap2-android/2.6.0+;version=3.6.4”
[08/Feb/2023:21:28:15 -0500] “POST /xmds.php?v=6&method=getFile HTTP/2.0” 200 0 “-” “ksoap2-android/2.6.0+;version=3.6.4”
[08/Feb/2023:21:28:16 -0500] “POST /xmds.php?v=6&method=getFile HTTP/2.0” 200 1048368 “-” “ksoap2-android/2.6.0+;version=3.6.4”

So I started looking at the players management page to see what files might be causing the issue and delaying a full sync and there seems to be no pattern there either, some of the remaining files are images we uploaded, others are system files, like 10.otf, emojione.sprites.png, 1594.apk, pdf.worker.js, wi-day-cloudy.jpg. The files eventually fully download and sync but this can take all night.

Here is our setup,
Debian 11 LXC container
Nginx, PHP 7.4, MariaDB
Xibo CMS 3.3.1
Xibo Andriod 309
File download mode = Off

Any help would be appreciated. Thank you in advance.
Sebastian

[ksainc]

So after some more investigating I have finally founds the cause of all my troubles.

After looking at the nginx error.log i found a bunch of errors like these,

2023/02/09 22:14:00 [crit] 98316#98316: *98 open() “/var/lib/nginx/fastcgi/6/09/0000000096” failed (13: Permission denied) while reading upstream, client: x.x.x.x, server: console.ksaedia.com, request: “POST /xmds.php?v=6&method=getFile HTTP/2.0”, upstream: “fastcgi://unix:/run/php/php7.4-fpm.sock:”, host: “console”

Doing some research on these errors led me to the cause, the permissions on nginx fastcgi folder where set wrong. Setting the permissions of /var/lib/nginx and all subfolders to www-data fixed all my problems.

Nothing like a OS update curve ball to make you scratch your head for a few hours.

Anyway hope this topic helps someone in the future!
Sebastian