Note - This caught me out. I had left my nginx configurations to php7.4, but forgot to force php-cli to be on 7.4, you can do so easily by doing:
update-alternatives --set php /usr/bin/php7.4
@nodle are you sure your background tasks are working on php8.1?