It has happened with many times on dev environment. I was running the update but have to cancel completely because I got some error (like permissions)

But there is no button to cancel it. It just get stuck most of the time.

How do I force cancel the upgrade?

You cannot cancel an upgrade that has already been started, other than restoring the backup taken prior to that upgrade