How can I do that?

It seems like 4.4 no longer support a payment gateaway, and I am honestly f'd.. How can I downgrade? Is there any way to downgrade to stable?

Revert to the backup you took before you upgraded.

There is no downgrade path, outside of restoring a backup.

Out of curiosity....which payment gateway are you referring to?