As @Woodsman says, follow the guide. And the answer is no, you dont remove ALL of the files of 3.x You have to keep specific files.
Do it step by step and tell us where you stuck. It doesn't matter how simple your question is..There are no stupid questions....