I have 2 installations. On the first one i'm able to get in that 'create' dialog a direct link to create a page from a page database.

For some reason it doesn't show there in my second installation. What should I set for the page creation link of a particular db to appear here? 

It’s based on the database permissions. You should see a link for any database the current member is allowed to post in.