Duh you say. How would I be reading this if WordPress was not installed.

It was really easy by following the 5 minute setup of the WordPress doc. I was too excited, so of course on the first run I forgot to create the database.