You definitely should have some idea of what the old domain was used for before you buy it.
Try the Way Back Machine to see what used to be hosted there:
http://www.archive.org
If a domain was using blackhat tactics, was hosting adult content or banned from Google: That's not a good way to start off your new site.