There is usually a small delay while the file is read and a preview generated. You might want to check your Windows configuration if you never see previews.
In Windows Vista/7:
Click the Organize button on any folder, and choose Folder and Search Options from the menu.
Click the View tab, and then un-check the Always show icons, never thumbnails checkbox.
Click OK