Thanks for all of the suggestions. I looked at Inno Setup and it looks like easiest way to deploy a simple Win32 application with a SQLite database file.
What settings would I need in my TFDConnection so that it looks locally where it is installed? Just use Inno Setup with the exe and db file, so that the applications looks in the same location as the exe file.