I was the same way and actually returned my first scale boat kit to the hobby store after I opened it. Figured there was NO WAY I could possibly build it. But I was wrong, tried again a couple years later and it's much easier than it looks. It's easy to forget how much sanding, filler and epoxy can smooth out the hull, especially around the bow.

Check out kits with fiberglass or ABS hulls too if you want to only concentrate efforts on the deck and cabin.