Oh Boy! A home built project.
So, first things first. Before anyone can help you, we need to know some design parameters:
1) Are you looking at a hull built for speed or for load carrying
2) Are you looking for a higher top speed or high torque
3) Are you looking at something you can program a route into or looking at manual control?
Next, you need to consider what kind of hull you want to build:
There are displacement hulls, such as the type used for cargo ships
There are planing hulls, like used on a ski boat
There are semi-displacement hulls that are sort of a combination of the other two. An example of one would be a WWII PT Boat.
As you can tell, there is a lot more to designing and building a boat than just calculations and formulas.