Try adding some weight to the front to keep it level

Several things could cause this, but you don't provide much information.

To me, what you are describing is to much control with not enough flying speed.

This assumes that the model is built correctly and is balanced properly.

Welcome to a fellow Matt, I don't know how much experience you have but I will assume you are just getting started. Getting started in RC can be intimidating but it is rewarding. There are a lot of experienced fliers on this site like Tom Crump above. They can be a very useful source of advice and knowledge. To take best advantage of that advice people need to see as much information as possible about the airplane. Even if it is one of those chain store foam gliders, knowing what you are working with is helpful. If you spend much time on this forum it won't take long to make 10 posts.

I have to agree with Matt Kirk. There are a lot of really knowledgeable people on this site and a lot of them are more than willing to try and help you out. The biggest issue we have, when trying to help someone is lack of information. What we would need, to be able to help you out, is the following:
1) Type of plane. Is it a kit build, foamy, ARF, etc? An example of this would be a Kadet Sr ARF. A Kadet is a well known aircraft, the SR is what size, while ARF means it's a plane that required assembling premade finished parts
2) Where are your control surfaces when compared to the wing or tail they are attached to? Are they straight, pointed up or down, rudder left or right?
3) Is the motor what came with the plane or something you had to buy to complete it?
4) Is the plane's motor an electric or does it require liquid fuel
5) Are we correct in assuming you're a beginner with no flight experience? You initial post would lead us to believe that is the case but, as many of us have found out, appearances can be deceiving
With these questions answered, we will be able to help you much more effectively than just guessing at what's actually going on

Don't make changes to your airplane yet. We don't know enough to diagnose your problem.

Chances are what you really need is the most neglected accessory for new RC pilots- an instructor. This hobby is rewarding, but it's a skill that you have to work at.

Should probably check the CG first. Then let us know what model this is and what if any changes he made to it. Then we can start to diagnose it.

Appowner nailed it.
You can't fix anything unless you start with establishing the correct CG balance first.
Matt needs to at least tell us what plane he has so someone could tell him how to balance it.
Then we go from there.

Somehow, I get the feeling he's not too interested in getting help. He hasn't posted anything since the 13th of last month.

A lot of that out there in all endevours. Instant gratification runs rampant!

You must determine the C G point and balance the model neutral. Then it wont nose up but fly correctly.

Yep, I hate to see the young guys who log in one time and then never return. Maybe they get help from someone else. Or maybe he waited 6 or 7 seconds and gave up on getting a reply and just went back out hoping it fixed itself.

or quite possibly,...he posted a question while doing a search and found information that answered his question. this has happened to me many times. it is polite however, to post a thanks and a short message saying the information has been found. I like to say where I found the info I was looking for , so that other people who might have the same problem can use it.

Maybe you`ve got the wing pushed all the way up to the front of the slot in the fuselage. Try sliding it back to the middle.