They always say it's best to error on the side of caution. At the very least coat the area with thin CA or replace the wood. The CA will add strength to the area and still not look to bad once the covering is back on.

Replacing is the best option but not your only one.