There shouldn't be any problem with removing it, especially since you are going to replace it with a similar (larger?) piece. As mentioned above just make sure it is very securely attached, both for security of the trolling motor, and any structural integrity that it provides the boat.