If he keeps on repeatedly hitting the container, chances are that he will damage his nose, lips and teeth, which can result in mouth canker (necrotising stomatisis). That is something you need to avoid. Cover the container so he can't see you all the time and feed him using long forceps, so the mouse is the target and not your hand. You can wrap a towel over you hand so if he bites, he is not going to hurt himself (or you). Hopefully, he will soon realise that biting a towel is not much fun and will concentrate more on the mouse. Keep your hand steady and move the mouse in front of him. Be patient.