My phone doesn't charge

I turned it off. Turned it back on: Nothing. Took off sim card. Insert sim card again and tried again. Nothing. Tried to plug it in my computer. Nothing. THEN turn down volume, way down, and plug in outlet. Get the sign NOKIA, then a big "!" exclamation point. then show me the battery in red, but doesn't charge. Do I need to change the battery?