Sounds like the starter relay or solinoid , did the new starter come with new relay if solinoid I am thinking that will need to be replaced , check that all terminals earth straps to battery /engine are all tight and not corroded and battery is charged maybe try jump starting