Needs battery to be inserted to turn on briefly then shuts down?

Hello, my s4 turns on briefly until the first "samsung galaxy S4" logo just to turn off and refusing to turn on again until I remove and re-insert the battery again. I tried goin into recovery/download mode and even when it allowed me into those modes the phone ended up doing the same thing by turning on for about 4-5 second and then shutting down until I placed the battery back.

Also the phone turn on automatically when i place the battery on it, I dont think that is a normal behaviour is it? I have two galaxy s4 and the one that works doesnt do that. That to say that ive tried two different batteries without success.

I only want to know which part could be giving me the problem so i can replace it with my spare s4.