The new battery, is it OEM or some aftermarket one? If the latter, that could well be your problem.
Now, if that is not the case, then it is possible that the charging circuit is damaged and either needs to be repaired/replaced (if possible on that device) or the motherboard would need...