We prove that if a curve of a non-isotrivial family of abelian varieties over a curve contains infinitely many isogeny orbits of a finitely generated subgroup of a simple abelian variety then it is special. This result fits into the context of Zilber-Pink conjecture and partially generalizes a result of Faltings. Moreover by using the polyhedral reduction theory we give a new proof of a result of Bertrand.