We consider in this work stochastic differential equation (SDE) model for particles in contact with a heat bath when the memory effects are non-negligible. As a result of the fluctuation-dissipation theorem, the differential equations driven by fractional Brownian noise to model memory effects should be paired with Caputo derivatives and based on this we consider fractional stochastic differential equations (FSDEs), which should be understood in an integral form. We establish the existence of strong solutions for such equations. In the linear forcing regime, we compute the solutions explicitly and analyze the asymptotic behavior, through which we verify that satisfying fluctuation-dissipation indeed leads to the correct physical behavior. We further discuss possible extensions to nonlinear forcing regime, while leave the rigorous analysis for future works.