Consider a linear model Y= X + z, where X= X n, p and z~ N (0, I n). The vector is unknown and it is of interest to separate its nonzero coordinates from the zero ones (ie, variable selection). Motivated by examples in long-memory time series (Fan and Yao, 2003) and the change-point problem (Bhattacharya, 1994), we are primarily interested in the case where the Gram matrix G= X X is non-sparse but sparsifiable by a finite order linear filter. We focus on the regime where signals are both rare and weak so that successful variable selection is very challenging but is still possible.