In this paper we investigate staggered discontinuous Galerkin method for the Helmholtz equation with large wave number on general quadrilateral and polygonal meshes. The method is highly flexible by allowing rough grids such as the trapezoidal grids and highly distorted grids, and at the same time, is numerical flux free. Furthermore, it allows hanging nodes, which can be simply treated as additional vertices. By exploiting a modified duality argument, the stability and convergence can be proved under the condition that \kappa h is sufficiently small, where \kappa h is the wave number and \kappa h is the mesh size. Error estimates for both the scalar and vector variables in \kappa h norm are established. Several numerical experiments are tested to verify our theoretical results and to present the capability of our method for capturing singular solutions.