Topological qauntum field theory(TQFT) is a very powerful theoretical tool to study topological phases and phase transitions. In 2+1D, it is well known that the Chern-Simons theory captures all the universal topological data of topological phases, e.g., quasi-particle braiding statistics, chiral central charge and even provides us a deep insight for the nature of topological phase transitions. Recently, topological phases of quantum matter are also intensively studied in 3+1D and it has been shown that loop like excitation obeys the so-called three-loop-braiding statistics. In this paper, we will try to establish a TQFT framework to understand the quantum statistics of particle and loop like excitation in 3+1D. We will focus on Abelian topological phases for simplicity, however, the general framework developed here is not limited to Abelian topological phases.