We study different classes of Jensen measures for plurisubharmonic functions, in particular the relation between Jensen measures for continuous functions and Jensen measures for upper bounded functions. We prove an approximation theorem for plurisubharmonic functions in$B$-regular domain. This theorem implies that the two classes of Jensen measures coincide in$B$-regular domains. Conversely we show that if Jensen measures for continuous functions are the same as Jensen measures for upper bounded functions and the domain is hyperconvex, the domain satisfies the same approximation theorem as above.