Clothing is one of the symbol of modern fashion trends, research concerning clothing detail’s recognition still remains a hot topic in the field of computer. Existing research is mainly focused on relating clothing detail features and aesthetic styles, realizing the possibilities of auto clothing aesthetic appreciation. In this paper, based on existing data sets, we will introduce the ideology of Deep Learning into the association model between clothing visual features to improve the model’s effectiveness and accuracy. By calculating the distance between aesthetic words and seed words, we are able to map the most often used aesthetic words in a two-dimensional space, building a fashion semantic space. Later, we introduce the ideology of Deep Learning into the association model between clothing detail features, and designed experiments to prove the effectiveness of the model. In the research, we discussed how different parameters and structures in Deep Learning effect the outcome of the relating model, and by comparison we choose the best parameters of the model. Based on the work mentioned above, we analyze different styles of different categories’ clothing in shopping websites, which further confirms the effectiveness of our model.