Ranking-Preserving Cross-Source Learning for Image Retargeting Quality Assessment

Yong-Jin Liu Tsinghua University Yiheng Han Tsinghua University Zipeng Ye Tsinghua University Yu-Kun Lai Cardiff University

Machine Learning mathscidoc:1908.41001

IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019
Image retargeting techniques adjust images into different sizes and have attracted much attention recently. Objective quality assessment (OQA) of image retargeting results is often desired to automatically select the best results. Existing OQA methods train a model using some benchmarks (e.g., RetargetMe), in which subjective scores evaluated by users are provided. Observing that it is challenging even for human subjects to give consistent scores for retargeting results of different source images (diff-source-results), in this paper we propose a learning-based OQA method that trains a General Regression Neural Network (GRNN) model based on relative scores --- which preserve the ranking --- of retargeting results of the same source image (same-source-results). In particular, we develop a novel training scheme with provable convergence that learns a common base scalar for same-source-results. With this source specific offset, our computed scores not only preserve the ranking of subjective scores for same-source-results, but also provide a reference to compare the diff-source-results. We train and evaluate our GRNN model using human preference data collected in RetargetMe. We further introduce a subjective benchmark to evaluate the generalizability of different OQA methods. Experimental results demonstrate that our method outperforms ten representative OQA methods in ranking prediction and has better generalizability to different datasets.
image quality assessment, learning to rank, general regression neural network, Image retargeting
[ Download ] [ 2019-08-27 19:34:25 uploaded by liuyongjin ] [ 583 downloads ] [ 0 comments ]
  • DOI (identifier) 10.1109/TPAMI.2019.2923998, https://doi.org/10.1109/TPAMI.2019.2923998
@inproceedings{yong-jin2019ranking-preserving,
  title={Ranking-Preserving Cross-Source Learning for Image Retargeting Quality Assessment},
  author={Yong-Jin Liu, Yiheng Han, Zipeng Ye, and Yu-Kun Lai},
  url={http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20190827193425822643467},
  booktitle={IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year={2019},
}
Yong-Jin Liu, Yiheng Han, Zipeng Ye, and Yu-Kun Lai. Ranking-Preserving Cross-Source Learning for Image Retargeting Quality Assessment. 2019. In IEEE Transactions on Pattern Analysis and Machine Intelligence. http://archive.ymsc.tsinghua.edu.cn/pacm_paperurl/20190827193425822643467.
Please log in for comment!
 
 
Contact us: office-iccm@tsinghua.edu.cn | Copyright Reserved