基于互反射先验的端到端沉浸式投影补偿

End-to-end projection compensation in immersive projection systems based on the inter-reflection prior

摘要:

沉浸式投影系统中的互反射现象会导致投影质量下降，投影补偿任务通过对输入图像的修改补偿，减少互反射造成的影响从而得到更好的成像效果.投影补偿任务是研究输入原图与最终成像之间的关系，通过对输入图像的修改补偿，减少互反射造成的影响从而得到更好的成像效果.本文提出互反射先验，互反射先验是指发生互反射的区域的临近区域通道像素值十分接近最大值256，因此通过图像的区域通道像素值可以获得互反射信息.本文提出的互反射补偿网络(IRCN)，通过互反射先验生成互反射掩膜，消除沉浸式投影环境中的多余互反射.为了验证IRCN模型，使用了超过5000对投影图像数据集和曲面投影系统以及折面投影系统来完成实验.本文将IRCN对比多种现有投影补偿方法，实验结果表明IRCN在PSNR，RMSE，SSIM，均值标准差分析等客观评价指标中具有明显优势，说明本文提出的IRCN能够有效利用互反射先验信息，对沉浸式投影环境中的互反射现象进行补偿，在均衡训练时间的基础上增强了投影效果.

Abstract:

The inter-reflection phenomenon in immersive projection systems seriously affects the effect of projection, the projection compensation task can reduce the influence caused by the inter-reflection by modifying and compensating the input image so as to obtain a better imaging effect. In this paper，an inter-reflection prior is proposed, which means that the color effect of the region where inter-reflection occurs is very close to the maximum 256 due to the light superposition effect. Therefore, inter-reflection information can be obtained through the regional channel pixel of the image. The Inter-Reflection Compensation Network (IRCN) proposed in this paper generates an inter-reflection mask value through the inter-reflection prior, so that the IRCN can eliminate the excess interreflection in immersive projection environments. To verify the IRCN model, the erperiment were performed on more than 5000 pairs of projected image datasets and curved projection system, and fold projection system.Compared with the existing projection compensation methods, the experiment results show that IRCN has obvious advantages in objective evaluation indicators such as PSNR, RMSE, SSIM, mean and standard deviation analysis. The proposed IRCN can effectively utilize the inter-reflection prior information to compensate for the inter-reflection phenomenon in the immersive projection environment, and enhance the projection effect based on balancing the training time.