[论文解读] Using Computer Vision Techniques for Moving Poster Design

Sérgio M. Rebelo, Pedro Martins+2 more|arXiv (Cornell University)|Nov 27, 2018

Augmented Reality Applications参考文献 1被引用 5

一句话总结

本文提出了一种基于计算机视觉的系统，通过运动追踪和环境数据感知物理环境，动态生成移动海报，实现与用户存在和周围环境实时互动的上下文感知设计。其主要贡献是一个新颖的框架，将实时视觉输入与平面设计相结合，为每位观众提供独特且个性化的海报体验。

ABSTRACT

Graphic Design encompasses a wide range of activities from the design of traditional print media (e.g., books and posters) to site-specific (e.g., signage systems) and electronic media (e.g., interfaces). Its practice always explores the new possibilities of information and communication technologies. Therefore, interactivity and participation have become key features in the design process. Even in traditional print media, graphic designers are trying to enhance user experience and exploring new interaction models. Moving posters are an example of this. This type of posters combine the specific features of motion and print worlds in order to produce attractive forms of communication that explore and exploit the potential of digital screens. In our opinion, the next step towards the integration of moving posters with the surroundings, where they operate, is incorporating data from the environment, which also enables the seamless participation of the audience. As such, the adoption of computer vision techniques for moving poster design becomes a natural approach. Following this line of thought, we present a system wherein computer vision techniques are used to shape a moving poster. Although it is still a work in progress, the system is already able to sense the surrounding physical environment and translate the collected data into graphical information. The data is gathered from the environment in two ways: (1) directly using motion tracking; and (2) indirectly via contextual ambient data. In this sense, each user interaction with the system results in a different experience and in a unique poster design.

研究动机与目标

• 开发一种将计算机视觉与平面设计相结合的系统，用于交互式移动海报。
• 基于实时环境数据和用户交互，实现动态海报生成。
• 探索上下文和基于运动的输入如何实时影响视觉输出。
• 通过环境感知个性化海报内容，提升用户参与度。

提出的方法

• 系统使用运动追踪检测用户相对于海报的移动和位置。
• 通过传感器和计算机视觉算法收集环境上下文数据（例如光照、噪音、存在状态）。
• 基于实时输入数据，程序化生成或修改海报中的视觉元素。
• 通过反馈回路持续根据环境刺激更新海报的视觉构图。
• 设计引擎将传感器数据映射到视觉参数，如颜色、运动和版式。
• 系统在数字显示平台上实现，支持自适应视觉内容的实时渲染。

实验结果

研究问题

• RQ1 如何利用计算机视觉技术根据实时环境输入动态调整移动海报内容？
• RQ2 哪些类型的用户交互和环境线索可以有效转化为视觉设计变化？
• RQ3 视觉元素的实时自适应如何影响用户对移动海报的感知和参与度？
• RQ4 来自物理环境的上下文数据在多大程度上能塑造移动海报的美学和行为输出？

主要发现

• 该系统成功利用计算机视觉感知用户存在和移动，实现海报的实时自适应。
• 整合光照和音量等环境数据，使海报能够实现上下文敏感的视觉变化。
• 每次用户交互均生成独特的海报设计，显著提升个性化与参与度。
• 原型证明了利用计算机视觉创建交互式、响应式海报体验的可行性。
• 该系统通过使海报对环境动态做出响应，实现了无缝的观众参与。
• 该方法在公共空间、展览和互动装置等未来应用中展现出巨大潜力。