大阪大学 · 情報科学
福橋拓也教授の研究室は、3次元映像・点群データの高効率かつ高品質な無線伝送を目的として、デジタルとアナログのハイブリッド伝送技術の研究を進めています。特に、無線環境の変動に強く、品質が段階的に低下する「崖の効果(cliff effect)」を回避するソフトデリバリー技術や、グラフ信号としての点群データを効果的に扱う新しい符号化方式の開発が主な研究テーマです。これにより、VR・ARや自動運転、ホログラフィックディスプレイなどの次世代応用分野におけるリアルタイムで高品質な3D映像伝送の実現を目指しています。
Figures are computed from collected data and may differ slightly.
Multi-view video consists of multiple video sequences captured simultaneously by multiple closely spaced cameras and enables users to freely change their viewpoints by playing different video sequences. Therefore, the transmission bitrate of multi-view video requires more bandwidth than conventional multimedia. In order to reduce the bandwidth requirement, User Dependent Multi-view Video Transmission (UDMVT), which is based on Multi-view Video Coding (MVC), has been proposed for single users. In
Soft video delivery, i.e., analog video transmission, has been proposed to provide high video quality in unstable wireless channels. However, existing analog schemes need to transmit a significant amount of metadata to a receiver for power allocation and decoding operations causing large overhead and quality degradation due to rate and power losses. To reduce the overhead while keeping the video quality high, we propose a new analog transmission scheme. Our scheme exploits a Gaussian Markov rand
Point cloud is an emerging data format useful for various applications such has holographic display, autonomous vehicle, and augmented reality. Conventionally, communications of point cloud data have relied on digital compression and digital modulation for three-dimensional (3D) data streaming. However, such digital-based delivery schemes have fundamental issues called cliff and leveling effects, where the 3D reconstruction quality is a step function in terms of wireless channel quality. We prop
Wireless multi-view plus depth (MVD) video streaming enables free viewpoint video playback on wireless devices, where a viewer can freely synthesize any preferred virtual viewpoint from the received MVD frames. Existing schemes of wireless MVD streaming use digital-based compression to achieve better coding efficiency. However, the digital-based schemes have an issue called the cliff effect, where the video quality is a step function in terms of wireless channel quality. In addition, parameter o
In typical point cloud delivery, a sender uses octree-based and graph-based digital video compression to send three-dimensional (3D) points and color attributes. However, the digital-based schemes have an issue called the cliff effect, where the 3D reconstruction quality will be a step function in terms of wireless channel quality. To prevent the cliff effect subject to channel quality fluctuation, we have proposed a wireless point cloud delivery called HoloCast inspired by soft delivery. Althou
In conventional point cloud delivery, a sender uses octree-based digital video compression to stream three-dimensional (3D) points and the corresponding color attributes over band-limited links, e.g., wireless channels, for 3D scene reconstructions. However, the digital-based delivery schemes have an issue called cliff effect, where the 3D reconstruction quality is a step function in terms of wireless channel quality. We propose a novel scheme of point cloud delivery, called HoloCast, to gracefu
Screen-camera communications, using a liquid crystal display (LCD) screen and camera image sensors, have been attractive variants of visible light communications (VLC) since any external light-emitting modules and photo detectors are required for recent mobile devices, which are usually equipped with display and camera. A major issue in screen-camera communications is a performance loss in transmission rate due to nonlinear channel impairments with ambient noise. To improve transmission rates, w
Existing studies on multiview video streaming are proposed for terrestrial environments. They can be classified into request-reply and all camera transmission models, while both models suffer from a long switching delay and low video quality in an underwater acoustic path. The implementation of multiview video transmission in an underwater acoustic path requires reduction of the switching delay and the maintenance of high video quality. To this end, we propose a video transmission scheme, namely
Wireless video streaming for multi-view plus depth (MVD) frames enables free viewpoint video on wireless devices, where a viewer can freely synthesize any preferred virtual viewpoint from the received MVD frames. To transmit MVD frames over wireless links, existing schemes use digital-based compression to achieve better compression efficiency. However, the digital-based schemes have an issue called cliff effect, where the video quality is a step function in terms of wireless channel quality. In
Conventional point cloud delivery schemes use graph-based compression to stream three-dimensional (3D) points and the corresponding color attributes over wireless channels for 3D scene reconstructions. However, the graph-based compression requires a significant communication overhead for graph signal decoding, i.e., inverse graph Fourier transform (IGFT), and such large overhead causes a low 3D reconstruction quality due to power and rate losses. We propose a novel scheme of point cloud delivery
The quality of wireless video delivery is susceptible to wireless channel instability, including channel fading, interference, noise, and packet loss. To improve the video quality in such wireless channels, analog transmission schemes have been proposed recently. However, the existing analog schemes have two drawbacks in high energy of video signals and loss resilience. To overcome the issues, we propose a new hybrid digital-analog transmission scheme, which jointly uses digital coding and analo
A major challenge of screen-camera visual multiinput multi-output (MIMO) communications is to increase the achievable throughput by reducing nonlinear channel effects including perspective distortion, ambient lights, and color mixing. To mitigate such nonlinear effects, an existing transmission method uses linear or simple nonlinear equalizations in decoding operations. However, the throughput improvement from the equalization techniques is often limited because the effects are composed of a com
Communication of bioelectric signals, such as electroencephalography (EEG) signals, will be a key technology for smooth interaction between users and remote robots. The existing solutions use an orthogonal transform for EEG signal compression, such as Discrete Wavelet Transform (DWT) or Discrete Cosine Transform (DCT). This paper proposes a graph-based compression scheme for EEG signals to improve the quality at the given rate. The proposed scheme constructs a graph from the positions of the EEG
Screen-camera communication, which uses a liquid crystal display (LCD) screen and camera image sensors, has been an attractive variant of visible light communications (VLC) since display and camera have been equipped with in various mobile devices. To improve transmission rates, we investigate the impact of nonlinear channel equalization and nonbinary channel coding as well as high-order modulation schemes. Equalization techniques can reduce the effect of channel impairments, such as color mixin
Multi-view video consists of multiple video sequences captured simultaneously from different angles by multiple closely spaced cameras. It enables the users to freely change their viewpoints by playing different video sequences. Transmission of multi-view video requires more bandwidth than conventional multimedia. To reduce the bandwidth, UDMVT (User Dependent Multi-view Video Transmission) based on MVC (Multi-view Video Coding) has been proposed for single user. In UDMVT, for multiple users the
Open papers in the app to read, cite, and organize with AI.