Waseda University · 신경과학
마시키 키부야 교수의 연구실은 시각 장애인의 실내 이동과 환경 탐색을 지원하기 위한 지능형 보조 시스템 개발에 초점을 맞추고 있습니다. 스마트폰과 로봇 기반의 실시간 환경 인식, 장애물 회피, 경로 안내, 그리고 기억 기반의 자연어 명령 이해 기술을 융합한 혁신적인 접근을 펼치고 있습니다. 특히, 사전 지도 없이도 장애인이 스스로 길을 찾을 수 있도록 돕는 지도 없는 내비게이션, 실시간 시각 정보 기반의 환경 설명, 그리고 인간의 기억에서 유래된 복잡한 경로 지시를 이해하는 데 중점을 두고 있습니다.
표시된 성과는 수집된 데이터 기준으로 산출되며, 일부 차이가 있을 수 있습니다.
Standing in line is one of the most common social behaviors in public spaces but can be challenging for blind people. We propose an assistive system named LineChaser, which navigates a blind user to the end of a line and continuously reports the distance and direction to the last person in the line so that they can be followed. LineChaser uses the RGB camera in a smartphone to detect nearby pedestrians, and the built-in infrared depth sensor to estimate their position. Via pedestrian position es
Indoor navigation systems with prebuilt maps have shown great potential in navigating blind people even in unfamiliar buildings. However, blind people cannot always benefit from them in every building, as prebuilt maps are expensive to build. This paper explores a map-less navigation system for blind people to reach destinations in unfamiliar buildings, which is implemented on a robot. We first conducted a participatory design with five blind people, which revealed that intersections and signs a
Navigating in an indoor corridor can be challenging for blind people as they have to be aware of obstacles while also having to recognize the intersections that lead to the destination. To aid blind people in such tasks, we propose Corridor-Walker, a smartphone-based system that assists blind people to avoid obstacles and recognize intersections. The system uses a LiDAR sensor equipped with a smartphone to construct a 2D occupancy grid map of the surrounding environment. Then, the system generat
assists users in recreational exploration by explaining the surrounding environment through images obtained from the robot's camera.Users can adjust the level of detail and ask questions about their surroundings.Additionally, the system can guide users to locations they have visited before.
Visual Language Navigation (VLN) powered robots have the potential to guide blind people by understanding route instructions provided by sighted passersby. This capability allows robots to operate in environments often unknown a prior. Existing VLN models are insufficient for the scenario of navigation guidance for blind people, as they need to understand routes described from human memory, which frequently contains stutters, errors, and omissions of details, as opposed to those obtained by thin
Visual Language Navigation (VLN) powered robots have the potential to guide blind people by understanding route instructions provided by sighted passersby. This capability allows robots to operate in environments often unknown a prior. Existing VLN models are insufficient for the scenario of navigation guidance for blind people, as they need to understand routes described from human memory, which frequently contains stutters, errors, and omissions of details, as opposed to those obtained by thin
