Dynamic Object Scanning:
Object-Based Elastic Timeline for Quickly Browsing First-Person Videos
Seita Kayukawa, Keita Higuchi, Ryo Yonetani, Masanori Nakamura, Yoichi Sato, and Shigeo Morishima
We present a video fast-forwarding technique based on automated content analysis and user inputs. By using our interface, users can browse a variety of videos quickly.
30-sec Preview Video
Main Video [2:15]
Abstract
This work presents an adaptive video fast-forwarding technique that helps users browse long and untrimmed videos quickly. The proposed method is built upon the concept of the elastic timeline that a) allows users to select low-level cues of a video that they like to enhance and b) adaptively fast-forwards the video while keeping scenes with the selected cues played at a lower speed. The proposed method helps users to choose appropriate cues, in particular, a small set of object cues arranged automatically tailored to the contents of a given video out of many. Our user studies show that object cues selected by our method allow users to browse videos recorded under a variety of scenarios, such as cooking at home, strolling in the street, and playing in an amusement park, more quickly compared to the state-of-the-art interface with the elastic timeline in event finding tasks.
Publications
Seita Kayukawa, Keita Higuchi, Ryo Yonetani, Masanori Nakamura, Yoichi Sato, and Shigeo Morishima. 2018. Dynamic Object Scanning: Object-Based Elastic Timeline for Quickly Browsing First-Person Videos. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA 2018).
CHI 2018 LBW and Demo DOI (LBW) DOI (Demo) Poster Paper (LBW) BibTeX

粥川青汰, 樋口啓太, 中村優文, 米谷竜, 佐藤洋一, 森島繁生. 一人称視点映像の高速閲覧に有効なキューの自動生成手法. インタラクティブシステムとソフトウェアに関するワークショップ. 2017.
WISS 2017 Paper

粥川青汰, 樋口啓太, 中村優文, 米谷竜, 佐藤洋一, 森島繁生. 物体検出とユーザ入力に基づく一人称視点映像の高速閲覧手法. 情報処理学会コンピュータビジョンとイメージメディア研究会. 2017.
CVIM 2017
Authors
Waseda University
University of Tokyo
University of Tokyo
Masanori Nakamura
Waseda University
University of Tokyo
Waseda Research Institute for Science and Engineering
Waseda University
University of Tokyo
University of Tokyo
Masanori Nakamura
Waseda University
University of Tokyo
Waseda Research Institute for Science and Engineering
Patent
表示制御装置、表示制御方法及び表示制御プログラム", 特願2018-80849, (出願中)
Acknowledgements
This work was supported by JST ACCEL (grant JPMJAC1602) and JST CREST (grant JPMJCR14E1).