基于草图交互的视频摘要方法及认知分析
Video sketch summarization, interaction and cognition analysis
查看参考文献17篇
|
文摘
|
视频是一类重要的视觉媒体,也是人们进行信息交流的重要载体.面向视频数据的高效内容表达,以及自然便捷的用户浏览和搜索等交互操作,本文提出了一种面向视频内容的草图摘要及交互方法.首先提出了面向视频语义的草图化表征方式,利用草图抽象性和概括性等特点,提出语义草图概念,支持对视频内容的语义草图注释,同时提出了草图摘要的优化布局算法.在此基础上,提出了基于草图摘要的草图交互技术,以及支持交互式视频浏览的自然手势操作,并进一步从认知心理学的角度分析了用于视频摘要的草图表征,以及草图交互中各认知单元的作用及相互关系.最后用户评估的实验结果表明,本文所提出的草图摘要以及草图交互方式提高了获取视频主要内容方面的用户效率,减轻了用户的认知负荷. |
|
其他语种文摘
|
Video, as one typical digital media, is important for message communication. For efficient video content visualization and natural interaction such as video browsing and searching, we propose a sketch-based video summarization with fluent sketch interaction in this paper. Firstly, we present the sketch representation for video semantics, which takes the advantages of abstractness and generality of sketches. The concept of semantic sketch is proposed, which supports annotating video contents with sketches. Furthermore, an optimized layout algorithm for sketch summarization is presented. Secondly, we present the interaction techniques for sketch summarization and natural sketch gesture operations. From the viewpoint of cognitive psychology, we analyze the sketch representation, as well as the effects and relations of cognitive units in sketch interaction. Finally, user studies show that the proposed sketch summarization and sketch interaction improve user efficiency in terms of acquiring the main video content and reduce users’ cognitive load. |
|
来源
|
中国科学. 信息科学
,2013,43(8):1012-1023 【核心库】
|
|
关键词
|
视频摘要
;
草图布局
;
手势交互
;
认知分析
|
|
地址
|
1.
中国科学院软件研究所, 人机交互北京市重点实验室, 北京, 100190
2.
清华大学计算机系, 清华信息科学与技术国家实验室, 北京, 100084
3.
中国科学院心理研究所, 脑与认知科学国家重点实验室, 北京, 100101
4.
中国科学院软件研究所, 人机交互北京市重点实验室;;计算机科学国家重点实验室, 北京, 100190
|
|
语种
|
中文 |
|
文献类型
|
研究性论文 |
|
ISSN
|
1674-7267 |
|
学科
|
自动化技术、计算机技术 |
|
基金
|
清华信息科学与技术国家实验室(筹)资助
;
国家自然科学基金
;
国家高技术研究发展计划
;
国家973计划
;
国家教育部新世纪优秀人才支持计划
|
|
文献收藏号
|
CSCD:4922065
|
参考文献 共
17
共1页
|
|
1.
Borgo R. State of the art report on video-based graphics and video visualization.
Comput Graph Forum,2012,31:2450-2477
|
被引
2
次
|
|
|
|
|
2.
Ma C X. Sketch-based annotation and visualization in video authoring.
IEEE Trans Multimedia,2012,14:1153-1165
|
被引
5
次
|
|
|
|
|
3.
Winnemoller H. Real-time video abstraction.
ACM Trans Graph (Proc SIGGRAPH'06),2006,25:1221-1226
|
被引
35
次
|
|
|
|
|
4.
Cernekova Z. Information theory-based shot cut/fade detection and video summarization.
IEEE Trans Circuits Syst Video Technol,2006,16:82-91
|
被引
16
次
|
|
|
|
|
5.
Ma C X. KnitSketch: a sketch pad for conceptual design of 2D garment patterns.
IEEE Trans Autom Sci Eng,2011,8:431-437
|
被引
5
次
|
|
|
|
|
6.
Liu Y J. EasyToy: plush toy design using editable sketching curves.
IEEE Comput Graph,2011,31:49-57
|
被引
1
次
|
|
|
|
|
7.
Liu Y J. User-adaptive sketch-based 3D CAD model retrieval.
IEEE Trans Autom Sci Eng,2013
|
被引
1
次
|
|
|
|
|
8.
Liu Y J. A semantic feature model in concurrent engineering.
IEEE Trans Autom Sci Eng,2010,7:659-665
|
被引
5
次
|
|
|
|
|
9.
Goldman D R.
A framework for video annotation, visualization, and interaction. Ph.D. Thesis,2007
|
被引
1
次
|
|
|
|
|
10.
Guo W J. Improving linear drawing concerning stylized sketch.
Signal Process,2012,28:1-4
|
被引
1
次
|
|
|
|
|
11.
Liu L G. Optimizing photo composition.
Comput Graph Forum,2010,29:469-478
|
被引
7
次
|
|
|
|
|
12.
Liu Y J. Image retargeting quality assessment.
Comput Graph Forum,2011,30:583-592
|
被引
23
次
|
|
|
|
|
13.
彭聃龄.
普通心理学,2004
|
被引
20
次
|
|
|
|
|
14.
Fu X L. A computational cognition model of perception, memory and judgment.
Sci China Inf Sci,2013
|
被引
1
次
|
|
|
|
|
15.
Fu Q F. Time course of natural scene categorization in human brain: simple line-drawings vs. color photographs..
J Vision,2013,13:1060
|
被引
1
次
|
|
|
|
|
16.
Shneiderman B. The eyes have it: a task by data type taxonomy for information visualizations.
Proceedings of IEEE Workshop Visual Languages,1996:336-343
|
被引
1
次
|
|
|
|
|
17.
Pirolli P. The Sensemaking process and leverage points for analyst technology as identi_ed through cognitive task analysis.
Proceedings of the International Conference on Intelligence Analysis,2005
|
被引
1
次
|
|
|
|
|
了解气象卫星更多信息，请访问