Full Text:   <1595>

Suppl. Mater.: 

CLC number: 

On-line Access: 2019-08-29

Received: 2022-04-22

Revision Accepted: 2022-04-22

Crosschecked: 2022-04-22

Cited: 0

Clicked: 3846

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
Open peer comments

Frontiers of Information Technology & Electronic Engineering  2019 Vol.20 No.8 P.1021-1025


On visual knowledge

Author(s):  Yun-he Pan

Affiliation(s):  Zhejiang University, Hangzhou 310027, China

Corresponding email(s):   panyh@cae.cn

Key Words: 

Share this article to: More |Next Article >>>

Yun-he Pan. On visual knowledge[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(8): 1021-1025.

@article{title="On visual knowledge",
author="Yun-he Pan",
journal="Frontiers of Information Technology & Electronic Engineering",
publisher="Zhejiang University Press & Springer",

%0 Journal Article
%T On visual knowledge
%A Yun-he Pan
%J Frontiers of Information Technology & Electronic Engineering
%V 20
%N 8
%P 1021-1025
%@ 2095-9184
%D 2019
%I Zhejiang University Press & Springer
%DOI 10.1631/FITEE.1910001

T1 - On visual knowledge
A1 - Yun-he Pan
J0 - Frontiers of Information Technology & Electronic Engineering
VL - 20
IS - 8
SP - 1021
EP - 1025
%@ 2095-9184
Y1 - 2019
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/FITEE.1910001

This paper presents the concept of “visual knowledge.” Visual knowledge is a new form of knowledge representation that is different from all other visual representations or knowledge represen-tations that have emerged in artificial intelligence (AI) development. A visual concept is composed of prototypes, category structures, hierarchical struc-tures, action structures, etc. It can further constitute a visual proposition, incorporating scene structures and their dynamics, and the visual proposition can then be used to narrate a visual scene. This paper suggests that careful utilization of developments from computer graphics technology will contribute to realizing visual knowledge representation, and to its reasoning and analysis, and that careful utilization of progression from computer vision will promote the learning of visual knowledge. Representation, reasoning, learn-ing, and utilization of visual knowledge will form a key step toward remarkable breakthroughs in the era of AI 2.0.


摘要:提出“视觉知识”概念. 视觉知识是知识表达的一种新形式. 它与迄今为止人工智能(AI)所用知识表达方法不同. 其中视觉概念具有典型(prototype)与范畴结构、层次结构与动作结构等要素. 视觉概念能构成视觉命题,包括场景结构与动态结构,视觉命题能构成视觉叙事. 指出重构计算机图形学成果可实现视觉知识表达及其推理与操作,重构计算机视觉成果可实现视觉知识学习. 实现视觉知识表达、推理、学习和应用技术将是AI 2.0取得突破的重要方向之一。


Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article


[1]Anderson JR, 1989. Cognitive Psychology (Yang Q, Trans.). Jilin Education Press, China.

[2]Greff K, Kaufmann RL, Kabra R, et al., 2019. Multi-object representation learning with iterative variational inference. https://arxiv.org/abs/1903.00450

[3]Horoufchin H, Bzdok D, Buccino G, et al., 2018. Action and object words are differentially anchored in the sensory motor system—a perspective on cognitive embodiment. Sci Reports, 8:6583.

[4]Hutchinson B, Mitchell M, 2019. 50 years of test (un)fairness: lessons for machine learning. Proc Conf on Fairness, Accountability, and Transparency, p.49-58.

[5]Kosiorek AR, Sabour S, Teh YW, et al., 2019. Stacked capsule autoencoders. https://arxiv.org/abs/1906.06818

[6]Ma SD, Zhang ZY, 1998. Computer Vision: Fundamentals of the Computational Theory and Algorithms. China Science Publishing & Media Ltd., Beijing, China (in Chinese).

[7]Pan YH, 1991. A study on the imagery information model of imagery thinking. Patt Recogn Artif Intell, 4(4):7-12 (in Chinese).

[8]Pan YH, 1996. A study on integrated reasoning. Patt Recogn Artif Intell, 9(3):201-208 (in Chinese).

[9]Pan YH, 2016. Heading toward artificial intelligence 2.0. Engineering, 2(4):409-413.

[10]Pan YH, Tong RF, Tang M, 2011. Computer Graphics: Principles, Methods and Applications (3rd). Higher Education Press, Beijing, China (in Chinese).

[11]Zhao Y, Birdal T, Deng H, et al., 2019. 3D point capsule networks. Proc IEEE Conf on Computer Vision and Pattern Recognition, p.1009-1018.

Open peer comments: Debate/Discuss/Question/Opinion


Please provide your name, email address and a comment

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2023 Journal of Zhejiang University-SCIENCE