Sora for foundation robots with parallel intelligence: three world models, three robotic systems

Lili FAN; Chao GUO; Yonglin TIAN; Hui ZHANG; Jun ZHANG; Fei-Yue WANG

doi:10.1631/FITEE.2400144

Your Location：

Home >

Browse articles >

Sora for foundation robots with parallel intelligence: three world models, three robotic systems

Regular Papers | Updated：2024-07-28

- Sora for foundation robots with parallel intelligence: three world models, three robotic systems
- 基于Sora的平行智能基础机器人：三个世界模型，三种机器人系统
- Frontiers of Information Technology & Electronic Engineering Vol. 25, Issue 7, Pages: 917-923(2024)
- Affiliations：
  
  1.School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China
  2.State Key Laboratory for Management and Control of Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
  3.School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044, China
  4.School of Electrical Engineering, Wuhan University, Wuhan 430072, China
- Author bio：
  
  E-mail: lilifan@bit.edu.cn
  ‡Corresponding author
- Funds：
- DOI：10.1631/FITEE.2400144
  CLC：
- Received：03 March 2024，
  
  Accepted：06 April 2024，
  
  Published Online：22 April 2024，
  
  Published：0 July 2024
- Accepted：
Scan QR Code
Lili FAN, Chao GUO, Yonglin TIAN, et al. Sora for foundation robots with parallel intelligence: three world models, three robotic systems[J]. Frontiers of Information Technology & Electronic Engineering, 2024, 25(7): 917-923.
DOI：

Lili FAN, Chao GUO, Yonglin TIAN, et al. Sora for foundation robots with parallel intelligence: three world models, three robotic systems[J]. Frontiers of Information Technology & Electronic Engineering, 2024, 25(7): 917-923. DOI： 10.1631/FITEE.2400144.

摘要

本文概述了基于基础模型和并行智能开发基础、基础设施机器人、机器人技术的初始步骤和基本框架，以及新型人工智能技术（如AlphaGO、ChatGPT和Sora）的潜在应用。

Abstract

关键词

Keywords

references

Bai TX , Wang S , Shen Z , et al. , 2017 . Parallel robotics and parallel unmanned systems: framework, structure, process, platform and applications . Acta Autom Sin , 43 ( 2 ): 161 - 175 (in Chinese) . https://doi.org/10.16383/j.aas.2017.y000002 https://doi.org/10.16383/j.aas.2017.y000002

Fan LL , Cao DP , Zeng CX , et al. , 2023a . Cognitive-based crack detection for road maintenance: an integrated system in cyber-physical-social systems . IEEE Trans Syst Man Cybern Syst , 53 ( 6 ): 3485 - 3500 . https://doi.org/10.1109/TSMC.2022.3227209 https://doi.org/10.1109/TSMC.2022.3227209

Fan LL , Zeng CX , Li YJ , et al. , 2023b . GRC-Net: Fusing GAT-based 4D Radar and Camera for 3D Object Detection. SAE Technical Paper 2023-01-7088 .

Fan LL , Zeng CX , Meng ZL , et al. , 2024a . A secured vehicle brain: DAO-based collaborative perception and decision-making systems for intelligent vehicles in CPSS . IEEE Trans Intell Veh , 9 ( 1 ): 52 - 54 . https://doi.org/10.1109/TIV.2023.3341698 https://doi.org/10.1109/TIV.2023.3341698

Fan LL , Wang JH , Chang YM , et al. , 2024b . 4D mmWave radar for autonomous driving perception: a comprehensive survey . IEEE Trans Intell Veh , early access . https://doi.org/10.1109/TIV.2024.3380244 https://doi.org/10.1109/TIV.2024.3380244

Fan LL , Zeng CX , Wang YT , et al. , 2024c . Social radars: finding targets in cyberspace for cybersecurity . IEEE/CAA J Autom Sin , 11 ( 2 ): 279 - 282 . https://doi.org/10.1109/JAS.2024.124251 https://doi.org/10.1109/JAS.2024.124251

Guo C , Bai TX , Wang X , et al. , 2022 . ShadowPainter: active learning enabled robotic painting through visual measurement and reproduction of the artistic creation process . J Intell Robot Syst , 105 ( 3 ): 61 . https://doi.org/10.1007/S10846-022-01616-1 https://doi.org/10.1007/S10846-022-01616-1

Guo C , Dou Y , Bai TX , et al. , 2023a . ArtVerse: a paradigm for parallel human-machine collaborative painting creation in metaverses . IEEE Trans Syst Man Cybern Syst , 53 ( 4 ): 2200 - 2208 . https://doi.org/10.1109/TSMC.2022.3230406 https://doi.org/10.1109/TSMC.2022.3230406

Guo C , Lu Y , Dou Y , et al. , 2023b . Can ChatGPT boost artistic creation: the need of imaginative intelligence for parallel art . IEEE/CAA J Autom Sin , 10 ( 4 ): 835 - 838 . https://doi.org/10.1109/JAS.2023.123555 https://doi.org/10.1109/JAS.2023.123555

Hobbes T , 2017 . Leviathan. Penguin Classics . Available from https://www.penguin.co.uk/books/263235/leviathanby-hobbes-thomas/9780141395098 https://www.penguin.co.uk/books/263235/leviathanby-hobbes-thomas/9780141395098 [Accessed on Jan. 20, 2024 ] .

Li L , Lin YL , Zheng NN , et al. , 2017 . Parallel learning: a perspective and a framework . IEEE/CAA J Autom Sin , 4 ( 3 ): 389 - 395 . https://doi.org/10.1109/JAS.2017.7510493 https://doi.org/10.1109/JAS.2017.7510493

Li X , Tian YL , Ye PJ , et al. , 2023 . A novel scenarios engineering methodology for foundation models in metaverse . IEEE Trans Syst Man Cybern Syst , 53 ( 4 ): 2148 - 2159 . https://doi.org/10.1109/TSMC.2022.3228594 https://doi.org/10.1109/TSMC.2022.3228594

Li X , Miao QH , Li LX , et al. , 2024 . Sora for senarios engineering of intelligent vehicles: V&V, C&C, and beyonds . IEEE Trans Intell Veh , early press . https://doi.org/10.1109/TIV.2024.3379989 https://doi.org/10.1109/TIV.2024.3379989

Malik AA , Brem A , 2021 . Digital twins for collaborative robots: a case study in human-robot interaction . Robot Comput Integr Manuf , 68 : 102092 . https://doi.org/10.1016/j.rcim.2020.102092 https://doi.org/10.1016/j.rcim.2020.102092

Miao QH , Lv YS , Huang M , et al. , 2023 . Parallel learning: overview and perspective for computational learning across Syn2Real and Sim2Real . IEEE/CAA J Autom Sin , 10 ( 3 ): 603 - 631 . https://doi.org/10.1109/JAS.2023.123375 https://doi.org/10.1109/JAS.2023.123375

Qin R , Wang FY , Zheng XL , et al. , 2024 . Sora for computational social systems: from counterfactual experiments to artificiofactual experiments with parallel intelligence . IEEE Trans Comput Soc Syst , 11 ( 2 ): 1531 - 1550 . https://doi.org/10.1109/TCSS.2024.3373928 https://doi.org/10.1109/TCSS.2024.3373928

Shen ZP , Zhou GZ , Huang HL , et al. , 2024 . Convex optimization-based trajectory planning for quadrotors landing on aerial vehicle carriers . IEEE Trans Intell Veh , 9 ( 1 ): 138 - 150 . https://doi.org/10.1109/TIV.2023.3327263 https://doi.org/10.1109/TIV.2023.3327263

Tian YL , Wang JG , Wang YT , et al. , 2022 . Federated vehicular Transformers and their federations: privacy-preserving computing and cooperation for autonomous driving . IEEE Trans Intell Veh , 7 ( 3 ): 456 - 465 . https://doi.org/10.1109/TIV.2022.3197815 https://doi.org/10.1109/TIV.2022.3197815

Tian YL , Li X , Zhang H , et al. , 2023a . VistaGPT: generative parallel transformers for vehicles with intelligent systems for transport automation . IEEE Trans Intell Veh , 8 ( 9 ): 4198 - 4207 . https://doi.org/10.1109/TIV.2023.3307012 https://doi.org/10.1109/TIV.2023.3307012

Tian YL , Zhang XJ , Wang X , et al. , 2023b . ACF-Net: asymmetric cascade fusion for 3D detection with LiDAR point clouds and images . IEEE Trans Intell Veh , early access . https://doi.org/10.1109/TIV.2023.3341223 https://doi.org/10.1109/TIV.2023.3341223

Wang FY , 2004 . Artificial societies, computational experiments, and parallel systems: a discussion on computational theory of complex social-economic systems . Compl Syst Compl Sci , 1 ( 4 ): 25 - 35 (in Chinese) . https://doi.org/10.13306/j.1672-3813.2004.04.002 https://doi.org/10.13306/j.1672-3813.2004.04.002

Wang FY , 2007 . Toward a paradigm shift in social computing: the ACP approach . IEEE Intell Syst , 22 ( 5 ): 65 - 67 . https://doi.org/10.1109/MIS.2007.4338496 https://doi.org/10.1109/MIS.2007.4338496

Wang FY , 2021 . Parallel philosophy: origin and goal of intelligent industries and smart economics . Bull Chin Acad Sci , 36 ( 3 ): 308 - 318 (in Chinese) . https://doi.org/10.16418/j.issn.1000-3045.20210301001 https://doi.org/10.16418/j.issn.1000-3045.20210301001

Wang FY , 2022 . Parallel management: the DAO to smart ecological technology for complexity management intelligence . Acta Autom Sin , 48 ( 11 ): 2655 - 2669 (in Chinese) . https://doi.org/10.16383/j.aas.c220773 https://doi.org/10.16383/j.aas.c220773

Wang FY , 2023a . Infrastructural vehicles: the TAO from infrastructural intelligence to foundational mobility and services . IEEE Trans Intell Veh , 8 ( 12 ): 4667 - 4670 . https://doi.org/10.1109/TIV.2023.3341692 https://doi.org/10.1109/TIV.2023.3341692

Wang FY , 2023b . New control paradigm for Industry 5.0: from big models to foundation control and management . IEEE/CAA J Autom Sin , 10 ( 8 ): 1643 - 1646 . https://doi.org/10.1109/JAS.2023.123768 https://doi.org/10.1109/JAS.2023.123768

Wang FY , Lv C , 2023 . Foundation vehicles: from foundation intelligence to foundation transportation for future mobility . IEEE Trans Intell Veh , 8 ( 10 ): 4287 - 4291 . https://doi.org/10.1109/TIV.2023.3326636 https://doi.org/10.1109/TIV.2023.3326636

Wang FY , Wang YT , 2024 . Digital scientists and parallel sciences: the origin and goal of AI for science and science for AI . Bull Chin Acad Sci , 39 ( 1 ): 27 - 33 (in Chinese) . https://doi.org/10.16418/j.issn.1000-3045.20231212004 https://doi.org/10.16418/j.issn.1000-3045.20231212004

Wang FY , Qin R , Chen YZ , et al. , 2021 . Federated ecology: steps toward confederated intelligence . IEEE Trans Comput Soc Syst , 8 ( 2 ): 271 - 278 . https://doi.org/10.1109/TCSS.2021.3063801 https://doi.org/10.1109/TCSS.2021.3063801

Wang FY , Miao QH , Li X , et al. , 2023 . What does ChatGPT say: the DAO from algorithmic intelligence to linguistic intelligence . IEEE/CAA J Autom Sin , 10 ( 3 ): 575 - 579 . https://doi.org/10.1109/JAS.2023.123486 https://doi.org/10.1109/JAS.2023.123486

Wang FY , Miao QH , Li LX , et al. , 2024 . When does Sora show: the beginning of TAO to imaginative intelligence and scenarios engineering . IEEE/CAA J Autom Sin , 11 ( 4 ): 809 - 815 . https://doi.org/10.1109/JAS.2024.124383 https://doi.org/10.1109/JAS.2024.124383

Wang JC , Tang Y , Hare R , et al. , 2023 . Parallel intelligent education with ChatGPT . Front Inform Technol Electron Eng , early access . https://doi.org/10.1631/FITEE.2300166 https://doi.org/10.1631/FITEE.2300166

Wang X , Chen YD , Zhu WW , 2022 . A survey on curriculum learning . IEEE Trans Patt Anal Mach Intell , 44 ( 9 ): 4555 - 4576 . https://doi.org/10.1109/TPAMI.2021.3069908 https://doi.org/10.1109/TPAMI.2021.3069908

Wang XX , Yang J , Wang YT , et al. , 2023 . Steps toward Industry 5.0: building “6S” parallel industries with cyber-physical-social intelligence . IEEE/CAA J Autom Sin , 10 ( 8 ): 1692 - 1703 . https://doi.org/10.1109/JAS.2023.123753 https://doi.org/10.1109/JAS.2023.123753

Yang J , Wang X , Tian YL , et al. , 2023 . Parallel intelligence in CPSSs: being, becoming, and believing . IEEE Intell Syst , 38 ( 6 ): 75 - 80 . https://doi.org/10.1109/MIS.2023.3284694 https://doi.org/10.1109/MIS.2023.3284694

Ye PJ , Wang FY , 2022 . Parallel population and parallel human—a cyber-physical social approach . IEEE Intell Syst , 37 ( 5 ): 19 - 27 . https://doi.org/10.1109/MIS.2022.3208362 https://doi.org/10.1109/MIS.2022.3208362

Ye PJ , Wang X , Zheng WB , et al. , 2022 . Parallel cognition: hybrid intelligence for human-machine interaction and management . Front Inform Technol Electron Eng , 23 ( 12 ): 1765 - 1779 . https://doi.org/10.1631/FITEE.2100335 https://doi.org/10.1631/FITEE.2100335

Yu HK , Liu XY , Tian YL , et al. , 2024 . Sora-based parallel vision for smart sensing of intelligent vehicles: from foundation models to foundation intelligence . IEEE Trans Intell Veh , early access . https://doi.org/10.1109/TIV.2024.3376575 https://doi.org/10.1109/TIV.2024.3376575

Zhou J , Ke P , Qiu XP , et al. , 2023 . ChatGPT: potential, prospects, and limitations . Front Inform Technol Electron Eng , early access . https://doi.org/10.1631/FITEE.2300089 https://doi.org/10.1631/FITEE.2300089

Views

627

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

TSNet: a foundation model for wireless network status prediction in digital twins

TransRAG for parallel transportation: toward reliable and trustworthy transportation systems via retrieval-augmented generation

Related Author

Siyao SONG

Guoao SUN

Yifan CHANG

Nengwen ZHAO

Yijun YU

Jing YANG

Xingyuan DAI

Yisheng LV

Related Institution

Huawei Technologies Co., Ltd.

Institute of Automation, Chinese Academy of Sciences

John von Neumann Faculty of Informatics, Obuda University

Faculty of Innovation Engineering, Macau University of Science and Technology

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰