面向工业过程监控的嵌入式轻型图形用户界面构件库与人机功效优化方法

谭大鹏; 陈树婷; 鲍官军; 张立彬

doi:10.1631/FITEE.1601660

Your Location：

Home >

Browse articles >

面向工业过程监控的嵌入式轻型图形用户界面构件库与人机功效优化方法

常规文章 | Updated：2022-05-19

- 面向工业过程监控的嵌入式轻型图形用户界面构件库与人机功效优化方法
- An embedded lightweight GUI component library and ergonomics optimization method for industry process monitoring
- 信息与电子工程前沿（英文） 2018年19卷第5期页码：604-625
- Affiliations：
  
  College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310032, China
  Department of Basic Medicine, Hangzhou Medical College, Hangzhou 310053, China
- Author bio：
  
  Shu-ting CHEN, E-mail: shutinren@163.com
- Funds：
  
  Project supported by the National Natural Science Foundation of China (Nos. 51775501, 51375446, U1509212, and 51405441), the Zhejiang Provincial Natural Science Foundation, China (No. LR16E050001), and the Zhejiang Provincial Health Department Program, China (No. 2015KYA067)
- DOI：10.1631/FITEE.1601660
  中图分类号： TP206
- 收稿：2016-10-24，
  
  修回：2018-;5-10，
  
  纸质出版：2018-05
- Accepted：
Scan QR Code
谭大鹏, 陈树婷, 鲍官军, 等. 面向工业过程监控的嵌入式轻型图形用户界面构件库与人机功效优化方法[J]. 信息与电子工程前沿（英文）, 2018,19(5):604-625.

Da-peng TAN, Shu-ting CHEN, Guan-jun BAO, et al. An embedded lightweight GUI component library and ergonomics optimization method for industry process monitoring[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(5): 604-625.
谭大鹏, 陈树婷, 鲍官军, 等. 面向工业过程监控的嵌入式轻型图形用户界面构件库与人机功效优化方法[J]. 信息与电子工程前沿（英文）, 2018,19(5):604-625. DOI： 10.1631/FITEE.1601660.

Da-peng TAN, Shu-ting CHEN, Guan-jun BAO, et al. An embedded lightweight GUI component library and ergonomics optimization method for industry process monitoring[J]. Frontiers of Information Technology & Electronic Engineering, 2018, 19(5): 604-625. DOI： 10.1631/FITEE.1601660.

摘要

面向工业过程监控的嵌入式轻型图形用户界面（GUI）构件库开发具有较高难度，当前方法在实时任务处理与人机功效等方面存在不足。针对上述问题，提出一种基于嵌入式Qt技术（Qt/E）的轻型GUI构件库设计方法。根据工业过程监控需求，建立构件库实体-关系（E-R）模型，定义系统功能构架与模块数据耦合关系。考虑嵌入式目标系统差异，搭建交叉编译环境以实现Qt/E共享库文件的按需裁剪。基于信号-槽通信接口，提出一种无需回调指针的消息映射方法，优化系统上下文切换性能。结合多线程控制技术，面向数据采集、计算与显示的并行任务处理能力得到强化，从而提高系统实时性与鲁棒性。通过滚动页面方法优化人机交互过程，并利用工业心理学方法验证系统人机功效性能。数值实例模拟与工业现场实验结果表明，与Windows-CE-GUI和Android-GUI相比：实时读写正确率分别提高26%与29%；构件库最小可裁减至900 kB，并可支持12种嵌入式硬件平台；系统平均会话切换时间可控制在0.6 s以内，关键人机功效指标可满足不同工业应用需求。

Abstract

Developing an efficient and robust lightweight graphic user interface (GUI) for industry process monitoring is always a challenging task. Current implementation methods for embedded GUI are with the matters of real-time processing and ergonomics performance. To address the issue

an embedded lightweight GUI component library design method based on quasar technology embedded (Qt/E) is proposed. First

an entity-relationship (E-R) model for the GUI library is developed to define the functional framework and data coupling relations. Second

a cross-compilation environment is constructed

and the Qt/E shared library files are tailored to satisfy the requirements of embedded target systems. Third

by using the signal-slot communication interfaces

a message mapping mechanism that does not require a call-back pointer is developed

and the context switching performance is improved. According to the multi-thread method

the parallel task processing capabilities for data collection

calculation

and display are enhanced

and the real-time performance and robustness are guaranteed. Finally

the human-computer interaction process is optimized by a scrolling page method

and the ergonomics performance is verified by the industrial psychology methods. Two numerical cases and five industrial experiments show that the proposed method can increase real-time read-write correction ratios by more than 26% and 29%

compared with Windows-CE-GUI and Android-GUI

respectively. The component library can be tailored to 900 KB and supports 12 hardware platforms. The average session switch time can be controlled within 0.6 s and six key indexes for ergonomics are verified by different industrial applications.

关键词

Keywords

references

G Acciani , , , G Fornarelli , , , A Giaquinto . . A fuzzy method for global quality index evaluation of solder joints in surface mount technology . . IEEE Trans Ind Inform , , 2011 . . 7 ( ( 1 ): ): 115 - - 124 . . DOI: 10.1109/TII.2010.2076292 http://doi.org/10.1109/TII.2010.2076292 . .

SH Ahn , , , D Sul , , , SH Choi , , , 等 . . Implementation of lightweight graphic library builder for embedded system . . IEEE Int Conf on Advanced Communication Technology , , 2006 . . p.166 - - 168 . . DOI: 10.1109/ICACT.2006.205944 http://doi.org/10.1109/ICACT.2006.205944 . .

F Barrero , , , S Toral , , , M Vargas , , , 等 . . Internet in the development of future road-traffic control systems . . Internet Res , , 2010 . . 20 ( ( 2 ): ): 154 - - 168 . . DOI: 10.1108/10662241011032227 http://doi.org/10.1108/10662241011032227 . .

H Cecotti . . A multimodal gaze-controlled virtual keyboard . . IEEE Trans Hum-Mach Syst , , 2016 . . 46 ( ( 4 ): ): 601 - - 606 . . DOI: 10.1109/THMS.2016.2537749 http://doi.org/10.1109/THMS.2016.2537749 . .

ST Chen , , , DP Tan . . A SA-ANN-based modeling method for human cognition mechanism and the PSACO cognition algorithm . . Complexity , , 2018 . . 2018 6264124 DOI: 10.1155/2018/6264124 http://doi.org/10.1155/2018/6264124 . .

A Chevalier , , , M Kicka . . Web designers and web users: influence of the ergonomic quality of the web site on the information search . . Int J Hum-Comput Stud , , 2006 . . 64 ( ( 10 ): ): 1031 - - 1048 . . DOI: 10.1016/j.ijhcs.2006.06.002 http://doi.org/10.1016/j.ijhcs.2006.06.002 . .

MK Dalheimer , , , S Hansen . . Embedded systems: embedded development with qt/embedded . . Dr Dobbs J , , 2002 . . 27 ( ( 3 ): ): 48 - - 54 . . . .

R Drossu , , , Z Obradovic , , , J Fletcher . . A flexible graphical user interface for embedding heterogeneous neural network simulators . . IEEE Trans Edu , , 1996 . . 39 ( ( 3 ): ): 367 - - 374 . . DOI: 10.1109/13.538760 http://doi.org/10.1109/13.538760 . .

F Du . . GUI Design Based on Ergonomics . . MS Thesis, Nanjing University of Aeronautics and Astronautics, Nanjing, China , , 2008 . . .

SM Ji , , , FQ Xiao , , , DP Tan . . Analytical method for softness abrasive flow field based on discrete phase model . . Sci China Technol Sci , , 2010 . . 53 ( ( 10 ): ): 2867 - - 2877 . . DOI: 10.1007/s11431-010-4046-9 http://doi.org/10.1007/s11431-010-4046-9 . .

SM Ji , , , XX Weng , , , DP Tan . . Analytical method of softness abrasive two-phase flow field based on 2D model of LSM . . Acta Phys Sin , , 2012 . . 61 ( ( 1 ): ): 010205 . .

SM Ji , , , JQ Ge , , , DP Tan . . Wall contact effects of particle- wall collision process in a two-phase particle fluid . . J Zhejiang Univ-Sci A (Appl Phys & Eng) , , 2017 . . 18 ( ( 12 ): ): 958 - - 973 . . DOI: 10.1631/jzus.A1700039 http://doi.org/10.1631/jzus.A1700039 . .

F Jin , , , ZH Wu . . Lightweight graphics device driver and graphical user interface based on embedded Linux . . Trans Beijing Inst Technol , , 2008 . . 28 ( ( 3 ): ): 233 - - 236 . . DOI: 10.15918/j.tbit1001-0645.2008.03.018 http://doi.org/10.15918/j.tbit1001-0645.2008.03.018 . .

C Li , , , SM Ji , , , DP Tan . . Study on machinability and the wall region of solid-liquid two phase softness abrasive flow . . Int J Adv Manuf Technol , , 2012 . . 61 ( ( 9-12 ): ): 975 - - 987 . . DOI: 10.1007/s00170-011-3621-y http://doi.org/10.1007/s00170-011-3621-y . .

C Li , , , SM Ji , , , DP Tan . . Multiple-loop digital control method for 400Hz inverter system based on phase feedback . . IEEE Trans Power Electron , , 2013 . . 28 ( ( 1 ): ): 408 - - 417 . . DOI: 10.1109/TPEL.2012.2188043 http://doi.org/10.1109/TPEL.2012.2188043 . .

J Li , , , SM Ji , , , DP Tan . . Improved soft abrasive flow finishing method based on turbulent kinetic energy enhancing . . Chin J Mech Eng , , 2017 . . 30 ( ( 2 ): ): 301 - - 309 . . DOI: 10.1007/s10033-017-0071-y http://doi.org/10.1007/s10033-017-0071-y . .

X Li , , , M Horie , , , T Kagawa . . Pressure-distribution methods for estimating lifting force of a swirl gripper . . IEEE/ASME Trans Mechatron , , 2014 . . 19 ( ( 2 ): ): 707 - - 718 . . DOI: 10.1109/TMECH.2013.2256793 http://doi.org/10.1109/TMECH.2013.2256793 . .

X Li , , , N Li , , , GL Tao . . Experimental comparison of Bernoulli gripper and vortex gripper . . Int J Prec Eng Manuf , , 2015 . . 16 ( ( 10 ): ): 2081 - - 2090 . . DOI: 10.1007/s12541-015-0270-3 http://doi.org/10.1007/s12541-015-0270-3 . .

YX Liao , , , X Li , , , W Zhong , , , 等 . . Study of pressure drop- flow rate and flow resistance characteristics of heated porous materials under local thermal non-equilibrium conditions . . Int J Heat Mass Transf , , 2016 . . 102 528 - - 543 . . DOI: 10.1016/j.ijheatmasstransfer.2016.05.101 http://doi.org/10.1016/j.ijheatmasstransfer.2016.05.101 . .

ZS Lin , , , SM Yu , , , JH Lu . . Design and ARM-embedded implementation of a chaotic map-based real-time secure video communication system . . IEEE Trans Circ Syst Video Technol , , 2015 . . 25 ( ( 7 ): ): 1203 - - 1216 . . DOI: 10.1109/TCSVT.2014.2369711 http://doi.org/10.1109/TCSVT.2014.2369711 . .

D Mazzei , , , F Vozzi , , , A Cisternino , , , 等 . . A high- throughput bioreactor system for simulating physiological environments . . IEEE Trans Ind Electron , , 2008 . . 55 ( ( 9 ): ): 3273 - - 3280 . . DOI: 10.1109/TIE.2008.928122 http://doi.org/10.1109/TIE.2008.928122 . .

J Park , , , J Lee . . A beacon color code scheduling for the localization of multiple robots . . IEEE Trans Ind Inform , , 2011 . . 7 ( ( 3 ): ): 467 - - 475 . . DOI: 10.1109/TII.2011.2158833 http://doi.org/10.1109/TII.2011.2158833 . .

MA Ramos , , , RAD Penteado . . Embedded software revitalization through component mining and software product line techniques . . J Univ Comput Sci , , 2008 . . 14 ( ( 8 ): ): 1207 - - 1227 . . DOI: 10.3217/jucs-014-08-1211 http://doi.org/10.3217/jucs-014-08-1211 . .

F Rehault . . Windows mobile advanced forensics: an alternative to existing tools . . Dig Invest , , 2010 . . 7 ( ( 1-2 ): ): 38 - - 47 . . DOI: 10.1016/j.diin.2010.08.003 http://doi.org/10.1016/j.diin.2010.08.003 . .

E Riskedal . . Qt and Windows CE . . Dr Dobbs J , , 2008 . . 33 ( ( 6 ): ): 30 - - 45 . . . .

S Saponara , , , E Petri , , , L Fanucci , , , 等 . . Sensor modeling, low-complexity fusion algorithms, and mixed-signal IC prototyping for gas measures in low-emission vehicles . . IEEE Trans Instrum Meas , , 2011 . . 60 ( ( 2 ): ): 372 - - 384 . . DOI: 10.1109/TIM.2010.2084230 http://doi.org/10.1109/TIM.2010.2084230 . .

K Steblovnik , , , D Zazula . . A novel agent-based concept of household appliances . . J Intell Manuf , , 2011 . . 22 ( ( 1 ): ): 73 - - 88 . . DOI: 10.1007/s10845-009-0279-5 http://doi.org/10.1007/s10845-009-0279-5 . .

LJ Su , , , NG Zheng , , , M Yao , , , 等 . . A computational model of the hybrid bio-machine MPMS for ratbots navigation . . IEEE Intell Syst , , 2014 . . 29 ( ( 6 ): ): 5 - - 13 . . DOI: 10.1109/MIS.2014.91 http://doi.org/10.1109/MIS.2014.91 . .

DP Tan , , , LB Zhang . . A WP-based nonlinear vibration sensing method for invisible liquid steel slag detection . . Sensor Actuat B Chem , , 2014 . . 202 1257 - - 1269 . . DOI: 10.1016/j.snb.2014.06.014 http://doi.org/10.1016/j.snb.2014.06.014 . .

DP Tan , , , SM Ji , , , PY Li , , , 等 . . Development of vibration style ladle slag detection method and the key technologies . . Sci China Technol Sci , , 2010 . . 53 ( ( 9 ): ): 2378 - - 2387 . . DOI: 10.1007/s11431-010-4073-6 http://doi.org/10.1007/s11431-010-4073-6 . .

DP Tan , , , SM Ji , , , MS Jin . . Intelligent computer-aided instruction modeling and a method to optimize study strategies for parallel robot instruction . . IEEE Trans Edu , , 2013a . . 56 ( ( 3 ): ): 268 - - 273 . . DOI: 10.1109/TE.2012.2212707 http://doi.org/10.1109/TE.2012.2212707 . .

DP Tan , , , PY Li , , , YX Ji , , , 等 . . SA-ANN-based slag carry-over detection method and the embedded WME platform . . IEEE Trans Ind Electron , , 2013b . . 60 ( ( 10 ): ): 4702 - - 4713 . . DOI: 10.1109/TIE.2012.2213559 http://doi.org/10.1109/TIE.2012.2213559 . .

DP Tan , , , SM Ji , , , YZ Fu . . An improved soft abrasive flow finishing method based on fluid collision theory . . Int J Adv Manuf Technol , , 2016a . . 85 ( ( 5-8 ): ): 1261 - - 1274 . . DOI: 10.1007/s00170-015-8044-8 http://doi.org/10.1007/s00170-015-8044-8 . .

DP Tan , , , T Yang , , , J Zhao , , , 等 . . Free sink vortex Ekman suction-extraction evolution mechanism . . Acta Phys Sin , , 2016b . . 65 ( ( 5 ): ): 054701 DOI: 10.7498/aps.65.054701 http://doi.org/10.7498/aps.65.054701 . .

DP Tan , , , LB Zhang , , , QL Ai . . An embedded self-adapting network service framework for networked manufacturing system . . J Intell Manuf, in press , , 2016c . . DOI: 10.1007/s10845-016-1265-3 http://doi.org/10.1007/s10845-016-1265-3 . .

DP Tan , , , L Li , , , YL Zhu , , , 等 . . An embedded cloud database service method for distributed industry monitoring . . IEEE Trans Ind Inform, in press , , 2017a . . .

DP Tan , , , YS Ni , , , LB Zhang . . Two-phase sink vortex suction mechanism and penetration dynamic characteristics in ladle teeming process . . J Iron Steel Res Int , , 2017b . . 24 ( ( 7 ): ): 669 - - 677 . . DOI: 10.1016/S1006-706X(17)30101-2 http://doi.org/10.1016/S1006-706X(17)30101-2 . .

AD Veltcheva , , , CG Soares . . Analysis of abnormal wave groups in Hurricane Camille by the Hilbert Huang transform method . . Ocean Eng , , 2012 . . 42 102 - - 111 . . DOI: 10.1016/j.oceaneng.2011.12.013 http://doi.org/10.1016/j.oceaneng.2011.12.013 . .

J Wang , , , DJ Li , , , CJ Yang , , , 等 . . Developing a power monitoring and protection system for the junction boxes of an experimental seafloor observatory network . . Front Inform Technol Electron Eng , , 2015 . . 16 ( ( 12 ): ): 1034 - - 1045 . . DOI: 10.1631/FITEE.1500099 http://doi.org/10.1631/FITEE.1500099 . .

ZH Wu , , , NG Zheng , , , SW Zhang , , , 等 . . Maze learning by a hybrid brain-computer system . . Sci Rep , , 2016 . . 6 31746 DOI: 10.1038/srep31746 http://doi.org/10.1038/srep31746 . .

V Wulf , , , V Pipek , , , M Won . . Component-based tailorability: enabling highly flexible software applications . . Int J Hum Comput Stud , , 2008 . . 66 ( ( 1 ): ): 1 - - 22 . . DOI: 10.1016/j.ijhcs.2007.08.007 http://doi.org/10.1016/j.ijhcs.2007.08.007 . .

LD Xu , , , W Viriyasitavat , , , P Ruchikachorn , , , 等 . . Using propositional logic for requirements verification of service workflow . . IEEE Trans Ind Inform , , 2012 . . 8 ( ( 3 ): ): 639 - - 646 . . DOI: 10.1109/TII.2012.2187908 http://doi.org/10.1109/TII.2012.2187908 . .

MQ Yao , , , K Yang , , , CY Xu , , , 等 . . Design of a novel RTD-based three-variable universal logic gate . . Front Inform Technol Electron Eng , , 2015 . . 16 ( ( 8 ): ): 694 - - 699 . . DOI: 10.1631/FITEE.1500102 http://doi.org/10.1631/FITEE.1500102 . .

S Yin , , , G Wang , , , H Gao . . Data-driven process monitoring based on modified orthogonal projections to latent structures . . IEEE Trans Contr Syst Technol , , 2015 . . 24 ( ( 4 ): ): 1480 - - 1487 . . DOI: 10.1109/TCST.2015.2481318 http://doi.org/10.1109/TCST.2015.2481318 . .

X Zeng , , , SM Ji , , , DP Tan , , , 等 . . Softness consolidation abrasives material removal characteristic oriented to laser hardening surface . . Int J Adv Manuf Technol , , 2013 . . 69 ( ( 9-12 ): ): 2323 - - 2332 . . DOI: 10.1007/s00170-013-4985-y http://doi.org/10.1007/s00170-013-4985-y . .

X Zeng , , , SM Ji , , , MS Jin , , , 等 . . Research on dynamic characteristic of softness consolidation abrasives in machining process . . Int J Adv Manuf Technol , , 2016 . . 82 ( ( 5-8 ): ): 1115 - - 1125 . . DOI: 10.1007/s00170-015-7392-8 http://doi.org/10.1007/s00170-015-7392-8 . .

K Zhang , , , JU Kang . . Real-time numerical dispersion compensation using graphics processing unit for Fourier- domain optical coherence tomography . . Electron Lett , , 2011 . . 47 ( ( 5 ): ): 309 - - 310 . . DOI: 10.1049/el.2011.0065 http://doi.org/10.1049/el.2011.0065 . .

M Zhang , , , JZ Jiang , , , CH Liu . . Development of a multi- function gateway node oriented environment monitoring in greenhouse . . Sens Lett , , 2013 . . 11 ( ( 6-7 ): ): 1236 - - 1239 . . DOI: 10.1166/sl.2013.2852 http://doi.org/10.1166/sl.2013.2852 . .

NG Zheng , , , Z Wu , , , M Lin , , , 等 . . Enhancing battery efficiency for pervasive health-monitoring systems based on electronic textiles . . IEEE Trans Inform Technol Biomed , , 2010a . . 14 ( ( 2 ): ): 350 - - 359 . . DOI: 10.1109/TITB.2009.2034972 http://doi.org/10.1109/TITB.2009.2034972 . .

NG Zheng , , , ZH Wu , , , M Lin , , , 等 . . Infrastructure and reliability analysis of electric networks for E-textiles . . IEEE Trans Syst Man Cybern Part C , , 2010b . . 40 ( ( 1 ): ): 36 - - 51 . . DOI: 10.1109/TSMCC.2009.2031497 http://doi.org/10.1109/TSMCC.2009.2031497 . .

NG Zheng , , , LJ Su , , , DQ Zhang , , , 等 . . A computational model for ratbot locomotion based on cyborg intelligence . . Neurocomputing , , 2015 . . 170 ( ( C ): ): 92 - - 97 . . DOI: 10.1016/j.neucom.2014.12.115 http://doi.org/10.1016/j.neucom.2014.12.115 . .

HJ Zhou , , , R Xiang . . MicroWindows-based multi-device support intelligent Chinese input system . . J Comput Appl , , 2013 . . 33 ( ( 7 ): ): 2067 - - 2070 . . DOI: 10.11772/j.issn.1001-9081.2013.07.2067 http://doi.org/10.11772/j.issn.1001-9081.2013.07.2067 . .

XF Zhuo , , , JB Fan , , , B Chen . . Application of Linux multilineality in GUI programming . . J Southwest Univ Sci Technol , , 2002 . . 17 ( ( 3 ): ): 21 - - 24 . . . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据