基于Spark的机会环境中内容传播特征度量与分析

张霄宏; 钱凯; 任建吉; 贾宗璞; 姜天鹏; 张权

doi:10.1631/FITEE.1900137

Your Location：

Home >

Browse articles >

基于Spark的机会环境中内容传播特征度量与分析

常规文章 | Updated：2022-05-19

- 基于Spark的机会环境中内容传播特征度量与分析
- Measurement and analysis of content diffusion characteristics in opportunity environments with Spark
- 信息与电子工程前沿（英文） 2019年20卷第10期页码：1404-1414
- Affiliations：
  
  College of Computer Science and Technology, Henan Polytechnic University, Jiaozuo 454000, China
  Beijing Anqi Zhilian Technology Co., Ltd., Beijing 100000, China
  Department of Computer Science, Wayne State University, Detroit 48202, USA
- Author bio：
  
  [ "Xiao-hong ZHANG, E-mail: xh.zhang@hpu.edu.cn" ]
  Jian-ji REN, E-mail:renjianji@hpu.edu.cn
- Funds：
  
  Project supported by the National Natural Science Foundation of China (Nos. 61433012 and 61602156), the Project of Science and Technology in Henan Province, China (No. 142102210435), the Project of the Basic and Frontier Technology in Henan Province, China (No. 142300410147), and the PhD Foundation of Henan Polytechnic University, China (No. B2012-099)
- DOI：10.1631/FITEE.1900137
  中图分类号： TP393.0
- 收稿：2019-03-11，
  
  修回：2019-10-10，
  
  纸质出版：2019-10
- Accepted：
Scan QR Code
张霄宏, 钱凯, 任建吉, 等. 基于Spark的机会环境中内容传播特征度量与分析[J]. 信息与电子工程前沿（英文）, 2019,20(10):1404-1414.

Xiao-hong ZHANG, Kai QIAN, Jian-ji REN, et al. Measurement and analysis of content diffusion characteristics in opportunity environments with Spark[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(10): 1404-1414.
张霄宏, 钱凯, 任建吉, 等. 基于Spark的机会环境中内容传播特征度量与分析[J]. 信息与电子工程前沿（英文）, 2019,20(10):1404-1414. DOI： 10.1631/FITEE.1900137.

Xiao-hong ZHANG, Kai QIAN, Jian-ji REN, et al. Measurement and analysis of content diffusion characteristics in opportunity environments with Spark[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(10): 1404-1414. DOI： 10.1631/FITEE.1900137.

摘要

机会网络为分流移动网络中由流行内容共享引起的巨大负载提供了机会。分析真实机会环境中的内容传播特征可以为负载分流决策提供重要线索。然而，由于从真实机会环境中收集数据并非易事，相关工作非常有限。本文以致力于内容共享的移动应用"闪传"为研究对象，从该应用用户构成的真实机会网络中搜集数据并分析。为发现内容传播特征，本文从传播规模和速度、内容类型等方面展开分析。分析结果表明，文件传输具有明显周期性，只有很少一部分文件能广泛传播，且移动应用类文件比其他类型文件更易成为流行文件。本文还提出一种有助于预测流行文件的最大化文件传播规模的方法。实验结果证实了该方法的有效性和有用性。

Abstract

Opportunity networks provide a chance to offload the tremendous cellular traffic generated by sharing popular content on mobile networks. Analyzing the content spread characteristics in real opportunity environments can discover important clues for traffic offloading decision making. However

relevant published work is very limited since it is not easy to collect data from real environments. In this study

we elaborate the analysis on the dataset collected from a real opportunity environment formed by the users of Xender

which is one of the leading mobile applications for content sharing. To discover content transmission characteristics

scale

speed

and type analyses are implemented on the dataset. The analysis results show that file transmission has obvious periodicity

that only a very small fraction of files spread widely

and that application files have much higher probability to be popular than other files. We also propose a solution to maximize file spread scales

which is very helpful for forecasting popular files. The experimental results verify the effectiveness and usefulness of our solution.

关键词

Keywords

references

S Andreev , , , A Pyattaev , , , K Johnsson , , , 等 . . Cellular traffic offloading onto network-assisted device-to-device connections . . IEEE Commun Mag , , 2014 . . 52 ( ( 4 ): ): 20 - - 31 . . DOI: 10.1109/MCOM.2014.6807943 http://doi.org/10.1109/MCOM.2014.6807943 . .

XY Bao , , , XJ Zhou , , , Y Zhang , , , 等 . . Cellular traffic offloading utilizing set-cover based caching in mobile social networks . . J China Univ Posts Telecommun , , 2016 . . 23 ( ( 2 ): ): 46 - - 55 . . DOI: 10.1016/S1005-8885(16)60020-1 http://doi.org/10.1016/S1005-8885(16)60020-1 . .

S Brin , , , L Page . . The anatomy of a large-scale hypertextual Web search engine . . Comput Netw ISDN Syst , , 1998 . . 30 ( ( 1-7 ): ): 107 - - 117 . . DOI: 10.1016/S0169-7552(98)00110-X http://doi.org/10.1016/S0169-7552(98)00110-X . .

M Cha , , , H Kwak , , , P Rodriguez , , , 等 . . I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system . . Proc 7 th ACM SIGCOMM Conf on Internet Measurement , , 2007 . . p.1 - - 14 . . DOI: 10.1145/1298306.1298309 http://doi.org/10.1145/1298306.1298309 . .

HL Che , , , Y Cao . . Examining WeChat users' motivations, trust, attitudes, and positive word-of-mouth: evidence from China . . Comput Human Behav , , 2014 . . 41 104 - - 111 . . DOI: 10.1016/j.chb.2014.08.013 http://doi.org/10.1016/j.chb.2014.08.013 . .

RG Cheng , , , NS Chen , , , YF Chou , , , 等 . . Offloading multiple mobile data contents through opportunistic device-to-device communications . . Wirel Pers Commun , , 2015 . . 84 ( ( 3 ): ): 1963 - - 1979 . . DOI: 10.1007/s11277-015-2492-1 http://doi.org/10.1007/s11277-015-2492-1 . .

YJ Chuang , , , KCJ Lin . . Cellular traffic offloading through community-based opportunistic dissemination . . IEEE Wireless Communications and Networking Conf , , 2012 . . p.3188 - - 3193 . . DOI: 10.1109/WCNC.2012.6214356 http://doi.org/10.1109/WCNC.2012.6214356 . .

Cisco . . Cisco Visual Networking Index: Global Mobile Data Traffic Forecast , , 2017 . . 2019 https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/whitepaper-c11-738429.html https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/whitepaper-c11-738429.html , , [Accessed on Feb. 27, 2019] . .

G Gao , , , M Xiao , , , J Wu , , , 等 . . Deadline-sensitive mobile data offloading via opportunistic communications . . 13 th Annual IEEE Int Conf on Sensing, Communication, and Networking (SECON) , , 2016 . . p.1 - - 9 . . DOI: 10.1109/SAHCN.2016.7732980 http://doi.org/10.1109/SAHCN.2016.7732980 . .

A Goyal , , , W Lu , , , L Lakshmanan . . CELF++: optimizing the greedy algorithm for influence maximization in social networks . . 20 th Int Conf Companion on World Wide Web , , 2011 . . p.47 - - 48 . . DOI: 10.1145/1963192.1963217 http://doi.org/10.1145/1963192.1963217 . .

W Guan , , , H Gao , , , M Yang , , , 等 . . Analyzing user behavior of the micro-blogging website Sina Weibo during hot social events . . Phys A Stat Mech Appl , , 2013 . . 395 340 - - 351 . . DOI: 10.1016/j.physa.2013.09.059 http://doi.org/10.1016/j.physa.2013.09.059 . .

S Ioannidis , , , A Chaintreau , , , L Massoulie . . Optimal and scalable distribution of content updates over a mobile social network . . IEEE INFOCOM , , 2009 . . p.1422 - - 1430 . . DOI: 10.1109/INFCOM.2009.5062058 http://doi.org/10.1109/INFCOM.2009.5062058 . .

J Jiang , , , S Zhang , , , B Li , , , 等 . . Maximized cellular traffic offloading via device-to-device content sharing . . IEEE J Select Areas Commun , , 2016 . . 34 ( ( 1 ): ): 82 - - 91 . . DOI: 10.1109/JSAC.2015.2452493 http://doi.org/10.1109/JSAC.2015.2452493 . .

N Jiang , , , L Guo , , , J Li , , , 等 . . Data dissemination protocols based on opportunistic sharing for data offloading in mobile social networks . . 22 nd Int Conf on Parallel and Distributed Systems , , 2016 . . p.705 - - 712 . . DOI: 10.1109/ICPADS.2016.0097 http://doi.org/10.1109/ICPADS.2016.0097 . .

D Kempe , , , J Kleinberg , , , E Tardos . . Maximizing the spread of influence through a social network . . Proc 9 th ACM SIGKDD Int Conf on Knowledge Discovery and Data Mining , , 2003 . . p.137 - - 146 . . DOI: 10.1145/956750.956769 http://doi.org/10.1145/956750.956769 . .

J Leskovec , , , J Kleinberg , , , C Faloutsos . . Graph evolution: densification and shrinking diameters . . ACM Trans Knowl Discov Data , , 2007a . . 1 ( ( 1 ): ): 1 - - 40 . . DOI: 10.1145/1217299.1217301 http://doi.org/10.1145/1217299.1217301 . .

J Leskovec , , , A Krause , , , C Guestrin , , , 等 . . Costeffective outbreak detection in networks . . Proc 13 th ACM SIGKDD Int Conf on Knowledge Discovery and Data Mining , , 2007b . . p.420 - - 429 . . DOI: 10.1145/1281192.1281239 http://doi.org/10.1145/1281192.1281239 . .

J Leskovec , , , D Huttenlocher , , , J Kleinberg . . Signed networks in social media . . 10 th SIGCHI Conf on Human Factors in Computing Systems , , 2010 . . p.1361 - - 1370 . . DOI: 10.1145/1753326.1753532 http://doi.org/10.1145/1753326.1753532 . .

KCJ Lin , , , CW Chen , , , CF Chou . . Preference-aware content dissemination in opportunistic mobile social networks . . IEEE INFOCOM , , 2012 . . p.1960 - - 1968 . . DOI: 10.1109/INFCOM.2012.6195573 http://doi.org/10.1109/INFCOM.2012.6195573 . .

Z Lu , , , Y Wen , , , G Cao . . Information diffusion in mobile social networks: the speed perspective . . IEEE Conf on Computer Communications , , 2014 . . p.1932 - - 1940 . . DOI: 10.1109/INFOCOM.2014.6848133 http://doi.org/10.1109/INFOCOM.2014.6848133 . .

AJ Mashhadi , , , SB Mokhtar , , , L Capra . . Fair content dissemination in participatory DTNs . . Ad Hoc Netw , , 2012 . . 10 ( ( 8 ): ): 1633 - - 1645 . . DOI: 10.1016/j.adhoc.2011.05.010 http://doi.org/10.1016/j.adhoc.2011.05.010 . .

JA Obar , , , S Wildman . . Social media definition and the governance challenge: an introduction to the special issue . . Telecommun Pol , , 2015 . . 39 ( ( 9 ): ): 745 - - 750 . . DOI: 10.1016/j.telpol.2015.07.014 http://doi.org/10.1016/j.telpol.2015.07.014 . .

AK Pietilänen , , , C Diot . . Dissemination in opportunistic social networks: the role of temporal communities . . 13 th ACM Int Symp on Mobile Ad Hoc Networking and Computing , , 2012 . . p.165 - - 174 . . DOI: 10.1145/2248371.2248396 http://doi.org/10.1145/2248371.2248396 . .

K Rahimkhani , , , A Aleahmad , , , M Rahgozar , , , 等 . . A fast algorithm for finding most influential people based on the linear threshold model . . Expert Syst Appl , , 2015 . . 42 ( ( 3 ): ): 1353 - - 1361 . . DOI: 10.1016/j.eswa.2014.09.037 http://doi.org/10.1016/j.eswa.2014.09.037 . .

F Rebecchi , , , MD de Amorim , , , V Conan . . Should I seed or should I not: on the remuneration of seeders in D2D offloading . . 17 th Int Symp on a World of Wireless, Mobile and Multimedia Networks , , 2016 . . p.1 - - 9 . . DOI: 10.1109/WoWMoM.2016.7523496 http://doi.org/10.1109/WoWMoM.2016.7523496 . .

R Tang . . Performance tradeoff between energy conservation and user fairness for D2D communication underlaying cellular networks . . Chin J Electron , , 2017 . . 26 600 - - 607 . . DOI: 10.1049/cje.2016.11.011 http://doi.org/10.1049/cje.2016.11.011 . .

K Thilakarathna , , , AC Viana , , , A Seneviratne , , , 等 . . The Power of Hood Friendship for Opportunistic Content Dissemination in Mobile Social Networks . . Research Report No. 8042, Teams HIPERCOM, Université ParisSaclay, France , , 2012 . . .

K Thilakarathna , , , A Seneviratne , , , AC Viana , , , 等 . . User generated content dissemination in mobile social networks through infrastructure supported content replication . . Perv Mob Comput , , 2014 . . 11 ( ( 2 ): ): 132 - - 147 . . DOI: 10.1016/j.pmcj.2014.01.005 http://doi.org/10.1016/j.pmcj.2014.01.005 . .

F Tian , , , B Liu , , , J Xiong , , , 等 . . Movement-based incentive for cellular traffic offloading through D2D communications . . IEEE Int Symp on Broadband Multimedia Systems and Broadcasting , , 2016 . . p.1 - - 5 . . DOI: 10.1109/BMSB.2016.7521954 http://doi.org/10.1109/BMSB.2016.7521954 . .

G Wang , , , PZ Liu , , , Z Yang , , , 等 . . Joint college admissions game and auction theory for data offloading in heterogeneous networks . . Chin J Electron , , 2018 . . 27 ( ( 1 ): ): 168 - - 174 . . DOI: 10.1049/cje.2017.09.001 http://doi.org/10.1049/cje.2017.09.001 . .

H Wang , , , S Wang , , , Y Zhang , , , 等 . . Measurement and analytics on social groups of device-to-device sharing in mobile social networks . . Int Conf on Communications , , 2017a . . p.1 - - 6 . . DOI: 10.1109/ICC.2017.7997038 http://doi.org/10.1109/ICC.2017.7997038 . .

H Wang , , , X Wang , , , K Li , , , 等 . . A measurement study of device-to-device sharing in mobile social networks based on Spark . . Concurr Comput Pract Exp , , 2017b . . 29 ( ( 16 ): ): e4021 DOI: 10.1002/cpe.4021 http://doi.org/10.1002/cpe.4021 . .

X Wang , , , M Chen , , , Z Han , , , 等 . . TOSS: traffic offloading by social network service-based opportunistic sharing in mobile social networks . . IEEE Conf on Computer Communications , , 2014 . . p.2346 - - 2354 . . DOI: 10.1109/INFOCOM.2014.6848179 http://doi.org/10.1109/INFOCOM.2014.6848179 . .

Z Wang , , , L Sun , , , M Zhang , , , 等 . . Social- and mobilityaware device-to-device content delivery , , 2016 . . http://arxiv.org/abs/1606.04195 http://arxiv.org/abs/1606.04195 , , . .

S Zhang , , , J Wu , , , Z Qian , , , 等 . . Mobicache: cellular traffic offloading leveraging cooperative caching in mobile social networks . . Comput Netw , , 2015 . . 83 184 - - 198 . . DOI: 10.1016/j.comnet.2015.03.011 http://doi.org/10.1016/j.comnet.2015.03.011 . .

Y Zhang , , , E Pan , , , L Song , , , 等 . . Social network aware device-to-device communication in wireless networks . . IEEE Trans Wirel Commun , , 2015 . . 14 ( ( 1 ): ): 177 - - 190 . . DOI: 10.1109/TWC.2014.2334661 http://doi.org/10.1109/TWC.2014.2334661 . .

Y Zhao , , , W Song . . Social-aware energy-efficient data dissemination with D2D communications . . IEEE 83rd Vehicular Technology Conf , , 2016 . . p.1 - - 5 . . DOI: 10.1109/VTCSpring.2016.7504479 http://doi.org/10.1109/VTCSpring.2016.7504479 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据