Big data storage technologies: a survey

Aisha SIDDIQA; Ahmad KARIM; Abdullah GANI

doi:10.1631/FITEE.1500441

Your Location：

Home >

Browse articles >

Big data storage technologies: a survey

Regular Papers | Updated：2022-05-19

- Big data storage technologies: a survey
- 大数据存储技术综述
- Frontiers of Information Technology & Electronic Engineering Vol. 18, Issue 8, Pages: 1040-1070(2017)
- Affiliations：
  
  Faculty of Computer Science and Information Technology, University of Malaya, Kuala Lumpur 50603, Malaysia
  Department of Information Technology, Bahauddin Zakariya University, Multan 60000, Pakistan
- Author bio：
  
  Aisha SIDDIQA, E-mail: aasiddiqa@gmail.com
- Funds：
- DOI：10.1631/FITEE.1500441
  CLC： TP311.13
- Received：08 December 2015，
  
  Revised：2017-;8-;8，
  
  Published：2017-08
- Accepted：
Scan QR Code
Aisha SIDDIQA, Ahmad KARIM, Abdullah GANI. Big data storage technologies: a survey[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(8): 1040-1070.
DOI：

Aisha SIDDIQA, Ahmad KARIM, Abdullah GANI. Big data storage technologies: a survey[J]. Frontiers of Information Technology & Electronic Engineering, 2017, 18(8): 1040-1070. DOI： 10.1631/FITEE.1500441.

摘要

对于容量快速增长、日趋多元化的大数据，业界亟需开发可行性更好的存储工具。为满足大数据存储需求，存储机制已经形成从传统数据管理系统到NoSQL技术的结构化转移。然而，目前可用的大数据存储技术无法为持续增长的异构数据提供一致、可扩展和可用的解决方案。在科学实验、医疗保健、社交网络和电子商务等实际应用中，存储是大数据分析的第一步。截至目前，亚马逊、谷歌和阿帕奇等公司形成了大数据存储方案的行业标准，但尚未有关于大数据存储技术性能和容量提升的深入调查和文献报告。本文旨在对目前可用于大数据的最先进的存储技术进行全面调查，提供了一个明确的大数据存储技术分类方法，以帮助数据分析师和研究人员了解和选择更适合其需求的存储机制。我们使用布鲁尔的CAP定理比较和分析了现有存储方法，评估了不同存储架构的性能，讨论了存储技术的意义、应用及其对其他类别数据的支持。为了加快部署可靠和可扩展的存储系统，文中还突出了未来研究面临的几个挑战。

Abstract

There is a great thrust in industry toward the development of more feasible and viable tools for storing fast-growing volume

velocity

and diversity of data

termed 'big data'. The structural shift of the storage mechanism from traditional data management systems to NoSQL technology is due to the intention of fulfilling big data storage requirements. However

the available big data storage technologies are inefficient to provide consistent

scalable

and available solutions for continuously growing heterogeneous data. Storage is the preliminary process of big data analytics for real-world applications such as scientific experiments

healthcare

social networks

and e-business. So far

Amazon

Google

and Apache are some of the industry standards in providing big data storage solutions

yet the literature does not report an in-depth survey of storage technologies available for big data

investigating the performance and magnitude gains of these technologies. The primary objective of this paper is to conduct a comprehensive investigation of state-of-the-art storage technologies available for big data. A well-defined taxonomy of big data storage technologies is presented to assist data analysts and researchers in understanding and selecting a storage mechanism that better fits their needs. To evaluate the performance of different storage architectures

we compare and analyze the existing approaches using Brewer's CAP theorem. The significance and applications of storage technologies and support to other categories are discussed. Several future research challenges are highlighted with the intention to expedite the deployment of a reliable and scalable storage system.

关键词

Keywords

references

J. Aasman . . Event Processing Using an RDF Database (White Paper) . . Association for the Advancement of Artificial Intelligence , , 2008 . . p.1 - - 5 . . . .

D.J. Abadi , , , P.A. Boncz , , , S. Harizopoulos . . Column-oriented database systems . . Proc. VLDB Endow. , , 2009 . . 2 ( ( 2 ): ): 1664 - - 1665 . . DOI: 10.14778/1687553.1687625 http://doi.org/10.14778/1687553.1687625 . .

A. Abouzeid , , , K. Bajda-Pawlikowski , , , D. Abadi , , , 等 . . HadoopDB: an architectural hybrid of MapReduce and DBMS technologies for analytical workloads . . Proc. VLDB Endow. , , 2009 . . 2 ( ( 1 ): ): 922 - - 933 . . DOI: 10.14778/1687627.1687731 http://doi.org/10.14778/1687627.1687731 . .

V. Abramova , , , J. Bernardino . . NoSQL databases: MongoDB vs Cassandra . . Proc. Int. Conf. on Computer Science and Software Engineering , , 2013 . . p.14 - - 22 . . DOI: 10.1145/2494444.2494447 http://doi.org/10.1145/2494444.2494447 . .

Aerospike . . Aerospike, Architecture Overview . . (White Paper) , , 2012 . . http://www.aerospike.com/ http://www.aerospike.com/ , , . .

Aerospike . . NoSQL Database, In-Memory or Flash Optimized and Web Scale . . [Accessed on May 5, 2015] , , 2015 . . http://www.aerospike.com/ http://www.aerospike.com/ , , . .

P. Alex , , , B. Ana-Maria . . Terrastore: a Consistent, Partitioned and Elastic Document Database . . [Accessed on May 7, 2015] , , 2009 . . http://nosql.mypopescu.com/post/304908601/terrastore-consistent-partitioned-elastic-document-datab http://nosql.mypopescu.com/post/304908601/terrastore-consistent-partitioned-elastic-document-datab , , . .

AllegroGraph . . AllegroGraph . . [Accessed on May 5, 2015] , , 2015 . . http://franz.com/agraph/allegrograph/ http://franz.com/agraph/allegrograph/ , , . .

J.C. Anderson , , , J. Lehnardt , , , N. Slater . . CouchDB: the Definitive Guide , , : : California O'Reilly Media, Inc. , , 2010 . . .

Apache . . Apache CouchDB: a Database for the Web . . [Accessed on May 5, 2015] , , 2015 . . http://couchdb.apache.org/ http://couchdb.apache.org/ , , . .

Apache Software Foundation . . HBase Apache . . [Accessed on Jan. 15, 2015] , , 2015 . . http://hbase.apache.org/ http://hbase.apache.org/ , , . .

M. Armbrust , , , A. Fox , , , D. Patterson , , , 等 . . Scads: scale-independent storage for social computing applications . . arXiv:0909.1775 , , 2009 . . .

R. Azeem , , , M.I.A. Khan . . Techniques about data replication for mobile ad-hoc network databases . . Int. J. Multidiscipl. Sci. Eng. , , 2012 . . 3 ( ( 5 ): ): 53 - - 57 . . . .

K. Banker . . MongoDB in Action , , : : New York Manning Publications Co. , , 2011 . . .

J. Baron , , , S. Kotecha . . Storage Options in the AWS Cloud . . Technical Report, Amazon Web Services, Washington DC. , , 2013 . . .

S. Batra , , , C. Tyagi . . Comparative analysis of relational and graph databases . . Int. J. Soft Comput. Eng. , , 2012 . . 2 ( ( 2 ): ): 509 - - 512 . . . .

M. Bohlouli , , , F. Schulz , , , L. Angelis , , , 等 . . Towards an integrated platform for big data analysis . . In : Fathi, M. (Ed.), Integration of Practice-Oriented Knowledge Technology: Trends and Prospectives. Springer Berlin Heidelberg , , 2013 . . p.47 - - 56 . . DOI: 10.1007/978-3-642-34471-8_4 http://doi.org/10.1007/978-3-642-34471-8_4 . .

D. Borthakur . . HDFS Architecture Guide . . 2008 . . http://hadoop.apache.org/common/docs/current/hdfsdesign.pdf http://hadoop.apache.org/common/docs/current/hdfsdesign.pdf , , . .

S. Bossa . . Thoughts and Fragments: Terrastore and the CAP Theorem . . [Accessed on May 7, 2015] , , 2009 . . http://sbtourist.blogspot.com/2009/12/terrastore-and-cap-theorem.html http://sbtourist.blogspot.com/2009/12/terrastore-and-cap-theorem.html , , . .

E. Brewer . . CAP twelve years later: how the "rules" have changed . . Computer , , 2012 . . 45 ( ( 2 ): ): 23 - - 29 . . DOI: 10.1109/MC.2012.37 http://doi.org/10.1109/MC.2012.37 . .

C. Bunch , , , N. Chohan , , , C. Krintz , , , 等 . . An evaluation of distributed datastores using the AppScale cloud platform . . IEEE 3rd Int. Conf. on Cloud Computing , , 2010 . . p.305 - - 312 . . DOI: 10.1109/CLOUD.2010.51 http://doi.org/10.1109/CLOUD.2010.51 . .

M. Burrows . . The Chubby lock service for loosely-coupled distributed systems . . Proc. 7th Symp. on Operating Systems Design and Implementation , , 2006 . . p.335 - - 350 . . . .

K. Buza , , , G.I. Nagy , , , A. Nanopoulos . . Storage-optimizing clustering algorithms for high-dimensional tick data . . Expert Syst. Appl. , , 2014 . . 41 ( ( 9 ): ): 4148 - - 4157 . . DOI: 10.1016/j.eswa.2013.12.046 http://doi.org/10.1016/j.eswa.2013.12.046 . .

J. Carlson . . Redis in Action , , : : New York Manning Publications Co. , , 2013 . . .

R. Cattell . . Scalable SQL and NoSQL data stores . . SIGMOD Rec. , , 2010 . . 39 ( ( 4 ): ): 12 - - 27 . . DOI: 10.1145/1978915.1978919 http://doi.org/10.1145/1978915.1978919 . .

T.D. Chandra , , , R. Griesemer , , , J. Redstone . . Paxos made live: an engineering perspective . . Proc. 26th Annual ACM Symp. on Principles of Distributed Computing , , 2007 . . p.398 - - 407 . . DOI: 10.1145/1281100.1281103 http://doi.org/10.1145/1281100.1281103 . .

F. Chang , , , J. Dean , , , S. Ghemawat , , , 等 . . Bigtable: a distributed storage system for structured data . . ACM Trans. Comput. Syst. , , 2008 . . 26 ( ( 2 ): ): 1 - - 26 . . DOI: 10.1145/1365815.1365816 http://doi.org/10.1145/1365815.1365816 . .

C.L.P. Chen , , , C.Y. Zhang . . Data-intensive applications, challenges, techniques and technologies: a survey on big data . . Inform. Sci. , , 2014 . . 275 314 - - 347 . . DOI: 10.1016/j.ins.2014.01.015 http://doi.org/10.1016/j.ins.2014.01.015 . .

M. Chen , , , S.W. Mao , , , Y.H. Liu . . Big data: a survey . . Mob. Networks Appl. , , 2014 . . 19 ( ( 2 ): ): 171 - - 209 . . DOI: 10.1007/s11036-013-0489-0 http://doi.org/10.1007/s11036-013-0489-0 . .

A. Cichocki . . Era of big data processing: a new approach via tensor networks and tensor decompositions . . arXiv: 1403.2048. , , 2014 . . .

J. Coburn , , , A.M. Caulfield , , , A. Akel , , , 等 . . NV-Heaps: making persistent objects fast and safe with next-generation, non-volatile memories . . ACM SIGPLAN Not. , , 2011 . . 47 ( ( 3 ): ): 105 - - 118 . . DOI: 10.1145/2248487.1950380 http://doi.org/10.1145/2248487.1950380 . .

P. Cudré-Mauroux , , , H. Kimura , , , K.T. Lim , , , 等 . . A demonstration of SciDB: a science-oriented DBMS . . Proc. VLDB Endow. , , 2009 . . 2 ( ( 2 ): ): 1534 - - 1537 . . DOI: 10.14778/1687553.1687584 http://doi.org/10.14778/1687553.1687584 . .

C.A.D. Deagustini , , , S.E.F. Dalibón , , , S. Gottifredi , , , 等 . . Relational databases as a massive information source for defeasible argumentation . . Knowl.-Based Syst. , , 2013 . . 51 93 - - 109 . . DOI: 10.1016/j.knosys.2013.07.010 http://doi.org/10.1016/j.knosys.2013.07.010 . .

J. Dean , , , S. Ghemawat . . MapReduce: simplified data processing on large clusters . . Commun. ACM , , 2008 . . 51 ( ( 1 ): ): 107 - - 113 . . DOI: 10.1145/1327452.1327492 http://doi.org/10.1145/1327452.1327492 . .

G. DeCandia , , , D. Hastorun , , , M. Jampani , , , 等 . . Dynamo: Amazon's highly available key-value store . . ACM SIGOPS Oper. Syst. Rev. , , 2007 . . 41 ( ( 6 ): ): 205 - - 220 . . DOI: 10.1145/1323293.1294281 http://doi.org/10.1145/1323293.1294281 . .

G.C. Deka . . A survey of cloud database systems . . IT Prof. , , 2014 . . 16 ( ( 2 ): ): 50 - - 57 . . DOI: 10.1109/MITP.2013.1 http://doi.org/10.1109/MITP.2013.1 . .

R. Dharavath , , , C. Kumar . . A scalable generic transaction model scenario for distributed NoSQL databases . . J. Syst. Softw. , , 2015 . . 101 43 - - 58 . . DOI: 10.1016/j.jss.2014.11.037 http://doi.org/10.1016/j.jss.2014.11.037 . .

B.W. Diack , , , S. Ndiaye , , , Y. Slimani . . CAP theorem between claims and misunderstandings: what is to be sacrificed . . Int. J. Adv. Sci. Technol. , , 2013 . . 56 1 - - 12 . . . .

J. Dittrich , , , J. Quiané-Ruiz , , , S. Richter , , , 等 . . Only aggressive elephants are fast elephants . . Proc. VLDB Endow. , , 2012 . . 5 ( ( 11 ): ): 1591 - - 1602 . . DOI: 10.14778/2350229.2350272 http://doi.org/10.14778/2350229.2350272 . .

D. Dominguez-Sal , , , P. Urbón-Bayes , , , A. Giménez-Vaó , , , 等 . . Survey of graph database performance on the HPC scalable graph analysis benchmark . . In : Shen H.T., Pei J., zsu M.T., et al. (Eds.), Web-Age Information Management. Springer Berlin Heidelberg , , 2010 . . p.37 - - 48 . . DOI: 10.1007/978-3-642-16720-1_4 http://doi.org/10.1007/978-3-642-16720-1_4 . .

L. Excoffier , , , H.E.L. Lischer . . Arlequin suite ver 3.5: a new series of programs to perform population genetics analyses under Linux and Windows . . Mol. Ecol. Res. , , 2010 . . 10 ( ( 3 ): ): 564 - - 567 . . DOI: 10.1111/j.1755-0998.2010.02847.x http://doi.org/10.1111/j.1755-0998.2010.02847.x . .

A. Fox , , , E.A. Brewer . . Harvest, yield, and scalable tolerant systems . . Proc. 7th Workshop on Hot Topics in Operating Systems , , 1999 . . p.174 - - 178 . . DOI: 10.1109/HOTOS.1999.798396 http://doi.org/10.1109/HOTOS.1999.798396 . .

A. Fox , , , S.D. Gribble , , , Y. Chawathe , , , 等 . . Cluster-based scalable network services . . Proc. 16th ACM Symp. on Operating Systems Principles , , 1997 . . p.78 - - 91 . . DOI: 10.1145/268998.266662 http://doi.org/10.1145/268998.266662 . .

S. Fulton . . The Other Non-SQL Alternative: Infinite Graph 2.0 . . [Accessed on May 5, 2015] , , 2011 . . http://readwrite.com/2011/08/24/the-other-non-sql-alternative http://readwrite.com/2011/08/24/the-other-non-sql-alternative , , . .

A. Gani , , , A. Siddiqa , , , S. Shamshirband , , , 等 . . A survey on indexing techniques for big data: taxonomy and performance evaluation . . Knowl. Inform. Syst. , , 2015 . . 46 ( ( 2 ): ): 241 - - 284 . . DOI: 10.1007/s10115-015-0830-y http://doi.org/10.1007/s10115-015-0830-y . .

L. George . . HBase: the Definitive Guide , , : : California O'Reilly Media, Inc. , , 2011 . . .

S. Ghemawat , , , H. Gobioff , , , S.T. Leung . . The Google file system . . SIGOPS Oper. Syst. Rev. , , 2003 . . 37 ( ( 5 ): ): 29 - - 43 . . DOI: 10.1145/1165389.945450 http://doi.org/10.1145/1165389.945450 . .

I. Gorton , , , J. Klein . . Distribution, data, deployment: software architecture convergence in big data systems . . IEEE Softw. , , 2015 . . 32 ( ( 3 ): ): 78 - - 85 . . DOI: 10.1109/MS.2014.51 http://doi.org/10.1109/MS.2014.51 . .

J. Gray . . The transaction concept: virtues and limitations . . Proc. 7th Int. Conf. on Very Large Data Bases , , 1981 . . p.144 - - 154 . . . .

M. Habeeb . . A Developer's Guide to Amazon SimpleDB , , Addison-Wesley Professional , , 2010 . . .

J. Han , , , E. Haihong , , , G. Le , , , 等 . . Survey on NoSQL database . . 6th Int. Conf. on Pervasive Computing and Applications , , 2011 . . p.363 - - 366 . . DOI: 10.1109/ICPCA.2011.6106531 http://doi.org/10.1109/ICPCA.2011.6106531 . .

R. Hecht , , , S. Jablonski . . NoSQL evaluation: a use case oriented survey . . Int. Conf. on Cloud and Service Computing , , 2011 . . p.336 - - 341 . . DOI: 10.1109/CSC.2011.6138544 http://doi.org/10.1109/CSC.2011.6138544 . .

M. Helmke . . Ubuntu Unleashed 2012 Edition: Covering 11.10 and 12.04 , , : : Sams Publishing 2012 . . .

E. Hewitt . . Cassandra: the Definitive Guide , , : : California 'Reilly Media, Inc. , , 2010 . . .

S. Hilker . . Survey Distributed Databases-Toad for Cloud . . [Accessed on May 5, 2015] , , 2012 . . http://www.toadworld.com/products/toad-for-cloud-databases/w/wiki/308.survey-distributed-databases.aspx http://www.toadworld.com/products/toad-for-cloud-databases/w/wiki/308.survey-distributed-databases.aspx , , . .

Y. Hu , , , S. Dessloch . . Extracting deltas from column oriented NoSQL databases for different incremental applications and diverse data targets . . Data Knowl. Eng. , , 2014 . . 93 42 - - 59 . . DOI: 10.1016/j.datak.2014.07.002 http://doi.org/10.1016/j.datak.2014.07.002 . .

HyperGraphDB . . HyperGraphDB-A Graph Database . . [Accessed on May 5, 2015] , , 2010 . . http://www.hypergraphdb.org/ http://www.hypergraphdb.org/ , , . .

HyperTable . . Hypertable . . [Accessed on Jan. 15, 2015] , , 2015 . . http://hypertable.com/documentation/ http://hypertable.com/documentation/ , , . .

IMDB . . The Internet Movie DataBase . . [Accessed on May 5, 2015] , , 2015 . . http://www.imdb.com/ http://www.imdb.com/ , , . .

InfiniteGraph . . InfiniteGraph | Distributed Graph Database . . [Accessed on May 5, 2015] , , 2014 . . http://www.objectivity.com/ http://www.objectivity.com/ , , . .

B. Iordanov . . HyperGraphDB: a generalized graph database . . In : Shen H.T., Pei J., zsu M.T., et al. (Eds.), Web-Age Information Management. Springer Berlin Heidelberg , , 2010 . . p.25 - - 36 . . DOI: 10.1007/978-3-642-16720-1_3 http://doi.org/10.1007/978-3-642-16720-1_3 . .

S. Kaisler , , , F. Armour , , , J.A. Espinosa , , , 等 . . Big data: issues and challenges moving forward . . 46th Hawaii Int. Conf. on System Sciences , , 2013 . . p.995 - - 1004 . . DOI: 10.1109/HICSS.2013.645 http://doi.org/10.1109/HICSS.2013.645 . .

D. Karaboga , , , C. Ozturk . . A novel clustering approach: artificial bee colony (ABC) algorithm . . Appl. Soft Comput. , , 2011 . . 11 ( ( 1 ): ): 652 - - 657 . . DOI: 10.1016/j.asoc.2009.12.025 http://doi.org/10.1016/j.asoc.2009.12.025 . .

A. Khetrapal , , , V. Ganesh . . HBase and Hypertable for Large Scale Distributed Storage Systems . . Department of Computer Science, Purdue University , , 2006 . . .

M. Kim , , , K.S. Candan . . Efficient static and dynamic in-database tensor decompositions on chunk-based array stores . . Proc. 23rd ACM Int. Conf. on Information and Knowledge Management , , 2014a . . p.969 - - 978 . . DOI: 10.1145/2661829.2661864 http://doi.org/10.1145/2661829.2661864 . .

M. Kim , , , K.S. Candan . . TensorDB: in-database tensor manipulation with tensor-relational query plans . . Proc. 23rd ACM Int. Conf. on Information and Knowledge Management , , 2014b . . p.2039 - - 2041 . . DOI: 10.1145/2661829.2661842 http://doi.org/10.1145/2661829.2661842 . .

C. Kristina , , , D. Michael . . MongoDB: the Definitive Guide , , : : California O'Reilly Media, Inc. , , 2010 . . .

G. Kumar . . Just Say Yes to NoSQL . . [Accessed on May 5, 2015] , , 2014 . . http://www.3pillarglobal.com/insights/just-say-yes-to-nosql http://www.3pillarglobal.com/insights/just-say-yes-to-nosql , , . .

A. Lakshman , , , P. Malik . . Cassandra: a decentralized structured storage system . . SIGOPS Oper. Syst. Rev. , , 2010 . . 44 ( ( 2 ): ): 35 - - 40 . . DOI: 10.1145/1773912.1773922 http://doi.org/10.1145/1773912.1773922 . .

C.F. Lam , , , H. Liu , , , B. Koley , , , 等 . . Fiber optic communication technologies: what's needed for datacenter network operations . . IEEE Commun. Mag. , , 2010 . . 48 ( ( 7 ): ): 32 - - 39 . . DOI: 10.1109/MCOM.2010.5496876 http://doi.org/10.1109/MCOM.2010.5496876 . .

B. Lorica . . The Tensor Renaissance in Data Science . . 2015 . . http://radar.oreilly.com/2015/05/the-tensor-renaissance-in-data-science.html http://radar.oreilly.com/2015/05/the-tensor-renaissance-in-data-science.html , , . .

G. MacFadden . . 21 NoSQL Innovators to Look for in 2020 . . [Accessed on May 5, 2015] , , 2013 . . http://blog.parityresearch.com/21-nosql-innovators-to-look-for-in-2020/ http://blog.parityresearch.com/21-nosql-innovators-to-look-for-in-2020/ , , . .

MemcacheDB . . MemcacheDB . . [Accessed on Jan. 10, 2015] , , 2015 . . http://memcachedb.org/ http://memcachedb.org/ , , . .

D. Milne , , , I.H. Witten . . An open-source toolkit for mining Wikipedia . . Artif. Intell. , , 2013 . . 194 222 - - 239 . . DOI: 10.1016/j.artint.2012.06.007 http://doi.org/10.1016/j.artint.2012.06.007 . .

MongoDB . . MongoDB Architecture Guide (White Paper) . . [Accessed on May 7, 2015] , , 2015 . . https://www.mongodb.com/lp/white-paper/architecture-guide?jmp=docs&_ga=1.165918654.1239465962.1430978187:MongoDB https://www.mongodb.com/lp/white-paper/architecture-guide?jmp=docs&_ga=1.165918654.1239465962.1430978187:MongoDB , , . .

D. Montag . . Understanding Neo4j Scalability . . 2013 . . http://info.neotechnology.com/rs/neotechnology/images/Understanding%20Neo4j%20Scalability(2).pdf http://info.neotechnology.com/rs/neotechnology/images/Understanding%20Neo4j%20Scalability(2).pdf , , . .

MovieLens . . MovieLens . . [Accessed on May 5, 2015] , , 2015 . . https://movielens.org/ https://movielens.org/ , , . .

D. Nagy , , , A.M. Yassin , , , A. Bhattacherjee . . Organiza-tional adoption of open source software: barriers and remedies . . Commun. ACM , , 2010 . . 53 ( ( 3 ): ): 148 - - 151 . . DOI: 10.1145/1666420.1666457 http://doi.org/10.1145/1666420.1666457 . .

Neo4j . . Overcoming SQL Strain and SQL Pain (White Paper) . . [Accessed on May 5, 2015] , , 2015 . . http://neo4j.com/resources/wp-overcoming-sql-strain/?utm_source=db-engines&utm_medium=textsqlpain&utm_content=download&utm_campaign=dl http://neo4j.com/resources/wp-overcoming-sql-strain/?utm_source=db-engines&utm_medium=textsqlpain&utm_content=download&utm_campaign=dl , , . .

L. Neumeyer , , , B. Robbins , , , A. Nair , , , 等 . . S4: distributed stream computing platform . . IEEE Int. Conf. on Data Mining Workshops , , 2010 . . p.170 - - 177 . . DOI: 10.1109/ICDMW.2010.172 http://doi.org/10.1109/ICDMW.2010.172 . .

M. Niranjanamurthy , , , U.L. Archana , , , K.T. Niveditha , , , 等 . . The research study on DynamoDB-NoSQL database service . . Int. J. Comput. Sci. Mob. Comput. , , 2014 . . 3 ( ( 10 ): ): 268 - - 279 . . . .

Objectivity, Inc. . . InfiniteGraph: the Distributed Graph Database (White Paper) . . [Accessed on May 5, 2015] , , 2012 . . http://www.objectivity.com/products/infinitegraph/ http://www.objectivity.com/products/infinitegraph/ , , . .

S.F. Oliveira , , , K. Fürlinger , , , D. Kranzlmüller . . Trends in computation, communication and storage and the consequences for data-intensive science . . IEEE 14th Int. Conf. on High Performance Computing and Communi-cation and IEEE 9th Int. Conf. on Embedded Software and Systems , , 2012 . . p.572 - - 579 . . DOI: 10.1109/HPCC.2012.83 http://doi.org/10.1109/HPCC.2012.83 . .

Oracle . . Managing Consistency with Berkeley DB-HA(White Paper) . . [Accessed on May 5, 2015] , , 2015a . . http://www.oracle.com/technetwork/products/berkeleydb/high-availability-099050.html http://www.oracle.com/technetwork/products/berkeleydb/high-availability-099050.html , , . .

Oracle . . Oracle Berkeley DB . . [Accessed on May 5, 2015] , , 2015b . . http://www.oracle.com/technetwork/database/database-technologies/berkeleydb/overview/index.html http://www.oracle.com/technetwork/database/database-technologies/berkeleydb/overview/index.html , , . .

Oracle . . Unleash High Availability Applications with Berkeley DB (White Paper) . . [Accessed on May 5, 2015] , , 2015c . . http://www.oracle.com/technetwork/products/berkeleydb/high-availability-099050.html http://www.oracle.com/technetwork/products/berkeleydb/high-availability-099050.html , , . .

Secondary Oracle . . Secondary Indexes . . [Accessed on May 5, 2015] , , 2015 . . https://docs.oracle.com/cd/E17275_01/html/programmer_reference/am_second.html https://docs.oracle.com/cd/E17275_01/html/programmer_reference/am_second.html , , . .

OrientDB . . OrientDB-OrientDB Mulit-model NoSQL Database . . [Accessed on May 5, 2015] , , 2015 . . http://orientdb.com http://orientdb.com , , . .

V. Padhye , , , A. Tripathi . . Scalable transaction manage-ment with snapshot isolation for NoSQL data storage systems . . IEEE Trans. Serv. Comput. , , 2015 . . 8 ( ( 1 ): ): 121 - - 135 . . DOI: 10.1109/TSC.2013.47 http://doi.org/10.1109/TSC.2013.47 . .

J. Pokorny . . NoSQL databases: a step to database scalability in web environment . . Int. J. Web Inform. Syst. , , 2013 . . 9 ( ( 1 ): ): 69 - - 82 . . DOI: 10.1108/17440081311316398 http://doi.org/10.1108/17440081311316398 . .

G. Putnik , , , A. Sluga , , , H. ElMaraghy , , , 等 . . Scalability in manufacturing systems design and operation: state-of-the-art and future developments roadmap . . CIRP Ann. Manuf. Technol. , , 2013 . . 62 ( ( 2 ): ): 751 - - 774 . . DOI: 10.1016/j.cirp.2013.05.002 http://doi.org/10.1016/j.cirp.2013.05.002 . .

Qualcomm . . NoSQL XML Databases Qualcomm Qizx . . [Accessed on May 5, 2015] , , 2014a . . https://www.qualcomm.com/qizx https://www.qualcomm.com/qizx , , . .

Qualcomm . . Qualcomm Qizx | User Guide . . [Accessed on May 5, 2015] , , 2014b . . https://www.qualcomm.com/qizx https://www.qualcomm.com/qizx , , . .

R. Ramakrishnan . . CAP and cloud data management . . Computer , , 2012 . . 45 ( ( 2 ): ): 43 - - 49 . . DOI: 10.1109/MC.2011.388 http://doi.org/10.1109/MC.2011.388 . .

RethinkDB . . RethinkDB: the Open Source Database for Real-Time Web . . [Accessed on May 5, 2015] , , 2015 . . http://rethinkdb.com/ http://rethinkdb.com/ , , . .

RocketSoftware . . High Availability and Dissaster Recovery for Rocket U2 Databases . . [Accessed on May 5, 2015] , , 2014a . . 2015 http://info.rocketsoftware.com/hadr.html http://info.rocketsoftware.com/hadr.html , , . .

RocketSoftware . . Vermont Teddy Bear | A Top Ecommerce Retailer Relies on Rocket U2 to Successfully Manage Information Processing Activities in Its Direct-to-Consumer Divisions [Case Study] . . 2014b . . http://blog.rocketsoftware.com/blog/2014/12/22/vermont-teddy-bear-relies-rocket-u2-improve-service-increase-revenue/ http://blog.rocketsoftware.com/blog/2014/12/22/vermont-teddy-bear-relies-rocket-u2-improve-service-increase-revenue/ , , . .

RocketSoftware . . Flexible, High Volume Data Management | Rocket Software . . [Accessed on May 5, 2015] , , 2015 . . http://www.rocketsoftware.com/product-families/rocket-u2 http://www.rocketsoftware.com/product-families/rocket-u2 , , . .

N. Ruflin , , , H. Burkhart , , , S. Rizzotti . . Social-data storage-systems . . Proc. Databases and Social Networks , , 2011 . . p.7 - - 12 . . DOI: 10.1145/1996413.1996415 http://doi.org/10.1145/1996413.1996415 . .

S. Sakr , , , A. Liu , , , D.M. Batista , , , 等 . . A survey of large scale data management approaches in cloud environments . . IEEE Commun. Surv. Tutor. , , 2011 . . 13 ( ( 3 ): ): 311 - - 336 . . DOI: 10.1109/SURV.2011.032211.00087 http://doi.org/10.1109/SURV.2011.032211.00087 . .

Scalaris . . Scalaris . . [Accessed on May 5, 2015] , , 2015 . . http://scalaris.zib.de/ http://scalaris.zib.de/ , , . .

T. Schütt , , , F. Schintke , , , A. Reinefeld . . Scalaris: reliable transactional P2P key/value store . . Proc. 7th ACM SIGPLAN Workshop on ERLANG , , 2008 . . p.41 - - 48 . . DOI: 10.1145/1411273.1411280 http://doi.org/10.1145/1411273.1411280 . .

E. Sciore . . SimpleDB: a simple Java-based multiuser system for teaching database internals . . SIGCSE Bull. , , 2007 . . 39 ( ( 1 ): ): 561 - - 565 . . DOI: 10.1145/1227504.1227498 http://doi.org/10.1145/1227504.1227498 . .

SD Times Newswire . . OrientDB Becomes Distributed Using Hazelcast, Leading Open Source In-Memory Data Grid . . [Accessed on May 5, 2015] , , 2013 . . http://sdtimes.com/orientdb-becomes-distributed-using-hazelcast-leading-open-source-in-memory-data-grid/ http://sdtimes.com/orientdb-becomes-distributed-using-hazelcast-leading-open-source-in-memory-data-grid/ , , . .

M. Seltzer , , , K. Bostic . . The Architecture of Open Source Applications: Berkeley DB . . [Accessed on May 5, 2015] , , 2015 . . http://www.aosabook.org/en/bdb.html http://www.aosabook.org/en/bdb.html , , . .

J. Sheehy . . Riak 0.10 is Full of Great Stuff . . [Accessed on May 5, 2015] , , 2010 . . http://basho.com/riak-0-10-is-full-of-great-stuff/ http://basho.com/riak-0-10-is-full-of-great-stuff/ , , . .

K.V. Shvachko . . HDFS scalability: the limits to growth . . Login , , 2010 . . 35 ( ( 2 ): ): 6 - - 16 . . . .

S. Sivasubramanian . . Amazon DynamoDB: a seamlessly scalable non-relational database service . . Proc. ACM SIGMOD Int. Conf. on Management of Data , , 2012 . . p.729 - - 730 . . DOI: 10.1145/2213836.2213945 http://doi.org/10.1145/2213836.2213945 . .

I. Skoulis , , , P. Vassiliadis , , , A.V. Zarras . . Growing up with stability: how open-source relational databases evolve . . Inform. Syst. , , 2015 . . 53 363 - - 385 . . DOI: 10.1016/j.is.2015.03.009 http://doi.org/10.1016/j.is.2015.03.009 . .

SourceForge . . KAI SourceForge . . [Accessed on May 5, 2015] , , 2015 . . http://sourceforge.net/projects/kai/ http://sourceforge.net/projects/kai/ , , . .

E. Spaho , , , L. Barolli , , , F. Xhafa , , , 等 . . P2P data replication and trustworthiness for a JXTA-overlay P2P system using fuzzy logic . . Appl. Soft Comput. , , 2013 . . 13 ( ( 1 ): ): 321 - - 328 . . DOI: 10.1016/j.asoc.2012.08.044 http://doi.org/10.1016/j.asoc.2012.08.044 . .

M. Stonebraker , , , P. Brown , , , D. Zhang , , , 等 . . SciDB: a database management system for applications with complex analytics . . Comput. Sci. Eng. , , 2013 . . 15 ( ( 3 ): ): 54 - - 62 . . DOI: 10.1109/MCSE.2013.19 http://doi.org/10.1109/MCSE.2013.19 . .

V. Subramaniyaswamy , , , V. Vijayakumar , , , R. Logesh , , , 等 . . Unstructured data analysis on big data using MapReduce . . Proc. Comput. Sci. , , 2015 . . 50 456 - - 465 . . DOI: 10.1016/j.procs.2015.04.015 http://doi.org/10.1016/j.procs.2015.04.015 . .

R. Sumbaly , , , J. Kreps , , , L. Gao , , , 等 . . Serving large-scale batch computed data with project Voldemort . . Proc. 10th USENIX Conf. on File and Storage Technologies , , 2012 . . p.18 . .

D.W. Sun , , , G.R. Chang , , , S. Gao , , , 等 . . Modeling a dynamic data replication strategy to increase system availability in cloud computing environments . . J. Comput. Sci. Technol. , , 2012 . . 27 ( ( 2 ): ): 256 - - 272 . . DOI: 10.1007/s11390-012-1221-4 http://doi.org/10.1007/s11390-012-1221-4 . .

J. Taheri , , , Y.C. Lee , , , A.Y. Zomaya , , , 等 . . A bee colony based optimization approach for simultaneous job scheduling and data replication in grid environments . . Comput. Oper. Res. , , 2013 . . 40 ( ( 6 ): ): 1564 - - 1578 . . DOI: 10.1016/j.cor.2011.11.012 http://doi.org/10.1016/j.cor.2011.11.012 . .

A. Tanenbaum , , , M. van Steen . . Distributed Systems , , Pearson Prentice Hall , , 2007 . . .

R.C. Taylor . . An overview of the Hadoop/MapReduce/ HBase framework and its current applications in bioinformatics . . BMC Bioinform. , , 2010 . . 11 ( ( Suppl 12 ): ): 1 - - 6 . . DOI: 10.1186/1471-2105-11-S12-S1 http://doi.org/10.1186/1471-2105-11-S12-S1 . .

Terrastore . . Terrastore-Scalable, Elastic, Consistent Document Store . . [Accessed on May 7, 2015] , , 2015 . . http://code.google.com/p/terrastore/ http://code.google.com/p/terrastore/ , , . .

B.G. Tudorica , , , C. Bucur . . A comparison between several NoSQL databases with comments and notes . . 10th Roedunet Int. Conf. , , 2011 . . p.1 - - 5 . . DOI: 10.1109/RoEduNet.2011.5993686 http://doi.org/10.1109/RoEduNet.2011.5993686 . .

A. Turk , , , R.O. Selvitopi , , , H. Ferhatosmanoglu , , , 等 . . Temporal workload-aware replicated partitioning for social networks . . IEEE Trans. Knowl. Data Eng. , , 2014 . . 26 ( ( 11 ): ): 2832 - - 2845 . . DOI: 10.1109/TKDE.2014.2302291 http://doi.org/10.1109/TKDE.2014.2302291 . .

C. Vicknair , , , M. Macias , , , Z.D. Zhao , , , 等 . . A comparison of a graph database and a relational database: a data provenance perspective . . Proc. 48th Annual Southeast Regional Conf. , , 2010 . . p.1 - - 6 . . DOI: 10.1145/1900008.1900067 http://doi.org/10.1145/1900008.1900067 . .

Voldemort . . Project Voldemort . . [Accessed on Jan. 10, 2015] , , 2015 . . http://www.project-voldemort.com/voldemort/ http://www.project-voldemort.com/voldemort/ , , . .

U. Vyas , , , P. Kuppusamy . . DynamoDB Applied Design Patterns , , : : Birmingham Packt Publishing Ltd. , , 2014 . . .

L. Walsh , , , V. Akhmechet , , , M. Glukhovsky . . RethinkDB-Rethinking Database Storage (White Paper) . . , , 2009 . . .

H.J. Wang , , , J.H. Li , , , H.M. Zhang , , , 等 . . Benchmarking Replication and Consistency Strategies in Cloud Serving Databases: HBase and Cassandra . . In : Zhan J.F., Han R., Weng, C.L. (Eds.), Big Data Benchmarks, Performance Optimization, and Emerging Hardware. Springer International Publishing , , 2014 . . p.71 - - 82 . . DOI: 10.1007/978-3-319-13021-7_6 http://doi.org/10.1007/978-3-319-13021-7_6 . .

X. Wang , , , H.L. Sun , , , T. Deng , , , 等 . . On the tradeoff of availability and consistency for quorum systems in data center networks . . Comput. Networks , , 2015 . . 76 191 - - 206 . . DOI: 10.1016/j.comnet.2014.11.006 http://doi.org/10.1016/j.comnet.2014.11.006 . .

A. Wenk , , , N. Slater . . Introduction . . [Accessed on May 5, 2015] , , 2014 . . https://cwiki.apache.org/confluence/display/COUCHDB/Introduction https://cwiki.apache.org/confluence/display/COUCHDB/Introduction , , . .

Z.F. Xiao , , , Y.M. Liu . . Remote sensing image database based on NOSQL database . . 19th Int. Conf. on Geoinformatics , , 2011 . . p.1 - - 5 . . DOI: 10.1109/GeoInformatics.2011.5980724 http://doi.org/10.1109/GeoInformatics.2011.5980724 . .

X.X. Zhang , , , F. Xu . . Survey of research on big data storage . . 12th Int. Symp. on Distributed Computing and Applications to Business, Engineering and Science , , 2013 . . p.76 - - 80 . . DOI: 10.1109/DCABES.2013.21 http://doi.org/10.1109/DCABES.2013.21 . .

W.Z. Zhao , , , H.F. Ma , , , Q. He . . Parallel K -means clustering based on MapReduce . . IEEE Int. Conf. on Cloud Computing , , 2009 . . p.674 - - 679 . . DOI: 10.1007/978-3-642-10665-1_71 http://doi.org/10.1007/978-3-642-10665-1_71 . .

R.V. Zicari . . On Graph Databases . . [Accessed on May 5, 2015] , , 2015 . . http://www.odbms.org/blog/2015/05/on-graph-databases-interview-with-emil-eifrem/ http://www.odbms.org/blog/2015/05/on-graph-databases-interview-with-emil-eifrem/ , , . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰