当前位置:网站首页>Netflix test c assandra:- Million writes per second

Netflix test c assandra:- Million writes per second

2021-05-04 14:53:04 Jiedao jdon

Tools for testing cloud products also need the cloud ,Netflix Recently used Amazon The impact of cloud computing on cloud storage NoSQLCassandra A performance test was conducted :

The Netflix Tech Blog: Benchmarking Cassandra Scalability on AWS - Over a million writes per second

Netflix Has been used Apache Cassandra NoSQL It's been six months since data was stored in the production environment , Their testing department decided to conduct a comprehensive performance test on it . This test helps the development team use... More effectively Amazon Of Aws.

This test is based on Amazon Cloud computing platform AWS On going , They put the Cassandra Deployed in Amazon Of EC2 Server , A total of 288 An example , Scattered in three parts of the eastern United States , Everywhere 96 An example , In addition, use 60 Instance user client test , Run per second 1.1 Million pressure programs , Between three different data centers at a rate of 3.3 Millions of write operations for data replication . The whole test was completed in two hours , It costs hundreds of dollars .

The test is from 48 96 144 To 288 The number of cases is increasing , Tests show that throughput also increases linearly , Test software using Cassandra 0.8.6, It's all about production environment configuration ,EC2 establish 288 It's working 15 minute , common 66 minute , The rest of the time to start Linux and Tomcat JVM The autotest program has been run on it , start-up Cassandra JVM wait .

Configuration is to use EC2 Of m1.x1 Specification server , Four medium speed CPU 15G Memory ,4 individual 400G Hard disk , They have also used m2.4xl specifications 8、 ... and CPU 68G And two 800G Hard disk , Network environment is every second 1G bandwidth , The operating system is CentOS 5.6 and XFS,Cassandra Of commit Logs and data files are stored in the disk file system .60 The test client uses m2.4xl The server .

All test cases are created using EC2 Of ASG(auto-scale group () establish , Create three ASG,EC2 Create them and maintain management , once ASG Found a crash , Use the backup server immediately , and NetFlix Our tools are responsible for this time Cassandra The start of the cluster on the new server . Here is ASG Configuration thumbnails :

[ The quilt admin On 2011-11-19 10:35 A modified ]

[ The quilt admin On 2011-11-19 10:36 A modified ]


版权声明
本文为[Jiedao jdon]所创,转载请带上原文链接,感谢
https://chowdera.com/2021/05/20210504144409817V.html

随机推荐