当前位置:网站首页>Modern storage performance is "surplus", API is the biggest bottleneck

Modern storage performance is "surplus", API is the biggest bottleneck

2020-12-06 21:03:58 InfoQ

{"type":"doc","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" Over the past decade , I spent my precious years in a professional product company , Focus on building high performance I\/O System . As practitioners , I'm lucky to see the rapid development of storage technology , The actual feeling at work is more like team mobilization ."}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" This year, , I changed my job , Joined a large enterprise with many engineers with different backgrounds . What really surprised me was , Although these colleagues are also very intelligent , But most of them have misunderstandings about how to make full use of the performance advantages of modern storage technology . let me put it another way , They know that storage technology is improving , But it's not clear what kind of improvement it is ."}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" In reflecting on this disconnect , I realize that this kind of misunderstanding exists for a long time , Mainly once people start to benchmark their assumptions , Then the data will prove this hypothesis to some extent 、 Or at least it seems to prove ."}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" Common examples of this misunderstanding include :"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"“ ok , Here we can copy memory and perform high cost calculations , After all, this can help us save a higher cost I\/O operation .”"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"“ I'm designing a system that needs to run fast , So it has to run in memory .”"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"“ If split into multiple files , It's affected by speed , Because it creates randomness I\/O Pattern . We need to optimize , Read through a single file while accessing sequentially .”"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"blockquote","content":[{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":"DirectI\/O Very slow , And only for some very professional applications . If there is no cache , That's bound to drag down performance .”"}]}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null},"content":[{"type":"text","text":" however , If you focus on Modernity NVMe Equipment specifications , You'll find that the latency of commercial devices has been compressed to microseconds , And the throughput is in the number of seconds GB, Can support hundreds of thousands of random IOPS. The performance is so strong , Why can't we know each other ?"}]},{"type":"paragraph","attrs":{"indent":0,"number":0,"align":null,"origin":null}}]}

版权声明
本文为[InfoQ]所创,转载请带上原文链接,感谢
https://chowdera.com/2020/12/20201206210057798s.html