{"id":2500,"date":"2015-03-27T12:00:39","date_gmt":"2015-03-27T02:00:39","guid":{"rendered":"https:\/\/www.penguinpunk.net\/blog\/?p=2500"},"modified":"2015-04-09T10:18:01","modified_gmt":"2015-04-09T00:18:01","slug":"storage-field-day-7-day-1-kaminario","status":"publish","type":"post","link":"https:\/\/www.penguinpunk.net\/blog\/storage-field-day-7-day-1-kaminario\/","title":{"rendered":"Storage Field Day 7 &#8211; Day 1 &#8211; Kaminario"},"content":{"rendered":"<p><b>Disclaimer: I recently attended\u00a0<\/b><a title=\"Storage Field Day 7\" href=\"http:\/\/techfieldday.com\/event\/sfd7\/\" target=\"_blank\"><b>Storage Field Day\u00a07<\/b><\/a><b>.\u00a0 My flights,\u00a0accommodation and other expenses were paid for by Tech Field Day. There is no requirement for me to blog about any of the content presented and I am not compensated in any way for my time at the event.\u00a0 Some materials presented were discussed under NDA and don\u2019t form part of my blog posts, but could influence future discussions.<\/b><\/p>\n<p>For each of the presentations I attended at SFD7, there are a few things I want to include in the post. Firstly, you can see video footage of the <a title=\"Kaminario presents at Storage Field Day 7\" href=\"http:\/\/techfieldday.com\/appearance\/kaminario-presents-at-storage-field-day-7\/\" target=\"_blank\">Kaminario\u00a0presentation here<\/a>. You can also download my raw notes from the presentation <a title=\"Kaminario presents at Storage Field Day 7 - Raw Notes\" href=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario.pdf\" target=\"_blank\">here<\/a>. Finally, here&#8217;s a link to the\u00a0<a title=\"Kaminario - Capacity Efficiency\" href=\"http:\/\/kaminario.com\/flash-array\/features\/capacity_efficiency.php\" target=\"_blank\">Kaminario\u00a0website<\/a>\u00a0that covers some of what they presented.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Overview<\/strong><\/p>\n<p align=\"LEFT\">Dani Golan, CEO of Kaminario, gave us a quick overview of the company. They&#8217;ve recently launched the 5th generation of their all-flash array\u00a0(AFA), with the majority (80%)\u00a0of customers being\u00a0in the\u00a0midrange (rev $100m &#8211; $5B).<\/p>\n<p align=\"LEFT\">The entry level for the solution is 20TB, with the average\u00a0capacity being between\u00a050\u00a0and 150TB. The largest implementation runs to\u00a01.5PB.<\/p>\n<p align=\"LEFT\">Use cases are primarily:<\/p>\n<ul>\n<li>VDI \/ Virtualisation;<\/li>\n<li>Analytics; and<\/li>\n<li>OLTP.<\/li>\n<\/ul>\n<p>Kaminario state that they&#8217;re balanced across all verticals\u00a0and offer\u00a0general purpose storage.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Architecture<\/strong><\/p>\n<p>Kaminario state that architecture is key. I think we&#8217;re all agreed on that point. Kaminario&#8217;s design goals are to:<\/p>\n<ul>\n<li>scale easily and cost-efficiently; and<\/li>\n<li>provide the lowest overhead on the storage system to fulfil the customer&#8217;s needs.<\/li>\n<\/ul>\n<p>Kaminario want to offer capacity, performance and flexibility. They do this by offering scale up and scale out.<\/p>\n<p>Customers want somewhere in between best $\/capacity and best $\/performance.<\/p>\n<p>The K2 basic building block (K-blocks, not 2K blocks) is:<\/p>\n<ul>\n<li>Off the shelf hardware;<\/li>\n<li>2x K-nodes (1U server);<\/li>\n<li>Infiniband;<\/li>\n<li>SSD Shelf (24 SSDs &#8211; 2RU); and<\/li>\n<li>SSD expansion shelf (24 SSDs &#8211; 2RU).<\/li>\n<\/ul>\n<p>Here&#8217;s a diagram of the K2 scale up model.<\/p>\n<p><a href=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_ScaleUp.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2630\" src=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_ScaleUp.png\" alt=\"SFD7_Day1_Kaminario_ScaleUp\" width=\"500\" height=\"536\" srcset=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_ScaleUp.png 662w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_ScaleUp-280x300.png 280w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/a><\/p>\n<p>And here&#8217;s what it looks like when you scale out.<\/p>\n<p><a href=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_Scale_Out.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2631\" src=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_Scale_Out-1024x606.png\" alt=\"SFD7_Day1_Kaminario_Scale_Out\" width=\"600\" height=\"355\" srcset=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_Scale_Out-1024x606.png 1024w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_Scale_Out-300x178.png 300w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_Scale_Out.png 1392w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/a><\/p>\n<p>I want to do both! Sure, here&#8217;s what scale up and out looks like.<\/p>\n<p><a href=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_ScaleUpandOut.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2634\" src=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_ScaleUpandOut-1024x601.png\" alt=\"SFD7_Day1_Kaminario_ScaleUpandOut\" width=\"600\" height=\"352\" srcset=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_ScaleUpandOut-1024x601.png 1024w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_ScaleUpandOut-300x176.png 300w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_ScaleUpandOut.png 1424w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/a><\/p>\n<p>In the K2 scale-out architecture:<\/p>\n<ul>\n<li>Data is spread across all nodes;<\/li>\n<li>Metadata is spread across all nodes;<\/li>\n<li>Provides the ability to mix and match different generations of servers and SSDs;<\/li>\n<li>Offers global deduplication; and<\/li>\n<li>Provides resiliency for multiple simultaneous failures.<\/li>\n<\/ul>\n<p>Data is protected against block (nodes and storage) failure, but the system will go down to secure the data.<\/p>\n<p>As for metadata scalability, modern data reduction means fine grain metadata:<\/p>\n<ul>\n<li>Pointer per 4KB of addressable; and<\/li>\n<li>Signature per 4KB of unique data.<\/li>\n<\/ul>\n<p>According to Kaminario, reducing the metadata footprint is crucial.<\/p>\n<ul>\n<li>The adaptive block size architecture means less pointers;<\/li>\n<li>Deduplication with weak hash reduces signature footprint; and<\/li>\n<li>Density per node is critical.<\/li>\n<\/ul>\n<p>K-RAID<\/p>\n<p><a href=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_K-RAID.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-2632\" src=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_K-RAID-1024x155.png\" alt=\"SFD7_Day1_Kaminario_K-RAID\" width=\"600\" height=\"91\" srcset=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_K-RAID-1024x155.png 1024w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_K-RAID-300x45.png 300w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2015\/03\/SFD7_Day1_Kaminario_K-RAID.png 1350w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/a><\/p>\n<p>K-RAID is Kaminario&#8217;s interpretation of RAID 6, and works thusly:<\/p>\n<ul>\n<li>2P + Q &#8211; 2 R5 groups, single Q parity on them;<\/li>\n<li>Fully rotating, RAID is fully balanced;<\/li>\n<li>Fully automatic, no manual configuration; and<\/li>\n<li>High utilisation (87.5%), no dedicated spares.<\/li>\n<\/ul>\n<p>The K2 architecture also offers the following data reduction technologies:<\/p>\n<p>Deduplication<\/p>\n<ul>\n<li>Global and adaptive;<\/li>\n<li>Selective &#8211; can be turned off per volume; and<\/li>\n<li>Weak hash and compare &#8211; low MD and CPU footprint, fits well\u00a0with flash.<\/li>\n<\/ul>\n<p>Compression<\/p>\n<ul>\n<li>Byte-aligned compression;<\/li>\n<li>Adaptive block size &#8211; large chunks are stored contiguously, each 4k compressed separately;<\/li>\n<li>Standard LZ4 algorithm; and<\/li>\n<li>Optimized zero elimination.<\/li>\n<\/ul>\n<p>From a resiliency perspective, K2 supports:<\/p>\n<ul>\n<li>Two\u00a0concurrent SSD failures per shelf;<\/li>\n<li>Consistent, predictable and high performance under failure; and<\/li>\n<li>Fast SSD firmware upgrades.<\/li>\n<\/ul>\n<p>The architecture currently scales to 8 K-Blocks, with the sweet spot being around\u00a02 &#8211; 4 K-Blocks. I strongly recommend you check out the\u00a0<a title=\"K2 Architecture White Paper\" href=\"http:\/\/kaminario.com\/resources\/files\/WP-K2_SPEAR.pdf\" target=\"_blank\">Kaminario architecture white paper<\/a> &#8211; it&#8217;s actually very informative.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Final Thoughts and Further Reading<\/strong><\/p>\n<p>I first came across Kaminario at VMworld last year, and I liked what they had to say. Their presentation at SFD7 backs that up for me, along with the reading I&#8217;ve done and the conversations I&#8217;ve had with people from the company. I like the approach, but I think they have a bit of an uphill battle to crack what seems to be a fairly congested AFA market. With a little bit more marketing, they might yet get there. Yes, I said more marketing. While we all like to criticise the marketing of products by IT vendors, I think it&#8217;s still a fairly critical piece of the overall solution puzzle, particularly when it comes to getting in front of customers who want to spend money. But that&#8217;s just my view. In any case, Enrico did a great write-up on Kaminario &#8211; you can read it <a title=\"When looking good is no longer enough\" href=\"http:\/\/juku.it\/en\/when-looking-good-is-no-longer-enough\/\" target=\"_blank\">here<\/a>. I also recommend checking out Keith&#8217;s <a title=\"Kaminario \u2013 Storage Field Day 7 Preview\" href=\"http:\/\/www.virtualizedgeek.com\/2015\/03\/kaminario-storage-field-day-7-preview\/\" target=\"_blank\">preview blog of Kaminario<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Disclaimer: I recently attended\u00a0Storage Field Day\u00a07.\u00a0 My flights,\u00a0accommodation and other expenses were paid for by Tech Field Day. There is no requirement for me to blog about any of the content presented and I am not compensated in any way for my time at the event.\u00a0 Some materials presented were discussed under NDA and don\u2019t [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[711,686],"tags":[736,637,729,718,787,684,683],"class_list":["post-2500","post","type-post","status-publish","format-standard","hentry","category-kaminario","category-storage-field-day","tag-afa","tag-flash","tag-kaminario","tag-sfd7","tag-storage","tag-storagefieldday","tag-techfieldday"],"_links":{"self":[{"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/posts\/2500","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/comments?post=2500"}],"version-history":[{"count":11,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/posts\/2500\/revisions"}],"predecessor-version":[{"id":2707,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/posts\/2500\/revisions\/2707"}],"wp:attachment":[{"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/media?parent=2500"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/categories?post=2500"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/tags?post=2500"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}