{"id":5233,"date":"2017-05-12T11:09:29","date_gmt":"2017-05-12T01:09:29","guid":{"rendered":"https:\/\/www.penguinpunk.net\/blog\/?p=5233"},"modified":"2017-05-12T11:09:29","modified_gmt":"2017-05-12T01:09:29","slug":"dell-emc-world-2017-storage-58-isilon-next-raising-the-bar-on-performance-archive-use-cases-notes","status":"publish","type":"post","link":"https:\/\/www.penguinpunk.net\/blog\/dell-emc-world-2017-storage-58-isilon-next-raising-the-bar-on-performance-archive-use-cases-notes\/","title":{"rendered":"Dell EMC World 2017 &#8211; storage.58 &#8211; Isilon.Next: Raising the Bar on Performance &#038; Archive Use Cases Notes"},"content":{"rendered":"<p><strong>Disclaimer: I recently attended\u00a0<\/strong><a href=\"http:\/\/www.dellemcworld.com\/index.htm\"><strong>Dell EMC World 2017<\/strong><\/a><strong>.\u00a0 My flights, accommodation and conference pass were paid for by Dell EMC via the Dell EMC Elect program. There is no requirement for me to blog about any of the content presented and I am not compensated in any way for my time at the event.\u00a0 Some materials presented were discussed under NDA and don\u2019t form part of my blog posts, but could influence future discussions.<\/strong><\/p>\n<p><a href=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/03\/DellEMCWorld2017.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5079\" src=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/03\/DellEMCWorld2017.jpg\" alt=\"\" width=\"800\" height=\"188\" srcset=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/03\/DellEMCWorld2017.jpg 1000w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/03\/DellEMCWorld2017-300x71.jpg 300w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/03\/DellEMCWorld2017-768x180.jpg 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/a><\/p>\n<p>Here are my rough notes from the\u00a0#storage.58 session. This was presented by <a href=\"https:\/\/www.linkedin.com\/in\/johnhar\/\">John Har<\/a> and covered the H and A series Isilon hardware.<\/p>\n<p><a href=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/Storage58.jpeg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5235\" src=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/Storage58.jpeg\" alt=\"\" width=\"800\" height=\"501\" srcset=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/Storage58.jpeg 2739w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/Storage58-300x188.jpeg 300w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/Storage58-768x481.jpeg 768w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/Storage58-1024x642.jpeg 1024w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p><strong>Isilon Overview<\/strong><\/p>\n<p><em>Isilon: the true scale out NAS<\/em><\/p>\n<p>Has been around for 15 years<\/p>\n<ul>\n<li>Single scalable namespace<\/li>\n<li>18TB to 65PB, 1GB\/s to 140GB\/s<\/li>\n<li>Distributed filesystem across cluster, up to 144 nodes<\/li>\n<li>No bottlenecks, no hotspots<\/li>\n<li>Easy to manage, no RAID, LUNs or multiple FS to manage<\/li>\n<li>Up to 89% storage efficiency<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><em>Transparent, optimised storage tiering<\/em><\/p>\n<ul>\n<li>Reduce capital expense<\/li>\n<li>Optimise storage<\/li>\n<li>Transparent to users and applications<\/li>\n<li>Flexible admin defined policies<\/li>\n<li>Deduplication<\/li>\n<\/ul>\n<p>Cloud tiering to ECS, Azure, AWS, virtustream, etc<\/p>\n<p>&nbsp;<\/p>\n<p><em>Enterprise Grade Data Protection and Management<\/em><\/p>\n<ul>\n<li>SnapshotIQ &#8211; Fast, efficient data backup and recovery<\/li>\n<li>SyncIQ &#8211; Fast and flexible asynchronous replication for disaster recovery protection<\/li>\n<li>SmartConnect &#8211; Policy-based client failover with load balancing<\/li>\n<li>SmartLock &#8211; Policy-based compliance and WORM data protection<\/li>\n<li>SmartDedupe &#8211; Data deduplication to reduce storage requirements and costs<\/li>\n<li>SmartPools &#8211; Policy-based automated tiering<\/li>\n<li>SmartQuotas &#8211; Quota management and thin provisioning<\/li>\n<li>InsightIQ &#8211; Performance monitoring and reporting to manage storage resources<\/li>\n<li>CloudPools &#8211; Seamlessly tier cold or frozen data to a choice of public or private cloud options<\/li>\n<li>Access Zones &#8211; Secure separation of data for different groups or users<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><em>New generation architecture<\/em><\/p>\n<ul>\n<li>Drive sleds future-proofed to support other drives such as NVMe<\/li>\n<li>Compute \u201csuitcases\u201d &#8211; performance \/ cost optimised<\/li>\n<li>Use either with IB or Ethernet (one or the other) &#8211; Isilon still owns \/ qualifies the back-end networking<\/li>\n<li>Non-disruptive migration will be possible too (from InfiniBand to Ethernet)<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><strong>Streaming image\/video workflows Everywhere<\/strong><\/p>\n<p><em>Typical requirements<\/em><\/p>\n<ul>\n<li>&gt;1GB\/s sequential read\/write<\/li>\n<li>GB-TB sized datasets<\/li>\n<li>Low, stable latency &lt;2ms<\/li>\n<\/ul>\n<p><em>Example: M&amp;E 4K uncompressed workflows <\/em><\/p>\n<p><a href=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K1.jpeg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5239\" src=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K1.jpeg\" alt=\"\" width=\"800\" height=\"587\" srcset=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K1.jpeg 2053w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K1-300x220.jpeg 300w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K1-768x563.jpeg 768w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K1-1024x751.jpeg 1024w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/a><\/p>\n<ul>\n<li>Post-production and visual effects flow<\/li>\n<li>5-100 artists &amp; editors, 5K &#8211; 10K core render farm<\/li>\n<li>1.2GB\/s per 4K uncompressed stream (73GB\/min)<\/li>\n<li>Sometimes cache on clients &#8211; data management headache<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><em>Solution: Work directly off Isilon<\/em><\/p>\n<p><a href=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K2.jpeg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5240\" src=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K2.jpeg\" alt=\"\" width=\"800\" height=\"564\" srcset=\"https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K2.jpeg 1989w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K2-300x212.jpeg 300w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K2-768x542.jpeg 768w, https:\/\/www.penguinpunk.net\/blog\/wp-content\/uploads\/2017\/05\/4K2-1024x722.jpeg 1024w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/a><\/p>\n<ul>\n<li>H600 and F800 optimised for many 1-2GB\/s streams<\/li>\n<li>Can edit and create effects directly off of H600<\/li>\n<li>Eliminate dedicated edit storage and data movements<\/li>\n<li>Seamless tiering with archive in same cluster &#8211; transparent to clients<\/li>\n<\/ul>\n<p>Why not just use ECS for archive? ECS is great for geo-distributed, PB scale. Isilon ideal for the same site.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>High IOPS Workloads<\/strong><\/p>\n<p>IOPS-intensive design, distribution, and search<\/p>\n<p><em>Typical requirements<\/em><\/p>\n<ul>\n<li>Millions of small temporary files<\/li>\n<li>Heavy on creates and deletes<\/li>\n<li>Metadata intensive<\/li>\n<\/ul>\n<p><em>Example: EDA Design<\/em><\/p>\n<p>Intensive, multi-staged chip design process<\/p>\n<ul>\n<li>Thousands of files created (checkout)<\/li>\n<li>Millions of temp files created<\/li>\n<li>Simulation and verification testing<\/li>\n<li>Millions of files deleted<\/li>\n<\/ul>\n<p>10s to 100s of concurrent projects<\/p>\n<p>&nbsp;<\/p>\n<p><em>Solution: Performance and density with Generation 6<\/em><\/p>\n<ul>\n<li>F800 or H600 can simplify the performance tier for active design projects<\/li>\n<li>H500 \/ H400 \/ A200 can be recent projects or DR site<\/li>\n<li>A200 \/ A2000 can provide TBs to PBs of deep archive<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><strong>Archive &#8211; You never know when you\u2019ll need that again<\/strong><\/p>\n<p><em>Typical requirements<\/em><\/p>\n<ul>\n<li>10s &#8211; 100s of PB<\/li>\n<li>Online and few seconds of latency<\/li>\n<li>Moderate read throughput when data needed<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><em>Example: Population-scale genomics<\/em><\/p>\n<ul>\n<li>Per million people &#8211; 80PB of whole genome data<\/li>\n<li>\u201cVariant calling\u201d to extract population-scale insights using traditional HPC or newer Hadoop methods<\/li>\n<li>Need performant, deep archives<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><em>Solution:\u00a0Generation 6<\/em><\/p>\n<p>H-series for single namespace of active processing<\/p>\n<ul>\n<li>H600 for continuous ingest, transfers, intense HPC<\/li>\n<li>H500\/H400 for researchers<\/li>\n<\/ul>\n<p>A2000 for deep archives in same namespace or separate site.\u00a0Continue to tier further down to ECS for geo-collaboration<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Closing Thoughts<\/strong><\/p>\n<ul>\n<li>H-series and A-series are future-proofed in performance and capacity to grow your business<\/li>\n<li>Isilon Generation 6 delivers the optimal mix of performance, capacity and densities for every part of your workflows, new and existing<\/li>\n<li>Existing Isilon benefits continue: single namespace, scalability and simplicity<\/li>\n<li>Seamless data lake to Dell EMC ECS and public cloud for colder archives<\/li>\n<li>Looking at how to replace the backup accelerators (A100)<\/li>\n<\/ul>\n<p>Very useful session. 4.5 stars.<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Disclaimer: I recently attended\u00a0Dell EMC World 2017.\u00a0 My flights, accommodation and conference pass were paid for by Dell EMC via the Dell EMC Elect program. There is no requirement for me to blog about any of the content presented and I am not compensated in any way for my time at the event.\u00a0 Some materials [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14,939,60],"tags":[790,940,942,992,21,489],"class_list":["post-5233","post","type-post","status-publish","format-standard","hentry","category-dell","category-dell-emc-world","category-emc-storage","tag-dell","tag-dell-emc","tag-dell-emc-world","tag-dellemcelect","tag-emc","tag-emcelect"],"_links":{"self":[{"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/posts\/5233","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/comments?post=5233"}],"version-history":[{"count":5,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/posts\/5233\/revisions"}],"predecessor-version":[{"id":5241,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/posts\/5233\/revisions\/5241"}],"wp:attachment":[{"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/media?parent=5233"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/categories?post=5233"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.penguinpunk.net\/blog\/wp-json\/wp\/v2\/tags?post=5233"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}