Welcome to Random Short Take #37. Not a huge amount of players have worn 37 in the NBA, but Metta World Peace did a few times. When he wasn’t wearing 15, and other odd numbers. But I digress. Let’s get random.
Pavilion Data recently added S3 capability to its platform. It’s based on a variant of MinIO, and adds an interesting dimension to what Pavilion Data has traditionally offered. Mellor provided some good coverage here.
Speaking of object storage, Dell EMC recently announced ECS 3.5. You can read more on that here. The architectural white paper has been updated to reflect the new version as well.
Online events are all the rage at the moment, and two noteworthy events are coming up shortly: Pure//Accelerate and VeeamON 2020. Speaking of online events, we’re running a virtual BNEVMUG next week. Details on that here. ZertoCON Virtual is also a thing.
Speaking of Pure Storage, this article from Cody Hosterman on NVMe and vSphere 7 is lengthy, but definitely worth the read.
I can’t recall whether I mentioned that this white paper covering VCD on VCF 3.9 is available now, and I can’t be bothered checking. So here it is.
I’m not just a fan of Backblaze because of its cool consumer backup solution and object storage platform, I’m also a big fan because of its blog. Articles like this one are a great example of companies doing corporate culture right (at least from what I can see).
I have the impression that Datadobi has been doing some cool stuff recently, and this story certainly seems to back it up.
Disclaimer: I recently attended Dell Technologies World 2019. My flights, accommodation and conference pass were paid for by Dell Technologies via the Media, Analysts and Influencers program. There is no requirement for me to blog about any of the content presented and I am not compensated in any way for my time at the event. Some materials presented were discussed under NDA and don’t form part of my blog posts, but could influence future discussions.
As part of my attendance at Dell Technologies World 2019 I had the opportunity to attend Tech Field Day Extra sessions. You can view the videos from the Kemp session here, and download my rough notes from here.
Yue made the point that “[l]oad balancing is not networking. And it’s not servers either. It’s somehow in between”. Kemp look to “[d]eal with the application from the networking perspective”.
Dell EMC ECS
So what’s Dell EMC ECS then? ECS stands for “Elastic Cloud Storage”, and it’s Dell EMC’s software-defined object storage offering. If you’re unfamiliar with it, here are a few points to note:
Objects are bundled data with metadata;
The object storage application manages the storage;
No real file system is needed;
Easily scale by just adding disks;
Delivers a low TCO.
It’s accessible via an API and offers the following services:
S3
Atmos
Swift
NFS
Kemp / Dell EMC ECS Solution
So how does a load balancing solution from Kemp help? One of the ideas behind object storage is that you can lower primary storage costs. You can also use it to accelerate cloud native apps. Kemp helps with your ECS deployment by:
Maximising value from infrastructure investment
Improving service availability and resilience
Enabling cloud storage scalability for next generation apps
Load Balancing Use Cases for ECS
High Availability
ECS Node redundancy in the event of failure
A load balancer is required to allow for automatic failover and event distribution of traffic
Global Balancing
[image courtesy of Kemp]
Multiple clusters across different DCs
Global Server Load Balancing provides distribution of connections across these clusters based on proximity
Security
Offloading encryption from the Dell EMC ECS nodes to Kemp LoadMaster can greatly increase performance and simplify the management of transport layer security certificates
IPv6 to IPv4 – Dell EMC ECS does not support IPv6 natively – Kemp will provide that translation to IPv4
Thoughts and Further Reading
The first thing that most people ask when seeing this solution is “Won’t the enterprise IT organisation already have a load-balancing solution in place? Why would they go to Kemp to help with their ECS deployment?”. It’s a valid point, but the value here is more that Dell EMC are recommending that customers use the Kemp solution over the built-in load balancer provided with ECS. I’ve witnessed plenty of (potentially frustrating) situations where enterprises deploy multiple load balancing solutions depending on the application requirements or where the project funding was coming from. Remember that things don’t always make sense when it comes to enterprise IT. But putting those issues aside, there are likely plenty of shops looking to deploy ECS in a resilient fashion that haven’t yet had the requirement to deploy a load balancer, and ECS is that first requirement. Kemp are clearly quite good at what they do, and have been in the load balancing game for a while now. The good news is if you adopt their solution for your ECS environment, you can look to leverage their other offerings to provide additional load balancing capabilities for other applications that might require it.
You can read the deployment guide from Dell EMC here, and check out Adam’s preparation post on Kemp here for more background information.
Elastic Cloud Storage (ECS to its friends) has been around a little while. Today Dell EMC announced the release of version 3.0. I thought I’d cover off some of the reasons why ECS might be something you’d be interested in. I’ll then go through the new features with ECS 3.0. If you make it that far you’ll be treated to some light opinionalysis to finish off.
Why ECS?
Dell EMC provided me with a list of reasons why you might want to consider ECS.
Highly Efficient Data Protection
One of the problems we have is protecting unstructured data at scale. To this end, ECS uses a hybrid protection scheme comprised of triple mirroring, erasure coding and XOR algorithms. The key benefits of this approach are:
Lower storage overhead option for cold data scenarios
Enhanced data durability without the overhead of storing multiple copies
Efficient Large and Small File Storage
Small files stored in cache and written to a single disk through box-carting
Large files over 128MB in size are erasure coded immediately vs triple mirroring and erasure coded later
Provides up to 20% higher throughput for larger files
Fully Geo-distributed High Availability & Protection
A geographically distributed environment that acts as single logical resource
Active/Active platform with access to content through a single global namespace
Provides geo-caching to improve operational performance and reduces latency
Read/write access from any location globally
Comprehensive Data Access
Simultaneous access to underlying data through multiple interfaces
Object, File, HDFS
Support for S3, Swift, Atmos, Centera CAS, and NFS v3
HDFS compatible with Cloudera, Pivotal, Hortonworks, etc.
What does this mean?
Native Upgrade path for Centera/Atmos
Enables S3 like offering in-house
Eliminates storage gateways
Breaks down storage silos
Native Multi-tenant Architecture
Shared storage resources amongst multiple applications and tenants
System securely and automatically separates Namespaces, object buckets and users
Integration with LDAP and AD environments
Ensures the integrity of customers’ stored data
Built-in Metadata search
Integrated Metadata storage – store metadata using the same constructs as objects eliminating the need for a separate database and infrastructure to run it.
Metadata search via SQL construct
Enables applications and users to query metadata using SQL constructs. Supports several attribute and sort functions.
Global metadata search
Enables applications and users to search across the global namespace.
So what’s really new in 3.0?
So this ECS stuff is great, but what’s exciting about 3.0?
Advanced Retention Management
Event Based Retention – Enables application to specify retention period that will start when a specified event occurs
Litigation Hold – Enables application to temporarily prevent deletion of an object that is subject to an investigation or legal action
Min/Max Governor – Enables system administrator to specify a min and max value for the default retention period
This unblocks Centera customers using ARM from migration to ECS. I’m actually really excited about this, mainly because I was a big Centera fanboy and have found it difficult to put forward other EMC solutions to replace it for customers heavily leveraging ARM.
SNMP Traps Support
ECS 3.0 will support for SNMP Traps for ECS critical events
SNMP Traps is an optional feature, based on whether system admin configures SNMP information via UI/API
When configured, ECS sends a SNMP Trap to the configured server for any event that causes an alert on the management API
ECS supports the ability to configure up to 10 SNMP Trap Destination targets
SNMPv2 and SNMPv3 (USM mode) support
SNMP Query Service support (CPU & Memory)
Remote Syslog Support
Shipping ECS Monitoring & Diagnostics logs to a remote syslog server
Ability to forward all ECS Audit Logs and ECS Alerts to a centralized Syslog server
Forward OS syslog messages
Support for UDP and TCP based communication with syslog servers
Support for multiple redundant syslog servers , all active
Distributed service, resilient to node failures
Only System Admin can perform syslog management operations
Specify a severity threshold of logs to be forwarded
Ability to Add, Edit and Delete Syslog server configuration from the portal and REST API
Logs can be seen on ECS nodes in /var/log/<node IP>/syslog.log
Platform Lockdown
ECS will support a ability to do the following via the ECS RESTful management API
Lockdown an entire cluster
Lockdown a specific node
Unlock a locked node
A new management user role, the lock admin user, for locking is defined that will have the privilege of locking/unlocking the cluster.
In ECS 3.0 this will be a pre-provisioned local user ‘emcsecurity’.
The lock admin user i.e. ‘emcsecurity’ will have the ability to
Modify their password (forced during first login)
Lock the cluster
Lock a node
Unlock a node
System admin/monitor has the privilege to view the lock status of a node but NOT modify it
Thoughts and Further Reading
I’ve been talking to a lot of scale-out object storage folks lately. Given the amount of EMC stuff I’ve covered here previously, it’s a little surprising that this is the first time I’ve posted about ECS. That doesn’t mean it’s the first time I’ve looked, and I’ve had customers looking at it fairly seriously. In my opinion, the advanced retention management in 3.0 is really going to put a few customers over the line and finally give them the confidence to throw their Centera grids in the river (figuratively speaking).
The cool thing about ECS, like a lot of these types of solutions, is that you can consume it on your terms, via
Appliance;
Software defined;
Dedicated cloud; and
Multi-tenant Storage Cloud.
If you’re feeling keen on ECS, you can take it for a spin here. You can also download a version for free, non-production use here. Grab the datasheet from here.
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
