Random Short Take #105

Random short take #105. Want news? Sorry I’ve had a bit on. Let’s get random.

Random Short Take #102

Random short take #102. You’ll see from the age of some of these stories that this one has been in drafts for far too long.

Arcitecta Announces Key Mediaflux Features

I recently had the opportunity to speak to Eric Polet from Arcitecta about the company’s recent Mediaflux announcements. This is some cool stuff, and I figured I’d share some brief thoughts here.

 

The News?

Artitecta has announced three new features: Mediaflux Multi-Site, Mediaflux Edge and Mediaflux Burst. I’ll share the highlights here.

Mediaflux Multi-Site

Mediaflux Multi-Site provides a single Global Namespace for all your data. Customers can choose between two options: 1) a global file system (GFS) that leverages a single global namespace, and 2) a federated file system (FFS) that uses multiple independent synchronised namespaces for data sets that are separated by greater distances – across oceans, for example. FFS is great for content and creative organisations, where teams may collaborate between New York and Tokyo, or Los Angeles and the United Kingdom.

Mediaflux Edge

According to Arcitecta, MediaFlux Edge significantly reduces redundant data transfers, eases network traffic and meets applications’ low-latency requirements. It uses a hub-and-spoke model for caching data at the edge, and keeps frequently accessed content close to users.  Data is secured by maintaining a copy of the data within a central repository to provide a full recovery capability should a threat or unplanned event occur at the edge.

Mediaflux Burst

Mediaflux Burst allows organisations to expand access to compute resources and processing power in the cloud or any another site that has additional resource availability, when they exceed their current on-premises computing resources. Mediaflux Burst decouples computing from the data’s location, allowing it to be stored for optimal cost or security, while computing tasks are optimised for performance or scalability.

[image courtesy of Arcitecta]

 

Thoughts

Getting data to the place it’s needed most remains a problem that many organisations still face today. We haven’t magically solved the problem of global data access, at scale, and at speed, with the performance that applications need. Getting data out to the edge can be tricky, and having teams across the world collaborating effectively can be difficult at the best of times, without having to also deal with supporting that data with the right amount of performance, availability, and compute facilities. The great thing about this announcement is that the Arcitecta solution is moving things in the right direction by looking at delivering flexibility within its solution by offering a single global namespace or federated file system access. It helps with the challenges of network traffic, particularly at the edge, by somewhat engineering around the challenge that not every endpoint has 100Gbps of bandwidth available to it. And it looks at more effective use of compute by giving users the ability to easily attach storage (and the data hosted on it) to available compute as required. It’s not exactly automatic at the moment, and relies on user intervention, but I can only imagine this will change in the future.

I’ve been out of the storage game for a little while, but it’s always nice to talk to companies like Arcitecta that are working on solving real problems for customers via innovative means. The company offers per-user (as opposed to capacity-based) licensing, and has also started doing some interesting stuff with Dell Technologies that you can read more about on the Resources page.

Arcitecta Announces Mediaflux Universal Data System

I had the opportunity to speak to Jason Lohrey and Robert Murphy from Arcitecta a little while ago about the company’s Mediaflux announcement. It was a great conversation, and I’m sad that I hadn’t heard about the company beforehand. In any case I figured I’d share some thoughts on the announcement.

 

What Is It?

The folks at Arcitecta describe the Mediaflux Universal Data System as “a convergence of data management, data orchestration, multi-protocol access, and storage in one platform”. The idea is that the system manages your data across all of your storage platforms. It’s not just clustered or distributed storage. It’s not just a control plane that gives you multi-protocol access to your storage platforms. It’s not just an orchestration engine that can move your data around as required. It’s all of these things and a bit more too. Features include:

  • Converges data management, orchestration and storage within a single platform – that’s right, it’s all in the one box.
  • Manages every aspect of the data lifecycle: On-premises and cloud, with globally distributed access.
  • Offers multi-protocol access and support. The system supports NFS, SMB, S3, SFTP and DICOM, among many others.
  • Empowers immense scalability. Mediaflux licensing is decoupled from the volume of data stored so organisations can affordably scale storage needs to hundreds of petabytes, accommodating hundreds of billions of files without the financial strain typically associated with such vast capacities. Note that Mediaflux’s pricing is based on the number of concurrent users.
  • Provides the option to forego third-party software and clustered file systems.
  • Supports multi-vendor storage environments, allowing customers to choose best-of-breed hardware.

Seem ambitious? Maybe, but it also seems like something that would be super useful.

 

Global Storage At A Worldwide Scale

One of the cool features of Mediaflux is how it handles distributed file systems, not just across data centres, but across continents. A key feature of the platform is the ability to deliver the same file system to every site.

[image courtesy of Arcitecta]

It has support for centralised file locking, as well as replication between sites. You can also configure variable retention policies for different site copies, giving you flexibility when it comes to how long you store your data in various locales. According to the folks at Arcitecta, it’s also happy to make the most of your bandwidth, and able to use up to 95% of the available bandwidth.

 

Thoughts And Further Reading

There have been a few data management / orchestration / unified control plane companies that have had a tilt at doing universal storage access well, across distances, and with support for multiple protocols. Sometimes the end result looks like an engineering project at best, and you have to hold your mouth right to have any hope of seeing your data again once you send it on its way. Putting these kinds of platforms together is no easy task, and that’s why this has been something of a journey for the team at Arcitecta. The company previously supported Mediaflux on top of third-party file and object systems, but customers needed a solution that was more flexible and affordable.

So why not just use the cloud? Because some people don’t like storing stuff in hyperscaler environments. And sometimes there’s a requirement for better performance than you can reasonably pay for in a cloud environment. And not every hyperscaler might have a presence where you want your data to be. All that said, if you do have data in the cloud, you can manage it with Mediaflux too.

I’m the first to admit that I haven’t had any recent experience with the type of storage systems that would benefit from something like Mediaflux, but on paper it solves a lot of the problems that enterprises come across when trying to make large datasets available across the globe, while managing the lifecycle of those datasets and keeping them readily available. Given some of the reference customers that are making use of the platform, it seems reasonable to assume that the company has been doing something right. As with all things storage, your mileage might vary, but if you’re running into roadblocks with the storage platforms you know and love, it might be time to talk to the nice people in Melbourne about what they can do for you. If you’d like to read more, you can download a Solution Brief as well.