Intel® ISA-L Erasure Coding Sample Application Overview

  • Overview
  • Resources
  • Transcript

Reed-Solomon erasure coding (RS-EC) schemes are well known and have been in use for a long time. This video provides an overview of a code sample that shows how the Intel® Intelligent Storage Library (Intel ISA-L) implementation of RS-EC can keep up with current storage hardware throughput requirements in software rather than offloading to dedicated hardware. To demonstrate, the example creates up to 24 different buffers in memory to store data; a larger data set of up to 256 MB of data is distributed across these buffers. To simulate failure, up to two memory buffers are made inaccessible and the program demonstrates that on Intel® architecture the data can be completely and correctly recovered from the remaining buffers. The example shows one way to incorporate the Intel ISA-L RS-EC feature into your storage applications and shows how to prepare and recover data.

Code Sample: Intel® ISA-L Erasure Code and Recovery

Watch the rest of the videos in this series:

What is Intel® ISA-L? 
Intel® ISA-L Compression Algorithms
Intel® ISA-L Semi-Dynamic Compression Code Sample Walk Through
Intel® ISA-L Cryptographic Hashing
Intel® ISA-L: Cryptographic Hashing Code Sample Overview
Intel® ISA-L Erasure Coding
- Intel® ISA-L Erasure Coding Sample Application Overview

The second point is that we are measuring the latency numbers. And we are measuring time. If we work back these numbers, we get to the throughput numbers. And that is what I called out previously. 

If you do 256 megabytes in 46 milliseconds, or 4,600 microseconds, you work backwards. And you get the 5.5 gigabytes per second throughput. 

The third point is this optimizes the latency and throughput. And as it is configurable and flexible, you can deploy it in number of servers, or if not servers, nodes within your individual server. The example shows a method on how to incorporate the Intel ISA-L Reed-Solomon error correction feature into your storage applications and shows how to be able to prepare the data and recover data, which can help you on how to adapt to the technology. 

Thanks for watching. To learn more about ISA-L, check out the links below. And make sure to watch the rest of this video playlist on Intel ISA-L. Don't forget to like this video and subscribe.