Mellanox Accelerates Hadoop and Memcached for Web 2.0 Applications

Mellanox RDMA-Enabled InfiniBand and Ethernet Adapter and Switch Solutions Cut Hadoop Job Runtimes in Half and Deliver over 500,000 Transactions per Second on Memcached

INTEROP LAS VEGAS 2011 – May 9, 2011 – Mellanox® Technologies, Ltd. (NASDAQ: MLNX; TASE: MLNX), a leading supplier of end-to-end connectivity solutions for data center servers and storage systems, today introduced application acceleration technology targeting two key Web 2.0 applications;  Hadoop and Memchached. Hadoop and Memcached are popular open source software platforms used for distributed computing and memory object caching. Utilizing Mellanox’s 40Gb/s InfiniBand adapters and switches, the acceleration software enables world-leading performance and scalability. When used with Mellanox 10/40GbE NICs and switches, the acceleration software provides best-in-class Ethernet performance.

The Hadoop performance results, demonstrated with the known Terasort benchmark (an I/O intensive benchmark for Hadoop), showed that the total job runtime was cut in half when using Hadoop-Direct™  and Mellanox RDMA-enabled ConnectX-2 InfiniBand or 10GbE with RoCE-enabled network adapters compared to traditional Ethernet alternatives.  Hadoop-Direct is transparent to Hadoop users and applications, and does not require any modification for existing application and usage models.

“With data exponentially increasing in Hadoop clusters and Web 2.0 applications, bottlenecks are emerging in network, storage and compute resources that limit application performance and increase cost,” said Michael Kagan, chief technology officer at Mellanox Technologies. “Mellanox’s innovations in hardware and software target the Web 2.0 applications and data analytics infrastructure for improved user experience and increased infrastructure efficiency.”

“Network bandwidth and usage of compute capacity per node to process network-related functions are key factors that limit efficient scale of Hadoop clusters,” said Dhruba Borthakur, distinguished member of the Hadoop Apache Development Team. “Hadoop-Direct with Mellanox networking solutions help minimize the latency of data access; the use of higher bandwidth enables overlapping communications and computation thus improving Hadoop cluster's performance.”

Memcached services, when running over Mellanox’s networking hardware and acceleration software, deliver two to three times more transactions per seconds with up to 10 times faster response time. The results provide web developers with faster web application services while using fewer servers.

The advanced feature set, combined with the highest RDMA performance of any standard interconnect, makes Mellanox’s ConnectX-2 adapters with Hadoop-Direct the leading performance solution for Hadoop clusters. Together with Mellanox’s world-leading networking switch systems, copper and fiber cables, and comprehensive fabric management and storage acceleration software, Mellanox provides its customers with the richest, most advanced and highest performing end-to-end networking solutions for improving and scaling Hadoop and Memcached infrastructures.

In addition to software availability, Mellanox is also offering a Hadoop-Direct and Memcached demonstration platform that includes Hadoop-Direct and Memcached acceleration software, ConnectX-2 40Gb/s InfiniBand adapters and an IS5030 36-port 40Gb/s InfiniBand switch. To learn more about the demo kit, please visit or email Mellanox at

Visit Mellanox Technologies at Interop Las Vegas 2011 (May 10-12, 2011)
Visit Mellanox Technologies at booth #1939 to see a live demonstration of the ‘Best-of Interop’ Finalist SX1036 10/40GbE switch, and the full suite of Mellanox’s end-to-end high-performance Ethernet and InfiniBand data center connectivity products.

Supporting Resources:

About Mellanox
Mellanox Technologies is a leading supplier of end-to-end InfiniBand and Ethernet connectivity solutions and services for servers and storage. Mellanox products optimize data center performance and deliver industry-leading bandwidth, scalability, power conservation and cost-effectiveness while converging multiple legacy network technologies into one future-proof architecture. The company offers innovative solutions that address a wide range of markets including HPC, enterprise, mega warehouse data centers, cloud computing, Internet and Web 2.0.

Mellanox, BridgeX, ConnectX, CORE-Direct, InfiniBlast, InfiniBridge, InfiniHost, InfiniRISC, InfiniScale, InfiniPCI, PhyX, Virtual Protocol Interconnect and Voltaire are registered trademarks of Mellanox Technologies, Ltd. FabricIT and SwitchX are trademarks of Mellanox Technologies, Ltd. All other trademarks are property of their respective owners.

NVIDIA Mellanox Cookie Policy

This website uses cookies which may help to deliver content tailored to your preferences and interests, provide you with a better browsing experience, and to analyze our traffic. You may delete and/or block out cookies from this site, but it may affect how the site operates. Further information can be found in our Privacy Policy.