How In-Memory Data Grids Can Analyze Fast-Changing Data in Real Time

The ability to continuously analyze operational data using big data techniques unlocks the potential for organizations to extract important patterns and trends that otherwise cannot be seen as the data rapidly changes. Unfortunately, popular big data systems such as Hadoop, which employ file-based storage and batch processing techniques, are not well suited for this challenge. However, the technology of in-memory data grids (IMDGs) offers important breakthroughs that enable real-time analysis of operational data. Recent measurements have demonstrated that an IMDG can deliver a complete map/reduce analysis every four seconds across a terabyte data set which is continuously being updated at the rate of one gigabyte per second.

This article discusses how IMDGs differ from other big data systems and deliver this important new capability to analyze fast-changing, operational data.
Publisher:ScaleOut Software Published:01/15/2013 Type:
12 pages
No votes yet
Share:Send to a friend
Topics: Algorithms Apache Big Data Blueprints C & C++ Cloud CSS DevOps dzcontent_comparison IDEs Java Server-side Tips and Tricks Visual Studio Client-side dzcontent_tutorial HTML & XHTML Linux NoSQL Python Research Security Testing Windows Phone C-Sharp Education GNU & FSF Graphic Design Humor Javascript Mobile Reporting SOA Storage Ajax & Scripting Commercial Flex & AIR Frameworks Grid Computing Milestones Modeling Networking Trends VB.NET Deployment Flash MS-Office Dev News Non-commercial Persistence PHP Project Mgmt. Virtualization Data Access Events Ideology Integration Performance SQL Telecom Usability Version Control Accessibility ASP.NET Build Automation ColdFusion Hardware Legal Opinions Performance .NET & Windows Agile Groovy Inspirations Interoperability Personalities Reliability Silverlight Careers Issue Tracking Patterns Ruby Win32 & COM Web Design Architecture Infrastructure Tools & Methods Languages Computer Science Open Source Industry

Spotlight Resources

Camel Essential Components

DZone's 170th Refcard is an essential reference to Camel, an open-source, lightweight, integration library.  This Refcard is authored by...

Want your resource here? Contact our team today.