SCIENCE
Map Reduce & Hadoop Scheduling Supported by EnFuzion
- Written by: Webmaster
- Category: SCIENCE
Axceleon has announced that’s its EnFuzion product now supports optimized job scheduling on Map Reduce and Hadoop clusters.
MapReduce is a framework for processing extremely large datasets for certain kinds of problems that can be parallelized and typically run on a large number of computers or a cluster. MapReduce can work on unstructured data, a file system for example, or structured data, such as a database. MapReduce allows for distributed processing of the map and reduction operations and can sort a petabyte of data in only a few hours on a large cluster. MapReduce from Google, and Hadoop are used by many companies to provide internet data and sentiment based news seach capability, Google, Yahoo and Skygrid for example.
“EnFuzion has always had the capability to manage and control MapReduce and Hadoop clusters and now this is becoming more and more important to our customer base. This technology and capability has always existed in EnFuzion and we have done work recently to optimize the scheduling processes to maximize throughput and minimize response times”, said Mary Keogh CEO of Axceleon.
EnFuzion can drive and manage one million jobs per minute and this performance makes it a good fit for this type of activity where it’s best to keep the tasks small for better response times”, commented Mary Keogh.