White Elephant: Task Statistics for Hadoop

White Elephant: Task Statistics for Hadoop:

From LinkedIn’s engineering team:

While tools like Ganglia provide system-level metrics, we wanted to be ableto understand what resources were being used by each user and at what times.White Elephant parses Hadoop logs to provide visual drill downs and rollupsof task statistics for your Hadoop cluster, including total task time, slotsused, CPU time, and failed job counts.

Isn’t this a form of resource usage auditing? Based on this, next you could build support for resource quotas and then start enforcing them.

Original title and link: White Elephant: Task Statistics for Hadoop (NoSQL database?myNoSQL)

White Elephant: Task Statistics for Hadoop

相关文章:

你感兴趣的文章:

标签云: