White Elephant: Task Statistics for Hadoop:
From LinkedIn’s engineering team:
While tools like Ganglia provide system-level metrics, we wanted to be ableto understand what resources were being used by each user and at what times.White Elephant parses Hadoop logs to provide visual drill downs and rollupsof task statistics for your Hadoop cluster, including total task time, slotsused, CPU time, and failed job counts.
Isn’t this a form of resource usage auditing? Based on this, next you could build support for resource quotas and then start enforcing them.
Original title and link: White Elephant: Task Statistics for Hadoop (NoSQL database?myNoSQL)
原文地址:White Elephant: Task Statistics for Hadoop, 感谢原作者分享。 有时不但是必要的,而且是很有必要的。