Dr-Elephant with Tez support#264
Open
harishnvh wants to merge 252 commits into
Open
Conversation
… Size' help pages
…job history server on hadoop2
Changed the script so it prints out what it is doing. I suspect that somehow the directory name was not getting set correctly. Used a one-liner that seems to work on both Mac and Linux to determine directory of a script. Used braces to delimit the shell variable names. May be random variables were getting set? The zip command included a -x that pretty much amounted to nothing, since it excluded '*'. Changed the zip command to be more specific. Finally, added a trap command that fields ^C and exits the script. It seems to survive ctrl-C now. RB=399693 BUGS=HADOOP-7816 R=fli,akrai A=fli
* adding more metrics for monitoring process jobs count and latency * Fix metrics null ptr API usage issues * Add jobs processed in last 24 hours metric
Includes resource usage, resource wastage and runtime metrics for Spark.
…e is to publish the metrics to other applications. The property is disabled by default and users who wish to make use of this specify their own agent jar.
LIHADOOP-23967: Setup JobHistory, FlowHistory and help pages for new UI
Other fixes:
* Additional information to workflow, workflow-summaries rest end point
* Added an rest end point for the dashboard summary
Integration of the Dr. Elephant ember app with play framework
…inkedin#158) * Adding tests for SparkAggregated Metrics * Fix code review comments * Make Memory Buffer Percentage Configurable. Disable Schedule Delay for spark * Fix code to not use getOrDefault * use parseDouble instead for faster performance * return resource usage by user in GB Hours * Handle NumberFormatException when map/reduce memory config is not defined * build fix
* Added not-found page * Search panel on pages served by play * Piwik integration
LIHADOOP-24687 Dr Elephant shows more than 100% waittime for some jobs
LIHADOOP-24688 Dr Elephant shows NAN when the resource usage and resource wasted is zero
LIHADOOP-24695 Dr Elephant should show loading panel on search page
Fix #2 * Instructions to build with qubole jars * Use Qubole's public maven repository * Set hadoop version to latest Qubole release
* new:dev:#5:Support publish to Qubole's maven repository The first step to automate releases is to publish to Qubole's public maven repo in s3://maven-qubole. https://github.com/frugalmechanic/fm-sbt-s3-resolver is used to publish to S3.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
19 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Is it possible to merge q-master with master so that we have updated code along with tez support to clone?