[GitHub] zeppelin pull request #2369: [ZEPPELIN-2591] Show user info in spark job des...

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] zeppelin pull request #2369: [ZEPPELIN-2591] Show user info in spark job des...

zjffdu
GitHub user karuppayya opened a pull request:

    https://github.com/apache/zeppelin/pull/2369

    [ZEPPELIN-2591] Show user info in spark job description

    ### What is this PR for?
    Show user info in spark job description in spark UI.
    With this info on spark UI, we will be able to find which user's job took most time, which users job is currently consuming the resources etc
   
    ### What type of PR is it?
    improvement
   
   
    ### What is the Jira issue?
    https://issues.apache.org/jira/browse/ZEPPELIN-2591
   
    ### How should this be tested?
    Run a spark job(scala, python, sql, R) , check the spark UI jobs page.
    The job should display the username in its description.
   
    ### Screenshots (if appropriate)
    <img width="1032" alt="screen shot 2017-05-27 at 15 41 30" src="https://cloud.githubusercontent.com/assets/5082742/26520572/00924702-42f3-11e7-8938-5a4b875d6c5d.png">
    Check the description column
   
    ### Questions:
    * Does the licenses files need update? No
    * Is there breaking changes for older versions? No
    * Does this needs documentation? No


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/karuppayya/zeppelin ZEPPELIN-2591

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/zeppelin/pull/2369.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2369
   
----
commit 22d850ddc7d99bddebb89082b2565df0663211f4
Author: Karup <[hidden email]>
Date:   2017-05-21T11:51:15Z

    Populate user info

commit 2cc9c089215754476f0ce08c93228bbef68feb97
Author: Karup <[hidden email]>
Date:   2017-05-27T09:48:09Z

    Add description to jobs

commit 47cf5ede8293b8e5a463787ebc7211ea71559ec8
Author: Karup <[hidden email]>
Date:   2017-05-27T09:55:15Z

    Code clean up

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] zeppelin issue #2369: [ZEPPELIN-2591] Show user info in spark job descriptio...

zjffdu
Github user karuppayya commented on the issue:

    https://github.com/apache/zeppelin/pull/2369
 
    @felixcheung Thanks for the feedback.
    Not sure if i got your question.
    I will try to elaborate more on the change
    The userinfo will give a picture of what is run/being run by whom  and its duration, in the spark application.(Currently, we display **zeppelin**)
    The spark web UI will list all jobs, with this user information.
   



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] zeppelin issue #2369: [ZEPPELIN-2591] Show user info in spark job descriptio...

zjffdu
In reply to this post by zjffdu
Github user karuppayya commented on the issue:

    https://github.com/apache/zeppelin/pull/2369
 
    Ready for reviewing @Leemoonsoo @zjffdu @felixcheung


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] zeppelin issue #2369: [ZEPPELIN-2591] Show user info in spark job descriptio...

zjffdu
In reply to this post by zjffdu
Github user Leemoonsoo commented on the issue:

    https://github.com/apache/zeppelin/pull/2369
 
    Thanks @karuppayya for the improvement. LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] zeppelin issue #2369: [ZEPPELIN-2591] Show user info in spark job descriptio...

zjffdu
In reply to this post by zjffdu
Github user jongyoul commented on the issue:

    https://github.com/apache/zeppelin/pull/2369
 
    LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] zeppelin issue #2369: [ZEPPELIN-2591] Show user info in spark job descriptio...

zjffdu
In reply to this post by zjffdu
Github user Leemoonsoo commented on the issue:

    https://github.com/apache/zeppelin/pull/2369
 
    Merge to master if no further comment.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] zeppelin issue #2369: [ZEPPELIN-2591] Show user info in spark job descriptio...

zjffdu
In reply to this post by zjffdu
Github user karuppayya commented on the issue:

    https://github.com/apache/zeppelin/pull/2369
 
    @Leemoonsoo @jongyoul  can this PR be merged?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|

[GitHub] zeppelin pull request #2369: [ZEPPELIN-2591] Show user info in spark job des...

zjffdu
In reply to this post by zjffdu
Github user asfgit closed the pull request at:

    https://github.com/apache/zeppelin/pull/2369


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---