[GitHub] zeppelin pull request #2376: Branch 0.7

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[GitHub] zeppelin pull request #2376: Branch 0.7

zjffdu
GitHub user simulight opened a pull request:

    https://github.com/apache/zeppelin/pull/2376

    Branch 0.7

    request for supporting insert iframe of  one paragraph to the other paragraph, this is very useful to increase the reusement and integration of paragraphs .


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/zeppelin branch-0.7

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/zeppelin/pull/2376.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2376
   
----
commit d91b310cbb985eac1e12ab9528a3be9e8e1b834c
Author: Prabhjyot Singh <[hidden email]>
Date:   2017-01-07T12:37:00Z

    [ZEPPELIN-1906] Use multiple InterpreterResult for displaying multiple JDBC queries
   
    ### What is this PR for?
    Use multiple InterpreterResult for displaying multiple JDBC queries.
    IMO since other sql editors allows to execute multiple sql separated with ";" and ours display mechanism being more powerful, hence, it should also allow the same.
   
    ### What type of PR is it?
    [Improvement]
   
    ### What is the Jira issue?
    * [ZEPPELIN-1906](https://issues.apache.org/jira/browse/ZEPPELIN-1906)
   
    ### How should this be tested?
    Try running following in a paragraph (with Postgres setting) and check for output.
   
    ```
    %jdbc
    create table test_temp_table (id int);
    select column_name, data_type, character_maximum_length from INFORMATION_SCHEMA.COLUMNS where table_name = 'test_temp_table';
    SELECT table_name FROM information_schema.tables WHERE table_schema = 'public';
    drop table test_temp_table;
    SELECT table_name FROM information_schema.tables WHERE table_schema = 'public';
    ```
   
    ### Screenshots (if appropriate)
   
    ### Questions:
    * Does the licenses files need update? N/A
    * Is there breaking changes for older versions? N/A
    * Does this needs documentation? N/A
   
    Author: Prabhjyot Singh <[hidden email]>
   
    Closes #1845 from prabhjyotsingh/ZEPPELIN-1906 and squashes the following commits:
   
    b27352a [Prabhjyot Singh] on error show previous output.
    f9fd5c6 [Prabhjyot Singh] allow last query to be without ";"
    b3e742e [Prabhjyot Singh] fixing checkstyle-fail-build
    ac4663d [Prabhjyot Singh] add block comment
    f3da37f [Prabhjyot Singh] replace regex with slightly better logic.
    e6727b5 [Prabhjyot Singh] add testcase for spliting sql.
    c096e76 [Prabhjyot Singh] remove extra empty lines
    e675190 [Prabhjyot Singh] user same connection instead of creating new everytime
    f5ab796 [Prabhjyot Singh] Use multiple InterpreterResult for displaying multiple JDBC queries
   
    (cherry picked from commit 8464971c7aab0734f96d0a5a11d842b8e595324a)
    Signed-off-by: Prabhjyot Singh <[hidden email]>

commit b8637f5e5fa4aab8859e6bc90fa7886ba9157b24
Author: Alexander Shoshin <[hidden email]>
Date:   2017-01-11T08:45:31Z

    [ZEPPELIN-1787] Add an example of Flink Notebook
   
    ### What is this PR for?
    This PR will add an example of batch processing with Flink to Zeppelin tutorial notebooks. There are no any Flink notebooks in the tutorial at the moment.
   
    ### What type of PR is it?
    Improvement
   
    ### What is the Jira issue?
    [ZEPPELIN-1787](https://issues.apache.org/jira/browse/ZEPPELIN-1787)
   
    ### How should this be tested?
    You should open `Using Flink for batch processing` notebook from the `Zeppelin Tutorial` folder and run all paragraphs one by one
   
    ### Questions:
    * Does the licenses files need update? - **no**
    * Is there breaking changes for older versions? - **no**
    * Does this needs documentation? - **no**
   
    Author: Alexander Shoshin <[hidden email]>
   
    Closes #1758 from AlexanderShoshin/ZEPPELIN-1787 and squashes the following commits:
   
    83cbffb [Alexander Shoshin] remove localhost url
    5255e17 [Alexander Shoshin] Merge branch 'master' into ZEPPELIN-1787
    0b9df56 [Alexander Shoshin] add a link for this notebook to Zeppelin documentation
    593c47d [Alexander Shoshin] convert notebook to 0.7.0 format
    9013620 [Alexander Shoshin] convert notebook to 0.6.2 format
    fe2a39e [Alexander Shoshin] add download instruction, change "wget" to "curl"
    f64b60a [Alexander Shoshin] [ZEPPELIN-1787] Add an example of Flink Notebook
   
    (cherry picked from commit 0da08d1d726129f6b684c99b1af8802907475d8a)
    Signed-off-by: ahyoungryu <[hidden email]>

commit 6a15e7bf30876005b79f7593e02d5a4dc9f691d2
Author: Jeff Zhang <[hidden email]>
Date:   2017-01-11T07:22:19Z

    ZEPPELIN-1867. Update document for pig interpreter and add one sample note
   
    ### What is this PR for?
    * Minor update for pig interpreter
    * Add one sample pig tutorial note which do the same thing as the spark tutorial note.
   
    ### What type of PR is it?
    [Improvement | Documentation ]
   
    ### Todos
    * [ ] - Task
   
    ### What is the Jira issue?
    * https://issues.apache.org/jira/browse/ZEPPELIN-1867
   
    ### How should this be tested?
    Tested manually
   
    ### Screenshots (if appropriate)
    ![image](https://cloud.githubusercontent.com/assets/164491/21839221/8a4ffa04-d811-11e6-9096-f4f9da22ea49.png)
   
    ### Questions:
    * Does the licenses files need update? No
    * Is there breaking changes for older versions? No
    * Does this needs documentation? No
   
    Author: Jeff Zhang <[hidden email]>
   
    Closes #1830 from zjffdu/ZEPPELIN-1867 and squashes the following commits:
   
    1c0d819 [Jeff Zhang] rename note name
    50198a1 [Jeff Zhang] add more description of tutorial note
    88385f2 [Jeff Zhang] Add pig tutorial note
    25216f8 [Jeff Zhang] ZEPPELIN-1867. Update document for pig interpreter and add one sample note
   
    (cherry picked from commit 3d2d4b6f9804ecc5c157c1b4a3885ee01890884e)
    Signed-off-by: ahyoungryu <[hidden email]>

commit ffdc5e972e2d5dd36aab099c71a6e852ed0c9260
Author: soralee <[hidden email]>
Date:   2017-01-11T06:26:23Z

    [ZEPPELIN-1864] Improvement to show folder and note after searching note
   
    ### What is this PR for?
    This PR is for improvement to show folder and note after using the filter. And I found some bugs and fixed like this.
   
    the following list is improvement and bug fixed.
    1. After using the filter in Zeppelin Home, every note is shown by the form [FolderName/NoteName] like below. It would be nice to show folder icon and note icon as previous status.
    ![z1864_f_b](https://cloud.githubusercontent.com/assets/8110458/21604777/79dbb228-d1e8-11e6-974d-737520729d68.gif)
   
    2. When using the filter, some functions and icons next to note and folder are disappeared.
    ![z1864_f_2_b](https://cloud.githubusercontent.com/assets/8110458/21605057/f5a0143e-d1e9-11e6-86f3-ebff5be4c41d.gif)
   
    3. When using the filter, the `Rename Note` function doesn't work. ( When I was handling this PR, this bug was discovered.)
    ![z1864_f_4_b](https://cloud.githubusercontent.com/assets/8110458/21606384/71305796-d1f2-11e6-91a4-2ec14b8b4959.gif)
   
    ### What type of PR is it?
    [ Bug Fix | Improvement ]
   
    ### Todos
    * [x] - improve to show folder and note when finishing to use filter.
    * [x] - some functions and icons next to note and folder are appeared when using filter.
    * [x] - fix `Rename Note` function when using the filter.
   
    ### What is the Jira issue?
    https://issues.apache.org/jira/browse/ZEPPELIN-1864
   
    ### How should this be tested?
     - **[Test 1]** Before/After using the filter, check the list structure of your notes. It must be same appearance.
   
     - **[Test 2]** When using the filter, check the notes. Some icons and functions next to note and folder must be appeared.
   
     - **[Test 3]** When using the filter, click `Rename Note`. It must be appeared the path of Note.
   
    ### Screenshots (if appropriate)
    **Test 1**.
    ![z1864_f_1_a](https://cloud.githubusercontent.com/assets/8110458/21606849/a79dbf82-d1f5-11e6-8d48-3a1977099ab1.gif)
   
    **Test 2**.
    ![z1864_f_2_a](https://cloud.githubusercontent.com/assets/8110458/21606880/d1cf9550-d1f5-11e6-9311-ee54424d7e76.gif)
   
    **Test 3**.
    ![z1864_f_4_a](https://cloud.githubusercontent.com/assets/8110458/21606272/9e0b096a-d1f1-11e6-8bfb-ab1ea1a30b88.gif)
   
    ### Questions:
    * Does the licenses files need update? N/A
    * Is there breaking changes for older versions? N/A
    * Does this needs documentation? N/A
   
    Author: soralee <[hidden email]>
   
    Closes #1834 from soralee/ZEPPELIN-1864 and squashes the following commits:
   
    6fb53aa [soralee] resolve conflict
    fd2c243 [soralee] resolve conflict
    3e4b8ae [soralee] fix for that filter of navbar and home don't work
    61680e5 [soralee] Improvement to show folder and note after searching note
    69d6d6d [soralee] Improvement to show folder and note after searching note
   
    (cherry picked from commit d393a5b52d345adc4da807065a25757572202075)
    Signed-off-by: ahyoungryu <[hidden email]>

commit 0981d34f92de4ee3ec7f59f53c6d4f70b747c9ca
Author: Unknown <[hidden email]>
Date:   2017-01-10T14:03:03Z

    [MINOR] Small Selenium test fixes
   
    ### What is this PR for?
    Remove unused imports;
    Replace "Thread.sleep" (unstable solution);
    Add "deleteTestNotebook()" method  -> testWidth.
   
    ### What type of PR is it?
    [Refactoring]
   
    ### Todos
    * [ ] - Task
   
    ### What is the Jira issue?
    * Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/
    * Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533]
   
    ### How should this be tested?
    Travis-CI
   
    ### Screenshots (if appropriate)
    https://travis-ci.org/apache/zeppelin/builds/190644901 -> https://travis-ci.org/apache/zeppelin/jobs/190644918
   
    ### Questions:
    * Does the licenses files need update? (no)
    * Is there breaking changes for older versions? (no)
    * Does this needs documentation? (no)
   
    Author: Unknown <[hidden email]>
   
    Closes #1882 from bitchelov/automationTestFix and squashes the following commits:
   
    f898c59 [Unknown] [MINOR] Small Selenium test fixes
   
    (cherry picked from commit 434215668e9db51706230420f8ce2c1c268b2457)
    Signed-off-by: Jongyoul Lee <[hidden email]>

commit ab87537bb2c99857428f712979dd3feb8d971809
Author: Khalid Huseynov <[hidden email]>
Date:   2017-01-11T04:48:26Z

    [ZEPPELIN-1730, 1587] add spark impersonation through --proxy-user option
   
    ### What is this PR for?
    This is to add spark impersonation using --proxy-user option. note that it enables also to use spark impersonation without having logged user as system user with configured ssh.
   
    ### What type of PR is it?
    Improvement
   
    ### Todos
    * [x] - add `--proxy-user`
    * [x] - try on standalone spark 1.6.2
    * [x] - try on yarn-client mode spark 2.0.1
   
    ### What is the Jira issue?
    Directly solves [ZEPPELIN-1730](https://issues.apache.org/jira/browse/ZEPPELIN-1730) and also solves [ZEPPELIN-1587](https://issues.apache.org/jira/browse/ZEPPELIN-1587) according to discussion in #1566 since using `--proxy-user` in `spark-submit` is preferable method.
   
    ### How should this be tested?
    1. switch your spark cluster to `per user` and `isolated` mode
    2. set up `user impersonation` flag
    3. run some job using that spark interpreter
    4. spark context should be created with currently logged in user credentials on behalf of system user
   
    ### Screenshots (if appropriate)
    standalone
    ![spark_sc_impersonation](https://cloud.githubusercontent.com/assets/1642088/21639292/24240286-d224-11e6-8099-9bc74a06f0c2.gif)
   
    yarn-client
    <img width="997" alt="screen shot 2017-01-04 at 10 00 13 am" src="https://cloud.githubusercontent.com/assets/1642088/21653117/75410fde-d264-11e6-886f-11d8b5dbd29e.png">
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? yes
   
    Author: Khalid Huseynov <[hidden email]>
   
    Closes #1840 from khalidhuseynov/feat/spark-proxy-user and squashes the following commits:
   
    e4251de [Khalid Huseynov] update doc with env var
    dc61cae [Khalid Huseynov] check for env spark_proxy in interpreter.sh
    8b66740 [Khalid Huseynov] add spark_proxy_user to env.sh
    892b7e4 [Khalid Huseynov] add note in docs
    4c3dba9 [Khalid Huseynov] add --proxy-user option for spark
   
    (cherry picked from commit 5e0aacf8a8f187702452d7cd2ee83b26c56dec90)
    Signed-off-by: Jongyoul Lee <[hidden email]>

commit 7aa52d828fcfcd23f4a9c1c08279e0db8911fad0
Author: AhyoungRyu <[hidden email]>
Date:   2017-01-12T06:15:14Z

    [MINOR] Rename Pig tutorial note to consider priority
   
    ### What is this PR for?
    After #1830 merged, Pig tutorial note placed as a first under `Zeppelin Tutorial` folder. I told to zjffdu, I thought the note name should be same with Spark ("Basic Feature (Spark)") in [this comment](https://github.com/apache/zeppelin/pull/1830#discussion_r95522394) (because they have same contents).
   
    <img src="https://cloud.githubusercontent.com/assets/10060731/21879248/a6d9b88a-d8da-11e6-8f43-5ef192e5895c.png" width="300px">
   
    But considering the number of Spark and Pig users, the Spark tutorial note needs to be placed as first I think.
   
    <img src="https://cloud.githubusercontent.com/assets/10060731/21879244/a488e3d0-d8da-11e6-9e0b-c91ca890c611.png" width="300px">
   
    ### What type of PR is it?
    Rename Pig tutorial note
   
    ### What is the Jira issue?
    N/A
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: AhyoungRyu <[hidden email]>
   
    Closes #1889 from AhyoungRyu/rename/pigTutorialNote and squashes the following commits:
   
    f08fd69 [AhyoungRyu] Rename Pig tutorial note to consider priority
   
    (cherry picked from commit b9c667ae1dfcbc6d80d4fc65f64572acee96ede6)
    Signed-off-by: ahyoungryu <[hidden email]>

commit 94bbd41422ab98d8ee787163598e0aaa49fc2bc6
Author: astroshim <[hidden email]>
Date:   2017-01-11T06:02:00Z

    [ZEPPELIN-1229] Clear browser cache with version hashtag.
   
    ### What is this PR for?
    This PR avoids browser cache.
   
    ### What type of PR is it?
    Bug Fix
   
    ### What is the Jira issue?
    https://issues.apache.org/jira/browse/ZEPPELIN-1229
   
    ### How should this be tested?
    1. Run old version of zeppelin(I was using 0.6.1) and show main page up in your browser.
    2. Stop zeppelin.
    3. Run this PR of Zeppelin and show page up on the same browser of 1.
    4. check main page changed.
   
    - before (Job menu doesn't show)
    ![2017-01-06 01_50_29](https://cloud.githubusercontent.com/assets/3348133/21728478/43aec6d0-d3fb-11e6-84ce-9e1b18853611.gif)
   
    - after (Job menu show)
    ![2017-01-06 01_55_10](https://cloud.githubusercontent.com/assets/3348133/21728482/4a794e72-d3fb-11e6-8934-d6f92d65889b.gif)
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: astroshim <[hidden email]>
   
    Closes #1858 from astroshim/ZEPPELIN-1229 and squashes the following commits:
   
    18defbe [astroshim] modify regx
    85e0a05 [astroshim] remove arguments in code
    ca09eac [astroshim] change path
    13d8056 [astroshim] trying another way
    6b554e0 [astroshim] Merge branch 'master' into ZEPPELIN-1229
    655dc3d [astroshim] tag all html
    c94de90 [astroshim] delete unnecessary codes
    9d9f76f [astroshim] fix ZEPPELIN-1229
   
    (cherry picked from commit 02323e283c6cce12bb06bf5327420c2d2da5cbe2)
    Signed-off-by: Mina Lee <[hidden email]>

commit b0883a80d04918ce3fa79053469ce5cd96e9f63f
Author: Khalid Huseynov <[hidden email]>
Date:   2017-01-11T07:22:35Z

    [ZEPPELIN-1936] Fix user impersonation setting propagation
   
    ### What is this PR for?
    This is to fix bug of creating interpreter with impersonation enabled
   
    ### What type of PR is it?
    Bug Fix
   
    ### Todos
    * [x] - fix model
   
    ### What is the Jira issue?
    [ZEPPELIN-1936](https://issues.apache.org/jira/browse/ZEPPELIN-1936)
   
    ### How should this be tested?
    create new interpreter with "User Impersonation" enabled
   
    ### Screenshots (if appropriate)
    before:
    ![before_imp_setting](https://cloud.githubusercontent.com/assets/1642088/21839491/e187fa18-d78c-11e6-864d-755fc40f0096.gif)
   
    after:
    ![after_imp_setting](https://cloud.githubusercontent.com/assets/1642088/21839721/2756a7f0-d78e-11e6-9efd-4f3fd29df616.gif)
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: Khalid Huseynov <[hidden email]>
   
    Closes #1884 from khalidhuseynov/fix/new-interp-impersonation-setting and squashes the following commits:
   
    d5f8393 [Khalid Huseynov] fix model on interpreter-create
   
    (cherry picked from commit 7290200322174fa643625034af2a8c61737dad06)
    Signed-off-by: Mina Lee <[hidden email]>

commit 55addf1a3194f40ac48eb97dd98bf8b9c3d98b2e
Author: cloverhearts <[hidden email]>
Date:   2017-01-13T02:53:10Z

    [HOTFIX : ZEPPELIN-1932] paragraph blur error
   
    ### What is this PR for?
    When one or more hidden editors are present, clicking on the editor will cause a blur error.
    This means that when a paragraph is hidden through ng-if,
    Caused by calling the blur method in the absence of an editor object.
   
    ### What type of PR is it?
    Hot Fix
   
    ### What is the Jira issue?
    https://issues.apache.org/jira/browse/ZEPPELIN-1932
   
    ### How should this be tested?
    1. create paragraph and open debug console.
    2. enable hide paragraph.
    3. page refresh
    4. click to anywhere paragraph.
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: cloverhearts <[hidden email]>
   
    Closes #1879 from cloverhearts/hotfix/paragraphOnfocusEvent and squashes the following commits:
   
    7071638 [cloverhearts] fix show title and paragraph context issue
    8f4d0bf [cloverhearts] fixed readonly event error
    5ecfabb [cloverhearts] check editor object is undeifned.
   
    (cherry picked from commit 2b0e2a41cb7e0d7fc160d5c9193413ffe4d94f68)
    Signed-off-by: Mina Lee <[hidden email]>

commit 88e2ac2798780a589771bda22029bbd876910189
Author: 1ambda <[hidden email]>
Date:   2017-01-10T22:56:35Z

    [ZEPPELIN-1917] Improve python.conda interpreter
   
    ### What is this PR for?
   
    Add missing commands to the `python.conda` interpreter
   
    - `conda info`
    - `conda list`
    - `conda create`
    - `conda install`
    - `conda uninstall (alias of remove)`
    - `conda env *`
   
    #### Implementation Detail
   
    The reason I modified `PythonProcess` is due to NPE
   
    ```java
    // https://github.com/apache/zeppelin/blob/master/python/src/main/java/org/apache/zeppelin/python/PythonProcess.java#L107-L118
   
      public String sendAndGetResult(String cmd) throws IOException {
        writer.println(cmd);
        writer.println();
        writer.println("\"" + STATEMENT_END + "\"");
        StringBuilder output = new StringBuilder();
        String line = null;
   
        // NPE when line is null
        while (!(line = reader.readLine()).contains(STATEMENT_END)) {
          logger.debug("Read line from python shell : " + line);
          output.append(line + "\n");
        }
        return output.toString();
      }
    ```
   
    ```
    java.lang.NullPointerException
    at org.apache.zeppelin.python.PythonProcess.sendAndGetResult(PythonProcess.java:113)
    at org.apache.zeppelin.python.PythonInterpreter.sendCommandToPython(PythonInterpreter.java:250)
    at org.apache.zeppelin.python.PythonInterpreter.bootStrapInterpreter(PythonInterpreter.java:272)
    at org.apache.zeppelin.python.PythonInterpreter.open(PythonInterpreter.java:100)
    at org.apache.zeppelin.python.PythonCondaInterpreter.restartPythonProcess(PythonCondaInterpreter.java:139)
    at org.apache.zeppelin.python.PythonCondaInterpreter.interpret(PythonCondaInterpreter.java:88)
    at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
    at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:494)
    at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
    at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)
    ```
   
    ### What type of PR is it?
    [Improvement | Refactoring]
   
    ### Todos
    * [x] - info
    * [x] - list
    * [x] - create
    * [x] - install
    * [x] - uninstall (= remove)
    * [x] - env *
   
    ### What is the Jira issue?
   
    [ZEPPELIN-1917](https://issues.apache.org/jira/browse/ZEPPELIN-1917)
   
    ### How should this be tested?
   
    1. Install [miniconda](http://conda.pydata.org/miniconda.html)
    2. Make sure that your python interpreter can use `conda` (check the Interpreter Binding page)
    3. Remove `test` conda env since we will create in the following section
   
    ```sh
    $ conda env remove --yes --name test
    ```
   
    4. Run these commands with `%python.conda`
   
    ```
    %python.conda info
    %python.conda env list
    %python.conda create --name test
   
    # you should be able to see `test` in the list
    %python.conda env list
    %python.conda activate pymysql
    %python.conda install pymysql
   
    # you should be able to import
    %python
    import pymysql.cursors
   
    %python.conda uninstall pymysql
    %python.conda deactivate pymysql
   
    # you should be able to see `No module named pymysql.cursor` since we deactivated
    %python
    import pymysql.cursors
    ```
   
    ### Screenshots (if appropriate)
   
    ![conda-screenshot](https://cloud.githubusercontent.com/assets/4968473/21747565/98c0e366-d5ad-11e6-8000-e293996089fa.gif)
   
    ### Questions:
    * Does the licenses files need update? - NO
    * Is there breaking changes for older versions? - NO
    * Does this needs documentation? - NO
   
    Author: 1ambda <[hidden email]>
   
    Closes #1868 from 1ambda/ZEPPELIN-1917/improve-conda-interpreter and squashes the following commits:
   
    3ba171a [1ambda] fix: Wrap output style
    292ed6d [1ambda] refactor: Throw exception in runCommand
    2d4aa7d [1ambda] test: Add some tests
    49a4a11 [1ambda] feat: Supports other env commands
    6eb7e92 [1ambda] fix: NPE in PythonProcess
    9c5dd86 [1ambda] refactor: Activate, Deactivate
    f955889 [1ambda] fix: minor
    935cb89 [1ambda] refactor: Abstract commands
    b1c4c9f [1ambda] feat: Add conda remove (uninstall)
    e539c42 [1ambda] feat: Add conda install
    4f58fa2 [1ambda] feat: Add conda create
    7da132d [1ambda] docs: Add missing conda list description
    929ca8a [1ambda] feat: Make conda output beautiful
    0c6ebb4 [1ambda] feat: Add list conda command
    017c76f [1ambda] refactor: Import InterpreterResult.{Code, Type} to short codes
    b8a5154 [1ambda] refactor: Simplify exception flow so private funcs don't need care exceptions
    64d4bef [1ambda] style: Rename some funcs
    afc456d [1ambda] refactor: Add private to member vars
    f36fc74 [1ambda] feat: Add info command
    2eb9bf5 [1ambda] style: Remove useless newlines
    bd2564e [1ambda] refactor: PythonCondaInterpreter.interpret
    f0d69bc [1ambda] fix: Use specific command for env list in conda
   
    (cherry picked from commit 034fdc6735e075c89f727bb6bc6fddbc89b639c4)
    Signed-off-by: Lee moon soo <[hidden email]>

commit 8aea6a52eecc7cd5c75e0ae90d8b907cba2d537f
Author: robbins <[hidden email]>
Date:   2017-01-12T15:15:29Z

    [ZEPPELIN-1560] avoid generating minus sign in package name
   
    ### What is this PR for?
    using Object.hashCode() as part of the REPL wrapper class name can cause a compilation error as hashCode can validly return a negative integer.
   
    We would like this fix backported to 0.6 and later streams.
   
    ### What type of PR is it?
    Bug Fix
   
    ### Todos
    * [ ] - Task
   
    ### What is the Jira issue?
    https://issues.apache.org/jira/browse/ZEPPELIN-1560
   
    ### How should this be tested?
    regression tests with openJdk + tests with IBM jvm
   
    ### Screenshots (if appropriate)
    N/A
   
    ### Questions:
    * Does the licenses files need update? NO
    * Is there breaking changes for older versions? NO
    * Does this needs documentation? NO
   
    Author: robbins <[hidden email]>
   
    Closes #1894 from robbinspg/ZPPELIN-1560 and squashes the following commits:
   
    eeef3ad [robbins] [ZEPPELIN-1560] avoid generating minus sign in package name
   
    (cherry picked from commit 068c8946211823ac98fc7dbf8061da6e9a2712c3)
    Signed-off-by: Lee moon soo <[hidden email]>

commit 893c23dd9d48497f3aaeab2fa28917850203369d
Author: cloverhearts <[hidden email]>
Date:   2017-01-14T00:02:55Z

    [HOTFIX] Does not working settings menu in zeppelin web graph ui
   
    ### What is this PR for?
    Does not working settings menu in zeppelin web graph ui
   
    ### What type of PR is it?
    Bug Fix
   
    ### How should this be tested?
    1. toggle settings menu in zeppelin graph ui
   
    ### Screenshots (if appropriate)
    #### Before
    ![incorrect](https://cloud.githubusercontent.com/assets/10525473/21949815/1733ed6a-d9aa-11e6-92c8-8da98200cf43.gif)
   
    #### After
    ![correct](https://cloud.githubusercontent.com/assets/10525473/21949805/045c9a34-d9aa-11e6-86dc-445ce229f2a8.gif)
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: cloverhearts <[hidden email]>
   
    Closes #1899 from cloverhearts/ZEEPELIN-SETTING-PROBLEM-WEB-UI and squashes the following commits:
   
    e3453b7 [cloverhearts] invalid render life cycle for setting
   
    (cherry picked from commit 59e15c03d6a405e07dec59fb6e7f0ad87150794f)
    Signed-off-by: Lee moon soo <[hidden email]>

commit 59d2d107b841f637b8da0b1fcb7f3a8c90c8db7a
Author: 1ambda <[hidden email]>
Date:   2017-01-11T05:38:01Z

    [ZEPPELIN-1883] Can't import spark submitted packages in PySpark
   
    ### What is this PR for?
   
    Fixed importing packages in pyspack requested by `SPARK_SUBMIT_OPTION`
   
    ### What type of PR is it?
    [Bug Fix]
   
    ### Todos
   
    Nothing
   
    ### What is the Jira issue?
   
    [ZEPPELIN-1883](https://issues.apache.org/jira/browse/ZEPPELIN-1883)
   
    ### How should this be tested?
   
    0. Download Apache Spark 1.6.2 (since it's the most recent for pyspark-cassandra)
   
    1. Set `SPARK_HOME` and `SPARK_SUBMIT_OPTION` in `conf/zeppelin-env.sh` like
   
    ```sh
    export SPARK_HOME="~/github/apache-spark/1.6.2-bin-hadoop2.6"
    export SPARK_SUBMIT_OPTIONS="--packages com.datastax.spark:spark-cassandra-connector_2.10:1.6.2,TargetHolding:pyspark-cassandra:0.3.5 --exclude-packages org.slf4j:slf4j-api"
    ```
   
    2. Check before that you can run `spark-submit` or not
   
    ```
    ./bin/spark-submit --packages com.datastax.spark:spark-cassandra-connector_2.10:1.6.2,TargetHolding:pyspark-cassandra:0.3.5 --exclude-packages org.slf4j:slf4j-api --class org.apache.spark.examples.SparkPi lib/spark-examples-1.6.2-hadoop2.6.0.jar
    ```
   
    3. Test whether submitted packages can be import or not
   
    ```
    %pyspark
   
    import pyspark_cassandra
    ```
   
    ### Screenshots (if appropriate)
   
    ```
    import pyspark_cassandra
   
    Traceback (most recent call last):
      File "/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/zeppelin_pyspark-5266742863961917074.py", line 267, in <module>
        raise Exception(traceback.format_exc())
    Exception: Traceback (most recent call last):
      File "/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/zeppelin_pyspark-5266742863961917074.py", line 265, in <module>
        exec(code)
      File "<stdin>", line 1, in <module>
    ImportError: No module named pyspark_cassandra
    ```
   
    ### Questions:
    * Does the licenses files need update? - NO
    * Is there breaking changes for older versions? - NO
    * Does this needs documentation? - NO
   
    Author: 1ambda <[hidden email]>
   
    Closes #1831 from 1ambda/ZEPPELIN-1883/cant-import-submitted-packages-in-pyspark and squashes the following commits:
   
    585d48a [1ambda] Use spark.jars instead of classpath
    f76d2c8 [1ambda] fix: Do not extend PYTHONPATH in yarn-client
    c735bd5 [1ambda] fix: Import spark submit packages in pyspark
   
    (cherry picked from commit cb8e4187029fdd7b892d84f23efd51acaed65f78)
    Signed-off-by: Lee moon soo <[hidden email]>

commit 0f98dca046d6c21756d9f30672c867073535df7d
Author: Unknown <[hidden email]>
Date:   2016-12-12T14:14:12Z

    [MINOR] Remove unused import. Naming convention.
   
    ### What is this PR for?
    Change method name (Method names should comply with a naming convention).  Remove unused imports. Using append makes code simpler to read `sb.append("\nAccessTime = ").append(accessTime);` instead `sb.append("\nAccessTime = " + accessTime);`
   
    ### What type of PR is it?
    [Refactoring]
   
    ### Todos
    * [ ] - Task
   
    ### What is the Jira issue?
    * https://issues.apache.org/jira/browse/ZEPPELIN-1839
   
    ### How should this be tested?
    HDFSFileInterpreterTest.java (still working)
   
    ### Questions:
    * Does the licenses files need update? (no)
    * Is there breaking changes for older versions? (no)
    * Does this needs documentation? (no)
   
    Remove this unused import,  naming convention
   
    Author: Unknown <[hidden email]>
   
    Closes #1747 from bitchelov/hdfsFileInterpreterSmallChanges and squashes the following commits:
   
    6d27bb8 [Unknown] Minor changes
   
    (cherry picked from commit 69bc353d3c047ad8ad29584ce9e3b6c84d7ace7e)
    Signed-off-by: Jongyoul Lee <[hidden email]>

commit 054e0846dc558a48653c71d71438fe952775a82b
Author: Jeff Zhang <[hidden email]>
Date:   2017-01-13T03:30:13Z

    ZEPPELIN-1293. Livy Interpreter: Automatically attach or create to a new session
   
    ### What is this PR for?
    By default, livy session will expire after one hour. This PR would create session automatically for user if session is expired, and would also display the session expire information in frontend. The expire message would only display at the first time of session recreation, after that the message won't be displayed.
   
    ### What type of PR is it?
    [Improvement ]
   
    ### Todos
    * [ ] - Task
   
    ### What is the Jira issue?
    * https://issues.apache.org/jira/browse/ZEPPELIN-1293
   
    ### How should this be tested?
    Tested manually.
    ![image](https://cloud.githubusercontent.com/assets/164491/21761175/2473c0c0-d68c-11e6-8f39-9e87333c6168.png)
   
    ### Screenshots (if appropriate)
   
    ### Questions:
    * Does the licenses files need update? No
    * Is there breaking changes for older versions? No
    * Does this needs documentation? No
   
    Author: Jeff Zhang <[hidden email]>
   
    Closes #1861 from zjffdu/ZEPPELIN-1293 and squashes the following commits:
   
    e174593 [Jeff Zhang] minor update on warning message
    30c3569 [Jeff Zhang] address comments
    88f0d9a [Jeff Zhang] ZEPPELIN-1293. Livy Interpreter: Automatically attach or create to a new session

commit 8dc4721eaec0684ef3df6c25a8668badb4ed2ab5
Author: Lee moon soo <[hidden email]>
Date:   2017-01-12T18:58:06Z

    [ZEPPELIN-1619] Load js package as a plugin visualization
   
    ### What is this PR for?
    Current helium plugin application api (experimental) requires create library in java class, and need to create both backend / frontend code in the package. Which is good if your plugin requires both frontend and backend code running.
   
    However, when user just want to make new visualization which completely runs on front-end side in javascript, creating helium application in java project and taking care of backend code can be bit of overhead and barrier for javascript developers.
   
    This PR adds capability to load pure javascript package as a visualization.
   
    ### how it works
   
    1. create (copy, download) 'helium package json' file into `ZEPPELIN_HOME/helium` directory.
      The json file point visualization js package in npm repository or local file system in `artifact` field.
      `type` field in the json file need to be `VISUALIZATION`
   
    Here's an example (zeppelin-examples/zeppelin-example-horizontalbar/zeppelin-example-horizontalbar.json)
    ```
    {
      "type" : "VISUALIZATION",
      "name" : "zeppelin_horizontalbar",
      "description" : "Horizontal Bar chart (example)",
      "artifact" : "./zeppelin-examples/zeppelin-example-horizontalbar",
      "icon" : "<i class='fa fa-bar-chart rotate90flipX'></i>"
    }
    ```
   
    2. Go to helium GUI menu. (e.g. http://localhost:8080/#/helium).
      The menu will list all available packages.
    <img width="796" alt="writing_visualization_helium_menu" src="https://cloud.githubusercontent.com/assets/1540981/21749660/0f401c10-d558-11e6-9961-b6d0a9c023d8.png">
   
    3. click 'enable' in any package want to use.
    Once a visualization package is enabled, `HeliumVisualizationFactory` will collect all enabled visualizations and create js bundle on the fly.
   
    4. js bundle will be loaded on notebook and additional visualization becomes available
    ![image](https://cloud.githubusercontent.com/assets/1540981/21749729/709b2b3e-d559-11e6-8318-7f2871e7c39a.png)
   
    ### Programming API to create new plugin visualization.
   
    Simply extends [visualization.js](https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/app/visualization/visualization.js) and overrides some methods, such as
   
    ```
      /**
       * get transformation
       */
      getTransformation() {
        // override this
      };
   
      /**
       * Method will be invoked when data or configuration changed
       */
      render(tableData) {
        // override this
      };
   
      /**
       * Refresh visualization.
       */
      refresh() {
        // override this
      };
   
      /**
       * method will be invoked when visualization need to be destroyed.
       * Don't need to destroy this.targetEl.
       */
      destroy() {
        // override this
      };
   
      /**
       * return {
       *   template : angular template string or url (url should end with .html),
       *   scope : an object to bind to template scope
       * }
       */
      getSetting() {
        // override this
      };
    ```
   
    This is exactly the same api that built-in visualization uses.
   
    an example implementation included `zeppelin-examples/zeppelin-example-horizontalbar/horizontalbar.js`.
    Actually [all built-in visualizations](https://github.com/apache/zeppelin/tree/master/zeppelin-web/src/app/visualization/builtins) are example
   
    ### Packaging and publishing visualization
   
    Each visualization will need `package.json` file (e.g. `zeppelin-examples/zeppelin-example-horizontalbar/package.json`) to be packaged.
    Package can be published in npm repository or package can be deployed to the local filesystem.
   
    `zeppelin-examples/zeppelin-example-horizontalbar/` is an example package that is deployed in the local filesystem
   
    ### Development mode
   
    First, locally install and enable your development package by setting `artifact` field to the development directory.
    Then run zeppelin-web in visualization development mode with following command
    ```
    cd zeppelin-web
    npm run visdev
    ```
    When you have change in your local development package, just reload your notebook. Then Zeppelin will automatically rebuild / reload the package.
   
    Any feedback would be appreciated!
   
    ### What type of PR is it?
    Feature
   
    ### Todos
    * [x] - Load plugin visualization js package on runtime
    * [x] - Make the feature works in zeppelin Binary package
    * [x] - Show loading indicator while 'enable' / 'disable' package
    * [x] - Add document
    * [x] - Add license of new dependency
    * [x] - Development mode
    * [x] - Propagate error to front-end
    * [x] - Display multiple versions of a package.
   
    ### What is the Jira issue?
    https://issues.apache.org/jira/browse/ZEPPELIN-1619
   
    ### How should this be tested?
    Build Zeppelin with `-Pexamples` flag. That'll install example visualization package `horizontalbar`.
    You'll able to select `horizontalbar` along with other built-in visualizations
    ![image](https://cloud.githubusercontent.com/assets/1540981/21655057/27d61740-d26d-11e6-88f2-02c653e102c6.png)
   
    To test npm online package install capability,  Place [zeppelin-bubble.json](https://github.com/Leemoonsoo/zeppelin-bubble/blob/master/zeppelin-bubble.json) in hour local registry (`ZEPPELIN_HOME/helium`) and enable it in Helium gui menu.
    And then zeppelin will download package from npm repository and load.
    ![bubblechart](https://cloud.githubusercontent.com/assets/1540981/21749717/280aa430-d559-11e6-9209-889a4f86d7e2.gif)
   
    ### Questions:
    * Does the licenses files need update? yes
    * Is there breaking changes for older versions? no
    * Does this needs documentation? yes
   
    Author: Lee moon soo <[hidden email]>
   
    Closes #1842 from Leemoonsoo/ZEPPELIN-1619-rebased and squashes the following commits:
   
    7c49bbb [Lee moon soo] Let Zeppelin continue to bootstrap on offline
    816bdec [Lee moon soo] Display license of package when enabling
    28fb37d [Lee moon soo] beautifulize helium menu
    295768e [Lee moon soo] fix drag and drop visualization reorder
    bb304db [Lee moon soo] Sort version in decreasing order
    e7f18f1 [Lee moon soo] fix english in docs and labels
    c7b187f [Lee moon soo] Merge branch 'master' into ZEPPELIN-1619-rebased
    4c87983 [Lee moon soo] Merge remote-tracking branch 'apache-github/master' into ZEPPELIN-1619-rebased
    ecd925b [Lee moon soo] Merge remote-tracking branch 'apache-github/master' into ZEPPELIN-1619-rebased
    a92cadd [Lee moon soo] Use minifiable syntax
    cec534c [Lee moon soo] Reduce log message
    f373f1d [Lee moon soo] Ignore removed package
    e18d9a4 [Lee moon soo] Ability to customize order of visualization package display
    cd74396 [Lee moon soo] Add rest api doc
    9de5d6d [Lee moon soo] exclude .npmignore and package.json from zeppelin-web rat check
    08abded [Lee moon soo] exclude package.json from rat check
    661c26b [Lee moon soo] update screenshot and keep experimental tag only in docs
    4515805 [Lee moon soo] Display multiple versions of a package
    408c512 [Lee moon soo] Make unittest test bundling with proper vis package on npm registry
    fb7a147 [Lee moon soo] display svg icon
    47de6d9 [Lee moon soo] Propagate bundle error to the front-end
    0fe5e00 [Lee moon soo] visualization development mode
    022e8f6 [Lee moon soo] exclude zeppelin-examples/zeppelin-example-horizontalbar/package.json file from rat check
    2ef3b69 [Lee moon soo] Add new dependency license
    f943d33 [Lee moon soo] Add doc
    f494dbd [Lee moon soo] package npm dependency module in binary package
    b655fa6 [Lee moon soo] use any version of dependency in example. so zeppelin version bumpup doesn't need to take care of them
    2aec52d [Lee moon soo] show loading indicator while enable/disable package
    6c380f6 [Lee moon soo] refactor code to fix HeliumTest
    e142336 [Lee moon soo] update unittest
    7d5e0ae [Lee moon soo] Resolve dependency conflict
    c50a524 [Lee moon soo] Add conf/helium.json in .gitignore
    1c7b73a [Lee moon soo] add result.css
    d2823ad [Lee moon soo] load visualization and tabledata module from source instead npm if accessible
    4e1b061 [Lee moon soo] Convert horizontalbar to VISUALIZATION example
    a5a935b [Lee moon soo] connect visualization factory with restapi
    4b21252 [Lee moon soo] initial implementation of helium menu
    0c4da2e [Lee moon soo] pass bundled visualization to result.controller.js
    f5ce99e [Lee moon soo] import helium service js
    1663582 [Lee moon soo] initial implementation of helium menu
    74d52d4 [Lee moon soo] bundle visualization package from npm repository on the fly
   
    (cherry picked from commit 300f7532342d1ea47b85d3b777a8797a3e2248d4)
    Signed-off-by: Lee moon soo <[hidden email]>

commit 8956d682f591062cd129b93be23b3a10e91dcc83
Author: AhyoungRyu <[hidden email]>
Date:   2017-01-15T06:14:42Z

    [HOTFIX][ZEPPELIN-1970] Use relative path for broken screenshot imgs
   
    ### What is this PR for?
    Two screenshot imgs in [Writing a new visualization](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html) page are broken after deployed. It can be fixed by using relative path like other images. (e.g. [shiroauthentication.md](https://github.com/apache/zeppelin/blob/master/docs/security/shiroauthentication.md#4-login))
   
    ### What type of PR is it?
    Hot Fix
   
    ### What is the Jira issue?
    [ZEPPELIN-1970](https://issues.apache.org/jira/browse/ZEPPELIN-1970)
   
    ### How should this be tested?
    It can't be reproduced using docs dev mode. Needs to be tested with below steps.
   
    ```
    1) build gh-pages (website) branch
    JEKYLL_ENV=production bundle exec jekyll build
    cp -r _site/ /tmp/zeppelin_website/
    mkdir -p /tmp/zeppelin_website/docs/0.7.0-SNAPSHOT
   
    2) build this patch (docs) and copy it under docs/0.7.0-SNAPSHOT of website
    cd docs
    bundle exec jekyll build --safe
    cp -r _site/ /tmp/zeppelin_website/0.7.0-SNAPSHOT/
   
    3) start httpserver and browse http://localhost:8000/docs/0.7.0-SNAPSHOT/
    cd /tmp/zeppelin_website
    python -m SimpleHTTPServer
    ```
   
    ### Screenshots (if appropriate)
     - before
    <img width="809" alt="screen shot 2017-01-15 at 3 10 53 pm" src="https://cloud.githubusercontent.com/assets/10060731/21960655/a73ee658-db35-11e6-8e4d-7702adb1ab19.png">
   
     - after
    <img width="751" alt="screen shot 2017-01-15 at 3 10 13 pm" src="https://cloud.githubusercontent.com/assets/10060731/21960650/a23348a2-db35-11e6-80a4-a6bc9b9b188c.png">
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: AhyoungRyu <[hidden email]>
   
    Closes #1901 from AhyoungRyu/ZEPPELIN-1970 and squashes the following commits:
   
    d64e13f [AhyoungRyu] Use relative path for screenshot imgs
   
    (cherry picked from commit f86bb858b8032408b542f15ccb8794df02224a33)
    Signed-off-by: ahyoungryu <[hidden email]>

commit 835e9e21f7a94066313af98c44de9b793b1ba54d
Author: Jeff Zhang <[hidden email]>
Date:   2017-01-12T07:39:17Z

    ZEPPELIN-1933. Set pig job name and allow to set pig property in pig interpreter setting
   
    ### What is this PR for?
    Two improvements for pig interpreter.
    * Set job name via paragraph title if it exists, otherwise use the last line of pig script
    * Allow to set any pig property in interpreter setting
   
    ### What type of PR is it?
    [ Improvement]
   
    ### Todos
    * [ ] - Task
   
    ### What is the Jira issue?
    * https://issues.apache.org/jira/browse/ZEPPELIN-1933
   
    ### How should this be tested?
    Unit tested and manually tested.
   
    ### Screenshots (if appropriate)
    ![image](https://cloud.githubusercontent.com/assets/164491/21840291/a6af18b4-d817-11e6-9778-02e12ec02be1.png)
   
    ### Questions:
    * Does the licenses files need update? No
    * Is there breaking changes for older versions? No
    * Does this needs documentation? No
   
    Author: Jeff Zhang <[hidden email]>
   
    Closes #1885 from zjffdu/ZEPPELIN-1933 and squashes the following commits:
   
    d2e1cd4 [Jeff Zhang] address comments
    9cee380 [Jeff Zhang] ZEPPELIN-1933. Set pig job name and allow to set pig property in pig interpreter setting
   
    (cherry picked from commit 41f9fd921d77f5112107ba76c8794213cf3af929)
    Signed-off-by: Felix Cheung <[hidden email]>

commit a3d7316190f487ef5a5f041c2eede752b9b38df8
Author: Mina Lee <[hidden email]>
Date:   2017-01-13T02:39:42Z

    [BUILD] Update release script
   
    ### What is this PR for?
    * Change hadoop profile from `hadoop-2.4` to `hadoop-2.6`
    * Use `SCALA_VERSION` variable instead of hardcoding
    * Specify projects to be built for netinst package instead of excluding unnecessary projects.
   
    ### What type of PR is it?
    Build
   
    ### What is the Jira issue?
   
    ### How should this be tested?
    Outline the steps to test the PR here.
   
    ### Screenshots (if appropriate)
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: Mina Lee <[hidden email]>
   
    Closes #1890 from minahlee/update/release_script and squashes the following commits:
   
    a97b5fe [Mina Lee] Remove one r interpreter profile as only one will take effect
    1479d26 [Mina Lee] Use scala variable instead of hardcoding Specify project to build for net-inst package instead of adding exluding projects everytime zeppelin have new interpreter
    da9080a [Mina Lee] Update hadoop profile from 2.4 to 2.6
   
    (cherry picked from commit f8c11d15f4378523922c76a892a755a60e4a187b)
    Signed-off-by: Mina Lee <[hidden email]>

commit 20c3cbccfd0ac4e58637bd4324774b7e3ab536c9
Author: Khalid Huseynov <[hidden email]>
Date:   2017-01-12T23:12:29Z

    [ZEPPELIN-1961] Improve stability of sync when get fails
   
    ### What is this PR for?
    This is to improve the stability of sync mechanism when `get` from some backend storage fails (e.g. corrupt file, network issues).
   
    ### What type of PR is it?
    Bug Fix |  Hot Fix
   
    ### Todos
    * [x] - handle exception
   
    ### What is the Jira issue?
    [ZEPPELIN-1961](https://issues.apache.org/jira/browse/ZEPPELIN-1961)
   
    ### How should this be tested?
    CI green
   
    ### Screenshots (if appropriate)
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: Khalid Huseynov <[hidden email]>
   
    Closes #1895 from khalidhuseynov/fix-stability/sync-fail and squashes the following commits:
   
    aa1e199 [Khalid Huseynov] catch failed get command
   
    (cherry picked from commit e94d5c0fb66ee0954a74450002c5b81b8a7331a7)
    Signed-off-by: Mina Lee <[hidden email]>

commit 7b123fb8e5b593c6839613f4f851e692529543a8
Author: Jun Kim <[hidden email]>
Date:   2017-01-15T13:22:42Z

    [DOCS] Reflect changed default storage to doc
   
    ### What is this PR for?
    Reflect effects caused by changing the default notebook storage VFSNotebookRepo to GitNotebookRepo.
   
    ### What type of PR is it?
    [Documentation]
   
    ### Questions:
    * Does the licenses files need update? NO
    * Is there breaking changes for older versions? NO
    * Does this needs documentation? NO
   
    Author: Jun Kim <[hidden email]>
   
    Closes #1903 from tae-jun/patch-3 and squashes the following commits:
   
    60448da [Jun Kim] [DOCS] Reflect changed default storage to doc
   
    (cherry picked from commit 982cc0d17e6482844068dbb29ad5a11325a43446)
    Signed-off-by: ahyoungryu <[hidden email]>

commit 57f03df9e5bd5fbe5e715a78c0f7d809ea31a180
Author: victor.sheng <[hidden email]>
Date:   2017-01-12T06:54:26Z

    [ZEPPELIN-1941] Fix cron job with release resource option dead lock
   
    ### What is this PR for?
    There is a deadlock in concurrent cron job execution with release resource option.
    `Scenario`:
    Two notebook run with cron job that release resource after job finished.
   
    In `Notebook.CronJob.execute()` method:
   
    `T1. note.runAll(); // locked paragraphs(lock) and wait to interpreterSettings(lock)`
   
    `T2. notebook.getInterpreterFactory().restart() //locked(interpreterSettings) and wait for paragraphs(lock) during jobAbort.`
   
    This will trigger a deadlock that cause zeppelin hang.
   
    ### What type of PR is it?
    [Bug Fix ]
   
    ### Todos
    * [x] - Fix this by avoid acquire lock in job abort method.
   
    ### What is the Jira issue?
    * https://issues.apache.org/jira/browse/ZEPPELIN-1941
   
    ### How should this be tested?
    Outline the steps to test the PR here.
   
    ### Screenshots (if appropriate)
   
    ### Questions:
    * Does the licenses files need update?
    * Is there breaking changes for older versions?
    * Does this needs documentation?
   
    Author: victor.sheng <[hidden email]>
   
    Closes #1891 from OopsOutOfMemory/fix_dead_lock_cronjob and squashes the following commits:
   
    517fdfa [victor.sheng] fix cron job with release resource option dead lock
   
    (cherry picked from commit 215599cb39420a3564f8fcc7ac64a8da748aa526)
    Signed-off-by: Jongyoul Lee <[hidden email]>

commit 2a869c80edcaa8ebd2141fe97ddc0d036e66ccc8
Author: Jeff Zhang <[hidden email]>
Date:   2017-01-10T06:07:33Z

    ZEPPELIN-1770. Restart only the client user's interpreter when restarting interpreter setting
   
    ### What is this PR for?
    This PR would only restart the trigger user's interpreter rather than all the interpreter. So that restarting won't affect other users.
   
    ### What type of PR is it?
    [Improvement]
   
    ### Todos
    * [ ] - Task
   
    ### What is the Jira issue?
    * https://issues.apache.org/jira/browse/ZEPPELIN-1770
   
    ### How should this be tested?
    Tested manually.
   
    ### Screenshots (if appropriate)
   
    ### Questions:
    * Does the licenses files need update? No
    * Is there breaking changes for older versions? No
    * Does this needs documentation? No
   
    Author: Jeff Zhang <[hidden email]>
   
    Closes #1846 from zjffdu/ZEPPELIN-1770 and squashes the following commits:
   
    5ee076d [Jeff Zhang] fix scoped mode and add unit test
    8cb28a3 [Jeff Zhang] ZEPPELIN-1770. Restart only the client user's interpreter when restarting interpreter setting
   
    (cherry picked from commit ae1cb0527bc223b25761e1370618929e228183f8)
    Signed-off-by: Jongyoul Lee <[hidden email]>

commit 20ebb6cc1e8246f72e74af36fa286761a79c53f4
Author: Jeff Zhang <[hidden email]>
Date:   2017-01-11T02:56:53Z

    ZEPPELIN-1918. Fix build with Spark 2.1.0
   
    ### What is this PR for?
    It's my misunderstanding of `SPARK_VER` in travis. It is only used for downloading spark distribution. We need to specify spark profile explicitly for building with specific version of spark. This PR add new profile for spark 2.1 and fix the build issue with spark 2.1.0 because `SecurityManager` changes its constructor signature in spark 2.1
   
    ### What type of PR is it?
    [Bug Fix ]
   
    ### Todos
    * [ ] - Task
   
    ### What is the Jira issue?
    * https://issues.apache.org/jira/browse/ZEPPELIN-1918
   
    ### How should this be tested?
    Build with spark 2.1.0 and tested it manually as below screenshot.
   
    ### Screenshots (if appropriate)
    ![image](https://cloud.githubusercontent.com/assets/164491/21797414/d586aa04-d749-11e6-8c6f-3b12e9e2ae2d.png)
   
    ### Questions:
    * Does the licenses files need update? No
    * Is there breaking changes for older versions? No
    * Does this needs documentation? No
   
    Author: Jeff Zhang <[hidden email]>
   
    Closes #1880 from zjffdu/ZEPPELIN-1918 and squashes the following commits:
   
    8f87459 [Jeff Zhang] update release script
    34772e0 [Jeff Zhang] update build doc for spark 2.1
    5efdb11 [Jeff Zhang] fix unit test and address comments
    def502f [Jeff Zhang] ZEPPELIN-1918. Fix build with Spark 2.1.0
   
    (cherry picked from commit 9bc4dce9884ec4011f677560f708286968549374)
    Signed-off-by: Felix Cheung <[hidden email]>

commit 98f55c099b4baa814ec4cf7d680b8cbd7e667f1f
Author: Lee moon soo <[hidden email]>
Date:   2017-01-16T15:40:44Z

    [ZEPPELIN-1969] Can not change visualization package version.
   
    ### What is this PR for?
    Changing visualization package version from helium menu, sometimes fail.
    This PR fixes the problem and providing a unittest.
   
    ### What type of PR is it?
    Bug Fix
   
    ### Todos
    * [x] - remove package from node_module and let npm download again before bundle the package.
    * [x] - add unittest.
   
    ### What is the Jira issue?
    https://issues.apache.org/jira/browse/ZEPPELIN-1969
   
    ### How should this be tested?
    Unittest HeliumVisualizationFactoryTest.switchVersion() ensure the fix.
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: Lee moon soo <[hidden email]>
   
    Closes #1900 from Leemoonsoo/fix_helium_version_switch and squashes the following commits:
   
    540497f [Lee moon soo] fix style
    e9f2811 [Lee moon soo] Make download package everytime bundle to workaround inconsistent behavior of npm install
   
    (cherry picked from commit d61cd99dbb5c63078b3e20e94183355e2c401d5f)
    Signed-off-by: Lee moon soo <[hidden email]>

commit a2d6a8cf05104443b7a30c84fd4d71838136caaf
Author: Renjith Kamath <[hidden email]>
Date:   2017-01-11T17:13:32Z

    ZEPPELIN-1935 Add jceks stored password support for jdbc interpreter
   
    ### What is this PR for?
    Add support for jceks stored password instead of using password in clear text. This security enhancement prevents any user from reading clear passwords from interpreter json using shell/py/spark etc. #1315 is the parent PR which fixed similar a issue in Active Directory (shiro.ini config).
   
    ### What type of PR is it?
    Improvement
   
    ### Todos
   
    ### What is the Jira issue?
    ZEPPELIN-1935
   
    ### How should this be tested?
    Create a keystore file using the hadoop credential commandline, for this the hadoop commons should be in the classpath.
   
    `hadoop credential create jdbc.password -provider jceks://file/user/zeppelin/conf/zeppelin.jceks`
   
    Use the jceks file and the key to configure jdbc interpreter. Example interpreter setting:
   
    #### Following are the supported settings for backward compatibility
   
    - Settings with username and jceks
    ```
    default.driver org.postgresql.Driver
    default.jceks.credentialKey jdbc.password
    default.jceks.file jceks://file/tmp/zeppelin.jceks
    default.url jdbc:postgresql://rkamath-local-1:5432/
    default.user rk-user
    ```
   
    - Settings with user name and clear text password
    ```
    default.driver org.postgresql.Driver
    default.url jdbc:postgresql://rkamath-local-1:5432/
    default.user rk-user
    default.password password1
    ```
   
    ### Screenshots (if appropriate)
    <img width="1392" alt="screen shot 2017-01-10 at 7 02 12 pm" src="https://cloud.githubusercontent.com/assets/2031306/21808016/5e602982-d767-11e6-88f9-3d15b9a7f0b8.png">
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? yes
   
    Author: Renjith Kamath <[hidden email]>
   
    Closes #1881 from r-kamath/ZEPPELIN-1935 and squashes the following commits:
   
    5cc4db1 [Renjith Kamath] ZEPPELIN-1935 revert wildcard imports
    dfabe3a [Renjith Kamath] Merge branch 'master' of https://github.com/apache/zeppelin into ZEPPELIN-1935
    e62088a [Renjith Kamath] ZEPPELIN-1935 fix log message
    d41d56c [Renjith Kamath] ZEPPELIN-1935 Add jceks stored password support for jdbc interpreter
   
    (cherry picked from commit 04d34547a1453e16ea4cb306cfcfa0d79f22acfe)
    Signed-off-by: Prabhjyot Singh <[hidden email]>

commit f7edda1c4633329ed522dea088a12edb00013386
Author: Jeff Zhang <[hidden email]>
Date:   2017-01-16T01:01:54Z

    ZEPPELIN-1432. Support cancellation of paragraph execution
   
    ### What is this PR for?
    Livy 0.3 support cancel operation, this PR is to support cancel in livy interpreter. First we would check the livy version, then based on the livy version, we would call the livy rest api to cancel the statement.
   
    ### What type of PR is it?
     Improvement | Feature ]
   
    ### Todos
    * [ ] - Task
   
    ### What is the Jira issue?
    * https://issues.apache.org/jira/browse/ZEPPELIN-1432
   
    ### How should this be tested?
    Tested manually, because cancel is only avaible in livy 0.3 which is not released yet.
   
    ### Screenshots (if appropriate)
    ![image](https://cloud.githubusercontent.com/assets/164491/21712520/3ed292ec-d430-11e6-8829-581e1bba1a9c.png)
   
    ### Questions:
    * Does the licenses files need update? No
    * Is there breaking changes for older versions? No
    * Does this needs documentation? No
   
    Author: Jeff Zhang <[hidden email]>
   
    Closes #1859 from zjffdu/ZEPPELIN-1432 and squashes the following commits:
   
    83eaf83 [Jeff Zhang] minor update
    200ca71 [Jeff Zhang] address comments
    1cbeb26 [Jeff Zhang] add zeppelin.livy.pull_status.interval.millis
    070fea0 [Jeff Zhang] ZEPPELIN-1432. Support cancellation of paragraph execution
   
    (cherry picked from commit 2fcfaa8c74cad5adf9adcdf76987e4ffbe5983c7)
    Signed-off-by: Felix Cheung <[hidden email]>

commit 2dc5c8806c76136af5de7cba032f629118e73208
Author: AhyoungRyu <[hidden email]>
Date:   2017-01-16T13:30:21Z

    [Hot Fix] Fix deadlink in writingzeppelinvisualization.md
   
    ### What is this PR for?
    It should point [HeliumVisualizationFactory.java](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/helium/HeliumVisualizationFactory.java) not [HeliumVisualizationPackage.java](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/helium/HeliumVisualizationPackage.java)
   
    ### What type of PR is it?
    Documentation | HotFix
   
    ### What is the Jira issue?
    N/A
   
    ### How should this be tested?
    click `HeliumVisualizationFactory` link in [this section](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html#3-create-and-load-visualization-bundle-on-the-fly) :)
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: AhyoungRyu <[hidden email]>
   
    Closes #1904 from AhyoungRyu/fix/deadlink and squashes the following commits:
   
    60ac6c9 [AhyoungRyu] Fix deadlink in writingzeppelinvisualization.md
   
    (cherry picked from commit 425abe302374522278e7e76d4c78b71ce5dcdd9d)
    Signed-off-by: ahyoungryu <[hidden email]>

commit 350cf9c294114cd40ceef00c570d8f53caeea922
Author: Khalid Huseynov <[hidden email]>
Date:   2017-01-13T05:32:02Z

    [ZEPPELIN-1963] set cron job executor to current user by default
   
    ### What is this PR for?
    currently when executing cron job, backend doesn't know who initiated cron job (with subsequent save) unless user puts his name. This PR adds user name by default by keeping compatibility with current workflow.
   
    ### What type of PR is it?
    Improvement
   
    ### Todos
    * [x] - add user on front
   
    ### What is the Jira issue?
    [ZEPPELIN-1963](https://issues.apache.org/jira/browse/ZEPPELIN-1963)
   
    ### How should this be tested?
    go and set cron job
   
    ### Screenshots (if appropriate)
    ![cron_user](https://cloud.githubusercontent.com/assets/1642088/21919566/25330daa-d910-11e6-9373-aa3c44064f39.gif)
   
    ### Questions:
    * Does the licenses files need update? no
    * Is there breaking changes for older versions? no
    * Does this needs documentation? no
   
    Author: Khalid Huseynov <[hidden email]>
   
    Closes #1898 from khalidhuseynov/cron-user and squashes the following commits:
   
    30dc440 [Khalid Huseynov] add logged cron executing user
   
    (cherry picked from commit 8daf32563960b16db739e30c8dcd91d60f854917)
    Signed-off-by: Mina Lee <[hidden email]>

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[GitHub] zeppelin issue #2376: Branch 0.7

zjffdu
Github user soralee commented on the issue:

    https://github.com/apache/zeppelin/pull/2376
 
    Hi, @simulight.
    If you want to improve zeppelin about your idea, could you create a JIRA ticket?
    And, this branch is fault. could you close this PR, please?



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[GitHub] zeppelin issue #2376: Branch 0.7

zjffdu
In reply to this post by zjffdu
Github user zjffdu commented on the issue:

    https://github.com/apache/zeppelin/pull/2376
 
    @simulight , Could you close this PR and create a new one ? This PR is mixed with other commits.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[GitHub] zeppelin pull request #2376: Branch 0.7

zjffdu
In reply to this post by zjffdu
Github user asfgit closed the pull request at:

    https://github.com/apache/zeppelin/pull/2376


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [hidden email] or file a JIRA ticket
with INFRA.
---
Loading...