Install Unravel HDInsight app

Unraveldata recently published its HDInsight application on Azure Market Place. 

The Unravel HDInsight app currently only supports Spark 2.1 and 2.2 HDInsight cluster running on either blob (wasb) or adl (Azure Data Lake) storage 

Support on other HDInsight clusters will be coming soon. 

How to to install Unravel HDInsight app on a fresh Spark 2.1 cluster 

1. Launch a Spark 2.1 Cluster

Login to the Azure port. Click or choose HDInsight service. Create a new cluster; choosing Spark as the cluster type and 2.1 as the version. Complete rest of the access credentials for the spark cluster and click Next.


2. Setup storage account configuration for the cluster

Either create a new storage account or use existing one. Fill in the storage account information for the spark cluster.

3. Find Unravel app on search box or available app listing

Enter UNRAVEL in the search box to filter out the Unravel app or you can find it in the Available applications list.

Click OK to display "Terms of Use" and "Privacy Policy". Click the Create button to accept it.


After you accepted the "Terms of Use" and "Privacy Policy" click Next to proceed.

4. Review the summary and click Create to launch the cluster + Unravel app.

      Change the worker node size or number on step 4. You can change the edge node size for Unravel app if you wish.

5. Access to Unravel app user interface

After Unravel app and the spark2 cluster is successfully launched, go to HDinsight service, look for the spark2 cluster, and click on it.

Click on Application on cluster screen, and click the application name "unravel-edgenode" to see the the webpage URL


In most cases, the Unravel HDInsight app user interface is in the following format


6. Login to the Unravel app 

Start your browser and navigate to the Unravel app webpage URL You should see the Unravel app login screen.

The default admin login credential is admin and password is unraveldata.

Step 7. Unravel Dashboard

When logging into Unravel, you will see the Dashboard. See the User Guide for information on Unravel's features.

Step 8. Unravel daemons

ssh to the Unravel edge node, and check the unravel daemons' process status.

/usr/local/unravel/init_scripts/ status

To restart Unravel daemons enter:

/usr/local/unravel/init_scripts/ restart

To stop Unravel daemons enter:

/usr/local/unravel/init_scripts/ stop

Step 9. Licensing and support

By default Unravel app doesn't contains any license keys, and runs without any issue during the inital 30 days trial period. To continue using Unravel app and technical support, contact our sales.

Support contact:

License contact:

Unraveldata Main number:  (650) 741-3442

Step 10. Getting started to use Unravel

Please read the Unravel User Guide to understand the unravel user interface environment and features provided. You will find videos in Getting Started section under the User Guide.

Step 11. Unravel API   (special note for Unravel app)

Unravel provides REST api to perform some operations. To try the api, click on the API tab on the dashboard

An API page with avaiable api command options are displayed and explained. 

You can try the API by clicking "Try it out" → Execute  buttons; it will display the corresponding curl commands for that REST api call.  See below screen capture.


 From the Unravel user interface, trying out the api will always has "TypeError: Failed to fetch". Because the generated curl command is not using https.


Copy the generated curl commands and modify it to include default user credential and using https protocol.

## From original 
curl -X GET "" -H  "accept: application/json"

## Change to 
curl -u admin:unraveldata -X GET "" -H  "accept: application/json"

The api output will be in JSON format shown below and the long numeric string displayed is the epoch time