Unraveldata recently published its HDInsight application on Azure Market Place.
The Unravel HDInsight app currently only supports Spark 2.1 and 2.2 HDInsight cluster running on either blob (wasb) or adl (Azure Data Lake) storage
Support on other HDInsight clusters will be coming soon.
How to to install Unravel HDInsight app on a fresh Spark 2.1 cluster
1. Launch a Spark 2.1 Cluster
Login to the Azure port. Click or choose HDInsight service. Create a new cluster; choosing Spark as the cluster type and 2.1 as the version. Complete rest of the access credentials for the spark cluster and click Next.
2. Setup storage account configuration for the cluster
Either create a new storage account or use existing one. Fill in the storage account information for the spark cluster.
3. Find Unravel app on search box or available app listing
UNRAVEL in the search box to filter out the Unravel app or you can find it in the Available applications list.
4. Review the summary and click Create to launch the cluster + Unravel app.
Change the worker node size or number on step 4. You can change the edge node size for Unravel app if you wish.
5. Access to Unravel app user interface
After Unravel app and the spark2 cluster is successfully launched, go to HDinsight service, look for the spark2 cluster, and click on it.
Click on Application on cluster screen, and click the application name "unravel-edgenode" to see the the webpage URL
In most cases, the Unravel HDInsight app user interface is in the following format
6. Login to the Unravel app
Start your browser and navigate to the Unravel app webpage URL
https://clusterName-apps.azurehdinsight.net. You should see the Unravel app login screen.
The default admin login credential is
admin and password is
Step 7. Unravel Dashboard
When logging into Unravel, you will see the Dashboard. See the User Guide for information on Unravel's features.
Step 8. Unravel daemons
ssh to the Unravel edge node, and check the unravel daemons' process status.
To restart Unravel daemons enter:
To stop Unravel daemons enter:
Step 9. Licensing and support
By default Unravel app doesn't contains any license keys, and runs without any issue during the inital 30 days trial period. To continue using Unravel app and technical support, contact our sales.
Step 10. Getting started to use Unravel
Please read the Unravel User Guide to understand the unravel user interface environment and features provided. You will find videos in Getting Started section under the User Guide.
Step 11. Unravel API (special note for Unravel app)
Unravel provides REST api to perform some operations. To try the api, click on the API tab on the dashboard
An API page with avaiable api command options are displayed and explained.
You can try the API by clicking "Try it out" → Execute buttons; it will display the corresponding curl commands for that REST api call. See below screen capture.
From the Unravel user interface, trying out the api will always has "TypeError: Failed to fetch". Because the generated curl command is not using https.
Copy the generated curl commands and modify it to include default user credential and using https protocol.
## From original
curl -X GET "http://CLUSTERNAME-unr.apps.azurehdinsight.net/api/v1/clusters/nodes" -H "accept: application/json"
## Change to
curl -u admin:unraveldata -X GET "https://CLUSTERNAME-unr.apps.azurehdinsight.net/api/v1/clusters/nodes" -H "accept: application/json"
The api output will be in JSON format shown below and the long numeric string displayed is the epoch time