Connecting hadoop in Azure with radoop

User: "jan_bauer"
New Altair Community Member
Updated by Jocelyn

Hello,

 

i have an Hortonworks Sandbox in Azure and i am trying to connect it with Radoop. I am stucking at the 4(HDFS) test. There is an Timout exception and the log says i am unable to reach the namenode and datanode. Do i have to do some additinal changes ?

The first tests for hive etc. worked fine. Is there some firewall on the Azure Sandbox wich is refusing the connection from my machine?

 

Here is the console print:

[Nov 10, 2016 12:25:46 PM] SEVERE: java.util.concurrent.TimeoutException
[Nov 10, 2016 12:25:46 PM] SEVERE: Distributed file system test timed out. Please check that the NameNode and DataNodes are accessible on the address and port you specified.
[Nov 10, 2016 12:25:46 PM] SEVERE: Test failed: HDFS
[Nov 10, 2016 12:25:46 PM] SEVERE: Connection test for 'Test' failed.

 

Best regards,

Jan

Find more posts tagged with

Sort by:
1 - 1 of 11
    User: "phellinger"
    New Altair Community Member
    Accepted Answer

    Hi Jan,

     

    thank you for the details.

     

    The DataNode test reports that the client looks for the DataNode using the internal IP address 10.0.0.4, and it fails.

    Please try the test after adding this advanced Hadoop property to the connection with a true value: dfs.client.use.datanode.hostname. (In this case, the DataNode is expected to be accessed via sandbox.hortonworks.com.)Screen Shot 2016-11-14 at 13.36.26.png

     

    If it does not help, looking into the Log panel (use View -> Show Panel -> Log to enable it), or checking the output of the Extract Logs (on the connection dialog) action after the connection test may reveal more.

     

    By the way, Radoop 7.3.0 has been released, it also slightly improves the error logging on this panel.

     

    Best,

    Peter