Hive properties per Radoop Nest

daniel_moser
daniel_moser New Altair Community Member
edited November 2024 in Community Q&A

Hi,

 

is it somehow possible to set additional Hive properties on a Radoop Nest basis? 

 

Thanks,

Daniel

Answers

  • phellinger
    phellinger New Altair Community Member

    Hi Daniel,

     

    not without creating a new Radoop connection with the different advanced Hive properties, that you can then select as the Nest's connection.

     

    Can you share your use case, like what properties would be helpful to have on the Nest level?

     

    Best,

    Peter 

  • daniel_moser
    daniel_moser New Altair Community Member

    Hi Peter,

     

    thanks for your answer. In my case I have a join which fails with an OOM exception. However, setting hive.auto.convert.join to false resolves this problem. In general I would like to use MapJoins though, so it would be nice if I could set this property only for the nest with this join.

     

    Best,

    Daniel

  • phellinger
    phellinger New Altair Community Member

    Hi Daniel,

     

    that could be a useful feature, I take a note.

     

    Maybe even setting these properties on an operator level (not just the Nest) could help. Of course, we do not want to make the parameters too complicated, but the need to have a general way to alter the behavior like this often comes up with Hadoop.

     

    Best,

    Peter