How to import Hive Partitioned data

Comments

3 comments

  • Gido

    If there are existing time-based partitions available on the Hive connection, these will be available when importing data.

    If you like to access external stored Hive tables (files) directly on HDFS, you can specify the folder structure with a %pattern% and define which files from the included folders should be included in the partition. 

    0
    Comment actions Permalink
  • Souradeep

    How can i import hive partition keys as attributes? I have 4 hive partition keys which are being used to read the data but these are not available in the data as columns. Is there a way to get these partition keys in the workbook?

    0
    Comment actions Permalink
  • Joel Stewart

    Hive data sets in Datameer allow access to the columns of data only and not external attributes such as the partition keys. If your schema will allow, you can add the partition keys as additional columns so that you can access them directly in Datameer.

    0
    Comment actions Permalink

Please sign in to leave a comment.