Importing Mainframe file into hadoop using Datameer

2 followers
0
Avatar

Hi , 

I'm new to datameer and were planning to propose this to our client for next project. So , I had few questions related to the integration of mainframe files into the hadoop using Datameer . 

1. Which different type of character set formats (like CP037) are supported?
2. Does it support EBCDIC (Extended Binary Coded Decimal Interchange
Code) format import?
3. Does it support binary format import from Mainframe?
4. Does it support compressed (zipped) data import?
5. Does it support comp (compressed) data type?
6. How many hierarchical levels are supported?
7. Import jobs to Hadoop are run in Memory or Hadoop?
8. Will it require a separate lincence for integration and analysis for its bundled into one?
9. How Datameer installed on Hadoop? (data nodes, edge mode, name node)

Hoping for quick response

Thanks,
Rajat

Rajat Mishra

Official comment

  • Avatar
    Joel Stewart

    Hi Rajat, thanks for the questions and interest in Datameer for this project. 

    Datameer can read many different character formats including CP037 (or IBM037). This does include many EBCDIC type formats. 

    Yes, Datameer can import binary data from mainframe files. Yes, it can import compressed data as well. 

    I don't understand the context about the hierarchical levels question, can you elaborate a bit on that circumstance? 

    With Datameer's Smart Execution, jobs can run locally on in Hadoop. Most commonly, they are run on Hadoop though. Datameer is installed on an edge node most commonly, but could be entirely outside of the cluster too. 

    A Datameer Enterprise license includes access to integration, analysis and visualization altogether. 

    0

3 comments

  • Avatar
    Rajat Mishra

    Thanks joel !!!.

    The hierarchy level i'm talking about is the number present in the cobol copybook. For eg .

    01 TCRMCONTRACTBOBJ.
       05  OBJECT-NAME      PIC X(40).
       05  CONTRACTID PIC 9(18).
       05  CURRENCYTYPE     PIC X(2).
       05  CURRENCYVALUE    PIC X(4).
       05  TCRMCCBOBJ-COUNT PIC 99.
       05  C-TCRMANKEYBOBJ-COUNT PIC 99.
       05  TCRMCCBOBJ-OFFSET PIC 9(8) OCCURS 0 TO 99 TIMES
                 DEPENDING ON TCRMCCBOBJ-COUNT.
       05  C-TCRMANKEYBOBJ-OFFSET PIC 9(8) OCCURS 0 TO 99
                 TIMES DEPENDING ON C-TCRMANKEYBOBJ-COUNT.

    in the above copybook there 2 level 01 and 05 . In some copybook 05 is further goes down to 10 and so on.


    Thanks again!!

     

     

    0
  • Avatar
    Joel Stewart

    Within a copybook, there is no limit to the hierarchy size. However, copybook files with multiple variable length data types are not supported. If there is a variable length data field, it must be the last item of the copybook. 

    0
Please sign in to leave a comment.