Cannot configure email account for Email Analytics App

3 followers
0
Avatar

Hello,
I am trying to run the email analytics app but am stuck at the first step (configuring email). I am entering my yahoo email id with password and it populates the rest of the fields (mail server settings etc) but then I get an error and nothing gets pulled/populated into Datameer.
What am I doing wrong?
thanks & regards,
Rahul

Rahul Dhond Answered

8 comments

  • Avatar
    Rahul Dhond

    Import Job gets created (I can even see my emails being brought in during the steps) but when I run the import job nothing actually gets pulled and saved..(0 records)..
    Can you please let me know what am I doing wrong?

    0
  • Avatar
    Rahul Dhond

    ErrorLogException: Failed to read record source, byte position is 0
    ErrorLogException: The following split: 'MailMessageInputSplit[offset=0,length=1836]', has been dropped from import.

    0
  • Avatar
    Joel Stewart

    Rahul could you share the contents of the Job log in full? That would help determine where the issue may lie?

    0
  • Avatar
    Rahul Dhond

    !message:ErrorLogException: Failed to read record source, byte position is 0
    !Error Repeated:4 times
    !Reason:IOException: java.lang.NullPointerException
    !Source Split:DasDelegateSplit: MailMessageInputSplit[offset=0,length=1836] - plugin-mail
    !stack:datameer.dap.sdk.ErrorLogException: Failed to read record source, byte position is 0
    at datameer.dap.common.job.mr.input.ImportExceptionHandler.handleRecordException(ImportExceptionHandler.java:80)
    at datameer.dap.common.job.mr.input.BaseImportRecordReader.readNextRecordSource(BaseImportRecordReader.java:100)
    at datameer.dap.common.job.mr.input.DapImportRecordReader.consumeNextRecord(DapImportRecordReader.java:71)
    at datameer.dap.common.job.mr.input.DapImportRecordReader.next(DapImportRecordReader.java:49)
    at datameer.dap.common.job.mr.input.DapImportRecordReader.next(DapImportRecordReader.java:25)
    at datameer.dap.common.graphv2.RecordSequences$2.computeNext(RecordSequences.java:93)
    at datameer.dap.common.graphv2.RecordSequences$2.computeNext(RecordSequences.java:89)
    at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
    at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
    at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
    at datameer.dap.sdk.sequence.Sequence$14.computeNext(Sequence.java:647)
    at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
    at datameer.dap.sdk.sequence.Sequence$14.computeNext(Sequence.java:647)
    at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
    at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
    at datameer.dap.common.graphv2.local.LocalClusterJob.runImpl(LocalClusterJob.java:342)
    at datameer.dap.common.graphv2.local.LocalClusterJob.runImpl(LocalClusterJob.java:71)
    at datameer.dap.common.graphv2.ClusterJob.run(ClusterJob.java:128)
    at datameer.dap.common.graphv2.ClusterSession.execute(ClusterSession.java:181)
    at datameer.dap.common.graphv2.ClusterSession.runAllClusterJobs(ClusterSession.java:332)
    at datameer.dap.common.graphv2.MrPlanRunnerV2.run(MrPlanRunnerV2.java:103)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:96)
    at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:173)
    at datameer.dap.common.security.RunAsThread$1.run(RunAsThread.java:34)
    at datameer.dap.common.security.RunAsThread$1.run(RunAsThread.java:30)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Unknown Source)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
    at datameer.dap.common.filesystem.Impersonator.doAs(Impersonator.java:31)
    at datameer.dap.common.security.RunAsThread.run(RunAsThread.java:30)
    Caused by: java.io.IOException: java.lang.NullPointerException
    at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:104)
    at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:25)
    at datameer.dap.common.job.mr.input.BaseImportRecordReader.readNextRecordSource(BaseImportRecordReader.java:89)
    ... 29 more
    Caused by: java.lang.NullPointerException
    at datameer.das.plugins.mail.schema.MailMessageFilter.acceptMessage(MailMessageFilter.java:29)
    at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:93)
    ... 31 more

    !message:ErrorLogException: The following split: 'MailMessageInputSplit[offset=0,length=1836]', has been dropped from import.
    !Successive Record Errors:5
    !Reason:IOException: java.lang.NullPointerException
    !Source Split:DasDelegateSplit: MailMessageInputSplit[offset=0,length=1836] - plugin-mail
    !stack:datameer.dap.sdk.ErrorLogException: The following split: 'MailMessageInputSplit[offset=0,length=1836]', has been dropped from import.
    at datameer.dap.common.job.mr.input.ImportExceptionHandler.handleSplitException(ImportExceptionHandler.java:30)
    at datameer.dap.common.job.mr.input.BaseImportRecordReader.readNextRecordSource(BaseImportRecordReader.java:97)
    at datameer.dap.common.job.mr.input.DapImportRecordReader.consumeNextRecord(DapImportRecordReader.java:71)
    at datameer.dap.common.job.mr.input.DapImportRecordReader.next(DapImportRecordReader.java:49)
    at datameer.dap.common.job.mr.input.DapImportRecordReader.next(DapImportRecordReader.java:25)
    at datameer.dap.common.graphv2.RecordSequences$2.computeNext(RecordSequences.java:93)
    at datameer.dap.common.graphv2.RecordSequences$2.computeNext(RecordSequences.java:89)
    at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
    at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
    at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
    at datameer.dap.sdk.sequence.Sequence$14.computeNext(Sequence.java:647)
    at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
    at datameer.dap.sdk.sequence.Sequence$14.computeNext(Sequence.java:647)
    at datameer.dap.sdk.sequence.Sequence$Simple.moveToNext(Sequence.java:157)
    at datameer.dap.sdk.sequence.Sequence$13.moveToNext(Sequence.java:602)
    at datameer.dap.common.graphv2.local.LocalClusterJob.runImpl(LocalClusterJob.java:342)
    at datameer.dap.common.graphv2.local.LocalClusterJob.runImpl(LocalClusterJob.java:71)
    at datameer.dap.common.graphv2.ClusterJob.run(ClusterJob.java:128)
    at datameer.dap.common.graphv2.ClusterSession.execute(ClusterSession.java:181)
    at datameer.dap.common.graphv2.ClusterSession.runAllClusterJobs(ClusterSession.java:332)
    at datameer.dap.common.graphv2.MrPlanRunnerV2.run(MrPlanRunnerV2.java:103)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:96)
    at datameer.dap.common.security.DatameerSecurityService.runAsUser(DatameerSecurityService.java:173)
    at datameer.dap.common.security.RunAsThread$1.run(RunAsThread.java:34)
    at datameer.dap.common.security.RunAsThread$1.run(RunAsThread.java:30)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Unknown Source)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
    at datameer.dap.common.filesystem.Impersonator.doAs(Impersonator.java:31)
    at datameer.dap.common.security.RunAsThread.run(RunAsThread.java:30)
    Caused by: java.io.IOException: java.lang.NullPointerException
    at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:104)
    at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:25)
    at datameer.dap.common.job.mr.input.BaseImportRecordReader.readNextRecordSource(BaseImportRecordReader.java:89)
    ... 29 more
    Caused by: java.lang.NullPointerException
    at datameer.das.plugins.mail.schema.MailMessageFilter.acceptMessage(MailMessageFilter.java:29)
    at datameer.das.plugins.mail.schema.MailMessageRecordSourceReader.readNext(MailMessageRecordSourceReader.java:93)
    ... 31 more

    0
  • Avatar
    Joel Stewart

    Thanks Rahul. We'll work on trying to reproduce this by setting up a Yahoo mail connection as well.

    0
  • Avatar
    Venu Reddy

    Hi Rahul, when we tested the feature in-house, and it failed the same way. We opened a defect to investigate further, will update you on the progress.

    0
  • Avatar
    Rahul Dhond

    Hello,
    I was wondering if there has been any progress on this issue. Please let me know. Many Thanks.
    regards,
    Rahul

    0
  • Avatar
    Venu Reddy

    Hi Rahul, it's being assessed by product management at this point. We'll let you know as soon as there is an update.

    0
Please sign in to leave a comment.