Repository navigation
Job Execution Failure with NullPointerException #46
Copy link
Copy link
Closed
Description
Expected Behavior
Ingestion job execution should complete successfully
Current Behavior
Running a job using Dataflow Runner throw following exception
java.lang.RuntimeException: java.lang.NullPointerException
at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:193)
at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:164)
at org.apache.beam.runners.dataflow.worker.graph.Networks$TypeSafeNodeFunction.apply(Networks.java:63)
at org.apache.beam.runners.dataflow.worker.graph.Networks$TypeSafeNodeFunction.apply(Networks.java:50)
at org.apache.beam.runners.dataflow.worker.graph.Networks.replaceDirectedNetworkNodes(Networks.java:87)
at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.create(IntrinsicMapTaskExecutorFactory.java:124)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:337)
at org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:291)
at org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:135)
at org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:115)
at org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:102)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.apache.beam.sdk.values.TupleTag.hashCode(TupleTag.java:162)
at org.apache.beam.runners.dataflow.worker.repackaged.com.google.common.collect.RegularImmutableMap.fromEntryArray(RegularImmutableMap.java:72)
at org.apache.beam.runners.dataflow.worker.repackaged.com.google.common.collect.ImmutableMap$Builder.build(ImmutableMap.java:300)
at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.createParDoOperation(IntrinsicMapTaskExecutorFactory.java:268)
at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.access$000(IntrinsicMapTaskExecutorFactory.java:85)
at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:182)
Steps to reproduce
Run any ingestion job on commit 11114c5
Possible Cause
The job is successful if commit 11114c5 is excluded from build. So, probably it has something to do with it. (note: PR #45 has to be included when trying in order to complete job submission step)
Metadata
Metadata
Assignees
Labels
No labels
Activity
tims commentedon Jan 8, 2019
What did the storage specs look like?
Is it easy to send me a zip of all the specs as json?
Plus the import spec yaml.
pradithya commentedon Jan 10, 2019
fixed by #52
disable compile-protos-go build step (feast-dev#46)
Merge pull request feast-dev#46 from odh-on-pz/feature-server-ppc64le…
Revert "Merge pull request feast-dev#46 from odh-on-pz/feature-server…
Merge pull request feast-dev#48 from odh-on-pz/stable-2.x-revert-pr46