[SOLVED] Some components are stuck in starting if there is any Kafka input in Talend

Issue

This Content is from Stack Overflow. Question asked by Adjie Satrio Prabowo

enter image description here

Hi everyone,
I got some issues with Kafka input in talend, if there is any Kafka input component in the Talend job, some components are stuck in Starting as you saw in the picture after tExtractJSONFields_1 component, it happens to some components like tuniqrow, taggregate. I already test the job and change the input components with file delimiter input, but it not showing any problem.

is there any special configuration for the Kafka input component?



Solution

enter image description here

because Kafka still waiting for messages and it’s not waiting and delivering messages at the same time, we can set configurations in Kafka input basic settings, there is 3 way to deliver Kafka messages,

  1. send messages after waiting for a specific duration
  2. send messages after a number of messages
  3. send messages after waiting time between messages


 This Question was asked in  StackOverflow by  Adjie Satrio Prabowo and Answered by Adjie Satrio Prabowo It is licensed under the terms of 
CC BY-SA 2.5. - CC BY-SA 3.0. - CC BY-SA 4.0.
people found this article helpful. What about you?