[12:52 PM, 12/13/2018] Mannan Cali: Plan is to create a generoc field or timestamp, or sudo field. Which will be always unique
In this. Consumer code getting from kafja and putting in target kudu
[12:52 PM, 12/13/2018] Mannan Cali: The code is upserting, so we need to generate a unique ID and put in row. So that it appends
Function wil be like UId and add timestamp and generate source date and keep it as value and to the row.
There is avro in all that
2 фрилансеров(-а) в среднем готовы выполнить эту работу за $210
Hello I work in Bigdata technologies for years. I worked in Spark (Streaming & MLLib), Kafka, Kafka streaming with AVRO and JSON comm. using confluent kafka. Can we talk further on this? Thank you!