Package com.amazonaws.athena.connectors.msk.consumer

Class BaseMskConsumer<T>

java.lang.Object

com.amazonaws.athena.connectors.msk.consumer.BaseMskConsumer<T>

All Implemented Interfaces:

MskConsumer

Direct Known Subclasses:

MskAvroConsumer, MskDefaultConsumer, MskProtobufConsumer

public abstract class BaseMskConsumer<T>
extends Object
implements MskConsumer

Field Summary

Fields

Modifier and Type	Field	Description
protected static int	MAX_EMPTY_RESULT_FOUND_COUNT

Constructor Summary

Constructors

Constructor	Description
BaseMskConsumer()

Method Summary

Modifier and Type	Method	Description
void	consume(BlockSpiller spiller, ReadRecordsRequest recordsRequest, QueryStatusChecker queryStatusChecker, SplitParameters splitParameters, org.apache.kafka.clients.consumer.Consumer<?,?> consumer)	Consume topic data as batch.
protected abstract void	processRecord(BlockSpiller spiller, SplitParameters splitParameters, org.apache.kafka.clients.consumer.ConsumerRecord<String,T> record)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MAX_EMPTY_RESULT_FOUND_COUNT

protected static final int MAX_EMPTY_RESULT_FOUND_COUNT

See Also:

Constant Field Values

Constructor Detail

BaseMskConsumer

public BaseMskConsumer()

Method Detail

consume

public void consume(BlockSpiller spiller,
                    ReadRecordsRequest recordsRequest,
                    QueryStatusChecker queryStatusChecker,
                    SplitParameters splitParameters,
                    org.apache.kafka.clients.consumer.Consumer<?,?> consumer)

Description copied from interface: MskConsumer

Consume topic data as batch.

Specified by:

consume in interface MskConsumer

Parameters:

spiller - - instance of BlockSpiller

recordsRequest - - instance of ReadRecordsRequest

queryStatusChecker - - instance of QueryStatusChecker

splitParameters - - instance of SplitParameters

consumer - - instance of KafkaConsumer

processRecord

protected abstract void processRecord(BlockSpiller spiller,
                                      SplitParameters splitParameters,
                                      org.apache.kafka.clients.consumer.ConsumerRecord<String,T> record)