Package com.amazonaws.athena.connectors.elasticsearch

Class ElasticsearchRecordHandler

java.lang.Object

com.amazonaws.athena.connector.lambda.handlers.RecordHandler

com.amazonaws.athena.connectors.elasticsearch.ElasticsearchRecordHandler

All Implemented Interfaces:

com.amazonaws.services.lambda.runtime.RequestStreamHandler

public class ElasticsearchRecordHandler
extends RecordHandler

This class is responsible for providing Athena with actual rows level data from your Elasticsearch instance. Athena will call readWithConstraint(...) on this class for each 'Split' you generated in ElasticsearchMetadataHandler.

Field Summary

Fields inherited from class com.amazonaws.athena.connector.lambda.handlers.RecordHandler

configOptions

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	ElasticsearchRecordHandler(com.amazonaws.services.s3.AmazonS3 amazonS3, com.amazonaws.services.secretsmanager.AWSSecretsManager secretsManager, com.amazonaws.services.athena.AmazonAthena amazonAthena, AwsRestHighLevelClientFactory clientFactory, long queryTimeout, long scrollTimeout, Map<String,String> configOptions)
	ElasticsearchRecordHandler(Map<String,String> configOptions)

Method Summary

Modifier and Type	Method	Description
protected int	getQueryBatchSize()
protected void	readWithConstraint(BlockSpiller spiller, ReadRecordsRequest recordsRequest, QueryStatusChecker queryStatusChecker)	Used to read the row data associated with the provided Split.

Methods inherited from class com.amazonaws.athena.connector.lambda.handlers.RecordHandler

doHandleRequest, doReadRecords, getSecret, getSpillConfig, handleRequest, onPing, resolveSecrets

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ElasticsearchRecordHandler

public ElasticsearchRecordHandler(Map<String,String> configOptions)

ElasticsearchRecordHandler

protected ElasticsearchRecordHandler(com.amazonaws.services.s3.AmazonS3 amazonS3,
                                     com.amazonaws.services.secretsmanager.AWSSecretsManager secretsManager,
                                     com.amazonaws.services.athena.AmazonAthena amazonAthena,
                                     AwsRestHighLevelClientFactory clientFactory,
                                     long queryTimeout,
                                     long scrollTimeout,
                                     Map<String,String> configOptions)

Method Detail

readWithConstraint

protected void readWithConstraint(BlockSpiller spiller,
                                  ReadRecordsRequest recordsRequest,
                                  QueryStatusChecker queryStatusChecker)
                           throws RuntimeException

Used to read the row data associated with the provided Split.

Specified by:

readWithConstraint in class RecordHandler

Parameters:

spiller - A BlockSpiller that should be used to write the row data associated with this Split. The BlockSpiller automatically handles chunking the response, encrypting, and spilling to S3.

recordsRequest - Details of the read request, including: 1. The Split 2. The Catalog, Database, and Table the read request is for. 3. The filtering predicate (if any) 4. The columns required for projection.

queryStatusChecker - A QueryStatusChecker that you can use to stop doing work for a query that has already terminated

Throws:

RuntimeException - when an error occurs while attempting to send the query, or the query timed out.

getQueryBatchSize

protected int getQueryBatchSize()

Returns:

value used for pagination batch size.