Package com.amazonaws.athena.connectors.tpcds

Class TPCDSRecordHandler

java.lang.Object

com.amazonaws.athena.connector.lambda.handlers.RecordHandler

com.amazonaws.athena.connectors.tpcds.TPCDSRecordHandler

All Implemented Interfaces:

com.amazonaws.services.lambda.runtime.RequestStreamHandler

public class TPCDSRecordHandler
extends RecordHandler

Handles data read record requests for the Athena TPC-DS Connector.

For more detail, please see the module's README.md, some notable characteristics of this class include:

1. Generates data for the requested table on the fly. 2. Applies constraints to the data as it is generated, emulating predicate-pushdown.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static interface	TPCDSRecordHandler.CellWriter

Field Summary

Fields inherited from class com.amazonaws.athena.connector.lambda.handlers.RecordHandler

configOptions

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	TPCDSRecordHandler(com.amazonaws.services.s3.AmazonS3 amazonS3, com.amazonaws.services.secretsmanager.AWSSecretsManager secretsManager, com.amazonaws.services.athena.AmazonAthena athena, Map<String,String> configOptions)
	TPCDSRecordHandler(Map<String,String> configOptions)

Method Summary

Modifier and Type	Method	Description
protected void	readWithConstraint(BlockSpiller spiller, ReadRecordsRequest recordsRequest, QueryStatusChecker queryStatusChecker)	Generated TPCDS data for the given Table and scale factor as defined by the requested Split.

Methods inherited from class com.amazonaws.athena.connector.lambda.handlers.RecordHandler

doHandleRequest, doReadRecords, getSecret, getSpillConfig, handleRequest, onPing, resolveSecrets

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TPCDSRecordHandler

public TPCDSRecordHandler(Map<String,String> configOptions)

TPCDSRecordHandler

protected TPCDSRecordHandler(com.amazonaws.services.s3.AmazonS3 amazonS3,
                             com.amazonaws.services.secretsmanager.AWSSecretsManager secretsManager,
                             com.amazonaws.services.athena.AmazonAthena athena,
                             Map<String,String> configOptions)

Method Detail

readWithConstraint

protected void readWithConstraint(BlockSpiller spiller,
                                  ReadRecordsRequest recordsRequest,
                                  QueryStatusChecker queryStatusChecker)
                           throws IOException

Generated TPCDS data for the given Table and scale factor as defined by the requested Split.

Specified by:

readWithConstraint in class RecordHandler

Parameters:

spiller - A BlockSpiller that should be used to write the row data associated with this Split. The BlockSpiller automatically handles chunking the response, encrypting, and spilling to S3.

recordsRequest - Details of the read request, including: 1. The Split 2. The Catalog, Database, and Table the read request is for. 3. The filtering predicate (if any) 4. The columns required for projection.

queryStatusChecker - A QueryStatusChecker that you can use to stop doing work for a query that has already terminated

Throws:

IOException

See Also:

RecordHandler