Uses of Interface
com.amazonaws.athena.connector.lambda.data.BlockWriter
-
-
Uses of BlockWriter in com.amazonaws.athena.connector.lambda.data
Subinterfaces of BlockWriter in com.amazonaws.athena.connector.lambda.data Modifier and Type Interface Description interface
BlockSpiller
Used to write blocks which may require chunking and optionally spilling via a secondary communication channel.Classes in com.amazonaws.athena.connector.lambda.data that implement BlockWriter Modifier and Type Class Description class
S3BlockSpiller
Implementation of BlockSpiller which spills Blocks from large results to S3 with optional AES-GCM encryption.class
SimpleBlockWriter
Used to write a single Block using the BlockWriter programming model. -
Uses of BlockWriter in com.amazonaws.athena.connector.lambda.handlers
Methods in com.amazonaws.athena.connector.lambda.handlers with parameters of type BlockWriter Modifier and Type Method Description abstract void
MetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Used to get the partitions that must be read from the request table in order to satisfy the requested predicate. -
Uses of BlockWriter in com.amazonaws.athena.connectors.aws.cmdb
Methods in com.amazonaws.athena.connectors.aws.cmdb with parameters of type BlockWriter Modifier and Type Method Description void
AwsCmdbMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Delegates to the TableProvider that is registered for the requested table. -
Uses of BlockWriter in com.amazonaws.athena.connectors.aws.cmdb.tables
Methods in com.amazonaws.athena.connectors.aws.cmdb.tables with parameters of type BlockWriter Modifier and Type Method Description default void
TableProvider. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request)
Default implementation returns a single partition since many of the TableProviders may not support parallel scans. -
Uses of BlockWriter in com.amazonaws.athena.connectors.clickhouse
Methods in com.amazonaws.athena.connectors.clickhouse with parameters of type BlockWriter Modifier and Type Method Description void
ClickHouseMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
-
Uses of BlockWriter in com.amazonaws.athena.connectors.cloudera
Methods in com.amazonaws.athena.connectors.cloudera with parameters of type BlockWriter Modifier and Type Method Description void
HiveMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
Used to get the hive partitions that must be read from the request table in order to satisfy the requested predicate.void
ImpalaMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
Used to get the Impala partitions that must be read from the request table in order to satisfy the requested predicate. -
Uses of BlockWriter in com.amazonaws.athena.connectors.cloudwatch
Methods in com.amazonaws.athena.connectors.cloudwatch with parameters of type BlockWriter Modifier and Type Method Description void
CloudwatchMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Gets the list of LogStreams that need to be scanned to satisfy the requested table. -
Uses of BlockWriter in com.amazonaws.athena.connectors.cloudwatch.metrics
Methods in com.amazonaws.athena.connectors.cloudwatch.metrics with parameters of type BlockWriter Modifier and Type Method Description void
MetricsMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Our table doesn't support complex layouts or partitioning so we simply make this method a NoOp and the SDK will automatically generate a single placeholder partition for us since Athena needs at least 1 partition returned if there is potetnailly any data to read. -
Uses of BlockWriter in com.amazonaws.athena.connectors.datalakegen2
Methods in com.amazonaws.athena.connectors.datalakegen2 with parameters of type BlockWriter Modifier and Type Method Description void
DataLakeGen2MetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
The partitions are being implemented based on the type of data externally in case of Gen 2. -
Uses of BlockWriter in com.amazonaws.athena.connectors.db2
Methods in com.amazonaws.athena.connectors.db2 with parameters of type BlockWriter Modifier and Type Method Description void
Db2MetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
A partition is represented by a partition column(s) of type varchar. -
Uses of BlockWriter in com.amazonaws.athena.connectors.db2as400
Methods in com.amazonaws.athena.connectors.db2as400 with parameters of type BlockWriter Modifier and Type Method Description void
Db2As400MetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
A partition is represented by a partition column(s) of type varchar. -
Uses of BlockWriter in com.amazonaws.athena.connectors.docdb
Methods in com.amazonaws.athena.connectors.docdb with parameters of type BlockWriter Modifier and Type Method Description void
DocDBMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Our table doesn't support complex layouts or partitioning so we simply make this method a NoOp. -
Uses of BlockWriter in com.amazonaws.athena.connectors.dynamodb
Methods in com.amazonaws.athena.connectors.dynamodb with parameters of type BlockWriter Modifier and Type Method Description void
DynamoDBMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Generates hash key partitions if possible or generates a single partition with the heuristically determined optimal scan segment count specified inside of it -
Uses of BlockWriter in com.amazonaws.athena.connectors.elasticsearch
Methods in com.amazonaws.athena.connectors.elasticsearch with parameters of type BlockWriter Modifier and Type Method Description void
ElasticsearchMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Elasticsearch does not support partitioning so this method is a NoOp. -
Uses of BlockWriter in com.amazonaws.athena.connectors.example
Methods in com.amazonaws.athena.connectors.example with parameters of type BlockWriter Modifier and Type Method Description void
ExampleMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Used to get the partitions that must be read from the request table in order to satisfy the requested predicate. -
Uses of BlockWriter in com.amazonaws.athena.connectors.gcs
Methods in com.amazonaws.athena.connectors.gcs with parameters of type BlockWriter Modifier and Type Method Description void
GcsMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Used to get the partitions that must be read from the request table in order to satisfy the requested predicate. -
Uses of BlockWriter in com.amazonaws.athena.connectors.google.bigquery
Methods in com.amazonaws.athena.connectors.google.bigquery with parameters of type BlockWriter Modifier and Type Method Description void
BigQueryMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Currently not supporting Partitions since Bigquery having quota limits with triggering concurrent queries and having bit complexity to extract and use the partitions in the query instead we are using limit and offset for non constraints query with basic concurrency limit -
Uses of BlockWriter in com.amazonaws.athena.connectors.hbase
Methods in com.amazonaws.athena.connectors.hbase with parameters of type BlockWriter Modifier and Type Method Description void
HbaseMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Our table doesn't support complex layouts or partitioning so leave this as a NoOp and the SDK will notice that we do not have any partition columns, nor have we set an custom fields using enhancePartitionSchema(...), and as a result the SDK will generate a single place holder partition for us. -
Uses of BlockWriter in com.amazonaws.athena.connectors.hortonworks
Methods in com.amazonaws.athena.connectors.hortonworks with parameters of type BlockWriter Modifier and Type Method Description void
HiveMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
Used to get the hive partitions that must be read from the request table in order to satisfy the requested predicate. -
Uses of BlockWriter in com.amazonaws.athena.connectors.jdbc
Methods in com.amazonaws.athena.connectors.jdbc with parameters of type BlockWriter Modifier and Type Method Description void
MultiplexingJdbcMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
-
Uses of BlockWriter in com.amazonaws.athena.connectors.jdbc.manager
Methods in com.amazonaws.athena.connectors.jdbc.manager with parameters of type BlockWriter Modifier and Type Method Description abstract void
JdbcMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
-
Uses of BlockWriter in com.amazonaws.athena.connectors.kafka
Methods in com.amazonaws.athena.connectors.kafka with parameters of type BlockWriter Modifier and Type Method Description void
KafkaMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Since the kafka partition is not a part of the topic schema as well as not part of topic message data, we should not implement this method. -
Uses of BlockWriter in com.amazonaws.athena.connectors.msk
Methods in com.amazonaws.athena.connectors.msk with parameters of type BlockWriter Modifier and Type Method Description void
AmazonMskMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Since the kafka partition is not a part of the topic schema as well as not part of topic message data, we should not implement this method. -
Uses of BlockWriter in com.amazonaws.athena.connectors.mysql
Methods in com.amazonaws.athena.connectors.mysql with parameters of type BlockWriter Modifier and Type Method Description void
MySqlMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
-
Uses of BlockWriter in com.amazonaws.athena.connectors.neptune
Methods in com.amazonaws.athena.connectors.neptune with parameters of type BlockWriter Modifier and Type Method Description void
NeptuneMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Our table doesn't support complex layouts or partitioning so we simply make this method a NoOp. -
Uses of BlockWriter in com.amazonaws.athena.connectors.oracle
Methods in com.amazonaws.athena.connectors.oracle with parameters of type BlockWriter Modifier and Type Method Description void
OracleMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
If it is a table with no partition, then data will be fetched with single split. -
Uses of BlockWriter in com.amazonaws.athena.connectors.postgresql
Methods in com.amazonaws.athena.connectors.postgresql with parameters of type BlockWriter Modifier and Type Method Description void
PostGreSqlMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
-
Uses of BlockWriter in com.amazonaws.athena.connectors.redis
Methods in com.amazonaws.athena.connectors.redis with parameters of type BlockWriter Modifier and Type Method Description void
RedisMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Even though our table doesn't support complex layouts or partitioning, we need to convey that there is at least 1 partition to read as part of the query or Athena will assume partition pruning found no candidate layouts to read. -
Uses of BlockWriter in com.amazonaws.athena.connectors.saphana
Methods in com.amazonaws.athena.connectors.saphana with parameters of type BlockWriter Modifier and Type Method Description void
SaphanaMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
We are first checking if input table is a view, if it's a view, it will not have any partition info and data will be fetched with single split.If it is a table with no partition, then data will be fetched with single split. -
Uses of BlockWriter in com.amazonaws.athena.connectors.snowflake
Methods in com.amazonaws.athena.connectors.snowflake with parameters of type BlockWriter Modifier and Type Method Description void
SnowflakeMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
Snowflake manual partition logic based upon number of records -
Uses of BlockWriter in com.amazonaws.athena.connectors.sqlserver
Methods in com.amazonaws.athena.connectors.sqlserver with parameters of type BlockWriter Modifier and Type Method Description void
SqlServerMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
Check whether input table is a view or not. -
Uses of BlockWriter in com.amazonaws.athena.connectors.synapse
Methods in com.amazonaws.athena.connectors.synapse with parameters of type BlockWriter Modifier and Type Method Description void
SynapseMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
Partition metadata queries will be extracted from template files, we can check whether the table is partitioned or not using these queries. -
Uses of BlockWriter in com.amazonaws.athena.connectors.teradata
Methods in com.amazonaws.athena.connectors.teradata with parameters of type BlockWriter Modifier and Type Method Description void
TeradataMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest getTableLayoutRequest, QueryStatusChecker queryStatusChecker)
-
Uses of BlockWriter in com.amazonaws.athena.connectors.timestream
Methods in com.amazonaws.athena.connectors.timestream with parameters of type BlockWriter Modifier and Type Method Description void
TimestreamMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Our table doesn't support complex layouts or partitioning so we simply make this method a NoOp. -
Uses of BlockWriter in com.amazonaws.athena.connectors.tpcds
Methods in com.amazonaws.athena.connectors.tpcds with parameters of type BlockWriter Modifier and Type Method Description void
TPCDSMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
We do not support partitioning at this time since Partition Pruning Performance is not part of the dimensions we test using TPCDS. -
Uses of BlockWriter in com.amazonaws.athena.connectors.vertica
Methods in com.amazonaws.athena.connectors.vertica with parameters of type BlockWriter Modifier and Type Method Description void
VerticaMetadataHandler. getPartitions(BlockWriter blockWriter, GetTableLayoutRequest request, QueryStatusChecker queryStatusChecker)
Used to get the partitions that must be read from the request table in order to satisfy the requested predicate.
-