Class SnowflakeRecordHandler

    • Method Detail

      • readWithConstraint

        public void readWithConstraint​(BlockSpiller spiller,
                                       ReadRecordsRequest recordsRequest,
                                       QueryStatusChecker queryStatusChecker)
                                throws Exception
        Used to handle data transfer between Snowflake and Athena, supporting both direct query and S3 export paths, converts to arrow format, and manages spillover logic.
        Overrides:
        readWithConstraint in class JdbcRecordHandler
        Parameters:
        spiller - A BlockSpiller that should be used to write the row data associated with this Split. The BlockSpiller automatically handles chunking the response, encrypting, and spilling to S3.
        recordsRequest - Details of the read request, including: 1. The Split 2. The Catalog, Database, and Table the read request is for. 3. The filtering predicate (if any) 4. The columns required for projection.
        queryStatusChecker - A QueryStatusChecker that you can use to stop doing work for a query that has already terminated
        Throws:
        Exception - Throws an Exception
      • constructArrowReader

        protected org.apache.arrow.vector.ipc.ArrowReader constructArrowReader​(String uri,
                                                                               org.apache.arrow.vector.types.pojo.Schema schema)
      • createCredentialsProvider

        public CredentialsProvider createCredentialsProvider​(String secretName,
                                                             software.amazon.awssdk.awscore.AwsRequestOverrideConfiguration requestOverrideConfiguration)
        Description copied from interface: FederationRequestHandler
        Factory method to create CredentialsProvider. Subclasses can override this to provide custom credential provider implementations (e.g., SnowflakeCredentialsProvider).
        Parameters:
        secretName - The secret name to retrieve credentials from
        requestOverrideConfiguration - Optional AWS request override configuration
        Returns:
        CredentialsProvider instance