Class SnowflakeRecordHandler

    • Method Detail

      • readWithConstraint

        public void readWithConstraint​(BlockSpiller spiller,
                                       ReadRecordsRequest recordsRequest,
                                       QueryStatusChecker queryStatusChecker)
                                throws Exception
        Used to handle data transfer between Snowflake and Athena, supporting both direct query and S3 export paths, converts to arrow format, and manages spillover logic.
        Overrides:
        readWithConstraint in class JdbcRecordHandler
        Parameters:
        spiller - A BlockSpiller that should be used to write the row data associated with this Split. The BlockSpiller automatically handles chunking the response, encrypting, and spilling to S3.
        recordsRequest - Details of the read request, including: 1. The Split 2. The Catalog, Database, and Table the read request is for. 3. The filtering predicate (if any) 4. The columns required for projection.
        queryStatusChecker - A QueryStatusChecker that you can use to stop doing work for a query that has already terminated
        Throws:
        Exception - Throws an Exception
      • constructArrowReader

        protected org.apache.arrow.vector.ipc.ArrowReader constructArrowReader​(String uri)