Class GcsUtil


  • public class GcsUtil
    extends Object
    • Method Detail

      • installGoogleCredentialsJsonFile

        public static void installGoogleCredentialsJsonFile​(Map<String,​String> configOptions)
                                                     throws IOException
        Install/place Google cloud platform credentials from AWS secret manager to temp location This is required for dataset api
        Throws:
        IOException
      • createUri

        public static String createUri​(String bucketName,
                                       String path)
        Builds a GCS uri
        Parameters:
        bucketName - bucket name
        path - folder path
        Returns:
        String representation uri
      • createUri

        public static String createUri​(String path)
        Builds a GCS uri
        Parameters:
        path - bucket path
        Returns:
        String representation uri
      • getGlueTable

        public static software.amazon.awssdk.services.glue.model.Table getGlueTable​(TableName tableName,
                                                                                    software.amazon.awssdk.services.glue.GlueClient awsGlue)
        Get AWS Glue table object
        Parameters:
        tableName - table info
        awsGlue - AWS Glue client
        Returns:
        Table object
      • coerce

        public static Object coerce​(org.apache.arrow.vector.FieldVector vector,
                                    Object value)
      • setupNativeEnvironmentVariables

        public static void setupNativeEnvironmentVariables()