Class GcsConstants


  • public class GcsConstants
    extends Object
    • Field Detail

      • GCS_SECRET_KEY_ENV_VAR

        public static final String GCS_SECRET_KEY_ENV_VAR
        An environment variable in the deployed Lambda which is name of the secret in AWS Secrets Manager. contains credential keys/values in the form of JSON to access the GCS buckets/objects
        See Also:
        Constant Field Values
      • SSL_CERT_FILE_LOCATION

        public static final String SSL_CERT_FILE_LOCATION
        A ssl file location constant to store the SSL certificate The file location is fixed at /tmp directory to retrieve ssl certificate location
        See Also:
        Constant Field Values
      • GOOGLE_SERVICE_ACCOUNT_JSON_TEMP_FILE_LOCATION

        public static final String GOOGLE_SERVICE_ACCOUNT_JSON_TEMP_FILE_LOCATION
        A file name constant to store the GCP service account's credential JSON The file location is fixed at /tmp directory and the file used to access gs://.. like URI to read files to retrieve metadata and fetch data
        See Also:
        Constant Field Values
      • GOOGLE_SERVICE_ACCOUNT_JSON_TEMP_FILE_LOCATION_VALUE

        public static final String GOOGLE_SERVICE_ACCOUNT_JSON_TEMP_FILE_LOCATION_VALUE
        See Also:
        Constant Field Values
      • CLASSIFICATION_GLUE_TABLE_PARAM

        public static final String CLASSIFICATION_GLUE_TABLE_PARAM
        Glue Table classification to specify type of the data a Glue Table represents. For example, PARQUET, CSV, etc.
        See Also:
        Constant Field Values
      • PARTITION_PATTERN_KEY

        public static final String PARTITION_PATTERN_KEY
        Partition pattern parameter added as an additional parameter in a Glue Table to identify partition folder pattern after the Table's location URI. A pattern consists of storage prefix with one or more partition key variable placeholders For example, for partition fields state and city of type String, partition folder can be like the following:
        • state=Texas/city=Houston
        • state=California/city=Los Angeles
        • ....
        In such case the partition.pattern should look like the following:

        state=${state}/city=${city}
        Where {state} and {city} are the partition key variable placeholders values of which will be determined at runtime

        See Also:
        Constant Field Values