Microsoft Azure Data Lake Storage Gen2 Connector > Microsoft Azure Data Lake Storage Gen2 data type reference > Parquet data types and transformation data types
  

Parquet data types and transformation data types

Parquet file data types map to transformation data types that the Secure Agent uses to move data across platforms.
The following table lists the Parquet file data types that the Secure Agent supports and the corresponding transformation data types:
Parquet Data Type
Transformation Data Type
Range and Description
Boolean
Integer
TRUE (1) or FALSE (0)
Byte_Array
Binary
Arbitrarily long byte array
Date
Date/Time
January 1, 0001 to December 31, 9999.
Decimal
Decimal
Precision 1 to 28 digits, scale 0 to 28.
You cannot use decimal values with precision greater than 28.
Double
Double
Precision 15
Float
Double
Precision 15
group(LIST)1
Array
Unlimited number of characters.
Int32
Integer
-2,147,483,648 to +2,147,483,647
Int64
Bigint
-9,223,372,036,854,775,808 to +9,223,372,036,854,775,807
8-byte signed integer
Int96
Binary
12-byte signed integer
In an elastic mapping, the data preview displays the time zone of the Secure Agent machine.
Map1
Map
Unlimited number of characters.
String
String
1 to 104,857,600 characters
Precision 4000
Struct1
Struct
Unlimited number of characters.
Time
Date/Time
Time of the day. Precision to microsecond.
Timestamp
Date/Time
January 1, 0001 00:00:00 to December 31, 9999 23:59:59.997. Precision to microsecond.
You cannot set the precision to nanoseconds.
1Applies only to elastic mappings.
The Parquet schema that you specify to read or write a Parquet file must be in smaller case. Parquet does not support case-sensitive schema.

Parquet timestamp data type support

The following table lists the Timestamp data type supported for Parquet file format:
Timestamp Data type
Mapping
Elastic Mapping
Timestamp_micros
Yes
No
Timestamp_millis
Yes
No
Time_millis
Yes
No
Time_micros
Yes
No
int96
Yes
Yes
The Secure Agent does not support the following Parquet data types: