pyarrow.dataset.ParquetReadOptions#

class pyarrow.dataset.ParquetReadOptions(dictionary_columns=None, coerce_int96_timestamp_unit=None, binary_type=None, list_type=None)#

Bases: _Weakrefable

Parquet format specific options for reading.

Parameters:

dictionary_columnslist of str, default None

Names of columns which should be dictionary encoded as they are read

coerce_int96_timestamp_unitstr, default None

Cast timestamps that are stored in INT96 format to a particular resolution (e.g. ms). Setting to None is equivalent to ns and therefore INT96 timestamps will be inferred as timestamps in nanoseconds

binary_typepyarrow.DataType, default None

If given, Parquet binary columns will be read as this datatype. This setting is ignored if a serialized Arrow schema is found in the Parquet metadata.

list_typesubclass of pyarrow.DataType, default None

If given, non-MAP repeated columns will be read as an instance of this datatype (either pyarrow.ListType or pyarrow.LargeListType). This setting is ignored if a serialized Arrow schema is found in the Parquet metadata.

__init__(*args, **kwargs)#

Methods

__init__(*args,**kwargs)
equals(self,ParquetReadOptionsother)

Attributes

binary_type
coerce_int96_timestamp_unit
dictionary_columns	dictionary_columns: set
list_type

binary_type#

coerce_int96_timestamp_unit#

dictionary_columns#

dictionary_columns: set

equals(self, ParquetReadOptions other)#

Parameters:

otherpyarrow.dataset.ParquetReadOptions

Returns:

bool

list_type#