[ Web Proxy ]

Viewing: https://arrow.apache.org/docs/python/generated/../api/../generated/../api/formats.html#json-files

[Back] [Original]

Tabular File Formats — Apache Arrow v25.0.1

Back to top

Section Navigation

Implementations
Python
API Reference
Tabular File Formats

Tabular File Formats#

CSV Files#

`ConvertOptions`([check_utf8,column_types,...])	Options for converting CSV data.
`CSVStreamingReader`()	An object that reads record batches incrementally from a CSV file.
`CSVWriter`(sink,Schemaschema,...)	Writer to create a CSV file.
`ISO8601`	A special object indicating ISO-8601 parsing.
`ParseOptions`([delimiter,quote_char,...])	Options for parsing CSV files.
`ReadOptions`([use_threads,block_size,...])	Options for reading CSV files.
`WriteOptions`([include_header,batch_size,...])	Options for writing CSV files.
`open_csv`(input_file[,read_options,...])	Open a streaming reader of CSV data.
`read_csv`(input_file[,read_options,...])	Read a Table from a stream of CSV data.
`write_csv`(data,output_file[,write_options])	Write record batch or table to a CSV file.
`InvalidRow`(expected_columns,actual_columns,...)	Description of an invalid row in a CSV file.

Feather Files#

`read_feather`(source[,columns,use_threads,...])	Read a pandas.DataFrame from Feather format.
`read_table`(source[,columns,memory_map,...])	Read a pyarrow.Table from Feather format
`write_feather`(df,dest[,compression,...])	Write a pandas.DataFrame to Feather format.

JSON Files#

`ReadOptions`([use_threads,block_size])	Options for reading JSON files.
`ParseOptions`([explicit_schema,...])	Options for parsing JSON files.
`open_json`(input_file[,read_options,...])	Open a streaming reader of JSON data.
`read_json`(input_file[,read_options,...])	Read a Table from a stream of JSON data.

Parquet Files#

`ParquetDataset`(path_or_paths[,filesystem,...])	Encapsulates details of reading a complete Parquet dataset possibly consisting of multiple files and partitions in subdirectories.
`ParquetFile`(source,*[,metadata,...])	Reader interface for a single Parquet file.
`ParquetWriter`(where,schema[,filesystem,...])	Class for incrementally building a Parquet file for Arrow tables.
`filters_to_expression`(filters)	Check if filters are well-formed and convert to an `Expression`.
`read_table`(source,*[,columns,...])	Read a Table from Parquet format
`read_metadata`(where[,memory_map,...])	Read FileMetaData from footer of a single Parquet file.
`read_pandas`(source[,columns])	Read a Table from Parquet format, also reading DataFrame index values if known in the file metadata
`read_schema`(where[,memory_map,...])	Read effective Arrow schema from Parquet file metadata.
`write_metadata`(schema,where[,...])	Write metadata-only Parquet file from schema.
`write_table`(table,where[,row_group_size,...])	Write a Table to Parquet format.
`write_to_dataset`(table,root_path[,...])	Wrapper around dataset.write_dataset for writing a Table to Parquet format by partitions.

Parquet Metadata#

`FileMetaData`()	Parquet metadata for a single file.
`RowGroupMetaData`()	Metadata for a single row group.
`SortingColumn`(intcolumn_index,...)	Sorting specification for a single column.
`ColumnChunkMetaData`()	Column metadata for a single row group.
`Statistics`()	Statistics for a single column in a single row group.
`ParquetSchema`	A Parquet schema.
`ColumnSchema`	Schema for a single column.
`ParquetLogicalType`()	Logical type of parquet type.

Encrypted Parquet Files#

`CryptoFactory`(kms_client_factory)	A factory that produces the low-level FileEncryptionProperties and FileDecryptionProperties objects, from the high-level parameters.
`KmsClient`()	The abstract base class for KmsClient implementations.
`KmsConnectionConfig`([kms_instance_id,...])	Configuration of the connection to the Key Management Service (KMS)
`EncryptionConfiguration`(footer_key[,...])	Configuration of the encryption, such as which columns to encrypt
`DecryptionConfiguration`([cache_lifetime])	Configuration of the decryption, such as cache timeout.
`create_encryption_properties`(footer_key,*)	Create FileEncryptionProperties using a direct footer key.
`create_decryption_properties`(footer_key,*)	Create FileDecryptionProperties using a direct footer key.

ORC Files#

`ORCFile`(source)	Reader interface for a single ORC file
`ORCWriter`(where,*[,file_version,...])	Writer interface for a single ORC file
`read_table`(source[,columns,filesystem])	Read a Table from an ORC file.
`write_table`(table,where,*[,file_version,...])	Write a table into an ORC file.

previous

pyarrow.flight.CallInfo

next

pyarrow.csv.ConvertOptions

Web Proxy Viewer | New URL | Original Page