Sunday, April 28, 2019

Parquet read and write



https://arrow.apache.org/docs/python/parquet.html

Save to parquet

import pyarrow as pa
table = pa.Table.from_pandas(df)
import pyarrow.parquet as pq
pq.write_table(table, 'example.parquet')


Read from parquet

table2 = pq.read_table('example.parquet')

No comments:

Post a Comment

Loud fan of desktop

 Upon restart the fan of the desktop got loud again. I cleaned the desktop from the dust but it was still loud (Lower than the first sound) ...