awesome-parquet

Useful resources for using the Parquet format

GitHub Stars

Curated Resources

Use this list with your AI agent

Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:

"Show me command-line resources from awesome-parquet"

Agentsor File ContractsCommand-line
Python CLI for checking a Parquet file against an explicit TOML contract.
DataFusion CLICommand-line
A single, dependency-free executable that can read and write Parquet files, with a SQL interface.
DatanomyTerminal UI
A terminal-based tool for visualizing a Parquet file's metadata and structure.
DatasetteWeb
A tool to explore datasets, with support for reading Parquet files.
DataStudioWeb
Explore and visualize data, entirely in your browser.
DataTUITerminal UI
A keyboard-first terminal UI for exploring Parquet with tabs, sorting, filtering, SQL (Polars), and more.

Apache Arrow C++C++
A library with support for reading and writing Parquet files.
arrowR
The
Arrow GLibC GLib
A wrapper library for Arrow C++.
cudfJava
Java bindings for cudf, to be able to process large amounts of data on a GPU.
datafusionRust
An extensible query engine written in Rust that can read/write Parquet files using SQL or a DataFrame API.
DuckDBC GLib
An in-process database library that supports reading and writing Parquet files.

Apache Parquet DocumentationDocumentation
The official documentation for Apache Parquet.
Column Storage for the AI EraBlogs
A proposal by the creator of Parquet to better support AI workloads by adding encodings and metadata.
Handling Parquet FilesParquet engineering
Recommendations about the row group size and the Parquet file sizes.
Hyparquet: The Quest for Instant DataBlogs
6 optimization tricks to read Parquet files faster in the browser.
icem7Blogs
Un blog sur les outils de data science, avec des articles de fond sur Parquet.
I spent 8 hours learning Parquet. Here’s what I discoveredBlogs
A graphical description of the Parquet format.

F3
A data file format that is designed with efficiency, interoperability, and extensibility in mind.
GeoParquet
Specification for storing geospatial vector data (point, line, polygon) in Parquet.
Iceberg
A high-performance format for huge analytic tables that supports Parquet as one of its storage formats.
Lance
Modern columnar data format for ML and LLMs.
Nimble
File format for storage of large columnar datasets.
ORC
Self-describing type-aware columnar file format designed for Hadoop workloads.

Showing a sample of 88 resources. View the full list on GitHub →