# Using Parquet + Protobufs with Spark

DevFeed: [Using Parquet + Protobufs with Spark](<https://devfeed.tech/articles/using-parquet-protobufs-with-spark-32149.md>)

Original publisher: [Read original article](<https://adambard.com/blog/parquet-protobufs-spark/>)

Published: 2014-08-20T00:00:00Z

Content type: tutorial

Language: en

Sources: [Adam Bard](<https://devfeed.tech/sources/adam-bard.md>)

Topics: [parquet](<https://devfeed.tech/topics/parquet.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [Data serialization](<https://devfeed.tech/topics/data-serialization.md>), [Hadoop](<https://devfeed.tech/topics/hadoop.md>), [Maven](<https://devfeed.tech/topics/maven.md>), [Clojure](<https://devfeed.tech/topics/clojure.md>)

Tags: [clojure](<https://devfeed.tech/tags/clojure.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [data-serialization](<https://devfeed.tech/tags/data-serialization.md>), [hadoop](<https://devfeed.tech/tags/hadoop.md>), [maven](<https://devfeed.tech/tags/maven.md>), [parquet](<https://devfeed.tech/tags/parquet.md>), [query](<https://devfeed.tech/tags/query.md>), [spark](<https://devfeed.tech/tags/spark.md>)

## AI overview

A practical guide to using Parquet with Protobuf data in Spark. It explains the relevant data formats, dependency configuration, protobuf compilation, and the handling of Pair RDDs and Hadoop configuration when saving and loading data.

## Source excerpt

I recently had occasion to test out using Parquet with protobufs. I got some simple tests working, and since I had to do a lot of reading to get to this point, I thought I'd do the world a favor and document the process here.