# Data serialization

Data serialization is the process of converting application data structures into a transferable or storable representation, with deserialization recreating the data from that representation.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Using Parquet + Protobufs with Spark

DevFeed: [Using Parquet + Protobufs with Spark](<https://devfeed.tech/articles/using-parquet-protobufs-with-spark-32149.md>)

Original publisher: [Read original article](<https://adambard.com/blog/parquet-protobufs-spark/>)

Published: 2014-08-20T00:00:00Z

Content type: tutorial

Language: en

Sources: [Adam Bard](<https://devfeed.tech/sources/adam-bard.md>)

Topics: [parquet](<https://devfeed.tech/topics/parquet.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [Data serialization](<https://devfeed.tech/topics/data-serialization.md>), [Hadoop](<https://devfeed.tech/topics/hadoop.md>), [Maven](<https://devfeed.tech/topics/maven.md>), [Clojure](<https://devfeed.tech/topics/clojure.md>)

Tags: [clojure](<https://devfeed.tech/tags/clojure.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [data-serialization](<https://devfeed.tech/tags/data-serialization.md>), [hadoop](<https://devfeed.tech/tags/hadoop.md>), [maven](<https://devfeed.tech/tags/maven.md>), [parquet](<https://devfeed.tech/tags/parquet.md>), [query](<https://devfeed.tech/tags/query.md>), [spark](<https://devfeed.tech/tags/spark.md>)

### AI overview

A practical guide to using Parquet with Protobuf data in Spark. It explains the relevant data formats, dependency configuration, protobuf compilation, and the handling of Pair RDDs and Hadoop configuration when saving and loading data.

### Source excerpt

I recently had occasion to test out using Parquet with protobufs. I got some simple tests working, and since I had to do a lot of reading to get to this point, I thought I'd do the world a favor and document the process here.