# Datomic and Datalog for Complex Data Queries

DevFeed: [Datomic and Datalog for Complex Data Queries](<https://devfeed.tech/articles/datomic-and-content-addressable-techniques-an-ultimate-data-wonderland-29182.md>)

Original publisher: [Read original article](<https://www.latacora.com/blog/2024/09/13/datomic-and-content-addressable-techniques/>)

Published: 2024-09-13T17:00:00Z

Content type: article

Language: en

Sources: [Latacora](<https://devfeed.tech/sources/latacora.md>)

Topics: [Databases](<https://devfeed.tech/topics/databases.md>), [data](<https://devfeed.tech/topics/data.md>), [Security](<https://devfeed.tech/topics/security.md>), [Clojure](<https://devfeed.tech/topics/clojure.md>), [Programming](<https://devfeed.tech/topics/programming.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [analysis](<https://devfeed.tech/tags/analysis.md>), [aws](<https://devfeed.tech/tags/aws.md>), [clojure](<https://devfeed.tech/tags/clojure.md>), [data](<https://devfeed.tech/tags/data.md>), [database](<https://devfeed.tech/tags/database.md>), [programming](<https://devfeed.tech/tags/programming.md>), [s3](<https://devfeed.tech/tags/s3.md>), [security](<https://devfeed.tech/tags/security.md>)

## AI overview

Latacora describes moving from service-configuration snapshots stored in Amazon S3 toward Datomic, whose immutable facts and Datalog queries support complex questions across security data and relationships between resources.

## Source excerpt

Latacora collects and analyzes data about services our clients use. You may have read about our approach to building security tooling, but the tl;dr is we make requests to all the (configuration metadata) read-only APIs available to us and store the results in S3. We leverage the data to understand our clients' infrastructure and identify security issues and misconfigurations. We retain the files ("snapshots") to support future IR/forensics efforts. This approach has served us well, but the limited scope of a snapshot meant there was always a problem of first needing to figure out which files to look at. We love aws s3 sync and grep as much as anyone but security analysis requires looking for complex relationships between resources; text search is, at best, only a Bloom filter. What we really wanted was a performant way to ask any question across all the data we have for a client that would support complex queries using logic programming.