# druid

Published articles for druid.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## REDstack: An Open-Source Tool for Provisioning Kerberized Hadoop Clusters on OpenStack

DevFeed: [REDstack: An Open-Source Tool for Provisioning Kerberized Hadoop Clusters on OpenStack](<https://devfeed.tech/articles/redstack-20397.md>)

Original publisher: [Read original article](<https://target.github.io/big%20data%20infrastructure/REDstack-Hadoop-as-a-Service>)

Author: Target Brands, Inc

Published: 2017-12-07T06:00:00Z

Content type: article

Language: en

Sources: [Target](<https://devfeed.tech/sources/target.md>)

Topics: [big-data](<https://devfeed.tech/topics/big-data.md>), [Provisioning](<https://devfeed.tech/topics/provisioning.md>), [Hadoop](<https://devfeed.tech/topics/hadoop.md>), [openstack](<https://devfeed.tech/topics/openstack.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>), [Python](<https://devfeed.tech/topics/python.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Docker](<https://devfeed.tech/topics/docker.md>)

Tags: [big-data](<https://devfeed.tech/tags/big-data.md>), [big-data-infrastructure](<https://devfeed.tech/tags/big-data-infrastructure.md>), [chef](<https://devfeed.tech/tags/chef.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [docker](<https://devfeed.tech/tags/docker.md>), [druid](<https://devfeed.tech/tags/druid.md>), [elasticsearch](<https://devfeed.tech/tags/elasticsearch.md>), [hadoop](<https://devfeed.tech/tags/hadoop.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [openstack](<https://devfeed.tech/tags/openstack.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [provisioning](<https://devfeed.tech/tags/provisioning.md>), [python](<https://devfeed.tech/tags/python.md>)

### AI overview

REDstack is an open-source sandbox tool for Big Data development that provisions kerberized Hadoop clusters on OpenStack. It combines a cookbook for installing and configuring cluster components with a Python orchestration application that manages resource provisioning, Chef deployment, and component installation.

### Source excerpt

REDstack is Now Open Source! We are officially open sourcing REDstack, our sandbox tool for Big Data development at Target. What is REDstack? REDstack is a tool for provisioning kerberized clusters on OpenStack. We created it with four goals in mind: Provide a secured environment, with the ability to leverage preconfigured LDAP and Kerberos servers. Out of the box usability, allowing you to log in with preconfigured user accounts. Custom user management utilities to administer the cluster. Provide a fully customizable experience, everything is a configuration option in your build files: Cluster size, node sizes, types of nodes and node roles, Hadoop configurations, heap sizes, and components, All users, passwords, and secure assets. Components REDstack is made up of two major components: hdp-cloud - The cookbook The cookbook is used by the application itself to install components and lay down cluster configuration. The cookbook can be used independently of REDstack to manually provision a cluster. REDstack - The orchestration component REDstack is a python application that performs all of the high-level complexities and timings associated with a full Hadoop installation: Orchestrates the provisioning of resources over OpenStack APIs, Controls and monitors parallel Chef deployment across the cluster, Manages and monitors cluster component install over HTTPS requests. REDstack is bundled with a Docker image, where the configs are set up locally before an installation, and all of the dependencies are updated and configured. How to Get Started Head over to the repository at https://github.com/target/redstack and follow along. The repo has instructions on how to build and configure the clusters using the included Docker image. History of the Project Target's Big Data Platform Team manages multiple Big Data environments, with hundreds of nodes and many PB's of data. As mentioned in our prior blog posts, we depend heavily on Chef as a core part of our CI/CD pipeline. Durin