# The HackerEarth Data Challenge

DevFeed: [The HackerEarth Data Challenge](<https://devfeed.tech/articles/the-hackerearth-data-challenge-19984.md>)

Original publisher: [Read original article](<http://engineering.hackerearth.com/2013/09/13/the-hackerearth-data-challenge/>)

Published: 2013-09-13T00:00:00Z

Content type: article

Language: en

Sources: [HackerEarth](<https://devfeed.tech/sources/hackerearth.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [JSON](<https://devfeed.tech/topics/json.md>), [Database](<https://devfeed.tech/topics/database.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [Back end](<https://devfeed.tech/topics/backend.md>), [servers](<https://devfeed.tech/topics/servers.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [backend](<https://devfeed.tech/tags/backend.md>), [code](<https://devfeed.tech/tags/code.md>), [coding](<https://devfeed.tech/tags/coding.md>), [data](<https://devfeed.tech/tags/data.md>), [json](<https://devfeed.tech/tags/json.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [server](<https://devfeed.tech/tags/server.md>), [servers](<https://devfeed.tech/tags/servers.md>), [technology-stack](<https://devfeed.tech/tags/technology-stack.md>)

## AI overview

The article announces the HackerEarth Data Challenge, inviting participants to analyze more than 800,000 JSON records collected by monitoring services and stored in a schema-less RethinkDB database. It describes the available servers, tables, access details, and a sample Python-based data-reading workflow.

## Source excerpt

40,000+ programmers use HackerEarth. Everyday, people from all over India and other countries submit code on HackerEarth, solve problems and participate in online coding tests. Our CodeFactory server has processed over 500,000 requests till now. There are different types of challenges running every month. The technology stack consists of multiple servers of different types e.g. search-server, realtime-server, web-server, log-server, etc. running at any time. Over 100,000 lines of code are running to serve your requests, and we deploy a dozen times everyday. And we have been able to achieve that with relatively very high uptime all along. To make this possible, we have written many monitoring services for our backend. The public status page listing few of the services is now publicly available at http://status.hackerearth.com/. To make it even more interesting, we are making the data collected by status monitoring services public. All the data is in JSON format, they are over 800,000 in number, and they are available in a schema-less database - RethinkDB. Are you curious how that data looks like? There might be gold-rush in there, and we invite you to find that gold, to find something interesting out of the data and show what you can do with that in hand. There are umpteen stories to uncover, you just need to dig! ###Data Access The data is available in JSON format in RethinkDB. Following are the details of host, database and table: Endpoint: status-data-challenge.hackerearth.com Port: 80 Database name: careerstack Tables hackerearth_status: for HackerEarth webserver api_status: for HackerEarth API realtime_status: for Realtime server code_checker_status: for CodeChecker server celery_status: for task queue rabbitmq_status: for message queue Web UI: http://status-data-challenge.hackerearth.com:8080/ To get started, you need to install rethinkdb-client drivers on your machine. The query language is very simple and easy to get. You should go through RethinkDB QL for ge