Reading and Writing from ElasticSearch

Elastic Search is often used for indexing, searching and analyzing datasets. Fire Insights makes it easy to read data from Elastic Search, clean it and transform it as needed.

Elasticsearch-hadoop provides native integration between Elasticsearch and Apache Spark. In the example below we will first load data from HDFS into Elastic Search and then read it back into Apache Spark from Elastic Search.

If your data is already in Elastic Search, skip to “Workflow for Reading data from Elastic Search”.

Note: Documentation processor is just for documentation purposes.

Workflow Execution

When the example workflow above is executed, it reads in the dataset from HDFS and saves it into Elastic Search.

Dataset

Workflow Execution

When the example workflow above is executed, it reads in the index from Elastic Search and displays the first few lines.

Dataset