Reading Parquet Files

Fire insights supports reading from several file formats including Parquet files. Parquet files have schema embedded in them. Fire Insights is able to extract schema of Parquet files automatically.

Datasets

The existing datasets are displayed in the DataSets page of specific application.

Dataset

Dataset Creation

Navigate to the “Datasets” tab in your application where you want to create a new dataset. Click on the “Create” button and choose “Dataset”. We now create a dataset for people.parquet. It is a parquet file.

Dataset

In the ‘Create DataSet’ page fill in the required fields as below.

Dataset

Specify the name of the dataset you are creating.

After specifying name and path, click the ‘Update Sample data schema’ button. This brings up the sample data, extracts the schema and displays it. Below we see that there are 2 fields : age and name. Age is of type integer and name is of type string.

Dataset

Clicking the ‘Save’ button creates the new DataSet for us.

Dataset

Now you are ready to use the dataset in your workflows.