JSON Files
Infoveave supports adding file formats like Excel, JSON, Delimited, Unstructured, Fixed length files and Multiple files as Datasource in Infoveave.
Steps to Create a Datasource with JSON File
Access Datasources
- To access Infoveave Datasource types, navigate to Studio Datasource.All types of Datasources, created by you or shared with you will be displayed under My Datasources and Shared Datasources.
- To create a new Datasource, click on New Datasource.
Select the Datasource Type
To create the Datasource from JSON file follow the below steps
- Choose JSON under Files as the Datasource type.
- Upload the JSON file from your local storage.Please note that the maximum file size allowed for upload is 5.00 MB.
- Click on Next to configure the data table.
- As the file processing is complete, a tabular preview of the data will be available.
Configure Data Table
Configure your data table in Infoveave, to ensure the ease of identification by data table name. Define the data ingestion type to control how new data integrates with the existing dataset and add calculated columns to enhances your dataset. Follow the below steps on how to configure the data table.
- Provide a name for your Datasource.
- To add additional files to supplement your DataSource, click on Add Files option.
- To customize the Table Name and choose the Data Ingestion Type, click on the Edit icon close to the table name. Configure the following fields within this section
- Table Name Specify the desired table name.
- Ingestion Type Choose from options such as Incremental, Truncate and Reload, or Update to define how new data is integrated into the existing dataset.
- Date Column Exists This checkbox identifies the date column in your dataset by default.
- Add Upload Date If you wish to include an upload date column, select this checkbox. It can be helpful for tracking when new data was added to the dataset.
- Click on the column header of the tabular view to set the following
- Column Type Change the column data type.
- Auto Size All Columns Perfectly fit the data in the column.
- Fit to Chart Set the visibility of the data for quick viewing.
- Enable the Upload the select file option to upload the data to the table structure.
- To make any changes to any of the data table select the required one and click Previous.
- Use the Add Calculated Column feature to create a new column with calculated values not available in the original dataset. This is especially useful for performing custom calculations on your data.
- Configure the below fields to define the calculated column.
- Column Name Enter a meaningful and descriptive name for the new calculated column in the Column Name field.
- Type Choose the appropriate data type for your calculated column from the available options- Text, Integer, Decimal, Boolean, or Date.
- Formula
- In the “Formula” field, construct the formula for your calculated column using the available functions and operators.
- To reference a column from the source, use the “@” symbol followed by the column name (e.g., @SalesAmount).
- Click the Validate button to ensure the formula is correctly formatted and valid.
- After validating the formula, click the Preview button to see how the calculated column will look based on existing data. This helps you verify that the formula produces the expected results.
- Click Add Column button to add calculated column to your data table.
- To define the measures and dimensions on the dataset, click on Save.
- The table schema appears for you to rename the column (if required).
- Click on Save, to save the updated table schema. You will be redirected to Datasource designer.
- The Datasource you created will be available in the designer window.
-
Incremental With the “Incremental” ingestion type, new data is added to the existing dataset without affecting the already loaded data. This mode is ideal when you want to continuously append new records to your dataset without modifying or reloading the existing information. It’s efficient for scenarios where your dataset is frequently updated.
-
Truncate And Reload Selecting “Truncate and Reload” means that the existing dataset is completely replaced with the new data. This mode is useful when you want to refresh your dataset with the most recent information and remove any previous data. It’s particularly suitable for scenarios where the entire dataset needs to be updated periodically.
-
Update In this mode, Infoveave identifies matching records between the new data and the existing dataset based on defined keys. Updated records are replaced, while new records are added. This mode is efficient when you want to refresh your dataset with new information and update existing records without starting from scratch.
Define Measures and Dimensions
Configure columns as measures and dimensions for effective data analysis and visualization. Add Hierarchies to group data in a structured way, allowing for drill-down capabilities and detailed analysis. Establishing relationships between tables is crucial for combining data from different sources and performing comprehensive analyses, and create calculated columns and measures to detailed analysis.
To define measures, dimensions, calculated columns, calculated measures and define relationships follow the below steps
- Identify the specific data table and column for which you intend to create a measure.
- Locate the designated column within the required table and proceed to click on the Add Measure icon associated with that column.
- Upon clicking the Add Dimension icon, an Add Dimension modal window will open, allowing you to configure the properties of the dimension.
- To start defining a relationship, identify the table that you want to establish a relationship between from the list of all available tables.
- Drag and drop the two tables to the designer canvas.
- Identify the column that is common between the two tables (key column). This is the column, based on which you will establish the relationship.
- Define the key column on the newly added table as a dimension.
- Start defining the hierarchy, along with defining the dimension.
- To add calculated column, click on the Add Calculated Column option at the top of the data table.
- Click on the icon or the Add Calculated Measure option to initiate the process of adding a calculated measure.