Extracting meaningful insights from the millions of rows of data collected in real-time is always a huge challenge for organizations globally. Data Visualisations Tools like Power BI allow business teams to build visually stunning and informative dashboards & reports to keep a tab on their goals & objectives. Power BI provides a collection of features that simplifies the decision-making process.
One of the important sources of data today is the web. JSON is a common format in which the data is read from the data server and displayed on a web page. You can easily set up the Power BI JSON connection and start building your reports.
In this article, you will learn how to effectively set up the Power BI JSON connection using 3 different methods.
What is Power BI?
Image Source
Power BI is a Data Visualization and Business Intelligence tool that transforms data from a variety of data sources into interactive dashboards and BI reports. The Power BI suite offers multiple software, connectors, and services Power BI Desktop, Power BI services based on SaaS, and Power BI mobile apps available on a variety of platforms. This set of services is used by business users to consume data and create BI reports.
Key Features of Power BI
- DAX Functions: The DAX function is a Data Analysis expression included in Power BI. These analytic functions are predefined codes for performing analytics-related operations on your data. For instance, Power BI Lookup Value is a DAX Filter function that searches a table for the value of a column, given a set of values for other columns in the same table. Currently, there are about 200 functions in the Power BI function library.
- Data Security: Power BI protects your data with industry-leading data security features such as sensitivity labeling, end-to-end encryption, and real-time access monitoring.
- Flexibility: Power BI allows you to extract data from a variety of sources. From On-premise to Cloud-based database, structured to unstructured data Power BI allows you to work with a broader range of datasets.
- Data Filteration: In Power BI, you can create data subsets from several databases and work only on the filtered data that has contextual relevance.
What is JSON?
Image Source
JSON (JavaScript Object Notation) is a lightweight format for storing and transferring data from a server to a web page. Based on the JavaScript programming language standard ECMA262, 3rd edition, JSON is easy to read & write data exchange format. In JSON, the data is stored in a key-value pair where the curly braces contain the object, and each name is followed by a colon. Commas are used to separate multiple key-value pairs. Square brackets are used to hold an array where each value is separated by a comma.
Key Features of JSON
- Less Redundancy: Unlike XML, JSON follows a compact style and improves user readability. When working with complex systems, JSON tends to make significant improvements.
- Fast: The JSON parsing process is faster than XML because the XML DOM manipulation library requires additional memory to process large XML files. However, because JSON requires less data, it ultimately reduces costs and speeds up parsing.
- Easy-to-read: The JSON structure is easy to read and easy. You can easily map domain objects regardless of the programming language you use. It uses conventions similar to the C-family of languages, including C, C++, C#, Java, JavaScript, Perl, Python, and many others.
- Structured Data: Map data structures are used in JSON, but XML follows a tree structure. Key-value pairs constrain the task but make it easier to predict and understand the model.
Why Connect Power BI to JSON?
Power BI allows you to work with a broader range of datasets in various formats such as Excel, CSV, JSON, etc. JSON has become a popular data format as it is supported by most browsers and backend technologies. Its easy creation and manipulation allow JSON to gain JSON momentum in the programming of API code and web services. Hence, you may find yourself extracting JSON data from the web for your business analysis. Similar to XML, JSON is self-describing and uses a tagging method “to tell” about the data. However, it is focused on providing a flexible, yet organized methods of exchanging data.
Using manual scripts and custom code to move data into the warehouse is cumbersome. Changing API endpoints and limits, ad-hoc data preparation and inconsistent schema makes maintaining such a system a nightmare. Hevo’s reliable no-code data pipeline platform enables you to set up zero-maintenance data pipelines that just work.
Wide Range of Connectors – Instantly connect and read data from 150+ sources including SaaS apps and databases, and precisely control pipeline schedules down to the minute.
In-built Transformations – Format your data on the fly with Hevo’s preload transformations using either the drag-and-drop interface or our nifty python interface. Generate analysis-ready data in your warehouse using Hevo’s Postload Transformation
Near Real-Time Replication – Get access to near real-time replication for all database sources with log-based replication. For SaaS applications, near real-time replication is subject to API limits.
Auto-Schema Management – Correcting improper schema after the data is loaded into your warehouse is challenging. Hevo automatically maps source schema with destination warehouse so that you don’t face the pain of schema errors.
Transparent Pricing – Say goodbye to complex and hidden pricing models. Hevo’s Transparent Pricing brings complete visibility to your ELT spend. Choose a plan based on your business needs. Stay in control with spend alerts and configurable credit limits for unforeseen spikes in the data flow.
24×7 Customer Support – With Hevo you get more than just a platform, you get a partner for your pipelines. Discover peace with round-the-clock “Live Chat” within the platform. What’s more, you get 24×7 support even during the 14-day free trial.
Security – Discover peace with end-to-end encryption and compliance with all major security certifications including HIPAA, GDPR, SOC-2.
Get started for Free with Hevo!
Methods to Establish Power BI JSON Connection
You can set up the Power BI JSON Connection using the following methods:
Power BI JSON Connection Method 1: Load a Local JSON File from Power BI Desktop
In this Power BI JSON Connection example, a sample JSON file is used that is sourced from the NASDAQ stock exchange. To download this file, you can visit the NASDAQ’s On-Demand Data page. This sample file contains NASDAQ stocks-related data in attribute-value pairs. The red box highlights some of these attributes and values such as StartTime of 06/15/2011 09:29:05.698 or an AskQuantity of 100.
Image Source
Follow the simple instructions given below to set up the Power BI JSON connection:
Step 1: Start the Get Data Wizard
- For connecting Power BI JSON locally, open up Power BI Desktop. To import your local JSON file to Power BI, you need to start the Get Data Wizard. You can do that in 2 ways:
- Click on the Get Data Splash screen option.
Image Source
- Click on the Get Data tab from the top menu and then click on the More… option.
Image Source
Step 2: Select the Data Source and Desired JSON File
- Step 1: Now, a Get Data dialog box will pop up on your screen. Select JSON as your data source and click on the Connect button.
Image Source
- Step 2: Browse to the location where you have saved your JSON Data file and select it. Click on the Open button to start your Power BI JSON connection.
Image Source
- Step 3: You also import JSON files directly from the web by entering the required URL.
Image Source
Step 3: Link and Transform File using Power BI Query Editor
Starting the Power BI Connection will automatically launch the Power BI Query Editor. You will notice a Record is stated under the List column. Often Power BI recognizes a set of Record links in the initial stage when you import the JSON Data. By clicking on these records you can further drill down into the JSON file structure.
Image Source
Step 4: Drilldown to Records and Convert Rows
- Step 1: Click on the Record link and notice that Power BI will present you with the highest level of details within the JSON file.
Image Source
- Step 2: Among various details such as Start Time, End Time, etc, observe that the Quotes row has a hyperlinked “Links” option. Hover over it and you will notice a list of records. Finally, click on this option to view the records.
- Step 3: Now you can convert this list of records into the rows of a table. Click on the To Table option present on the top left corner.
Image Source
- Step 4: You can specify the delimiters used in your data as well as how Power BI should handle the extra columns. Click on the OK button once you are done.
Image Source
Step 5: Split into Columns
- Step 1: Once you have converted your records, a single column will appear. Click on the Split Columns button present on the column header.
Image Source
- Step 2: A list of possible columns is displayed. Select the columns according to your use case and click on the OK button. To set the current column as the prefix, check the box next to the “Use original column name as prefix” option.
Image Source
- Step 3: A table containing the desired columns will appear. You can also see the list of steps you applied to get to this stage on the Applied Steps feature present on the right-side vertical menu. By clicking on the X option you can also undo the steps you don’t like and again set up your table.
Image Source
- Step 4: Finally, click on the Close & Apply option available on the top left corner of your screen. This will return your data to the main Data Visualisation Window.
Step 6: Create Visualization
After setting up your Power BI JSON connection, you will now land upon the Reports View. Using various Filters, Charts & Graphs, and Value Fields you can create visually stunning reports based on your JSON data.
Image Source
Power BI JSON Connection Method 2: Importing JSON data with Power BI Rest API Calls
You can also set up a Power BI JSON Connection using the RESTful API Calls. You can easily extract data from Websites that allow Restful APIs for data access and use that data in several formats such as JSON and CSV. For this Power BI JSON Connection example, data about the 8 different houses from the TV Show Game of Thrones is extracted from the Anapioficeandfire Website.
- Step 1: Click on the above link and you will observe the following in your browser window.
Image Source
This website provides an API to access a collection of books, characters, and houses from the novel series: A Song Of Ice And Fire.
- Step 2: Go to Power BI Desktop and click on the Get Data option present on the top ribbon. Click on the More… option.
- Step 3: Type “Web” in the search box and select web as your data source. Click on the Connect button to start your Power BI JSON connection.
Image Source
Image Source
- Step 5: This will automatically open up the Power Bi Query Editor containing the data set in the form of a JSON file having 10 records. Each of these records describes one of the houses in the novel series. Similar to locally setting the Power BI JSON connection, click on the To Table option present on the top left corner.
Image Source
- Step 6: Click on the “<->” symbol present alongside the Column Name to split the columns.
Image Source
- Step 7: Select the column you desire to be placed in the table and click on the OK button.
Image Source
- Step 8: After expanding the columns, notice that the “titles” and “seats” columns still need to be expanded further. To do that, click on the “<->” button at the top right of the column name as shown below:
Image Source
After expanding both the “title” and the “seats” column, your table should look like this:
Image Source
You can also observe several duplicate records appear when you expand the “title” and “seats” columns. This is possible as one house can have multiple titles and seats.
- Step 9: Click on the “Close & Apply” button available on the top left corner to open this dataset in the Query window.
- Step 10: After the Power BI JSON connection is set up, you can now start creating visualizations. In this Power BI JSON connection example, a simple pie chart displaying the distribution of ancestral weapons by region is created. To do this, click on the “pie” chart option from visualizations. Now, in the “Legend” field, add “region” and in the values field, add “Count of ancestral Weapons”.
Image Source
The following pie chart is created showing that almost 50% of the ancestral weapons belong to the region “The Vale”. Similarly, 11.1% of weapons belong to each of the “The Reach” and “The North” regions.
Image Source
This completes the Power BI JSON connection via the REST API calls.
Power BI JSON Connection Method 3: Load a Local JSON File from Power Query Online
Apart from the Power BI Desktop version, you can also import the Local JSON file using the Power Query Online version. You can easily set up the Power BI JSON connection via Power BI Online by following the simple steps given below:
- Step 1: Go to the Data Sources page and select JSON.
- Step 2: In the Connection Settings, enter the location of your local JSON file stored on your computer.
Image Source
- Step 3: From Data Gateway, choose your on-premise data gateway.
- Step 4: Enter your credentials when asked for authorization purposes and click on the Next button. This will launch the Power Query Editor automatically. You can now follow the same steps as discussed in the above 2 methods to set up your table and create the desired visualizations.
How to Troubleshoot Power BI JSON connections?
While working with the Power BI JSON connection, you may get the following error message if the file is invalid. It could happen if it’s not really a JSON file, or is malformed. Another case might be that you are trying to load a JSON Lines file.
Image Source
For cases when you are loading a JSON Lines file, the following sample M code converts all JSON Lines input to a single flattened table automatically:
let
// Read the file into a list of lines
Source = Table.FromColumns({Lines.FromBinary(File.Contents("C:json-lines-example.json"), null, null)}),
// Transform each line using Json.Document
#"Transformed Column" = Table.TransformColumns(Source, {"Column1", Json.Document})
in
#"Transformed Column"
Note that you will require to use an Expand operation to combine the lines together.
Conclusion
In this article, you have learned how to effectively set up the Power BI JSON connection using 3 different methods. Power BI allows you to work with data in several formats such as CSV, Excel, and JSON. JSON is a common format when extracting data from the web. Both Power BI Desktop & Power BI Query Online supports the Power BI JSON connection. Apart from importing your locally stored JSON files, Power BI also allows you to extract data from the web via RESTful API calls.
As you collect and manage your data across several applications and databases in your business, it is important to consolidate it for complete performance analysis of your business. To achieve this you need to assign a portion of your engineering bandwidth to Integrate data from all sources, Clean & Transform it, and finally, Load it to a Cloud Data Warehouse, BI Tool like Power BI, or a destination of your choice for further Business Analytics. All of these challenges can be comfortably solved by a Cloud-based ETL tool such as Hevo Data.
Visit our Website to Explore Hevo
Hevo Data, a No-code Data Pipeline can seamlessly transfer data from a vast sea of 100+ sources to a Data Warehouse, BI Tool like Power BI, or a Destination of your choice. It is a reliable, completely automated, and secure service that doesn’t require you to write any code!
If you are using Power BI as your Data Analytics & Business Intelligence platform and searching for a no-fuss alternative to Manual Data Integration, then Hevo can effortlessly automate this for you. Hevo, with its strong integration with 100+ sources and BI tools(Including 40+ Free Sources), allows you to not only export & load data but also transform & enrich your data & make it analysis-ready in a jiffy.
Want to take Hevo for a ride? Sign Up for a 14-day free trial and simplify your Data Integration process. Do check out the pricing details to understand which plan fulfills all your business needs.
Tell us about your experience of setting up the Power BI JSON connection! Share your thoughts with us in the comments section below.