{"id":3307,"date":"2025-01-08T09:31:42","date_gmt":"2025-01-08T09:31:42","guid":{"rendered":"https:\/\/sparkminds.net\/?p=3307"},"modified":"2026-09-11T11:00:50","modified_gmt":"2026-09-11T11:00:50","slug":"bigquery-data-warehouse-a-completed-guide-for-beginner-2","status":"publish","type":"post","link":"https:\/\/sparkminds.net\/vi\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/","title":{"rendered":"Bigquery Data Warehouse: A Completed Guide for Beginner"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"3307\" class=\"elementor elementor-3307\">\n\t\t\t\t<div class=\"elementor-element elementor-element-923ab6f e-flex e-con-boxed e-con e-parent\" data-id=\"923ab6f\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-828e41c elementor-widget elementor-widget-heading\" data-id=\"828e41c\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Data Warehouse Overview<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-4b77d65 elementor-widget elementor-widget-heading\" data-id=\"4b77d65\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<p class=\"elementor-heading-title elementor-size-default\">What is data warehouse?  <\/p>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-bf63fac elementor-widget elementor-widget-text-editor\" data-id=\"bf63fac\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>A data warehouse is a system specifically designed to store, query, and analyze massive amounts of data, typically in range of terabytes (TB) or more.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3b689eb elementor-widget elementor-widget-heading\" data-id=\"3b689eb\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Why is it necessary to implement a Data Warehouse in a project?<\/p>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a068a56 elementor-widget elementor-widget-text-editor\" data-id=\"a068a56\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>A data Warehouse is crucial for improving performance and managing data effectively in projects, especially as the amount of information increases. Databases often can\u2019t keep up with the long-term storage and analysis needs of larger datasets.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3b384fb elementor-widget elementor-widget-heading\" data-id=\"3b384fb\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<p class=\"elementor-heading-title elementor-size-default\">What are the limitations of a database? <\/p>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a52d239 elementor-widget elementor-widget-text-editor\" data-id=\"a52d239\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><strong>Direct interaction with user applications:<\/strong> Databases are usually built to support operational applications, ensuring users have a smooth experience. However, when we start storing large amounts of data\u2014especially historical data like customer transactions\u2014it can affect the database\u2019s performance. For instance, if an application runs for 10 or 20 years without removing any information, the data volume can balloon, which slows everything down.<\/p><p><strong>Requirements for reporting and data analysis:<\/strong> Businesses often require information such as transactions and business activities to be compiled into periodic reports for monitoring, analysis, and strategy development. This not only increases the volume of stored data but also affects performance when the database has to handle complex tasks like data aggregation and analysis.<\/p><p>This creates two major issues:<\/p><ul><li><strong>The amount of data increases<\/strong> without directly serving users.<\/li><li><strong>Performance degrades<\/strong> when the database has to execute complex analytical queries, impacting the user experience.<\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-f87be5e elementor-widget elementor-widget-heading\" data-id=\"f87be5e\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Solution: Applying the Data Warehouse <\/p>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-801e0db elementor-widget elementor-widget-text-editor\" data-id=\"801e0db\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>A Data Warehouse is a specialized system designed for storing, querying, and analyzing large amounts of data. It allows you to separate data that doesn\u2019t directly interact with users\u2014like historical data or regular reports\u2014from the main database. This separation brings several key benefits:<\/p><ul><li><strong>Optimized performance:<\/strong> The database can focus solely on serving queries from applications, which helps maintain speed and high performance, ensuring a seamless user experience.<\/li><li><strong>Effective data analysis:<\/strong> The Data Warehouse creates a perfect environment for tackling complex analytical tasks without interrupting the main system\u2019s operations. This way, businesses can easily generate reports, spot trends, and make informed strategic decisions without worrying about slowing down their systems.<\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-80eca22 elementor-widget elementor-widget-heading\" data-id=\"80eca22\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Objectives of the guide<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-62af119 elementor-widget elementor-widget-text-editor\" data-id=\"62af119\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<ol><li>To transfer data that needs to be separated from the Database to the Data Warehouse.<\/li><li>To effectively generate periodic reports and store the reports in the Data Warehouse.<\/li><\/ol><p style=\"padding-left: 40px;\"><b>Technology used:<\/b><\/p><p style=\"padding-left: 80px;\">Database: MySQL<br \/>Data Warehouse: Google BigQuery<br \/>Language Service: Java<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-35e3cd2 elementor-widget elementor-widget-heading\" data-id=\"35e3cd2\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Overview of Implementation <\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a3f97f1 elementor-widget elementor-widget-text-editor\" data-id=\"a3f97f1\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><strong>Objective 1:<\/strong> To transfer data that needs to be separated from the Database to the Data Warehouse.\u00a0<\/p><p>This guide will walk you through two methods for moving data from a MySQL database to Google BigQuery:\u00a0<\/p><ul><li>Using a Java Application: You can create a Java application that uses the Google BigQuery library to upload data to the Data Warehouse.<\/li><li>Using Google Data Stream: You can take advantage of Google Cloud&#8217;s Data Stream feature to automate the process of transferring data between MySQL and BigQuery.\u00a0<\/li><\/ul><p><strong>Objective 2:<\/strong> To effectively generate periodic reports and store the reports in the Data Warehouse.\u00a0<\/p><p>This guide will cover two methods for creating reports and saving the results in BigQuery:\u00a0<\/p><ul><li>Using a Java Application: Build a Java application to run queries, gather data from BigQuery, and save the report results.\u00a0<\/li><li>Using Scheduled Query c\u1ee7a BigQuery: Take advantage of BigQuery\u2019s Scheduled Query feature to automate the regular periodic of reports.\u00a0<\/li><\/ul>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-f6f6cb2 elementor-widget elementor-widget-heading\" data-id=\"f6f6cb2\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Implementation tutorial<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b8b5f65 elementor-widget elementor-widget-heading\" data-id=\"b8b5f65\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Setup the environment on Google BigQuery: <\/p>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-07be132 elementor-widget elementor-widget-text-editor\" data-id=\"07be132\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>1. Go to the Google Cloud Console homepage via the link below.<br \/><a href=\"https:\/\/console.cloud.google.com\/\"><span style=\"text-decoration: underline;\">https:\/\/console.cloud.google.com\/<\/span><\/a><\/p><p><img fetchpriority=\"high\" decoding=\"async\" class=\"aligncenter wp-image-3345 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/google-clound-dashboard.webp\" alt=\"access to google cloud doashboard\" width=\"1905\" height=\"1032\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/google-clound-dashboard.webp 1905w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/google-clound-dashboard-300x163.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/google-clound-dashboard-1024x555.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/google-clound-dashboard-768x416.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/google-clound-dashboard-1536x832.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/google-clound-dashboard-570x309.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/google-clound-dashboard-270x146.webp 270w\" sizes=\"(max-width: 1905px) 100vw, 1905px\" \/><\/p><p>\u00a0<\/p><p>2. Create a new project for you application<\/p><p><img decoding=\"async\" class=\"aligncenter wp-image-3357 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/register-new-projects-e1736246136258.webp\" alt=\"\" width=\"1905\" height=\"527\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/register-new-projects-e1736246136258.webp 1905w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/register-new-projects-e1736246136258-300x83.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/register-new-projects-e1736246136258-1024x283.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/register-new-projects-e1736246136258-768x212.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/register-new-projects-e1736246136258-1536x425.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/register-new-projects-e1736246136258-570x158.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/register-new-projects-e1736246136258-270x75.webp 270w\" sizes=\"(max-width: 1905px) 100vw, 1905px\" \/><\/p><p><img decoding=\"async\" class=\"aligncenter wp-image-3321 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-new-project.webp\" alt=\"\" width=\"1886\" height=\"784\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-new-project.webp 1886w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-new-project-300x125.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-new-project-1024x426.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-new-project-768x319.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-new-project-1536x639.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-new-project-570x237.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-new-project-270x112.webp 270w\" sizes=\"(max-width: 1886px) 100vw, 1886px\" \/><\/p><p>3. After creating and selecting a project, go to the search bar and type \u2018BigQuery\u2019<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3366 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery.webp\" alt=\"\" width=\"1905\" height=\"759\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery.webp 1905w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-300x120.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-1024x408.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-768x306.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-1536x612.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-570x227.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-270x108.webp 270w\" sizes=\"(max-width: 1905px) 100vw, 1905px\" \/><\/p><p>4. After accessing the BigQuery page, click &#8216;Enable&#8217; to activate the Google BigQuery API. (When you want to use a specific feature of Google Cloud, you need to enable its API so that your application can connect to that feature&#8217;s API)<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3342 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/enable-BigQuery-API.webp\" alt=\"\" width=\"1903\" height=\"731\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/enable-BigQuery-API.webp 1903w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/enable-BigQuery-API-300x115.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/enable-BigQuery-API-1024x393.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/enable-BigQuery-API-768x295.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/enable-BigQuery-API-1536x590.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/enable-BigQuery-API-570x219.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/enable-BigQuery-API-270x104.webp 270w\" sizes=\"(max-width: 1903px) 100vw, 1903px\" \/><\/p><p>5. After enabling BigQuery API, next you need to grant permissions to work with BigQuery for the account you will use for the application. Click Navigation menu =&gt; Select \u2018IAM &amp; Admin\u2019 section =&gt; Select \u2018IAM\u2019 (Identity and Access Management)<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3346 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/grant-account-permision.webp\" alt=\"\" width=\"1902\" height=\"785\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/grant-account-permision.webp 1902w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/grant-account-permision-300x124.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/grant-account-permision-1024x423.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/grant-account-permision-768x317.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/grant-account-permision-1536x634.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/grant-account-permision-570x235.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/grant-account-permision-270x111.webp 270w\" sizes=\"(max-width: 1902px) 100vw, 1902px\" \/><\/p><p>6. Select the account you want to edit to grant permissions for working with the BigQuery API<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3341 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Edit-account-working-with-BigQuery-API.webp\" alt=\"\" width=\"1901\" height=\"804\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Edit-account-working-with-BigQuery-API.webp 1901w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Edit-account-working-with-BigQuery-API-300x127.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Edit-account-working-with-BigQuery-API-1024x433.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Edit-account-working-with-BigQuery-API-768x325.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Edit-account-working-with-BigQuery-API-1536x650.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Edit-account-working-with-BigQuery-API-570x241.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Edit-account-working-with-BigQuery-API-270x114.webp 270w\" sizes=\"(max-width: 1901px) 100vw, 1901px\" \/><\/p><p>7. Then click \u2018ADD ANOTHER ROLE\u2019 =&gt; Click Role BigQuery Admin for your account<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3322 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-role.webp\" alt=\"\" width=\"1903\" height=\"823\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-role.webp 1903w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-role-300x130.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-role-1024x443.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-role-768x332.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-role-1536x664.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-role-570x247.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-role-270x117.webp 270w\" sizes=\"(max-width: 1903px) 100vw, 1903px\" \/><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3371 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-role-for-BigQuery-account.webp\" alt=\"\" width=\"435\" height=\"384\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-role-for-BigQuery-account.webp 435w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-role-for-BigQuery-account-300x265.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-role-for-BigQuery-account-374x330.webp 374w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-role-for-BigQuery-account-204x180.webp 204w\" sizes=\"(max-width: 435px) 100vw, 435px\" \/><\/p><p>8. Next, we need to download the keys for the account to create Google Credentials in the application. Click Navigation menu =&gt; Select \u2018IAM &amp; Admin\u2019 section =&gt; Select \u2018Service Accounts\u2019<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3339 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-account-keys.webp\" alt=\"\" width=\"1908\" height=\"822\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-account-keys.webp 1908w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-account-keys-300x129.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-account-keys-1024x441.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-account-keys-768x331.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-account-keys-1536x662.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-account-keys-570x246.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-account-keys-270x116.webp 270w\" sizes=\"(max-width: 1908px) 100vw, 1908px\" \/><\/p><p>9. Select the account for which you granted the &#8216;BigQuery Admin&#8217; role in the previous step<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3365 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-admin-account.webp\" alt=\"\" width=\"1895\" height=\"543\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-admin-account.webp 1895w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-admin-account-300x86.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-admin-account-1024x293.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-admin-account-768x220.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-admin-account-1536x440.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-admin-account-570x163.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-BigQuery-admin-account-270x77.webp 270w\" sizes=\"(max-width: 1895px) 100vw, 1895px\" \/><\/p><p>10. Click \u2018KEYS\u2019 =&gt; Select \u2018ADD KEY\u2019 =&gt; Select \u2018Create new key\u2019 =&gt; Choose JSON key type =&gt; Select \u2018Create\u2019. At this point, Google will automatically download the JSON key to your computer<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3320 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-keys-.webp\" alt=\"\" width=\"1895\" height=\"621\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-keys-.webp 1895w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-keys--300x98.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-keys--1024x336.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-keys--768x252.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-keys--1536x503.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-keys--570x187.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-keys--270x88.webp 270w\" sizes=\"(max-width: 1895px) 100vw, 1895px\" \/><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3334 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-keys.webp\" alt=\"\" width=\"549\" height=\"389\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-keys.webp 549w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-keys-300x213.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-keys-466x330.webp 466w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-keys-254x180.webp 254w\" sizes=\"(max-width: 549px) 100vw, 549px\" \/><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3340 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-keys.webp\" alt=\"\" width=\"519\" height=\"83\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-keys.webp 519w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-keys-300x48.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/download-keys-270x43.webp 270w\" sizes=\"(max-width: 519px) 100vw, 519px\" \/><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3aaa9bd elementor-widget elementor-widget-heading\" data-id=\"3aaa9bd\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Create Dataset in Google BigQuery (corresponding to the Schema in the Database)<\/p>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b53c25d elementor-widget elementor-widget-text-editor\" data-id=\"b53c25d\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>1. Go back to BigQuery, here you will see the resource for the project you created. Select \u2018create dataset\u2019 to create dataset in Bigquery. Fill the information in the \u2018Create dataset\u2019 table:<\/p><ul><li>Dataset ID: Your dataset&#8217;s unique identifier.<\/li><li>Location type: Choose the location for storing your dataset (This affects quote limits [number of API requests] and costs)<\/li><\/ul><p>Then click \u2018CREATE DATASET\u2019<br \/>2. After creating the dataset, we continue to create a table within the dataset (corresponding to a table in the database)<br \/>3. Fill in the information in the \u2018Create table\u2019 table<\/p><ul><li>Table: Name of the table, e.g. transaction, report, etc.<\/li><li>Schema: Create columns in the table<\/li><li>Partitioning and cluster settings: Select the column you want to use for partitioning and clustering order<\/li><\/ul><p><strong>You&#8217;ve successfully set up the environment on Google BigQuery! Now, let&#8217;s move on to the next steps to help you achieve your objectives! <\/strong><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b649e1d elementor-widget elementor-widget-heading\" data-id=\"b649e1d\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Using a Java Application to transfer data from the Database to BigQuery and query data from BigQuery back to a Java Application.<\/p>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8755d48 elementor-widget elementor-widget-text-editor\" data-id=\"8755d48\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>1. Open the pom.xml file and add dependencies from Google BigQuery<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3319 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies.webp\" alt=\"\" width=\"1834\" height=\"805\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies.webp 1834w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-300x132.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-1024x449.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-768x337.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-1536x674.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-570x250.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-270x119.webp 270w\" sizes=\"(max-width: 1834px) 100vw, 1834px\" \/><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3318 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-2.webp\" alt=\"\" width=\"1840\" height=\"818\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-2.webp 1840w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-2-300x133.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-2-1024x455.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-2-768x341.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-2-1536x683.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-2-570x253.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/add-google-BigQuery-dependencies-2-270x120.webp 270w\" sizes=\"(max-width: 1840px) 100vw, 1840px\" \/><\/p><p>2. Save the details of the project, dataset, and table that need to be interacted with in BigQuery<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3363 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information.webp\" alt=\"\" width=\"284\" height=\"255\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information.webp 284w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information-200x180.webp 200w\" sizes=\"(max-width: 284px) 100vw, 284px\" \/><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3362 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information-2.webp\" alt=\"\" width=\"784\" height=\"203\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information-2.webp 784w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information-2-300x78.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information-2-768x199.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information-2-570x148.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information-2-270x70.webp 270w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/save-project-information-2-780x203.webp 780w\" sizes=\"(max-width: 784px) 100vw, 784px\" \/><\/p><p>3. Configure Google Credential and Project<\/p><p>This is the path to the downloaded JSON key file.<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3326 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-google-credential-and-project.webp\" alt=\"\" width=\"1069\" height=\"282\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-google-credential-and-project.webp 1069w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-google-credential-and-project-300x79.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-google-credential-and-project-1024x270.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-google-credential-and-project-768x203.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-google-credential-and-project-570x150.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-google-credential-and-project-270x71.webp 270w\" sizes=\"(max-width: 1069px) 100vw, 1069px\" \/><\/p><p>4. Query data from the Database (This guide will only mock the data)<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3356 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database.webp\" alt=\"\" width=\"1248\" height=\"576\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database.webp 1248w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database-300x138.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database-1024x473.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database-768x354.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database-570x263.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database-270x125.webp 270w\" sizes=\"(max-width: 1248px) 100vw, 1248px\" \/><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3355 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database-2-.webp\" alt=\"\" width=\"379\" height=\"258\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database-2-.webp 379w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database-2--300x204.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Query-data-from-Database-2--264x180.webp 264w\" sizes=\"(max-width: 379px) 100vw, 379px\" \/><\/p><p>5. Convert the data into Google BigQuery&#8217;s RowToInsert object<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3324 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery.webp\" alt=\"\" width=\"715\" height=\"232\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery.webp 715w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery-300x97.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery-570x185.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery-270x88.webp 270w\" sizes=\"(max-width: 715px) 100vw, 715px\" \/><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3323 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery-2.webp\" alt=\"\" width=\"939\" height=\"320\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery-2.webp 939w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery-2-300x102.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery-2-768x262.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery-2-570x194.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/change-data-into-RowToInsert-of-Google-BigQuery-2-270x92.webp 270w\" sizes=\"(max-width: 939px) 100vw, 939px\" \/><\/p><p>6. Insert the data into BigQuery<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3353 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery.webp\" alt=\"\" width=\"814\" height=\"231\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery.webp 814w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-300x85.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-768x218.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-570x162.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-270x77.webp 270w\" sizes=\"(max-width: 814px) 100vw, 814px\" \/><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3352 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-2.webp\" alt=\"\" width=\"1175\" height=\"190\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-2.webp 1175w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-2-300x49.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-2-1024x166.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-2-768x124.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-2-570x92.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/insert-data-into-BigQuery-2-270x44.webp 270w\" sizes=\"(max-width: 1175px) 100vw, 1175px\" \/><\/p><p><b>You have now completed the function of transferring data from the Database to the Data Warehouse using a Java Application. Next, you will implement the functionality to query data from BigQuery<br \/><\/b>7. Create a query<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3337 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence.webp\" alt=\"\" width=\"1109\" height=\"189\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence.webp 1109w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-300x51.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-1024x175.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-768x131.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-570x97.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-270x46.webp 270w\" sizes=\"(max-width: 1109px) 100vw, 1109px\" \/><\/p><p>8. Create a BigQuery job from the query and execute it<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3337 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence.webp\" alt=\"\" width=\"1109\" height=\"189\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence.webp 1109w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-300x51.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-1024x175.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-768x131.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-570x97.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-query-sentence-270x46.webp 270w\" sizes=\"(max-width: 1109px) 100vw, 1109px\" \/><\/p><p>9. Check for any errors and display the results received.<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3325 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/check-errors.webp\" alt=\"\" width=\"903\" height=\"388\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/check-errors.webp 903w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/check-errors-300x129.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/check-errors-768x330.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/check-errors-570x245.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/check-errors-270x116.webp 270w\" sizes=\"(max-width: 903px) 100vw, 903px\" \/><\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3354 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/print-results.webp\" alt=\"\" width=\"1422\" height=\"175\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/print-results.webp 1422w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/print-results-300x37.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/print-results-1024x126.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/print-results-768x95.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/print-results-570x70.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/print-results-270x33.webp 270w\" sizes=\"(max-width: 1422px) 100vw, 1422px\" \/><\/p><p><b>Example Result:<\/b><\/p><p>[<\/p><p>FieldValue{attribute=PRIMITIVE, value=1},<\/p><p>FieldValue{attribute=PRIMITIVE, value=BTC},<\/p><p>FieldValue{attribute=PRIMITIVE, value=A},<\/p><p>FieldValue{attribute=PRIMITIVE, value=B},<\/p><p>FieldValue{attribute=PRIMITIVE, value=1},<\/p><p>FieldValue{attribute=PRIMITIVE, value=1725718844.0}<\/p><p>]<\/p><p><b>You\u2019ve now finished setting up the process for querying data from BigQuery using a Java Application. Next, we\u2019ll walk you through how to transfer data from the Database to BigQuery and generate regular reports\u2014without needing a Java Application.<\/b><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0619496 elementor-widget elementor-widget-heading\" data-id=\"0619496\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Using DataStream to transfer data from the Database to BigQuery <\/p>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5804882 elementor-widget elementor-widget-text-editor\" data-id=\"5804882\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Datastream for BigQuery is a Google Cloud service that allows you to replicate data from relational databases, such as MySQL, PostgreSQL, Oracle, and others, into BigQuery<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3373 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/transfer-data-using-Datastream.webp\" alt=\"\" width=\"927\" height=\"409\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/transfer-data-using-Datastream.webp 927w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/transfer-data-using-Datastream-300x132.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/transfer-data-using-Datastream-768x339.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/transfer-data-using-Datastream-570x251.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/transfer-data-using-Datastream-270x119.webp 270w\" sizes=\"(max-width: 927px) 100vw, 927px\" \/><\/p><p>1. Go to Google cloud console, Search for the Datastream and enable API features<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3343 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Enable-Datastream-API-.webp\" alt=\"\" width=\"1886\" height=\"720\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Enable-Datastream-API-.webp 1886w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Enable-Datastream-API--300x115.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Enable-Datastream-API--1024x391.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Enable-Datastream-API--768x293.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Enable-Datastream-API--1536x586.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Enable-Datastream-API--570x218.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Enable-Datastream-API--270x103.webp 270w\" sizes=\"(max-width: 1886px) 100vw, 1886px\" \/><\/p><p>2. Create Stream<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-3336 size-medium\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-new-stream-300x89.webp\" alt=\"\" width=\"300\" height=\"89\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-new-stream-300x89.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-new-stream-1024x303.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-new-stream-768x228.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-new-stream-1536x455.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-new-stream-570x169.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-new-stream-270x80.webp 270w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-new-stream.webp 1893w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p><p>3. Fill the information in the \u2018Create stream\u2019 table:<\/p><p>&#8211; Stream name: Set a name for your stream<br \/>&#8211; Region: Select a region<br \/>&#8211; Source Type: Choose one of these source types: Oracle, MySQL, Postgre, SQL Server<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3367 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-data-source.webp\" alt=\"\" width=\"564\" height=\"294\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-data-source.webp 564w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-data-source-300x156.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-data-source-270x141.webp 270w\" sizes=\"(max-width: 564px) 100vw, 564px\" \/><\/strong><\/p><p>&#8211; Destination Type: Choose one of these destination types: Cloud storage, BigQuery<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3369 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-destination.webp\" alt=\"\" width=\"414\" height=\"165\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-destination.webp 414w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-destination-300x120.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-destination-270x108.webp 270w\" sizes=\"(max-width: 414px) 100vw, 414px\" \/><\/strong><\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3358 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/review-information.webp\" alt=\"\" width=\"1885\" height=\"790\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/review-information.webp 1885w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/review-information-300x126.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/review-information-1024x429.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/review-information-768x322.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/review-information-1536x644.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/review-information-570x239.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/review-information-270x113.webp 270w\" sizes=\"(max-width: 1885px) 100vw, 1885px\" \/><\/strong><\/p><p>4. For Datastream to pull data from the Database, the Database needs a few configurations. Depending on the type of Database you are using, follow the relevant configuration instructions. (In this guide, we will use Cloud SQL for MySQL).<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3344 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/further-configuration-for-data-stream.webp\" alt=\"\" width=\"1888\" height=\"841\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/further-configuration-for-data-stream.webp 1888w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/further-configuration-for-data-stream-300x134.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/further-configuration-for-data-stream-1024x456.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/further-configuration-for-data-stream-768x342.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/further-configuration-for-data-stream-1536x684.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/further-configuration-for-data-stream-570x254.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/further-configuration-for-data-stream-270x120.webp 270w\" sizes=\"(max-width: 1888px) 100vw, 1888px\" \/><\/strong><\/p><p>5. Click \u2018Next\u2019 to go to the next form. In the following form, you&#8217;ll need to enter the information to create a connection profile<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3335 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-MySQL-connection-profile.webp\" alt=\"\" width=\"1888\" height=\"513\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-MySQL-connection-profile.webp 1888w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-MySQL-connection-profile-300x82.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-MySQL-connection-profile-1024x278.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-MySQL-connection-profile-768x209.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-MySQL-connection-profile-1536x417.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-MySQL-connection-profile-570x155.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-MySQL-connection-profile-270x73.webp 270w\" sizes=\"(max-width: 1888px) 100vw, 1888px\" \/><\/strong><\/p><p>6. Fill the information in the\u2018Create MySQL connection profile\u2019 table:<\/p><p>&#8211; Connection profile name: The name of connection profile<\/p><p>&#8211; Hostname or IP: Hostname or IP address of your database.<\/p><p>&#8211; Port: Port database you\u2019re using<\/p><p>&#8211; Username: The login name for the database account<\/p><p>&#8211; Password: The password for the account<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3350 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-information-for-conection-profile.webp\" alt=\"\" width=\"549\" height=\"794\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-information-for-conection-profile.webp 549w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-information-for-conection-profile-207x300.webp 207w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-information-for-conection-profile-228x330.webp 228w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-information-for-conection-profile-124x180.webp 124w\" sizes=\"(max-width: 549px) 100vw, 549px\" \/><\/strong><\/p><p>7. Next, you can configure the security settings for your stream. In this guide, we will use the default settings. The IP addresses listed below will be accessing your database, so make sure to configure your database to allow connections from these IPs.<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3327 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-security-conditions.webp\" alt=\"\" width=\"551\" height=\"836\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-security-conditions.webp 551w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-security-conditions-198x300.webp 198w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-security-conditions-218x330.webp 218w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-security-conditions-119x180.webp 119w\" sizes=\"(max-width: 551px) 100vw, 551px\" \/><\/strong><\/p><p>8. Click \u2018Run test\u2019 and then click \u2018Continue\u2019<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3360 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/run-test-connection.webp\" alt=\"\" width=\"595\" height=\"533\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/run-test-connection.webp 595w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/run-test-connection-300x269.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/run-test-connection-368x330.webp 368w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/run-test-connection-201x180.webp 201w\" sizes=\"(max-width: 595px) 100vw, 595px\" \/><\/strong><\/p><p>9. Fill the information in the \u2018Configure stream source\u2019 table:<\/p><p>&#8211; Objects to include:<\/p><p>+ All tables from all schemas: Stream all tables and all schemas in the Database<\/p><p>+ Specific schemas and tables: Select tables and schemas you want to stream<\/p><p>+ Custom: Similar to specific schemas and tables, but using text instead of checkboxes to select<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3329 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/configure-stream-source.webp\" alt=\"\" width=\"616\" height=\"687\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/configure-stream-source.webp 616w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/configure-stream-source-269x300.webp 269w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/configure-stream-source-296x330.webp 296w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/configure-stream-source-161x180.webp 161w\" sizes=\"(max-width: 616px) 100vw, 616px\" \/><\/strong><\/p><p>10. Select \u2018SHOW ADVANCED OPTIONS\u2019, enter the information in this table:<\/p><p>&#8211; Objects to exclude: Choose the data you do not want to stream: schema, table, or column.<\/p><p>&#8211; Choose backfill mode for historical data: Select the mode for data that existed before using the stream:<\/p><p>+ Automatic: Stream all existing records in the Database and any records created after the stream is started<\/p><p>+ Manual: Only stream records created after starting the stream<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3370 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-objects-to-exclude.webp\" alt=\"\" width=\"581\" height=\"614\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-objects-to-exclude.webp 581w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-objects-to-exclude-284x300.webp 284w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-objects-to-exclude-312x330.webp 312w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-objects-to-exclude-170x180.webp 170w\" sizes=\"(max-width: 581px) 100vw, 581px\" \/><\/strong><\/p><p>11. Click CONTINUE, fill the information in the \u2018CREATE CONNECTION PROFILE\u2019 table<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3347 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-BigQuery-connection-profile-information.webp\" alt=\"\" width=\"501\" height=\"565\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-BigQuery-connection-profile-information.webp 501w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-BigQuery-connection-profile-information-266x300.webp 266w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-BigQuery-connection-profile-information-293x330.webp 293w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-BigQuery-connection-profile-information-160x180.webp 160w\" sizes=\"(max-width: 501px) 100vw, 501px\" \/><\/strong><\/p><p>12. Select CONTINUE, enter the information in the &#8216;Configure the connection from Datastream to BigQuery&#8217; table:<\/p><p>&#8211; Specify how Datastream should stream into a BigQuery dataset:<\/p><p>+ Dataset for each schema: Each schema will stream into its own dataset<\/p><p>+ Single dataset for all schemas: All schemas will stream into a single dataset<\/p><p>&#8211; Stream write mode:<\/p><p>+ Merge: Synchronize records with the database. We can add, update, or delete records according to the database<\/p><p>+ Append-only: Each event (insert, update, delete) in the database will be recorded in BigQuery<\/p><p>&#8211; Stateleness limit: Scheduled update time for data from the database to BigQuery<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3328 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-the-connection-from-Datastream-to-BigQuery.webp\" alt=\"\" width=\"1883\" height=\"847\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-the-connection-from-Datastream-to-BigQuery.webp 1883w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-the-connection-from-Datastream-to-BigQuery-300x135.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-the-connection-from-Datastream-to-BigQuery-1024x461.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-the-connection-from-Datastream-to-BigQuery-768x345.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-the-connection-from-Datastream-to-BigQuery-1536x691.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-the-connection-from-Datastream-to-BigQuery-570x256.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/config-the-connection-from-Datastream-to-BigQuery-270x121.webp 270w\" sizes=\"(max-width: 1883px) 100vw, 1883px\" \/><\/strong><\/p><p>13. Review the information, select run validation and create stream<\/p><p><strong><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3361 size-full\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Run-validation-and-create-stream.webp\" alt=\"\" width=\"1868\" height=\"815\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Run-validation-and-create-stream.webp 1868w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Run-validation-and-create-stream-300x131.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Run-validation-and-create-stream-1024x447.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Run-validation-and-create-stream-768x335.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Run-validation-and-create-stream-1536x670.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Run-validation-and-create-stream-570x249.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/Run-validation-and-create-stream-270x118.webp 270w\" sizes=\"(max-width: 1868px) 100vw, 1868px\" \/><\/strong><\/p><p><strong>You have completed the setup of Datastream to transfer data from the Database to BigQuery. Next, we will guide you on how to use Scheduled Queries to generate periodic reports.<\/strong><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5e31832 elementor-widget elementor-widget-heading\" data-id=\"5e31832\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Using Scheduled Queries to generate periodic reports<\/p>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-bcd649b elementor-widget elementor-widget-text-editor\" data-id=\"bcd649b\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>1. Go to the BigQuery page and add a Report table<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-3338\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-table-report-300x86.webp\" alt=\"\" width=\"300\" height=\"86\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-table-report-300x86.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-table-report-1024x295.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-table-report-768x221.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-table-report-1536x442.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-table-report-570x164.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-table-report-270x78.webp 270w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/create-table-report.webp 1886w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p><p>2. Turn on the Query tab to write the query for generating reports<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-3374 size-medium\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/write-general-report-sentence-300x130.webp\" alt=\"\" width=\"300\" height=\"130\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/write-general-report-sentence-300x130.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/write-general-report-sentence-1024x443.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/write-general-report-sentence-768x332.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/write-general-report-sentence-1536x664.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/write-general-report-sentence-570x246.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/write-general-report-sentence-270x117.webp 270w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/write-general-report-sentence.webp 1886w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p><p>3. After completing, click \u2018SCHEDULE\u2019 section to schedule the periodic execution of the query<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-3364 size-medium\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/schedule-query-300x95.webp\" alt=\"\" width=\"300\" height=\"95\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/schedule-query-300x95.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/schedule-query-1024x323.webp 1024w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/schedule-query-768x242.webp 768w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/schedule-query-1536x484.webp 1536w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/schedule-query-570x180.webp 570w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/schedule-query-270x85.webp 270w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/schedule-query.webp 1880w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p><p>4. Fill the information in the \u2018New scheduled query\u2019 table:<\/p><p>&#8211; Name for scheduled query: Enter scheduled query name<\/p><p>&#8211; Schedule options: Set the frequency for executing the query: hourly, daily, weekly, etc., along with other related options<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-3349 size-medium\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-details-and-schedule-281x300.webp\" alt=\"\" width=\"281\" height=\"300\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-details-and-schedule-281x300.webp 281w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-details-and-schedule-309x330.webp 309w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-details-and-schedule-169x180.webp 169w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/input-details-and-schedule.webp 552w\" sizes=\"(max-width: 281px) 100vw, 281px\" \/><\/p><p>&#8211; Destination for query results:<\/p><p>+ Dataset: Select the Dataset where the aggregated data will be inserted<\/p><p>+ TableId: Choose the table that will store the aggregated data<\/p><p>+ Destination table write preference:<\/p><ul><li>Append to table: New data will be inserted into the table<\/li><li>Overwrite table: New data will overwrite the existing table<\/li><\/ul><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-3368 size-medium\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-destination-for-query-results-295x300.webp\" alt=\"\" width=\"295\" height=\"300\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-destination-for-query-results-295x300.webp 295w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-destination-for-query-results-324x330.webp 324w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-destination-for-query-results-177x180.webp 177w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-destination-for-query-results.webp 559w\" sizes=\"(max-width: 295px) 100vw, 295px\" \/><\/p><p>&#8211; Service account: Select the account that will execute the scheduled query<\/p><p>&#8211; Notification option: Send notifications to the account if the scheduled query fails to execute<\/p><p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-3372 size-medium\" src=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-service-account-300x245.webp\" alt=\"\" width=\"300\" height=\"245\" srcset=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-service-account-300x245.webp 300w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-service-account-405x330.webp 405w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-service-account-221x180.webp 221w, https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/select-service-account.webp 552w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/p><p><strong>You have now completed the setup of Scheduled Query to generate periodic reports <\/strong><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-74396cf elementor-widget elementor-widget-heading\" data-id=\"74396cf\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Conclusion<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-32fa6d3 elementor-widget elementor-widget-text-editor\" data-id=\"32fa6d3\" data-element_type=\"widget\" data-settings=\"{&quot;ultimate_floating_fx_translate_y&quot;:{&quot;unit&quot;:&quot;px&quot;,&quot;size&quot;:&quot;&quot;,&quot;sizes&quot;:[]}}\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\tA Data Warehouse is the perfect solution for businesses looking to manage and process large amounts of data. It helps lighten the load on the application database and streamlines report generation. This not only boosts the performance and flexibility of the system but also enhances the overall user experience. \t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Data Warehouse Overview What is data warehouse? A data warehouse is a system specifically designed to store, query, and analyze [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":3384,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[24,47],"tags":[],"class_list":["post-3307","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-custom-web-app","category-general","no-social-count","single-post-item mb40"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.9 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Bigquery Data Warehouse: A Completed Guide for Beginner<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sparkminds.net\/vi\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/\" \/>\n<meta property=\"og:locale\" content=\"vi_VN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Bigquery Data Warehouse: A Completed Guide for Beginner\" \/>\n<meta property=\"og:description\" content=\"Data Warehouse Overview What is data warehouse? A data warehouse is a system specifically designed to store, query, and analyze [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sparkminds.net\/vi\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/\" \/>\n<meta property=\"og:site_name\" content=\"SparkMinds\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/sparkminds.jsc\" \/>\n<meta property=\"article:published_time\" content=\"2025-01-08T09:31:42+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-11T11:00:50+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1463\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"\u0110\u01b0\u1ee3c vi\u1ebft b\u1edfi\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"\u01af\u1edbc t\u00ednh th\u1eddi gian \u0111\u1ecdc\" \/>\n\t<meta name=\"twitter:data2\" content=\"19 ph\u00fat\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\/\/sparkminds.net\/#\/schema\/person\/f4769a5d0dd2b458b03580b337c920b8\"},\"headline\":\"Bigquery Data Warehouse: A Completed Guide for Beginner\",\"datePublished\":\"2025-01-08T09:31:42+00:00\",\"dateModified\":\"2026-09-11T11:00:50+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/\"},\"wordCount\":1914,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/sparkminds.net\/#organization\"},\"image\":{\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp\",\"articleSection\":[\"Custom Web\/App\",\"General\"],\"inLanguage\":\"vi\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/\",\"url\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/\",\"name\":\"Bigquery Data Warehouse: A Completed Guide for Beginner\",\"isPartOf\":{\"@id\":\"https:\/\/sparkminds.net\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp\",\"datePublished\":\"2025-01-08T09:31:42+00:00\",\"dateModified\":\"2026-09-11T11:00:50+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#breadcrumb\"},\"inLanguage\":\"vi\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"vi\",\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#primaryimage\",\"url\":\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp\",\"contentUrl\":\"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp\",\"width\":2560,\"height\":1463},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/sparkminds.net\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Bigquery Data Warehouse: A Completed Guide for Beginner\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sparkminds.net\/#website\",\"url\":\"https:\/\/sparkminds.net\/\",\"name\":\"SparkMinds\",\"description\":\"A Reliable Software Development Partner\",\"publisher\":{\"@id\":\"https:\/\/sparkminds.net\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sparkminds.net\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"vi\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/sparkminds.net\/#organization\",\"name\":\"SparkMinds J.S.C\",\"alternateName\":\"SparkMinds\",\"url\":\"https:\/\/sparkminds.net\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"vi\",\"@id\":\"https:\/\/sparkminds.net\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/sparkminds.net\/wp-content\/uploads\/2024\/11\/sticky-logo-menu-sparkmind.png\",\"contentUrl\":\"https:\/\/sparkminds.net\/wp-content\/uploads\/2024\/11\/sticky-logo-menu-sparkmind.png\",\"width\":181,\"height\":66,\"caption\":\"SparkMinds J.S.C\"},\"image\":{\"@id\":\"https:\/\/sparkminds.net\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/sparkminds.jsc\",\"https:\/\/www.linkedin.com\/company\/sparkminds-j-s-c\/about\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/sparkminds.net\/#\/schema\/person\/f4769a5d0dd2b458b03580b337c920b8\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"vi\",\"@id\":\"https:\/\/sparkminds.net\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/bdfb7783cd4581a22bc1899273891ef702c5338854739f578d2f5cb72d515f34?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/bdfb7783cd4581a22bc1899273891ef702c5338854739f578d2f5cb72d515f34?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/sparkminds.net\"],\"url\":\"https:\/\/sparkminds.net\/vi\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Bigquery Data Warehouse: A Completed Guide for Beginner","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sparkminds.net\/vi\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/","og_locale":"vi_VN","og_type":"article","og_title":"Bigquery Data Warehouse: A Completed Guide for Beginner","og_description":"Data Warehouse Overview What is data warehouse? A data warehouse is a system specifically designed to store, query, and analyze [&hellip;]","og_url":"https:\/\/sparkminds.net\/vi\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/","og_site_name":"SparkMinds","article_publisher":"https:\/\/www.facebook.com\/sparkminds.jsc","article_published_time":"2025-01-08T09:31:42+00:00","article_modified_time":"2026-09-11T11:00:50+00:00","og_image":[{"width":2560,"height":1463,"url":"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp","type":"image\/webp"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"\u0110\u01b0\u1ee3c vi\u1ebft b\u1edfi":"admin","\u01af\u1edbc t\u00ednh th\u1eddi gian \u0111\u1ecdc":"19 ph\u00fat"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#article","isPartOf":{"@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/"},"author":{"name":"admin","@id":"https:\/\/sparkminds.net\/#\/schema\/person\/f4769a5d0dd2b458b03580b337c920b8"},"headline":"Bigquery Data Warehouse: A Completed Guide for Beginner","datePublished":"2025-01-08T09:31:42+00:00","dateModified":"2026-09-11T11:00:50+00:00","mainEntityOfPage":{"@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/"},"wordCount":1914,"commentCount":0,"publisher":{"@id":"https:\/\/sparkminds.net\/#organization"},"image":{"@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#primaryimage"},"thumbnailUrl":"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp","articleSection":["Custom Web\/App","General"],"inLanguage":"vi","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/","url":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/","name":"Bigquery Data Warehouse: A Completed Guide for Beginner","isPartOf":{"@id":"https:\/\/sparkminds.net\/#website"},"primaryImageOfPage":{"@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#primaryimage"},"image":{"@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#primaryimage"},"thumbnailUrl":"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp","datePublished":"2025-01-08T09:31:42+00:00","dateModified":"2026-09-11T11:00:50+00:00","breadcrumb":{"@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#breadcrumb"},"inLanguage":"vi","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/"]}]},{"@type":"ImageObject","inLanguage":"vi","@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#primaryimage","url":"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp","contentUrl":"https:\/\/sparkminds.net\/wp-content\/uploads\/2025\/01\/datawarehouse-scaled.webp","width":2560,"height":1463},{"@type":"BreadcrumbList","@id":"https:\/\/sparkminds.net\/bigquery-data-warehouse-a-completed-guide-for-beginner-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sparkminds.net\/"},{"@type":"ListItem","position":2,"name":"Bigquery Data Warehouse: A Completed Guide for Beginner"}]},{"@type":"WebSite","@id":"https:\/\/sparkminds.net\/#website","url":"https:\/\/sparkminds.net\/","name":"SparkMinds","description":"A Reliable Software Development Partner","publisher":{"@id":"https:\/\/sparkminds.net\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sparkminds.net\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"vi"},{"@type":"Organization","@id":"https:\/\/sparkminds.net\/#organization","name":"SparkMinds J.S.C","alternateName":"SparkMinds","url":"https:\/\/sparkminds.net\/","logo":{"@type":"ImageObject","inLanguage":"vi","@id":"https:\/\/sparkminds.net\/#\/schema\/logo\/image\/","url":"https:\/\/sparkminds.net\/wp-content\/uploads\/2024\/11\/sticky-logo-menu-sparkmind.png","contentUrl":"https:\/\/sparkminds.net\/wp-content\/uploads\/2024\/11\/sticky-logo-menu-sparkmind.png","width":181,"height":66,"caption":"SparkMinds J.S.C"},"image":{"@id":"https:\/\/sparkminds.net\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/sparkminds.jsc","https:\/\/www.linkedin.com\/company\/sparkminds-j-s-c\/about\/"]},{"@type":"Person","@id":"https:\/\/sparkminds.net\/#\/schema\/person\/f4769a5d0dd2b458b03580b337c920b8","name":"admin","image":{"@type":"ImageObject","inLanguage":"vi","@id":"https:\/\/sparkminds.net\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/bdfb7783cd4581a22bc1899273891ef702c5338854739f578d2f5cb72d515f34?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/bdfb7783cd4581a22bc1899273891ef702c5338854739f578d2f5cb72d515f34?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/sparkminds.net"],"url":"https:\/\/sparkminds.net\/vi\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/posts\/3307","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/comments?post=3307"}],"version-history":[{"count":20,"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/posts\/3307\/revisions"}],"predecessor-version":[{"id":9239,"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/posts\/3307\/revisions\/9239"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/media\/3384"}],"wp:attachment":[{"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/media?parent=3307"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/categories?post=3307"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sparkminds.net\/vi\/wp-json\/wp\/v2\/tags?post=3307"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}