BigQuery Omni will query data across Google, AWS, and Azure clouds

Google Cloud has unveiled a new BigQuery service designed to remove one of data science’s primary pain points: having to move and unify data across environments in order to query it. 

Named BigQuery Omni, the first phase will see private alpha Google Cloud customers able to blend AWS data into the BigQuery data warehouse to run SQL queries, build dashboards, or push through APIs, without having to physically move any data, with similar capabilities for Microsoft Azure “coming soon.”

“Multicloud creates a problem – data becomes siloed and running analytics on that data needs data movement. To solve that problem BigQuery Omni lets customers analyse data no matter where that is: Google Cloud, AWS as a private alpha, and very soon on Microsoft Azure,” Debanjan Saha, GM of data analytics at Google said during a press conference last week.

Data movement is often cited as one of the primary pain points for data scientists and analysts, and it often comes with significant compute costs, which require justification with the finance team.

Here, Saha promises a service which gives users “a consistent data experience using the same SQL and user interface they use in BigQuery for queries, dashboards and to run analytics for consistency and familiarity.”

How BigQuery Omni works

By decoupling storage and compute, BigQuery Omni claims to be able to provide “stateless resilient compute that executes standard SQL queries,” Saha writes. “While competitors will require you to move or copy your data from one public cloud to another, where you might incur egress costs, this is not the case with BigQuery Omni,” he adds. 

Copyright © 2020 IDG Communications, Inc.

Source link