Tag: BigQuery

This post is part two of describing (near) real-time data processing for BigQuery. In this post, I will use Dataform to implement transforms as well as ASSERTS on the data and unit testing of BigQuery code and SQL statements. Part…

This post describes (near) real-time data processing for BigQuery with unique and other check constraints, and unit testing. This is part one of two, and describes the real-time ingestion of the data. Part two will describe how to implement ASSERTS…

“We have many disparate data sources and we’re having a hard time getting a global view of all our data across our organization.” “Our data is currently all in <enter data warehouse name here> and we want to migrate it…

Welcome to the July 2020 episode of the Datascape Cloud Update Podcast. This is the podcast where we distill the latest Cloud announcements from the leading public Cloud vendors and help to inform you about what matters and what to…

Cloud migration is hot nowadays. Enterprises are considering options to migrate on-premises data and applications to cloud (AWS/GCP/Azure) to get the benefits of quick deployments, pay-per-use models and flexibility. Recently, I got a chance to work on data migration from…

GoldenGate for Big Data 12.3.2.1.1 introduces a new target – Google BigQuery. BigQuery handler can work in two Audit log modes: 1. auditLogMode = true 2. auditLogMode = false I want to review the differences between these two operation modes…

Both MS Excel and Google Sheets offer ways to connect directly to BQ data, to run queries, to pull data back to Excel/Sheets and allow further analysis via options such as pivot tables, charts and drilling up/down. MS Excel The…

Pythian to showcase cloud-based analytics and data solutions at Google NEXT Ottawa, ON – March 2, 2017 – Pythian, a 400-person global technology services company that helps businesses adopt disruptive technologies to better compete, announced today that it has achieved…

Find out if Google BigQuery is the right tool for what you want to do and how to migrate your data into it.

Find out how Google Cloud Platform can help your enterprise get insight and value out of complex data on a massive scale.