0

I am experimenting with Biglake Iceberg tables in BigQuery.

I have created a Biglake Iceberg table in BigQuery, and added few records to the table using the BigQuery console. On the other end, I can read the records from the table in Spark via Biglake Metastore catalog implementation and through BigQuery read API.

But when I try to insert further records in the BigQuery console, the newly added records are not getting reflected in the Spark, even if I try to load the table again. After sometime it's getting reflected. Whereas the inserts from Spark to the table is immediately reflected in the BigQuery end.

I would like to understand why the sync from BigQuery to Spark is not immediate

Improve this question
Related questions
3
Getting error when querying iceberg table via Spark thrift server using beeline client?
2
How to write data to Apache Iceberg tables using Spark SQL?
0
write apache iceberg table to azure ADLS / S3 without using external catalog
Load 1 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.