Skip to main content

Database Reader

You can use Database Reader to read all the data that exists in a supported database or data warehouse at the time the Striim application containing Database Reader is started. The most common use case for Database Reader is to load this existing data to the target to establish an initial, point-in-time copy of the source data that can serve as a starting point for subsequent continuous updates or syncs. This process is called "initial load" in Striim, and "historical sync" or "initial snapshot" by others. After completing the initial load using Database Reader, you can use a CDC reader (if available) or Incremental Batch Reader to continuously load updates to the source database or data warehouse to the target.

Database Reader supports the following sources:

Note

Most sources supported by Database Reader are also supported by Incremental Batch Reader.

If the connection to the database is interrupted, the application will halt.

The drivers for BigQuery, Oracle, PostgreSQL, Snowflake, SQL Server, and YugabyteDB are bundled with Striim Platform. For all other databases, when this adapter is deployed to a Striim server, the appropriate JDBC driver must be installed as described in Installing third-party drivers in Striim Platform.

The drivers for BigQuery, Oracle, Snowflake, and SQL Server are bundled with the Forwarding Agent. For all other databases, when this adapter is deployed to a Forwarding Agent, the appropriate JDBC driver must be installed as described in Installing third-party drivers in the Forwarding Agent.

If you are using Database Reader to perform an initial load before running an application using a CDC reader, enable CDC on the source and perform the setup tasks for the CDC reader before starting the initial load.