Skip to main content

File lineage in readers and writers

See also File lineage in Oracle.

Enabling file lineage causes Striim to track the names of files or other objects that the following adapters read from or write to:

  • FileReader

  • HDFSReader

  • MultiFileReader

  • OracleReader (redo log files)

  • S3Reader

  • AzureBlobWriter

  • FileWriter

  • HDFSWriter

  • S3Writer

You may view the tracked history in the console using the SHOW <source or target name> LINEAGE command (see SHOW) or in Flow Designer by clicking a deployed or running source or target and View File Lineage.

FLM_button.png

With file lineage enabled, when a writer is restarted, writing resumes to the next file in the series (see Setting output names and rollover / upload policies). When it is not enabled, writing restarts from the beginning of the series, overwriting existing output files.