Skip to main content

DSV Parser

Parses delimited text. See Supported reader-parser combinations for compatible readers.

DSV Parser properties

property

type

default value

notes

Block as Complete Record

Boolean

False

With JMSReader or UDPReader, if set to True, the end of a block will be considered the end of the last record in the block, even if the rowdelimiter is missing. Do not change the default value with other readers.

Charset

String

UTF-8

Column Delimiter

String

,

use \t for tab

Column Delimit Till

Integer

-1

With the default value of -1, all delimiters are interpreted as columns. If a positive value is specified, that number of delimiters are interpreted as columns, and any additional delimiters are treated as if escaped. For example, if the columndelimiter value is a space, and columndelimittill is 4, this row:

2012-12-10 10:30:30:256 10.1.10.12 jsmith User Login Error, invalid username or password

would be interpreted as five columns:

2012-12-10
10:30:30:256
10.1.10.12
jsmith
User Login Error,
  invalid username or password

Comment Character

Character

if specified, lines beginning with this character will be skipped

Event Type

String

reserved

Header

Boolean

False

Set to True if the first row (or the row specified by headerlineno) contains field names.

When DSVParser is used with FileReader, the output stream type can be created automatically from the header (see Creating the FileReader output stream type automatically).

Header Line No

Integer

0

if the header is not the first line of the file, set this to the line number of the header row

Ignore Empty Column

Boolean

False

if set to True, empty columns will be skipped instead of output as null values

Ignore Multiple Record Begin

Boolean

True

see FreeFormTextParser

Ignore Row Delimiter in Quote

Boolean

False

if set to True, when the rowdelimiter character appears between a pair of quoteset characters it is treated as if escaped

Line Number

Integer

-1

With the default value of -1, reads all lines. Set to n to skip the first n-1 lines and begin with line number n.

No Column Delimiter

Boolean

False

if set to True, columndelimiter is ignored and the entire line is output as data[0]

Quote Set

String

"

character or characters that mark the start and end of each field; you may specify different start and end characters, such as [] or {}

Record Begin

String

see FreeFormTextParser

Record End

String

see FreeFormTextParser

Row Delimiter

String

\n

see Setting rowdelimiter values

Separator

String

:

character used to separate multiple values for columndelimiter, quoteset, or rowdelimiter (for example, ,:\t to recognize both comma and tab as delimiters)

Trim Quote

Boolean

True

if set to False, the quoteset and quotecharacter characters are not removed from the output

Trim Whitespace

Boolean

False

set to True if the data has spaces between values and delimiters (for example, "1" , "2")

The output type of a source using DSVParser is WAEvent.

DSV Parser example

... PARSE USING DSVParser (
	header:'yes'
)...