tokenizer
[utils]

String Tokenizer Functions. More...

Functions
s32	gf_token_get (char *buffer, s32 start, char *separators, char *token, s32 token_size)
	get string component
s32	gf_token_get_strip (char *buffer, s32 start, char *separators, char *strip_set, char *token, s32 token_size)
	get string component without delimitting characters
s32	gf_token_get_line (char *buffer, u32 start, u32 size, char *line_buffer, u32 line_buffer_size)
	line removal
s32	gf_token_find (char *buffer, u32 start, u32 size, char *pattern)
	pattern location

---

Detailed Description

This section documents the basic string tokenizer of the GPAC framework.

---

Function Documentation

s32 gf_token_get	(	char *	buffer,
		s32	start,
		char *	separators,
		char *	token,
		s32	token_size
	)

Gets the next string component comprised in a given set of characters

Parameters:

	buffer	source string to scan
	start	char offset from begining of buffer where tokenization shall start
	separators	separator characters to use
	token	output buffer location
	token_size	output buffer allocated size

Returns:

position of the first char in the buffer after the last terminating separator, or -1 if token could not be found

s32 gf_token_get_strip	(	char *	buffer,
		s32	start,
		char *	separators,
		char *	strip_set,
		char *	token,
		s32	token_size
	)

Gets the next string component comprised in a given set of characters, removing surrounding characters

Parameters:

	buffer	source string to scan
	start	char offset from begining of buffer where tokenization shall start
	separators	separator characters to use
	strip_set	surrounding characters to remove
	token	output buffer location
	token_size	output buffer allocated size

Returns:

position of the first char in the buffer after the last terminating separator, or -1 if token could not be found

s32 gf_token_get_line	(	char *	buffer,
		u32	start,
		u32	size,
		char *	line_buffer,
		u32	line_buffer_size
	)

Gets one line from buffer and remove delimiters CR, LF and CRLF

Parameters:

	buffer	source string to scan
	start	char offset from begining of buffer where tokenization shall start
	size	size of the input buffer to analyze
	line_buffer	output buffer location
	line_buffer_size	output buffer allocated size

Returns:

position of the first char in the buffer after the last line delimiter, or -1 if no line could be found

s32 gf_token_find	(	char *	buffer,
		u32	start,
		u32	size,
		char *	pattern
	)

Locates a pattern in the buffer

Parameters:

	buffer	source string to scan
	start	char offset from begining of buffer where tokenization shall start
	size	size of the input buffer to analyze
	pattern	pattern to locate

Returns:

position of the first char in the buffer after the pattern, or -1 if pattern could not be found

---