Tokener (NetworkParser 4.2.253 API)

java.lang.Object
- de.uniks.networkparser.Tokener

Direct Known Subclasses:

ByteTokener, JsonTokener, StringTokener, XMLTokener
```
public abstract class Tokener
extends java.lang.Object
```
parseToEntity The Class Tokener.

Field Summary

Fields
Modifier and Type Field and Description

protected Buffer buffer
BUFFER

protected NetworkParserLog logger

static java.lang.String STOPCHARS

Fields
Modifier and Type	Field and Description
`protected Buffer`	`buffer` BUFFER
`protected NetworkParserLog`	`logger`
`static java.lang.String`	`STOPCHARS`

Constructor Summary

Constructors
Constructor and Description

Tokener()

Constructors
Constructor and Description
`Tokener()`

Method Summary

All Methods Instance Methods Abstract Methods Concrete Methods
Modifier and Type	Method and Description
`void`	`back()` Back up one character.
`char`	`charAt(int pos)` Char at.
`boolean`	`checkValues(char... items)` Check values.
`char`	`getCurrentChar()` Gets the current char.
`java.lang.String`	`getNextString(int n)` Get the next n characters.
`java.lang.String`	`getNextTag()`
`protected java.lang.String`	`getStopChars()`
`boolean`	`isEnd()` Check if End of String
`int`	`length()` Gets the length.
`char`	`next()` Get the next character in the source string.
`char`	`nextClean()` Get the next char in the string, skipping whitespace.
`char`	`nextStartClean()`
`java.lang.String`	`nextString(char quote, boolean allowCRLF)`
`java.lang.String`	`nextString(char quote, boolean allowCRLF, boolean allowQuote, boolean mustQuote, boolean nextStep)` Return the characters up to the next close quote character.
`java.lang.Object`	`nextValue(BaseItem creator, boolean allowQuote)` Handle unquoted text.
`java.lang.Object`	`nextValue(BaseItem creator, boolean allowQuote, char c)`
`abstract void`	`parseToEntity(AbstractList<?> entityList)`
`abstract void`	`parseToEntity(SimpleKeyValueList<?,?> entity)`
`int`	`position()` Gets the index.
`void`	`setIndex(int index)` Sets the index.
`boolean`	`skip(int pos)` Skip.
`java.lang.String`	`skipPos(int n)` Get the next n characters.
`boolean`	`stepPos(java.lang.String search, boolean order, boolean notEscape)` Skip.
`java.lang.String`	`substring(int... positions)`
`byte[]`	`toArray()`
`java.lang.String`	`toString()` Make a printable string of this JSONTokener.
`java.lang.String`	`toText()`
`Tokener`	`withBuffer(Buffer buffer)`
`Tokener`	`withText(java.lang.String value)` Reset the Tokener

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

- Field Detail
  - STOPCHARS
```
public static final java.lang.String STOPCHARS
```
    See Also:
    
    Constant Field Values
  - buffer
```
protected Buffer buffer
```
    BUFFER
  - logger
```
protected NetworkParserLog logger
```
- Constructor Detail
  - Tokener
```
public Tokener()
```
- Method Detail
  - withText
```
public Tokener withText(java.lang.String value)
```
    Reset the Tokener
    
    Parameters:
    
    value - The Text for parsing
    
    Returns:
    
    Itself
  - back
```
public void back()
```
    Back up one character. This provides a sort of lookahead capability, so that you can test for a digit or letter before attempting to parse the next number or identifier.
  - isEnd
```
public boolean isEnd()
```
    Check if End of String
    
    Returns:
    
    true, if successful
  - next
```
public char next()
```
    Get the next character in the source string.
    
    Returns:
    
    The next character, or 0 if past the end of the source string.
  - getNextString
```
public java.lang.String getNextString(int n)
```
    Get the next n characters.
    
    Parameters:
    
    n - The number of characters to take.
    
    Returns:
    
    A string of n characters. Substring bounds error if there are not n characters remaining in the source string.
  - skipPos
```
public java.lang.String skipPos(int n)
```
    Get the next n characters.
    
    Parameters:
    
    n - The number of characters to take.
    
    Returns:
    
    A string of n characters. Substring bounds error if there are not n characters remaining in the source string.
  - nextClean
```
public char nextClean()
```
    Get the next char in the string, skipping whitespace.
    
    Returns:
    
    A character, or 0 if there are no more characters.
  - nextStartClean
```
public char nextStartClean()
```
  - nextString
```
public java.lang.String nextString(char quote,
                                   boolean allowCRLF)
```
  - nextString
```
public java.lang.String nextString(char quote,
                                   boolean allowCRLF,
                                   boolean allowQuote,
                                   boolean mustQuote,
                                   boolean nextStep)
```
    Return the characters up to the next close quote character. Backslash processing is done. The formal JSON format does not allow strings in single quotes, but an implementation is allowed to accept them.
    
    Parameters:
    
    quote - The quoting character, either " (double quote) or ' (single quote).
    
    allowCRLF - is allow CRLF in Stream
    
    allowQuote - is allow Quote in Stream
    
    mustQuote - must find Quote in Stream
    
    nextStep - must i step next after find Text
    
    Returns:
    
    A String.
  - nextValue
```
public java.lang.Object nextValue(BaseItem creator,
                                  boolean allowQuote)
```
    Handle unquoted text. This could be the values true, false, or null, or it can be a number. An implementation (such as this one) is allowed to also accept non-standard forms. Accumulate characters until we reach the end of the text or a formatting character.
    
    Parameters:
    
    creator - The creatorobject
    
    allowQuote - is allow Quote in Strem
    
    Returns:
    
    the new Element
  - nextValue
```
public java.lang.Object nextValue(BaseItem creator,
                                  boolean allowQuote,
                                  char c)
```
  - getStopChars
```
protected java.lang.String getStopChars()
```
  - skip
```
public boolean skip(int pos)
```
    Skip.
    
    Parameters:
    
    pos - the pos
    
    Returns:
    
    true, if successful
  - stepPos
```
public boolean stepPos(java.lang.String search,
                       boolean order,
                       boolean notEscape)
```
    Skip.
    
    Parameters:
    
    search - the The String of searchelements
    
    order - the if the order of search element importent
    
    notEscape - Boolean if escaping the text
    
    Returns:
    
    true, if successful
  - position
```
public int position()
```
    Gets the index.
    
    Returns:
    
    the index
  - length
```
public int length()
```
    Gets the length.
    
    Returns:
    
    the length
  - toString
```
public java.lang.String toString()
```
    Make a printable string of this JSONTokener.
    
    Overrides:
    
    toString in class java.lang.Object
    
    Returns:
    
    " at {index} [character {character} line {line}]"
  - charAt
```
public char charAt(int pos)
```
    Char at.
    
    Parameters:
    
    pos - the Position of the bufferarray
    
    Returns:
    
    the char
  - getCurrentChar
```
public char getCurrentChar()
```
    Gets the current char.
    
    Returns:
    
    the current char
  - substring
```
public java.lang.String substring(int... positions)
```
    Parameters:
    
    positions - first is start Position, second is Endposition Absolut fix Start and End start>0 StartPosition end>Start EndPosition Absolut from fix Position Start>0 Position end NULL To End end -1 To this.index Relativ from indexPosition Start Position from this.index + (-Start) End = 0 current Position
    
    Returns:
    
    substring from buffer
  - checkValues
```
public boolean checkValues(char... items)
```
    Check values.
    
    Parameters:
    
    items - the items
    
    Returns:
    
    true, if successful
  - getNextTag
```
public java.lang.String getNextTag()
```
  - setIndex
```
public void setIndex(int index)
```
    Sets the index.
    
    Parameters:
    
    index - the new index
  - toArray
```
public byte[] toArray()
```
  - toText
```
public java.lang.String toText()
```
  - withBuffer
```
public Tokener withBuffer(Buffer buffer)
```
  - parseToEntity
```
public abstract void parseToEntity(SimpleKeyValueList<?,?> entity)
```
  - parseToEntity
```
public abstract void parseToEntity(AbstractList<?> entityList)
```

Class Tokener

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

STOPCHARS

buffer

logger

Constructor Detail

Tokener

Method Detail

withText

back

isEnd

next

getNextString

skipPos

nextClean

nextStartClean

nextString

nextString

nextValue

nextValue

getStopChars

skip

stepPos

position

length

toString

charAt

getCurrentChar

substring

checkValues

getNextTag

setIndex

toArray

toText

withBuffer

parseToEntity

parseToEntity