Overview | Package | Class | Use | Tree | Deprecated | Index | Help
PREV CLASS NEXT CLASS | FRAMES NO FRAMES
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD

## net.sourceforge.pmd.cpd
Class AnyTokenizer

    java.lang.Object
      net.sourceforge.pmd.cpd.AnyTokenizer

All Implemented Interfaces:
  Tokenizer

public class AnyTokenizer
extends java.lang.Object
implements Tokenizer

This class does a best-guess try-anything tokenization.

Author:
  jheintz

Field Summary
`static java.lang.String` | `TOKENS`

Constructor Summary
`AnyTokenizer()`

Method Summary
`void` | `tokenize(SourceCode sourceCode, Tokens tokenEntries)`

Methods inherited from class java.lang.Object
`clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

Field Detail

### TOKENS

    public static final java.lang.String TOKENS

See Also:
  Constant Field Values

Constructor Detail

### AnyTokenizer

    public AnyTokenizer()

Method Detail

### tokenize

    public void tokenize(SourceCode sourceCode,
                         Tokens tokenEntries)

  Specified by:
    `tokenize` in interface `Tokenizer`

Overview | Package | Class | Use | Tree | Deprecated | Index | Help
PREV CLASS NEXT CLASS | FRAMES NO FRAMES
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD

Copyright © 2002-2006 InfoEther. All Rights Reserved.