HFST - Helsinki Finite-State Transducer Technology - C++ API  version 3.9.1
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros Pages
HfstTokenizer Member List

This is the complete list of members for HfstTokenizer, including all inherited members.

add_multichar_symbol(const std::string &symbol)HfstTokenizer
add_skip_symbol(const std::string &symbol)HfstTokenizer
check_utf8_correctness(const std::string &input_string)HfstTokenizerstatic
HfstTokenizer()HfstTokenizer
tokenize(const std::string &input_string) const HfstTokenizer
tokenize(const std::string &input_string, const std::string &output_string) const HfstTokenizer
tokenize_one_level(const std::string &input_string) const HfstTokenizer
Generated on Tue Mar 15 2016 12:06:10 for HFST - Helsinki Finite-State Transducer Technology - C++ API by   doxygen 1.8.7