File manager - Edit - /var/www/payraty/helpdesk/vendor/teamtnt/tntsearch/src/Support/Tokenizer.php
Back
<?php namespace TeamTNT\TNTSearch\Support; class Tokenizer extends AbstractTokenizer implements TokenizerInterface { static protected $pattern = '/[^\p{L}\p{N}\p{Pc}\p{Pd}@]+/u'; public function tokenize($text, $stopwords = []) { $text = mb_strtolower($text); $split = preg_split($this->getPattern(), $text, -1, PREG_SPLIT_NO_EMPTY); return array_diff($split, $stopwords); } }
| ver. 1.4 |
Github
|
.
| PHP 8.3.30 | Generation time: 0.01 |
proxy
|
phpinfo
|
Settings