504a0f3d1d49b691d4ad5028b3985478dd9345ae,pythainlp/tokenize/__init__.py,Tokenizer,__init__,#Tokenizer#Any#,12

Before Change


				self.trie_dict = Trie(custom_dict)
			elif type(custom_dict) is str:
				with codecs.open(custom_dict, "r",encoding="utf8") as f:
					vocabs = [word.rstrip() for word in f.readlines()]
				self.trie_dict = Trie(vocabs)
		else:
			self.trie_dict = Trie(get_dict())

After Change


				self.trie_dict = Trie(custom_dict)
			elif type(custom_dict) is str:
				with codecs.open(custom_dict, "r",encoding="utf8") as f:
					vocabs = f.read().splitlines()
				self.trie_dict = Trie(vocabs)
		else:
			self.trie_dict = Trie(get_dict())
	
Italian Trulli
In pattern: SUPERPATTERN

Frequency: 3

Non-data size: 5

Instances


Project Name: PyThaiNLP/pythainlp
Commit Name: 504a0f3d1d49b691d4ad5028b3985478dd9345ae
Time: 2018-03-02
Author: wizer_boss@hotmail.com
File Name: pythainlp/tokenize/__init__.py
Class Name: Tokenizer
Method Name: __init__


Project Name: Belval/TextRecognitionDataGenerator
Commit Name: 90c2e0df5127c85a780fd71c20e833002fb0608a
Time: 2019-06-14
Author: edouard@belval.org
File Name: TextRecognitionDataGenerator/run.py
Class Name:
Method Name: load_dict


Project Name: tensorflow/transform
Commit Name: cb7c20f6ad714f0b016a874b2b06a9fbed4e0a59
Time: 2020-07-16
Author: zoy@google.com
File Name: tensorflow_transform/test_case.py
Class Name: TransformTestCase
Method Name: AssertVocabularyContents