python - AttributeError: 'NoneType' object has no attribute ...
stackoverflow.com › questions › 67785438Jun 01, 2021 · Show activity on this post. I am trying to use XLNET through transformers. however i keep getting the issue "AttributeError: 'NoneType' object has no attribute 'tokenize'". I am unsure of how to proceed. if anyone could point me in the right direction it would be appreciated. tokenizer = XLNetTokenizer.from_pretrained ('xlnet-base-cased', do_lower_case=True) print (' Original: ', X_train [1]) # Print the tweet split into tokens. print ('Tokenized: ', tokenizer.tokenize (X_train [1])) # Print ...