Text Tokenization with Python

# Introduction In this challenge, we will implement a module called `texttokenizer.py` that tokenizes a given input text. The `generate_tokens` function in the module will take the input text and return an iterable of tokens. The tokens will be represented using a `Token` class, which will be a named Tuple with two data elements: `type` and `value`. The supported token types include NAME, NUM, ADD, SUB, MUL, DIV, EQ, and WS. To validate the implementation, a unit test will be provided which the `generate_tokens` function should pass.

|
60 : 00

Click the virtual machine below to start practicing