Can anyone explain how to do a tokenizer for jack

YOU ARE REQUIRED TO ONLY WRITE THE "TOKENIZER"; "PARSER" IS NOTREQUIRED AS PART OF THIS LAB Objective: Build a compiler for Jack - - a modern, object-based, Java-like language. The compiler construction spans two projects: 10 (Syntax Analysis) and 11 (Code Generation). In this project we build a syntax analyzer that parses programs according to the Jack grammar, producing an XML file that reflects the program's structure. Resources: The main tool in this project is the programming language in which you will implement the syntax analyzer. You will also need the TextComparer utility (available in your tools directory, assuming that you've installed the TECS_software suite, which allows comparing the output files generated by your analyzer to the compare files supplied by us. You may also want to inspect the generated and supplied output files using an XML viewer (any standard web browser should do the job). All the test files_necessary for this project are available in project 10.zip. Start by creating a directory named projects/10 on your computer, then extract this file into it (preserving the directory structure embedded in the zip file)