htcc-0.0.0.1: The full scratch implementation of tiny C compiler (x86_64)
Copyright(c) roki 2019
LicenseMIT
Maintainerfalgon53@yahoo.co.jp
Stabilityexperimental
PortabilityPOSIX
Safe HaskellNone
LanguageHaskell2010

Htcc.Tokenizer.Core

Contents

Description

The tokenizer

Synopsis

Tokenizer

tokenize' :: (Enum i, Num i, Eq i, Read i, Show i) => Text -> Either (ASTError i) [TokenLC i] Source #

The core function of tokenize