HomeAnnotated BibliographiesGenAI The Tokenization Problem: Understanding Generative AI’s Computational Language Bias Share: Section NavigationSkip section navigationIn this sectionAnnotated Bibliographies Affirming and Inclusive Engaged Learning for Neurodivergent Students Capstone Experiences Conditions for Meaningful Learning GenAI and Engaged Learning Global Learning Internships Learning Communities Learning on Location: Place-Based Pedagogies Mentoring Service-Learning Student-Faculty Partnership Supporting Neurodiverse and Physically Disabled Students Undergraduate Research Work-Integrated Learning Writing Transfer In and Beyond the University Reference List Entry:Asprovska, Marijana, and Nathan Hunter. 2024. "The Tokenization Problem: Understanding Generative AI’s Computational Language Bias." Ubiquity Proceedings 4 (1). https://doi.org/10.5334/uproc.123.About this Journal Article:The paper explains the process of tokenization in large language models and examines its impact on text outputs across different languages. Recommended by Nora Rivera.
