THE HISTORICAL DEVELOPMENT AND MODERN PERSPECTIVES OF COMPUTATIONAL LINGUISTICS
Keywords:
computational linguistics; machine translation; generative grammar; artificial intelligence; neural networksAbstract
This article examines and analyzes the main stages in the development of computational linguistics. It explores how the field has evolved from early machine translation experiments in the 1950s to modern neural network models such as GPT and BERT. Each stage—from theoretical and statistical approaches to deep learning innovations—is discussed to show the progress of computational language analysis over time.
Downloads
References
Encyclopaedia Britannica. (2024). Computational linguistics. Retrieved from https://www.britannica.com/science/computational-linguistics
Encyclopaedia Britannica. (2024). Machine translation. Retrieved from https://www.britannica.com/topic/machine-translation
Chomsky, N. (1965). Aspects of the Theory of Syntax. Cambridge, MA: The MIT Press.
ALPAC (Automatic Language Processing Advisory Committee). (1966). Language and Machines: Computers in Translation and Linguistics. Washington, D.C.: National Academy of Sciences.
Brown, P. F., Cocke, J., Della Pietra, S. A., Della Pietra, V. J., Jelinek, F., Mercer, R. L., & Roossin, P. S. (1993). The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2), 263–311.
Manning, C. D., & Schütze, H. (1999). Foundations of Statistical Natural Language Processing. Cambridge, MA: MIT Press.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention Is All You Need. Advances in Neural Information Processing Systems (NeurIPS). Retrieved from https://arxiv.org/abs/1706.03762
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019). Retrieved from https://aclanthology.org/N19-1423/
Downloads
Published
How to Cite
Issue
Section
License

This work is licensed under a Creative Commons Attribution 4.0 International License.
All content published in the Journal of Applied Science and Social Science (JASSS) is protected by copyright. Authors retain the copyright to their work, and grant JASSS the right to publish the work under a Creative Commons Attribution License (CC BY). This license allows others to distribute, remix, adapt, and build upon the work, even commercially, as long as they credit the author(s) for the original creation.