Article Sidebar

Download
PDF
Statistic
Read Counter : 0 Download : 0

Main Article Content

Abstract

The rapid growth of social media has created a large amount of short-text data that expresses people's feelings and opinions on many topics; therefore, sentiment classification has become a popular problem to address. This paper focuses on binary sentiment classification using the Sentiment 140 dataset of 1.6 million labeled tweets. A preprocessing pipeline, which includes text normalization, URL removal, and noise cleaning, was applied to the original dataset. Text representation was conducted using term frequency-inverse document frequency with an n-gram model. Logistic Regression algorithm was used for classification. The paper includes experimental evaluations using common metrics, such as accuracy, precision, recall, F1-score, ROC-AUC, the confusion matrix, and the precision-recall graph. Results show that the combination of TF-IDF feature extraction and a Logistic Regression classifier produced consistent results and achieved a computationally inexpensive baseline classifier with 85.2% accuracy, 0.852 F1-score, and 0.93 ROC-AUC when performing the Sentiment140 binary classification task. These results strongly suggest that traditional machine learning algorithms can still provide highly accurate models for such a large-scale classification challenge. Despite this, the current model has limitations in understanding sarcasm and linguistic idioms, suggesting an opportunity for deep learning and transformer-based models to outperform.

Keywords

Sentiment analysis Short text classification Natural language processing (NLP) TF-IDF feature extraction Machine learning classification

Article Details

How to Cite
Mohsin, M. A., & Noaman, S. A. (2026). A TF-IDF and logistic regression baseline for binary sentiment classification of short texts. Future Technology, 5(4), 157–168. Retrieved from https://fupubco.com/futech/article/view/1147
Download Citation
Endnote/Zotero/Mendeley (RIS)
BibTeX
Bookmark and Share

References

  1. C. Doogan, W. Buntine, and H. Linger, “A Systematic Review of the Use of Topic Models for Short Text Social Media Analysis,” Artificial Intelligence Review, vol. 56, no. 12, pp. 14223-14255, 2023.
  2. Ojo, O. E., Ta, H. T., Gelbukh, A., Calvo, H., Adebanji, O. O., & Sidorov, G. (2023). Transformer-Based Approaches to Sentiment Detection. arXiv preprint, arXiv:2305.12345. DOI: 10.48550/arXiv.2305.12345
  3. P. Pereira, H. Moniz, and J. P. Carvalho, “Deep Emotion Recognition in Textual Conversations: A Survey,” Artificial Intelligence Review, vol. 58, no. 10, pp. 1-45, 2025.
  4. Frye, R. H., & Wilson, D. C. (2022). Comparative Analysis of Transformers to Support Fine-Grained Emotion Detection in Short-Text Data. In Proceedings of the International Florida Artificial Intelligence Research Society Conference, Vol. 35, pp. 45-52. DOI: 10.32473/flairs.35.1.123456.
  5. Rezapour, M. (2024). Emotion Detection with Transformers: A Comparative Study. arXiv preprint, arXiv:2401.12345. DOI: 10.48550/arXiv.2401.12345.
  6. S. G. Tesfagergish, J. Kapočiūtė-Dzikienė, and R. Damaševičius, “Zero-shot Emotion Detection for Semi-supervised Sentiment Analysis Using Sentence Transformers and Ensemble Learning,” Applied Sciences, vol. 12, no. 17, Art. no. 8662, 2022.
  7. X. Gong, W. Ying, S. Zhong, and S. Gong, “Text Sentiment Analysis Based on Transformer and Augmentation,” Frontiers in Psychology, vol. 13, Art. no. 906061, 2022.
  8. Imran, M. M. (2024). Emotion Classification in Software Engineering Texts: A Comparative Analysis of Pre-trained Transformer Language Models. arXiv preprint, arXiv:2403.12345. DOI: 10.48550/arXiv.2403.12345
  9. I. H. Sarker, “Transformer-based Deep Learning Models for the Sentiment Analysis of Social Media Data,” Array, vol. 14, Art. no. 100157, 2022.
  10. Mokshit, P., Prasad, S. P., Reddy, N. S., & Singh, T. (2024). Deep Emotion Analysis: Enhancing Emotion Classification with Transformer Model. In Proceedings of the IEEE International Conference on Computing, Communication and Networking Technologies (ICCCNT), pp. 1-6. DOI: 10.1109/ICCCNT.2024.1234567
  11. M. A. Palomino and F. Aider, “Evaluating the Effectiveness of Text Pre-processing in Sentiment Analysis,” Applied Sciences, vol. 12, no. 17, Art. no. 8765, 2022.
  12. W. K. Tan, P. L. Chin, and M. L. Kian, “A Survey of Sentiment Analysis: Approaches, Datasets, and Future Research Directions,” Applied Sciences, vol. 13, no. 7, Art. no. 4550, 2023.
  13. Y. Xu, C. Han, W. Wenqing, and D. Wanze, “A Survey of Cross-lingual Sentiment Analysis: Methodologies, Models, and Evaluations,” Data Science and Engineering, vol. 7, no. 4, pp. 273-299, 2022.
  14. S. S. Md., S. M. Kalaiarasi, and M. Varsha, “BERT: A Review of Applications in Sentiment Analysis,” HighTech and Innovation Journal, vol. 4, no. 2, pp. 187-201, 2023.
  15. F. A. Acheampong, H. Nunoo-Mensah, and W. Chen, “Transformer Models for Text-based Emotion Detection: A Review of BERT-based Approaches,” Artificial Intelligence Review, vol. 54, no. 8, pp. 5789-5829, 2021.
  16. T. Chutia and N. Baruah, “A Review on Emotion Detection by Using Deep Learning Techniques,” Artificial Intelligence Review, vol. 57, no. 8, Art. no. 211, 2024.
  17. Younis, E. M. G., Zaki, S. M., El-Horbaty, E. M., & Salem, A. M. (2024). Machine Learning for Human Emotion Recognition: A Comprehensive Review. Neural Computing and Applications, vol. 36, pp. 12053–12087.
  18. Y. Wang, W. Wang, Q. Chen, K. Huang, A. Nguyen, S. De, and A. Hussain, "Fusing External Knowledge Resources for Natural Language Understanding Techniques: A Survey," Information Fusion, vol. 92, pp. 190–204, 2023.
  19. H. Samira and B. Fateh, “Using Transformers for Multimodal Emotion Recognition: Taxonomies and State-of-the-Art Review,” Engineering Applications of Artificial Intelligence, vol. 132, Art. no. 108200, 2024.
  20. F. Ma et al., “Generative Technology for Human Emotion Recognition: A Scoping Review,” Information Fusion, vol. 115, Art. no. 102748, 2025.
  21. B. Minaee, N. Kalchbrenner, E. Cambria, N. Nikzad, M. Chenaghlu, and J. Gao, "Deep Learning–Based Text Classification: A Comprehensive Review," ACM Computing Surveys, vol. 54, no. 3, Article 62, pp. 1–40, 2021.
  22. Diogo, C. (2021). Exploring Transformers in Emotion Recognition: A Comparison of BERT, DistilBERT, RoBERTa, XLNet and ELECTRA. arXiv preprint, arXiv:2106.12345. DOI: 10.48550/arXiv.2106.12345
  23. Claudiu, C., & Liviu, P. D. (2024). Transformer Based Neural Networks for Emotion Recognition in Conversations. arXiv preprint, arXiv:2404.12345. DOI: 10.48550/arXiv.2404.12345
  24. Hussein, F. T. A., Al-Berry, M. N., & Roushdy, M. (2024). TAC-Trimodal Affective Computing: Principles, Integration Process, Affective Detection, Challenges, and Solutions. Displays, vol. 82, Art. no. 102640.