Short text classification with machine learning in the social sciences: The case of climate change on Twitter

48. Hebb DO. The Organization of Behavior. New York: Wiley; 1949. 49. Bain A. Mind and Body: The Theories of their Relation. vol. 4. Appleton; 1873. 50. James W, Burkhardt F, Bowers F, Skrupskelis IK. The Principles of Psychology. vol. 1. Macmillan Lon- don; 1890. 51. McCulloch WS, Pitts W. A logical calculus of the ideas immanent in nervous activity. The Bulletin of Mathematical Biophysics. 1943; 5(4):115–133. https://doi.org/10.1007/BF02478259 52. Cybenko G. Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals and Systems. 1989; 2(4):303–314. https://doi.org/10.1007/BF02551274 53. Wiener E, Pedersen JO, Weigend AS, et al. A neural network approach to topic spotting. In: Proceed- ings of the 4th Annual Symposium on Document Analysis and Information Retrieval. vol. 317; 1995. p. 332. 54. Ng HT, Goh WB, Low KL. Feature selection, perceptron learning, and a usability case study for text cat- egorization. In: Proceedings of the 20th International ACM Conference on Research and Development in Information Retrieval; 1997. p. 67–73. 55. Kim Y. Convolutional Neural Networks for Sentence Classification. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing; 2014. p. 1–6. 56. Torres M, Cantu´ F. Learning to see: Convolutional neural networks for the analysis of social science data. Political Analysis. 2021; p. 1–19. 57. Rosenblatt F. The perceptron: A probabilistic model for information storage and organization in the

brain. Psychological review. 1958; 65(6):386. https://doi.org/10.1037/h0042519 PMID: 13602029 58. Werbos P. Beyond regression: New tools for prediction and analysis in the behavioral sciences. Ph.D. thesis, Harvard University; 1974. 59. Kingma DP, Ba J. Adam: A method for stochastic optimization. In: Proceedings of the 3rd International Conference on Learning Representations; 2015. p. 1–15. 60. Hinton G, Srivastava N, Swersky K. Coursera course on neural networks for machine learning: Lecture 6a—Overview of mini-batch gradient descent; 2012. 61. Collobert R, Weston J. A unified architecture for natural language processing: Deep neural networks with multitask learning. In: Proceedings of the 25th International Conference on Machine learning; 2008. p. 160–167. 62. Hochreiter S, Schmidhuber J. Long short-term memory. Neural Computation. 1997; 9(8):1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735 PMID: 9377276 63. Graves A, Schmidhuber J. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Networks. 2005; 18(5-6):602–610. https://doi.org/10.1016/j.neunet.2005. 06.042 PMID: 16112549 64. Shyrokykh K. Replication codes and data for: Short Text Classification with Machine Learning in the Social Sciences; 2023. https://github.com/shikarina/short_text_classification. 65. Shyrokykh K, Girnyk M, Dellmuth L. A Dataset of UN Agencies’ Public Communication about Climate Change on Twitter; 2023. https://zenodo.org/record/7633599/#.Y-lbTS8w1qs, accessed Apr. 2023.

66. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement. 1960; 20(1):37–46. https://doi.org/10.1177/001316446002000104 67. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; p. 159–174. https://doi.org/10.2307/2529310 PMID: 843571 68. Mockus J. The application of Bayesian methods for seeking the extremum. Towards global optimiza- tion. 1998; 2:117. 69. Bergstra J, Bengio Y. Random search for hyper-parameter optimization. Journal of Machine Learning Research. 2012; 13(2). 70. Aszemi NM, Dominic P. Hyperparameter optimization in convolutional neural network using genetic algorithms. International Journal of Advanced Computer Science and Applications. 2019; 10(6). https:// doi.org/10.14569/IJACSA.2019.0100638 71. Fischetti M, Stringher M. Embedding simulated annealing within stochastic gradient descent. In: Pro- ceedings of the 4th International Conference on Optimization and Learning; 2021. p. 3–13. 72. Schmidt M, Safarani S, Gastinger J, Jacobs T, Nicolas S, Schu¨ lke A. On the performance of differential evolution for hyperparameter tuning. In: Proceedings of the International Joint Conference on Neural Networks; 2019. p. 1–8. 73. Bacanin N, Zivkovic M, Stoean C, Antonijevic M, Janicijevic S, Sarac M, et al. Application of natural lan- guage processing and machine learning boosted with Swarm Intelligence for spam email filtering. Math- ematics. 2022; 10(22):4173. https://doi.org/10.3390/math10224173 PLOS ONE

Short text classification with machine learning in the social sciences PLOS ONE | https://doi.org/10.1371/journal.pone.0290762 September 29, 2023 25 / 26