Exploring transformers and time lag features for predicting changes in mood over time
AffiliationUniversity of Arizona
MetadataShow full item record
CitationJohn Culnan, Damian Romero Diaz, and Steven Bethard. 2022. Exploring transformers and time lag features for predicting changes in mood over time. In Proceedings of the Eighth Workshop on Computational Linguistics and Clinical Psychology, pages 226–231, Seattle, USA. Association for Computational Linguistics.
JournalCLPsych 2022 - 8th Workshop on Computational Linguistics and Clinical Psychology, Proceedings
RightsCopyright © 2022 Association for Computational Linguistics. This is an open access article licensed on a Creative Commons Attribution 4.0 International License.
Collection InformationThis item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at firstname.lastname@example.org.
AbstractThis paper presents transformer-based models created for the CLPsych 2022 shared task. Using posts from Reddit users over a period of time, we aim to predict changes in mood from post to post. We test models that preserve timeline information through explicit ordering of posts as well as those that do not order posts but preserve features on the length of time between a user’s posts. We find that a model with temporal information may provide slight benefits over the same model without such information, although a RoBERTa transformer model provides enough information to make similar predictions without custom-encoded time information. © 2022 Association for Computational Linguistics.
NoteOpen access journal
VersionFinal published version
Except where otherwise noted, this item's license is described as Copyright © 2022 Association for Computational Linguistics. This is an open access article licensed on a Creative Commons Attribution 4.0 International License.