Research implementation: Development of a "Truthful-Deceptive Video Dataset for Multimodal Lie Detection."

TEKNIK.UNISMUH.AC.ID, MAKASSAR — The Faculty of Engineering, Muhammadiyah University of Makassar, hosted a research visit from Dr. Yeni Dwi Rahayu, M.Kom., a lecturer from Muhammadiyah University of Jember. This activity is part of her doctoral research at the Institute of Technology of 10 November (ITS) Surabaya, with the research title "Development of Honest-Lie Video Dataset for Multimodal Deception Detection".

This research focuses on developing a video dataset that showcases human expressions and behaviors in the context of honesty and deception. This dataset will serve as the foundation for developing multimodal deception detection systems, which integrate visual analysis (facial expressions), audio (voice intonation), and text (speech). The research results are expected to make a significant contribution to the field of Artificial Intelligence (AI), particularly in the development of Computer Vision and Natural Language Processing (NLP) technology in Indonesia.

The activity was coordinated by Yeni Dwi Rahayu, M.Kom., a lecturer from the Faculty of Informatics, Muhammadiyah University of Jember, who is currently pursuing her S3 studies at ITS. During the implementation, she collaborated with lecturers and students from the Faculty of Engineering, Unismuh Makassar, as part of efforts to strengthen research networks among Muhammadiyah universities.

The research was conducted on October 17, 2025, involving several sessions within the Faculty of Engineering, Unismuh Makassar.

The research activity took place on the 3rd floor of the Faculty of Engineering, Muhammadiyah University of Makassar, which has facilities for computing, multimedia, and video data processing.

The main objective of this research is to develop a local Indonesian data source that can be used in AI research, specifically for recognizing human behavioral patterns in the context of honesty and deception. The resulting dataset will be tailored to Indonesian cultural and linguistic characteristics, making it highly relevant for national-level research and applications.

The research process involved collecting video data from participants who answered a series of questions in two conditions: honest and deceptive. The data will then be analyzed using machine learning and deep learning approaches to recognize patterns in facial expressions, voice changes, and differences in speech content.

The Faculty of Engineering, Unismuh Makassar fully supports this activity by providing laboratory facilities, technological equipment, and collaborative support from lecturers and students.

In an interview, Yeni Dwi Rahayu, M.Kom., expressed her appreciation and expectations for this collaboration: "We are very grateful to the Faculty of Engineering, Unismuh Makassar, for their support in conducting this research. This collaboration is an important step in developing data-based research, while also strengthening the network among Muhammadiyah universities. We hope that the dataset we develop can be widely used for research in the field of artificial intelligence, particularly in multimodal deception detection," said Dr. Yeni Dwi Rahayu, M.Kom.

The Faculty of Engineering, Unismuh Makassar welcomes this research activity as a form of academic and research synergy among Muhammadiyah universities. Through this collaboration, it is hoped that various innovations and real contributions will emerge for the advancement of Artificial Intelligence research in Indonesia.