TY - JOUR T1 - Decoding Individual Differences in Mental Information from Human Brain Response Predicted by Convolutional Neural Networks JF - bioRxiv DO - 10.1101/2022.05.16.492029 SP - 2022.05.16.492029 AU - Kiichi Kawahata AU - Jiaxin Wang AU - Antoine Blanc AU - Naoya Maeda AU - Shinji Nishimoto AU - Satoshi Nishida Y1 - 2022/01/01 UR - http://biorxiv.org/content/early/2022/05/16/2022.05.16.492029.abstract N2 - Recent advantages of brain decoding with functional magnetic resonance imaging (fMRI) have enabled us to estimate individual differences in mental information from brain responses to natural sensory inputs. However, the physical constraints and costs of fMRI measurements prevent brain decoding from achieving real-world applications. To address this issue, this study aims to build a framework to decode individual differences in mental information under natural situations via brain-response prediction using convolutional neural networks (CNNs). Once the CNN-based prediction model is constructed using measured brain response, mental information can be decoded from the predicted responses of individual brains with no additional fMRI measurements. As per our analysis, it was found that in 81 of 87 items to be decoded, this framework captured individual difference patterns consistent with conventional decoding using measured brain responses. Our framework has great potential to decode personal mental information with minimal fMRI measuring constraints or costs, which substantially expands the applicability of brain decoding in daily life.Competing Interest StatementThis study was funded by NTT Data Corp. NM is an employee of NTT Data Corp. ER -