Similar stories here with re-implementing published models. Cheating or gross ignorance.From the 2020 thesis.
The results in (Horvath et al., 2019) shows very accurate predictions. How- ever, after examining the source code, we discover that the ANN is validated and tested on the same data set. Thus, the high accuracy results does not give any information about how well the trained ANN generalises to unseen data.
In our experiment, we will use different data sets for validation and testing.
Horvath, Blankaetal.(Jan.2019).“DeepLearningVolatility”.In: URL: https: //ssrn.com/abstract=3322085.
How much the performance changed after training and testing the model correctly?