Serving the Quantitative Finance Community

 
User avatar
ISayMoo
Topic Author
Posts: 2332
Joined: September 30th, 2015, 8:30 pm

Detecting Overfitting via Adversarial Examples

March 7th, 2019, 10:49 am

We wrote a paper showing how to detect test set overfitting using adversarial examples: Detecting Overfitting via Adversarial Examples
 
User avatar
katastrofa
Posts: 7440
Joined: August 16th, 2007, 5:36 am
Location: Alpha Centauri

Re: Detecting Overfitting via Adversarial Examples

March 7th, 2019, 11:06 am

So adversarial examples are good in the end?
 
User avatar
ISayMoo
Topic Author
Posts: 2332
Joined: September 30th, 2015, 8:30 pm

Re: Detecting Overfitting via Adversarial Examples

March 7th, 2019, 11:46 am

They can be a useful tool to probe the quality of a model.
 
User avatar
katastrofa
Posts: 7440
Joined: August 16th, 2007, 5:36 am
Location: Alpha Centauri

Re: Detecting Overfitting via Adversarial Examples

March 8th, 2019, 3:47 pm

Or the researchers - this type of an error which leads to the overfitting, which the authors are testing, is called double dipping in statistics.