SERVING THE QUANTITATIVE FINANCE COMMUNITY

 
User avatar
ISayMoo
Topic Author
Posts: 1076
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

September 4th, 2018, 9:39 am

Do the Wolfe conditions apply to a stochastic optimisation setting?
 
User avatar
Cuchulainn
Posts: 57022
Joined: July 16th, 2004, 7:38 am
Location: Amsterdam
Contact:

Re: If you are bored with Deep Networks

September 4th, 2018, 12:35 pm

Do the Wolfe conditions apply to a stochastic optimisation setting?
Good question to get onto radar. A guess is 

probabilistic WC
stochastic WC

wouldn't surprise me one bits, so it wouldn't :)
 
User avatar
ISayMoo
Topic Author
Posts: 1076
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

September 4th, 2018, 4:18 pm

Would weak Wolfe conditions be enough?
 
User avatar
ISayMoo
Topic Author
Posts: 1076
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

September 4th, 2018, 5:25 pm

OK, so this looks like a reasonably decent paper: Probabilistic Line Searches for Stochastic Optimization

They discuss convergence guarantees briefly in Sec. 3.4.1. Experiments look encouraging, but I'd like to test them on something more challenging.

EDIT: replaced the URL with a published version.
 
User avatar
katastrofa
Posts: 6370
Joined: August 16th, 2007, 5:36 am
Location: Alpha Centauri

Re: If you are bored with Deep Networks

September 5th, 2018, 12:44 am

Ugh, can't you simply use a quantum annealer?
 
User avatar
ISayMoo
Topic Author
Posts: 1076
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

September 5th, 2018, 7:24 am

I can't afford one.
 
User avatar
berndL
Posts: 165
Joined: August 22nd, 2007, 3:46 pm

Re: If you are bored with Deep Networks

September 10th, 2018, 8:49 pm

Over 10% of it is dog photos, and less than half of that is cats. While everyone knows that most of Internet is cat pics!
Great statistics. I didnt knew this. But seems people like cats more than dogs. Sorry  for beeing off topic though.
 
User avatar
Cuchulainn
Posts: 57022
Joined: July 16th, 2004, 7:38 am
Location: Amsterdam
Contact:

Re: If you are bored with Deep Networks

September 11th, 2018, 6:27 am

There was a time when baboons' derrieres were the benchmark for CAD screen acceptance.


Image
 
User avatar
Cuchulainn
Posts: 57022
Joined: July 16th, 2004, 7:38 am
Location: Amsterdam
Contact:

Re: If you are bored with Deep Networks

September 11th, 2018, 9:10 am

Seriously many of the benchmark and articles tend to focus on pixel-related and vision? Is this not stunting the growth of ML in other areas? Is it engendering tunnel vision?

The mathematical rigour is very patchy. Just look at activation functions and ask: what, what kinds of, why, how, why, when, relationships, what if etc.

This is a crucial component and so little is known about it.
 
User avatar
ISayMoo
Topic Author
Posts: 1076
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

September 11th, 2018, 11:29 am

Computer Vision is a very old topic with many practical applications, so it's natural that it receives a lot of interest. But there is a lot of research in other areas: speech processing, text processing, robot control.
 
User avatar
Cuchulainn
Posts: 57022
Joined: July 16th, 2004, 7:38 am
Location: Amsterdam
Contact:

Re: If you are bored with Deep Networks

September 11th, 2018, 11:38 am

Computer Vision is a very old topic with many practical applications, so it's natural that it receives a lot of interest. But there is a lot of research in other areas: speech processing, text processing, robot control.
I don't doubt that. Speech processing is also ancient. Is there more? That was really my question, not a summary of current applications.
And whether those 60s/70s methodologies are suitable going forward.  How do you support geometry and topological data?

I read about HearSay-II during s/w designs

http://i.stanford.edu/pub/cstr/reports/ ... 6-1123.pdf
 
User avatar
ISayMoo
Topic Author
Posts: 1076
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

September 11th, 2018, 1:40 pm

Modern speech processing is not 60s/70s anymore ;-) Neither is vision.
 
User avatar
Cuchulainn
Posts: 57022
Joined: July 16th, 2004, 7:38 am
Location: Amsterdam
Contact:

Re: If you are bored with Deep Networks

September 11th, 2018, 2:45 pm

Modern speech processing is not 60s/70s anymore ;-) Neither is vision.
Of course. The difference is the documentation.
 
User avatar
ISayMoo
Topic Author
Posts: 1076
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

September 11th, 2018, 5:14 pm

Not really. I'm getting slightly tired of this ping-pong to be honest ;-)
 
User avatar
Cuchulainn
Posts: 57022
Joined: July 16th, 2004, 7:38 am
Location: Amsterdam
Contact:

Re: If you are bored with Deep Networks

September 11th, 2018, 5:42 pm

Not really. I'm getting slightly tired of this ping-pong to be honest ;-)
Mostly pong to date, I'm waiting on some ping.
ABOUT WILMOTT

PW by JB

Wilmott.com has been "Serving the Quantitative Finance Community" since 2001. Continued...


JOBS BOARD

JOBS BOARD

Looking for a quant job, risk, algo trading,...? Browse jobs here...


GZIP: On