Serving the Quantitative Finance Community

 
User avatar
katastrofa
Posts: 7440
Joined: August 16th, 2007, 5:36 am
Location: Alpha Centauri

Re: If you are bored with Deep Networks

September 15th, 2018, 4:52 pm

Sure! It can be even made into a statistical learning course for quants, £1000 per person per day.
Is it hands-on?
#metoo
 
User avatar
Cuchulainn
Posts: 20254
Joined: July 16th, 2004, 7:38 am
Location: 20, 000

Re: If you are bored with Deep Networks

September 15th, 2018, 7:19 pm

Sure! It can be even made into a statistical learning course for quants, £1000 per person per day.
Is it hands-on?
#metoo
Don't worry. I have a special pointing device for my slide shows (better than those silly lasers)
Image
 
User avatar
ISayMoo
Topic Author
Posts: 2332
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

September 16th, 2018, 7:17 am

It's a light saber according to the latest C++ standard.
 
User avatar
Cuchulainn
Posts: 20254
Joined: July 16th, 2004, 7:38 am
Location: 20, 000

Re: If you are bored with Deep Networks

September 16th, 2018, 9:49 am

It's a light saber according to the latest C++ standard.
Another distraction. Stick to Pareto. 90% of the stuff in ju-jutsu is useless.
 
User avatar
katastrofa
Posts: 7440
Joined: August 16th, 2007, 5:36 am
Location: Alpha Centauri

Re: If you are bored with Deep Networks

September 16th, 2018, 8:08 pm

The 90% is the element of surprise, which enables twiggies like I deafeat biggies like you.
 
User avatar
ISayMoo
Topic Author
Posts: 2332
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

September 21st, 2018, 8:56 pm

Some papers for peeps complaining about of lack rigorous analysis of SGD and deep networks:

http://proceedings.mlr.press/v80/kuzbor ... kij18a.pdf

https://arxiv.org/abs/1809.03090
 
User avatar
Cuchulainn
Posts: 20254
Joined: July 16th, 2004, 7:38 am
Location: 20, 000

Re: If you are bored with Deep Networks

October 2nd, 2018, 9:10 am

I have stopped reading all these articles. Why? I don't understand them(*) and I have decided to reverse engineer well-designed libraries to discover the algorithms and software design of the individual components.


(*) similar to Wiki comment
Many metaheuristic methods have been published with claims of novelty and practical efficacy. While the field also features high-quality research, many of the publications have been of poor quality; flaws include vagueness, lack of conceptual elaboration, poor experiments, and ignorance of previous literature.

That's the way it seems. Of course, I might be missing some vital information.
 
User avatar
Cuchulainn
Posts: 20254
Joined: July 16th, 2004, 7:38 am
Location: 20, 000

Re: If you are bored with Deep Networks

October 8th, 2018, 6:45 am

Some papers for peeps complaining about of lack rigorous analysis of SGD and deep networks:

http://proceedings.mlr.press/v80/kuzbor ... kij18a.pdf

https://arxiv.org/abs/1809.03090
It's not a matter of complaining; a mathematician would say that it not even wrong. Maybe other disciplines would take a different view on this.
These papers are more of the same. Not very exciting, is it? Too many Achilles' heels and fixes.It seems to be quite brittle if we read he literature..
What about more upmarket stuff. 
 
User avatar
Cuchulainn
Posts: 20254
Joined: July 16th, 2004, 7:38 am
Location: 20, 000

Re: If you are bored with Deep Networks

October 8th, 2018, 7:05 am

I was/am expecting to learn a lot more from this thread.
 
User avatar
ISayMoo
Topic Author
Posts: 2332
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

October 8th, 2018, 7:27 am

Hum, contribute more to it then.
 
User avatar
Cuchulainn
Posts: 20254
Joined: July 16th, 2004, 7:38 am
Location: 20, 000

Re: If you are bored with Deep Networks

October 8th, 2018, 8:46 am

Hum, contribute more to it then.
Wrong answer, sadly.  I mean like so many positive waves maybe we can’t lose! You’re on!
 
User avatar
ISayMoo
Topic Author
Posts: 2332
Joined: September 30th, 2015, 8:30 pm

Re: If you are bored with Deep Networks

October 8th, 2018, 10:31 am

Too many positive waves ROCK THE BOAT.
 
User avatar
katastrofa
Posts: 7440
Joined: August 16th, 2007, 5:36 am
Location: Alpha Centauri

Re: If you are bored with Deep Networks

October 8th, 2018, 12:03 pm

Too many positive waves ROCK THE BOAT.
Enough of this Kindergarten. When will we be able to read your article?
 
User avatar
Cuchulainn
Posts: 20254
Joined: July 16th, 2004, 7:38 am
Location: 20, 000

Re: If you are bored with Deep Networks

October 9th, 2018, 2:32 pm

Anyone for

SGD-BB
SVRG-BB

?
 
User avatar
Cuchulainn
Posts: 20254
Joined: July 16th, 2004, 7:38 am
Location: 20, 000

Re: If you are bored with Deep Networks

November 12th, 2018, 8:49 pm

Can you hear the shape of a drum with ML (or AI :))

https://en.wikipedia.org/wiki/Hearing_t ... _of_a_drum