In Reinforcement Learning you need to define functions for rewards and state transitions. Big data is an good source of modeling external actors to a deep learning system. What is needed is a causality model for the data to be able to simulate the external world correctly.

This set of lectures are quick introduction to the field.

part 1

part 2

part 3

part 4

## Monday, January 15, 2018

## Friday, April 21, 2017

### On back propagation algorithm

Nice detailed explanation of back propagation in neural networks:

- A nice post using straight python
- Couple of nice post using numpy basic neural network and RNN.
- MIT class notes
- Graph view of the gradient. The "Computational Victories" has good explanation of why back propagation is the preferred method of gradient calculation.

## Sunday, March 26, 2017

## Saturday, March 11, 2017

## Sunday, June 12, 2016

### Calculus and Algebra

I thin this video capture the essence of calculus.

"We have a geometric concept, and we want an algebraic expression for it".

It could be: we have XYZ concept, and want and algebraic expression for it.

An XYZ calculus (such as Tensor calculus in case of Geometry, differential calculus in case of algebra, Relational Calculus in case of Relational Algebra, Lambda Calculus in case of Function algebra...) is used to write an algebraic expression which is then solved with algebraic laws to reason.

The method seems to always be "Write down the correct identity"... Struggling to find how this applies to Lambda Calculus..

"We have a geometric concept, and we want an algebraic expression for it".

It could be: we have XYZ concept, and want and algebraic expression for it.

An XYZ calculus (such as Tensor calculus in case of Geometry, differential calculus in case of algebra, Relational Calculus in case of Relational Algebra, Lambda Calculus in case of Function algebra...) is used to write an algebraic expression which is then solved with algebraic laws to reason.

The method seems to always be "Write down the correct identity"... Struggling to find how this applies to Lambda Calculus..

## Sunday, October 4, 2015

## Tuesday, December 30, 2014

Subscribe to:
Posts (Atom)