LSTM + CNN

Introduction

Solution

Why sigmoid?

Sigmoid function is 0 - 1 layout, it could be used to remember or forget something.

Why tanh

We want to avoid vanishing gradient problem. The second derivative of tanh is mo