Gestures are a non-separable part of everyday communication and a crucial component of human-machine interaction. There are several methods of capturing gestures to make the recognition and detection easier, for instance using color, motion sensors, or depth cameras. However, in everyday practices, gestures are recorded by normal cameras and a lot of applications rely on recognizing gestures in this scenario. The goal of the Deepmime Project is to develop a system which performs real-time gesture recognition based on only RGB camera feeds.