The parser in our system is augmented by an annotation module which lets us associate a production rule with an annotation. Each time the production is used to expand a non-terminal which has annotation attached to it, this annotation is emitted and the rule's resulting starting and ending sample indexes are optionally used for segmenting the input signal into semantically significant blocks. In this paper we present results of semantic recognition and semantic segmentation of some gestures.