We made a video of Baxter interpreting multimodal referring expressions using our multimodal Bayes filter.  Our system interprets referring expressions in real time, outputting a distribution over objects at 14Hz.

We created an automous helicopter that accepts natural language commands.  The helicopter infers appropriate actions and navigates to a requested location.