Only the immediate past matters (Markov assumption):
Measurements depend only on the current state:
We assume we have models of (can compute) both of these right-hand expressions.