As seen, we can include information from the past by augmenting the state vector.
However, there are limits – higher-order models are difficult to handle in practice (and do not usually add much value).