Ah so 'long-term memory' in this case is just really large context windows with a long series of user inputs. That makes sense.