Migrate from Redis (or a homegrown log)

​

Before (Redis log)

# Append every turn
redis.rpush(f"hist:{sid}", json.dumps({"role":"user","text": user_msg}))
redis.rpush(f"hist:{sid}", json.dumps({"role":"assistant","text": reply}))

# Load the whole history into the prompt
history = [json.loads(x) for x in redis.lrange(f"hist:{sid}", 0, 50)]
prompt = build_prompt(history, user_msg)
reply = llm(prompt)

• Hits the LLM context limit fast.
• “Last 50” is a guess. Older relevant context gets evicted.
• Redis cost grows linearly forever.

​

After (Tex)

hits = tex.recall(q=user_msg, session_id=sid, top_k=8)
prompt = build_prompt_with_memory([h.text for h in hits.hits.turns], user_msg)
reply = llm(prompt)
tex.conversations.remember(session_id=sid, turns=[
    {"role":"user","text": user_msg, "timestamp": now_iso()},
    {"role":"assistant","text": reply, "timestamp": now_iso()},
])

1. Bounded prompts. You pull the relevant 8 turns regardless of how many exist.
2. Cross-session continuity. Use f"chat-{user_id}" to share memory across conversations.
3. Less prompt trimming. You stop guessing which recent turns fit in context.

​

Backfill plan

for sid, turns in redis_history.items():
    formatted = [
        {"role": t["role"], "text": t["text"], "timestamp": t["ts"]}
        for t in turns
    ]
    # Big batches are fine. Pass all turns at once.
    tex.conversations.remember(session_id=sid, turns=formatted)

​

Edge cases

• Streaming responses. Persist with remember after the stream completes. Run it in the background so the next request is not delayed.
• System messages. Do not migrate them. They consume tokens and add little recall value.
• Tool calls. Store the result of a tool call as an assistant turn, not the raw JSON. Recall returns text.
• Audit log. Tex is not an audit store. Keep Redis or another append-only log for compliance, and use Tex for retrieval.