Submitting to the leaderboard

By default, submitted models generate memory with Letta Dream and are evaluated on tasks with Letta Code. You can also submit your own memory-generation harness. Public harnesses can help you understand your model's behavior, but local scores are not official submissions.

  1. Submit a model. Email research@letta.com with the model name and how Letta can access it.
  2. Add a memory-generation harness (optional). Open a pull request against frontiermemory that implements an adapter for memory generation. Use the harness submission template.
  3. Letta runs three independent official evaluations. If you submitted a harness, email its PR link to research@letta.com.