Delegance Brokerage Surpasses Human Memory Benchmark in Commercial Insurance

Delegance Brokerage scored 88 percent on the LoCoMo long term conversational memory benchmark, exceeding the published human performance ceiling of 87.9 percent, announced in a press release.

The LoCoMo benchmark, created by Snap Research and published at ACL 2024, measures an AI system’s ability to recall facts, reason across multiple conversations, and handle temporal and adversarial queries. It includes 1,542 questions covering 10 dialogues with over 300 turns each, designed to assess memory across weeks or months of interaction.

Delegance evaluated its production memory system on the full benchmark. The company stated that the same system serves its commercial insurance clients daily, tracking details such as client expansions, fleet changes, and policy updates across extended time periods.

The company noted that LoCoMo reflects the type of long term, multi session recall required in commercial insurance, where brokers manage numerous clients with evolving coverage needs and renewal schedules.