I'm happy to spin up 10 app servers rather than make the single database faster, but I'm not sure these apps would be offloading much from the database just by doing "joins" in-memory.

Microsoft is building its SQL Server database so it will have an in-memory database to compete with the likes of SAP's Hana and Oracle's Exadata. Codenamed “Hekaton” the new in-memory database ...