When I was a kid I remember discovering the heft of the home phone came from a big chunk of metal screwed into the plastic case.

(My family moved to cell phones so I got the opportunity to disassemble the old phone.)

Maybe just find some washers and glue them inside your handset and receiver?