Successful refinance: what docs should I receive?

 I refinanced my house for the second time.

The first time, I got the note back with "PAID" written on it.  The
second time, I didn't---just got some kind of affidavit or something
saying the note was paid off.

Are you _always_ supposed to get the old note back?

TIA,

S