A thrift is a kind of bank that arranges mortgages (mostly for home ownership) and sets up accounts to receive deposits.
The statement is actually false. The difference is in who they can borrow from and whether or not they are set up for profit. Thrifts are usually non profit.