LOANS (Textuals) (Details)
$ in Thousands
12 Months Ended
Dec. 31, 2015
USD ($)
state
Dec. 31, 2014
USD ($)
Receivables with Imputed Interest [Line Items]    
Number of states licensed to transact in | state 41  
Loans held for sale, net [1] $ 95,946 $ 113,675
Allowance for loan loss 47,071 4,613
First lien loans held for sale at fair value 95,946 113,675
Allowance for credit losses, collectively evaluated for impairment 5,515 4,043
Principal paydown receivable [1] $ 17,941 $ 40,920
Georgia [Member]    
Receivables with Imputed Interest [Line Items]    
Percentage of loans originated 44.90% 56.00%
Utah [Member]    
Receivables with Imputed Interest [Line Items]    
Percentage of loans originated 11.20% 8.00%
Tennessee [Member}    
Receivables with Imputed Interest [Line Items]    
Percentage of loans originated   4.00%
Virginia [Member]    
Receivables with Imputed Interest [Line Items]    
Percentage of loans originated 9.10% 7.00%
Florida [Member]    
Receivables with Imputed Interest [Line Items]    
Percentage of loans originated 4.40%  
Alabama [Member]    
Receivables with Imputed Interest [Line Items]    
Percentage of loans originated   5.00%
Colorado [Member]    
Receivables with Imputed Interest [Line Items]    
Percentage of loans originated 4.10%  
Middle-market Loans [Member]    
Receivables with Imputed Interest [Line Items]    
Loans held for sale, net $ 375,500 $ 250,100
Allowance for loan loss 3,939  
Bank and Middle Market Loans [Member]    
Receivables with Imputed Interest [Line Items]    
Loans held for sale, net 134,700 330,400
Allowance for loan loss 1,300 570
Whole Loans [Member]    
Receivables with Imputed Interest [Line Items]    
Allowance for loan loss $ 3,745 $ 3,758
Commercial Real Estate Loans [Member] | California [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths) 28.70% 27.40%
Commercial Real Estate Loans [Member] | Texas [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths) 26.80% 27.30%
Commercial Real Estate Loans [Member] | Georgia [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths) 7.40%  
Commercial Real Estate Loans [Member] | Arizona [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths)   7.30%
Bank Loans [Member] | Minimum [Member]    
Receivables with Imputed Interest [Line Items]    
Basis spread on variable rate 1.25% 1.25%
Bank Loans [Member] | Maximum [Member]    
Receivables with Imputed Interest [Line Items]    
Basis spread on variable rate 8.00% 8.75%
Bank Loans [Member] | Industry Grouping of Automobile [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths) 13.50%  
Bank Loans [Member] | Industry Grouping of Diversified/conglomerate Service [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths) 13.00% 11.70%
Bank Loans [Member] | Industry Grouping of Retail Stores [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths) 9.60%  
Bank Loans [Member] | Industry Grouping of Healthcare [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths)   17.50%
Bank Loans [Member] | Industry Diversified/conglomerate Service and Chemicals, Plastics and Rubber [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths)   6.70%
Middle-market Loans [Member] | Minimum [Member]    
Receivables with Imputed Interest [Line Items]    
Basis spread on variable rate 6.25% 5.50%
Middle-market Loans [Member] | Maximum [Member]    
Receivables with Imputed Interest [Line Items]    
Basis spread on variable rate 12.00% 9.25%
Middle-market Loans [Member] | Industry Grouping of Diversified/conglomerate Service [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths) 12.80%  
Middle-market Loans [Member] | Industry Grouping of Healthcare, Education, and Childcare [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths) 12.40%  
Middle-market Loans [Member] | Industry Grouping of Personal, Food and Miscellaneous Service [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths)   13.70%
Middle-market Loans [Member] | Industry Grouping Miscellaneous Services and Hotels, Motels, Inns and Gaming [Member]    
Receivables with Imputed Interest [Line Items]    
Concentration of loan portfolio risk (in hundredths)   13.10%
Lease Receivables [Member]    
Receivables with Imputed Interest [Line Items]    
Allowance for credit losses, collectively evaluated for impairment $ 11 $ 0
Agency-Conforming [Member]    
Receivables with Imputed Interest [Line Items]    
First lien loans held for sale at fair value 29,200 28,900
Jumbo Mortgage Loans [Member]    
Receivables with Imputed Interest [Line Items]    
First lien loans held for sale at fair value $ 65,300 $ 82,600
[1] December 31, 2015December 31, 2014Assets of consolidated Variable Interest Entities ("VIEs") included in the total assets above: Cash and cash equivalents $95 $25 Restricted cash$39,061 $121,247 Investments securities available-for-sale, pledged as collateral, at fair value66,137 119,203 Loans held for sale1,475 282Loans, pledged as collateral and net of allowances of $3.3 million and $8.8 million1,416,441 1,261,137 Interest receivable6,592 8,941 Prepaid expenses238 221 Principal paydown receivable17,800 25,767 Other assets833 (12) Total assets of consolidated VIEs$1,548,672 $1,536,811