Loans Receivable (Details 4) (USD $)
In Thousands, unless otherwise specified
 12 Months Ended 12 Months Ended
Dec. 31, 2012
Loans Held for Investment
Dec. 31, 2011
Loans Held for Investment
Dec. 31, 2012
SBA Held for Investment, net
Dec. 31, 2011
SBA Held for Investment, net
Dec. 31, 2012
Affiliates and Other
Dec. 31, 2011
Affiliates and Other
Dec. 31, 2012
Affiliates
Dec. 31, 2011
Affiliates
Dec. 31, 2012
Other
Dec. 31, 2011
Other
Dec. 31, 2012
Commercial loans
Loans Held for Investment
Dec. 31, 2011
Commercial loans
Loans Held for Investment
Dec. 31, 2012
Commercial loans
SBA Held for Investment, net
Dec. 31, 2011
Commercial loans
SBA Held for Investment, net
Dec. 31, 2012
Commercial loans
SBA Held for Investment, net
Pass
Dec. 31, 2011
Commercial loans
SBA Held for Investment, net
Pass
Dec. 31, 2012
Commercial loans
SBA Held for Investment, net
Special Mention
Dec. 31, 2011
Commercial loans
SBA Held for Investment, net
Special Mention
Dec. 31, 2012
Commercial loans
SBA Held for Investment, net
Substandard
Dec. 31, 2011
Commercial loans
SBA Held for Investment, net
Substandard
Dec. 31, 2012
Commercial loans
SBA Held for Investment, net
Doubtful
Dec. 31, 2011
Commercial loans
SBA Held for Investment, net
Doubtful
Dec. 31, 2012
Commercial loans
Affiliates
Dec. 31, 2011
Commercial loans
Affiliates
Dec. 31, 2012
Commercial loans
Other
Dec. 31, 2011
Commercial loans
Other
Dec. 31, 2010
Commercial loans
Other
Activity in the allowance for loan losses                                                      
Beginning Balance $ 1,416 $ 1,448                     $ 333 $ 365                     $ 1,083 $ 1,083 $ 1,083
Provisions 635 463                     635 463                          
Recoveries (46) (78)                     (46) (78)                          
Charge-offs (404) (417)                     (404) (417)                          
Ending Balance 1,601 1,416                     518 333                     1,083 1,083 1,083
Analysis of the allowance for loan losses and recorded investment in loans (excluding loans held for sale)                                                      
Loans individually evaluated for impairment 15,782 20,418                     585 404                 6,584 6,719 8,613 13,295  
Loans collectively evaluated for impairment 19,305 19,080                     19,305 19,080                          
Total loans evaluated for impairment (excluding loans held for sale) 35,087 39,498 21,013 20,503 15,197 20,014 6,203 6,518 8,859 13,541 35,087 39,498 19,890 19,484 15,315 15,325 3,954 3,648 434 107 187 404 6,584 6,719 8,613 13,295  
Allowance for loans individually evaluated for impairment 1,408 1,391                     325 308                     1,083 1,083  
Allowance for loans collectively evaluated for impairment 193 25                     193 25                          
Non-Accrual Loans 8,975 9,301     8,390 8,897             585 404                 3,261   5,129 8,897  
Current Loans 25,780 30,197     6,807 11,117             18,973 19,080                 3,323 6,719 3,484 4,398  
Aging Analysis                                                      
Loans Past Due and Still Accruing 31-60 Days 327                       327                            
Loans Past Due and Still Accruing 61-90 Days 5                       5                            
Loans Past Due and Still Accruing Total $ 332                       $ 332