Fair Value Measurements (Details) (USD $)
12 Months Ended
Dec. 31, 2013
Dec. 31, 2012
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]    
Loans held for sale (at fair value) $ 97,021,000 $ 133,613,000
Real Estate Owned, Fair Value Disclosure 22,663,000 35,974,000
Unrealized holding losses arising during the period [Abstract]    
Ending balance 5,829,000  
Loans and Leases Receivable, Impaired, Outstanding Balance 31,500,000 52,500,000
Loans and Leases Receivable, Impaired, Specific Reserve 6,900,000 12,400,000
Real Estate Owned, Change in Fair Value 1,400,000 7,600,000
Securities (Assets) [Member]
   
Assets measured on recurring basis, unobservable input reconciliation [Roll Forward]    
Beginning balance 0 18,451,000
Transfer into level 3 0 0
Unrealized holding losses arising during the period [Abstract]    
Included in other comprehensive income   1,023,000
Other than temporary impairment in net loss   (113,000)
Principal repayments   (1,352,000)
Net accretion of discount/amortization of premium   (18,009,000)
Mortgage derivative gain, net 0 0
Ending balance 0 0
Mortgage Banking Derivatives [Member]
   
Assets measured on recurring basis, unobservable input reconciliation [Roll Forward]    
Beginning balance 1,419,000 527,000
Transfer into level 3 0 0
Unrealized holding losses arising during the period [Abstract]    
Included in other comprehensive income   0
Other than temporary impairment in net loss   0
Principal repayments   0
Net accretion of discount/amortization of premium   0
Mortgage derivative gain, net (230,000) 892,000
Ending balance 1,189,000 1,419,000
Impaired Loans, Net [Member]
   
Unrealized holding losses arising during the period [Abstract]    
Ending balance 24,596,000  
Real Estate Owned [Member]
   
Unrealized holding losses arising during the period [Abstract]    
Ending balance 22,663,000  
Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value, Fair Value Disclosure [Member]
   
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]    
Mortgage-backed securities 104,923,000 119,056,000
Collateralized mortgage obligations, Government sponsored enterprise bonds 19,241,000 29,579,000
Government sponsored enterprise bonds 17,934,000 8,017,000
Municipal securities 58,793,000 37,371,000
Other debt securities 5,160,000 5,070,000
Certificates of deposit 7,367,000 5,924,000
Loans held for sale (at fair value) 97,021,000 133,613,000
Mortgage Banking Derivative Assets 1,189,000 1,668,000
Mortgage Banking Derivatives Liabilities   249,000
Impaired Loans, Fair Value Disclosure 24,596,000 40,071,000
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
   
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]    
Mortgage-backed securities 0 0
Collateralized mortgage obligations, Government sponsored enterprise bonds 0 0
Government sponsored enterprise bonds 0 0
Municipal securities 0 0
Other debt securities 5,160,000 5,070,000
Certificates of deposit 0 0
Loans held for sale (at fair value) 0 0
Mortgage Banking Derivative Assets 0 0
Mortgage Banking Derivatives Liabilities   0
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
   
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]    
Mortgage-backed securities 104,923,000 119,056,000
Collateralized mortgage obligations, Government sponsored enterprise bonds 19,241,000 29,579,000
Government sponsored enterprise bonds 17,934,000 8,017,000
Municipal securities 58,793,000 37,371,000
Other debt securities 0 0
Certificates of deposit 7,367,000 5,924,000
Loans held for sale (at fair value) 97,021,000 133,613,000
Mortgage Banking Derivative Assets 0 0
Mortgage Banking Derivatives Liabilities   0
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
   
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]    
Mortgage-backed securities 0 0
Collateralized mortgage obligations, Government sponsored enterprise bonds 0 0
Government sponsored enterprise bonds 0 0
Municipal securities 0 0
Other debt securities 0 0
Certificates of deposit 0 0
Loans held for sale (at fair value) 0 0
Mortgage Banking Derivative Assets 1,189,000 1,668,000
Mortgage Banking Derivatives Liabilities   249,000
Number of corporate collateralized mortgage obligations, available-for-sale securities (in loans)     
Fair Value, Measurements, Nonrecurring [Member] | Estimate of Fair Value, Fair Value Disclosure [Member]
   
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]    
Impaired Loans, Fair Value Disclosure 24,596,000 [1] 40,071,000 [1]
Real Estate Owned, Fair Value Disclosure 22,663,000 35,974,000
Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 1 [Member]
   
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]    
Impaired Loans, Fair Value Disclosure 0 [1] 0 [1]
Real Estate Owned, Fair Value Disclosure 0 0
Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 2 [Member]
   
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]    
Impaired Loans, Fair Value Disclosure 0 [1] 0 [1]
Real Estate Owned, Fair Value Disclosure 0 0
Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
   
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]    
Impaired Loans, Fair Value Disclosure 24,596,000 [1] 40,071,000 [1]
Real Estate Owned, Fair Value Disclosure $ 22,663,000 $ 35,974,000
[1] Represents collateral-dependent impaired loans, net, which are included in loans.