Loans (Details 7) (USD $)
In Thousands, unless otherwise specified
Dec. 31, 2014
Dec. 31, 2013
Impaired Loans with Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance $ 21,863 $ 40,645
Recorded Investment 17,231 33,812
Related Allowance 4,427 7,124
Impaired Loans with No Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 43,526 30,207
Recorded Investment 37,888 24,284
Commercial | Impaired Loans with Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 9,390 9,501
Recorded Investment 7,527 9,381
Related Allowance 2,608 4,037
Commercial | Impaired Loans with No Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 18,776 12,495
Recorded Investment 16,316 11,522
SBA | Impaired Loans with Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 4,519 9,762
Recorded Investment 3,652 8,079
Related Allowance 25 607
SBA | Impaired Loans with No Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 13,618 12,706
Recorded Investment 12,578 10,545
Construction | Impaired Loans with Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 686 15,408
Recorded Investment 583 10,500
Related Allowance 278 625
Construction | Impaired Loans with No Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 9,009 2,758
Recorded Investment 6,893 1,266
Indirect automobile | Impaired Loans with Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 2,219 2,364
Recorded Investment 1,855 2,362
Related Allowance 9 13
Indirect automobile | Impaired Loans with No Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 0 0
Recorded Investment 0 0
Installment | Impaired Loans with Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 1,783 461
Recorded Investment 463 431
Related Allowance 296 302
Installment | Impaired Loans with No Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 59 1,461
Recorded Investment 47 170
Residential mortgage | Impaired Loans with Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 2,418 2,270
Recorded Investment 2,418 2,270
Related Allowance 532 805
Residential mortgage | Impaired Loans with No Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 1,921 725
Recorded Investment 1,921 725
Home equity lines of credit | Impaired Loans with Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 848 879
Recorded Investment 733 789
Related Allowance 679 735
Home equity lines of credit | Impaired Loans with No Allowance    
Financing Receivable, Impaired [Line Items]    
Unpaid Principal Balance 143 62
Recorded Investment $ 133 $ 56