Note 4 - Loans - Summary of Aging of Recorded Investment in Past Due and Non-accrual Loan (Details) - USD ($)
$ in Thousands
Dec. 31, 2016
Dec. 31, 2015
Past Due $ 10,899 $ 11,303
Current 1,475,074 1,308,591
Loans 1,485,973 1,319,894
Impaired loans 2,837 3,695
Commercial, Financial and Agricultural Portfolio Segment [Member]    
Past Due 13 21
Current 170,972 196,711
Loans 170,985 196,732
Impaired loans
Factored Commercial Receivables Portfolio Segment [Member]    
Past Due 7,911 7,609
Current 75,990 60,019
Loans 83,901 67,628
Impaired loans
Real Estate Portfolio Segment [Member] | Mortgage Loans [Member]    
Past Due 2,907 3,378
Current 1,053,307 878,178
Loans 1,056,214 881,556
Impaired loans 2,718 3,300
Real Estate Portfolio Segment [Member] | Construction Loans [Member]    
Past Due 147
Current 155,813 152,715
Loans 155,813 152,862
Impaired loans 98 283
Consumer Portfolio Segment [Member]    
Past Due 68 148
Current 18,992 20,968
Loans 19,060 21,116
Impaired loans 21 112
Financing Receivables, 30 to 59 Days Past Due [Member]    
Past Due 6,468 7,663
Financing Receivables, 30 to 59 Days Past Due [Member] | Commercial, Financial and Agricultural Portfolio Segment [Member]    
Past Due 13 21
Financing Receivables, 30 to 59 Days Past Due [Member] | Factored Commercial Receivables Portfolio Segment [Member]    
Past Due 5,947 5,762
Financing Receivables, 30 to 59 Days Past Due [Member] | Real Estate Portfolio Segment [Member] | Mortgage Loans [Member]    
Past Due 440 1,707
Financing Receivables, 30 to 59 Days Past Due [Member] | Real Estate Portfolio Segment [Member] | Construction Loans [Member]    
Past Due 59
Financing Receivables, 30 to 59 Days Past Due [Member] | Consumer Portfolio Segment [Member]    
Past Due 68 114
Financing Receivables, 60 to 89 Days Past Due [Member]    
Past Due 1,775 2,443
Financing Receivables, 60 to 89 Days Past Due [Member] | Commercial, Financial and Agricultural Portfolio Segment [Member]    
Past Due
Financing Receivables, 60 to 89 Days Past Due [Member] | Factored Commercial Receivables Portfolio Segment [Member]    
Past Due 1,383 1,595
Financing Receivables, 60 to 89 Days Past Due [Member] | Real Estate Portfolio Segment [Member] | Mortgage Loans [Member]    
Past Due 392 760
Financing Receivables, 60 to 89 Days Past Due [Member] | Real Estate Portfolio Segment [Member] | Construction Loans [Member]    
Past Due 88
Financing Receivables, 60 to 89 Days Past Due [Member] | Consumer Portfolio Segment [Member]    
Past Due
Financing Receivables, Equal to Greater than 90 Days Past Due [Member]    
Past Due 2,656 1,197
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Commercial, Financial and Agricultural Portfolio Segment [Member]    
Past Due
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Factored Commercial Receivables Portfolio Segment [Member]    
Past Due 581 252
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Real Estate Portfolio Segment [Member] | Mortgage Loans [Member]    
Past Due 2,075 911
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Real Estate Portfolio Segment [Member] | Construction Loans [Member]    
Past Due
Financing Receivables, Equal to Greater than 90 Days Past Due [Member] | Consumer Portfolio Segment [Member]    
Past Due $ 34