Note 4 - Loans - Summary of Risk Category of Loans by Class of Loans (Details) - USD ($)
$ in Thousands
Dec. 31, 2016
Dec. 31, 2015
Loans $ 1,485,973 $ 1,319,894
Commercial, Financial and Agricultural Portfolio Segment [Member]    
Loans 170,985 196,732
Factored Commercial Receivables Portfolio Segment [Member]    
Loans 83,901 67,628
Real Estate Portfolio Segment [Member] | Mortgage Loans [Member]    
Loans 1,056,214 881,556
Real Estate Portfolio Segment [Member] | Construction Loans [Member]    
Loans 155,813 152,862
Consumer Portfolio Segment [Member]    
Loans 19,060 21,116
Pass [Member]    
Loans 1,473,784 1,303,936
Pass [Member] | Commercial, Financial and Agricultural Portfolio Segment [Member]    
Loans 168,004 193,176
Pass [Member] | Factored Commercial Receivables Portfolio Segment [Member]    
Loans 83,901 67,628
Pass [Member] | Real Estate Portfolio Segment [Member] | Mortgage Loans [Member]    
Loans 1,047,797 870,617
Pass [Member] | Real Estate Portfolio Segment [Member] | Construction Loans [Member]    
Loans 155,583 152,255
Pass [Member] | Consumer Portfolio Segment [Member]    
Loans 18,499 20,260
OAEM [Member]    
Loans 3,611 4,298
OAEM [Member] | Commercial, Financial and Agricultural Portfolio Segment [Member]    
Loans 1,422 1,509
OAEM [Member] | Factored Commercial Receivables Portfolio Segment [Member]    
Loans
OAEM [Member] | Real Estate Portfolio Segment [Member] | Mortgage Loans [Member]    
Loans 2,163 2,756
OAEM [Member] | Real Estate Portfolio Segment [Member] | Construction Loans [Member]    
Loans
OAEM [Member] | Consumer Portfolio Segment [Member]    
Loans 26 33
Substandard [Member]    
Loans 5,791 7,965
Substandard [Member] | Commercial, Financial and Agricultural Portfolio Segment [Member]    
Loans 1,559 2,047
Substandard [Member] | Factored Commercial Receivables Portfolio Segment [Member]    
Loans
Substandard [Member] | Real Estate Portfolio Segment [Member] | Mortgage Loans [Member]    
Loans 3,586 4,882
Substandard [Member] | Real Estate Portfolio Segment [Member] | Construction Loans [Member]    
Loans 132 324
Substandard [Member] | Consumer Portfolio Segment [Member]    
Loans 514 712
Doubtful [Member]    
Loans 2,787 3,695
Doubtful [Member] | Commercial, Financial and Agricultural Portfolio Segment [Member]    
Loans
Doubtful [Member] | Factored Commercial Receivables Portfolio Segment [Member]    
Loans
Doubtful [Member] | Real Estate Portfolio Segment [Member] | Mortgage Loans [Member]    
Loans 2,668 3,301
Doubtful [Member] | Real Estate Portfolio Segment [Member] | Construction Loans [Member]    
Loans 98 283
Doubtful [Member] | Consumer Portfolio Segment [Member]    
Loans $ 21 $ 111