Note 21 - Quarterly Financial Data - Quarterly Financial Data (Unaudited) (Details) - USD ($)
$ / shares in Units, shares in Thousands, $ in Thousands
 3 Months Ended 12 Months Ended
Dec. 31, 2016
Sep. 30, 2016
Jun. 30, 2016
Mar. 31, 2016
Dec. 31, 2015
Sep. 30, 2015
Jun. 30, 2015
Mar. 31, 2015
Dec. 31, 2016
Dec. 31, 2015
Dec. 31, 2014
Interest income $ 14,449 $ 14,619 $ 14,973 $ 15,330 $ 15,172 $ 15,123 $ 15,721 $ 15,220 $ 59,371 $ 61,236 $ 64,352
Interest expense 928 1,809 1,975 2,043 2,118 2,158 2,148 2,217 6,755 8,641 10,153
Net interest income 13,521 12,810 12,998 13,287 13,054 12,965 13,573 13,003 52,616 52,595 54,199
Provision for loan losses 175 (190) (156) (473) (722) (898) (264) (1,545) (644) (3,429) (4,364)
Net interest income after provision for loan losses 13,346 13,000 13,154 13,760 13,776 13,863 13,837 14,548 53,260 56,024 58,563
Noninterest income 5,351 10,772 [1] 5,521 9,542 [2] 5,573 5,689 5,508 5,441 31,186 22,211 23,273
Noninterest expense 15,221 17,888 [1] 13,884 14,407 14,685 14,281 14,474 14,510 61,400 57,950 59,278
Income before income tax benefit and equity in undistributed income of subsidiaries 3,476 5,884 4,791 8,895 4,664 5,271 4,871 5,479      
Income tax expense 931 1,560 1,235 2,715 1,080 1,439 1,369 1,405 6,441 5,293 6,099
Net income 2,545 4,324 3,556 6,180 3,584 3,832 3,502 4,074 16,605 14,992 16,459
Less preferred stock dividends and discount accretion 170 225 395 1,927
Net income available to common shareholders, basic and diluted $ 2,545 $ 4,324 $ 3,556 $ 6,180 $ 3,584 $ 3,832 $ 3,332 $ 3,849 $ 16,605 $ 14,597 $ 14,532
Net income per common share, basic and diluted (in dollars per share) $ 0.34 $ 0.58 $ 0.47 $ 0.82 $ 0.48 $ 0.51 $ 0.44 $ 0.51 $ 2.21 $ 1.95 $ 1.94
Weighted average common shares outstanding, basic and diluted (in shares) 7,508 7,505 7,502 7,500 7,497 7,495 7,492 7,490 7,504 7,494 7,483
[1] Noninterest income includes $3.8 million of gain on the sale of investment securities and noninterest expense includes $3.8 million of loss on the early extinguishment of debt, both related to a series of transactions to deleverage the balance sheet.
[2] Noninterest income includes $4.1 million related to the gain on the early extinguishment of subordinated notes payable.