SEGMENT REPORTING (Details) - USD ($)
$ in Thousands
 3 Months Ended 12 Months Ended
Dec. 31, 2016
Sep. 30, 2016
Jun. 30, 2016
Mar. 31, 2016
Dec. 31, 2015
Sep. 30, 2015
Jun. 30, 2015
Mar. 31, 2015
Dec. 31, 2016
Dec. 31, 2015
Dec. 31, 2014
Dec. 31, 2013
Revenues:                        
Interest income $ 13,638 $ 13,523 $ 13,580 $ 13,382 $ 12,352 $ 11,416 $ 10,694 $ 9,638 $ 54,123 $ 44,100 $ 36,168  
Mortgage fee income                 35,673 29,472 17,557  
Insurance and investment services income                 420 338 328  
Other income                 7,112 5,145 4,137  
Total operating income                 97,328 79,055 58,190  
Expenses:                        
Interest expense                 11,132 9,225 7,511  
Salary and employee benefits                 45,225 36,073 27,774  
Provision for loan losses                 3,632 2,493 2,582  
Other expense                 23,984 21,775 17,420  
Total operating expenses                 83,973 69,566 55,287  
Income from continuing operations, before income taxes 3,420 3,441 10,228 2,612 1,910 1,912 2,688 3,332 13,355 9,489 2,903  
Income tax (benefit) - continuing operations                 4,378 2,886 248  
Net Income from continuing operations                 8,977 6,603 2,655  
Income (loss) from discontinued operations, before income taxes                 6,346 353 (920)  
Income tax expense (benefit) - discontinued operations                 2,411 140 (344)  
Net Income (loss) from discontinued operations                 3,935 213 (576)  
Net Income 2,307 $ 2,310 $ 6,499 $ 1,796 1,402 $ 1,406 $ 1,905 $ 2,103 12,912 6,816 2,079  
Preferred dividends                 1,128 575 332  
Net Income available to common shareholders                 11,784 6,241 1,747  
Capital expenditures                 1,668 2,153 9,798  
Total assets 1,418,804       1,384,476       1,418,804 1,384,476 1,110,459  
Goodwill 18,480       18,480       18,480 18,480 17,779 $ 17,779
Commercial & Retail Banking                        
Expenses:                        
Provision for loan losses                 1,100      
Operating Segments | Commercial & Retail Banking                        
Revenues:                        
Interest income                 50,413 40,524 33,175  
Mortgage fee income                 (252) 7 64  
Insurance and investment services income                 420 338 328  
Other income                 5,485 3,721 4,458  
Total operating income                 56,066 44,590 38,025  
Expenses:                        
Interest expense                 8,437 6,776 5,663  
Salary and employee benefits                 11,592 11,049 9,629  
Provision for loan losses                 3,632 2,493 2,582  
Other expense                 18,009 16,132 13,994  
Total operating expenses                 41,670 36,450 31,868  
Income from continuing operations, before income taxes                 14,396 8,140 6,157  
Income tax (benefit) - continuing operations                 4,496 2,176 1,326  
Net Income from continuing operations                 9,900 5,964 4,831  
Income (loss) from discontinued operations, before income taxes                 0 0 0  
Income tax expense (benefit) - discontinued operations                 0 0 0  
Net Income (loss) from discontinued operations                 0 0 0  
Net Income                 9,900 5,964 4,831  
Preferred dividends                 0 0 0  
Net Income available to common shareholders                 9,900 5,964 4,831  
Capital expenditures                 1,145 1,174 9,072  
Total assets 1,415,735       1,378,988       1,415,735 1,378,988 1,048,101  
Goodwill 1,598       1,598       1,598 1,598 897  
Operating Segments | Mortgage Banking                        
Revenues:                        
Interest income                 4,285 3,882 2,645  
Mortgage fee income                 36,960 30,560 18,691  
Insurance and investment services income                 0 0 0  
Other income                 1,674 1,673 (2)  
Total operating income                 42,919 36,115 21,334  
Expenses:                        
Interest expense                 2,082 1,647 1,063  
Salary and employee benefits                 27,696 20,774 14,487  
Provision for loan losses                 0 0 0  
Other expense                 8,125 7,471 5,990  
Total operating expenses                 37,903 29,892 21,540  
Income from continuing operations, before income taxes                 5,016 6,223 (206)  
Income tax (benefit) - continuing operations                 1,954 2,394 (57)  
Net Income from continuing operations                 3,062 3,829 (149)  
Income (loss) from discontinued operations, before income taxes                 0 0 0  
Income tax expense (benefit) - discontinued operations                 0 0 0  
Net Income (loss) from discontinued operations                 0 0 0  
Net Income                 3,062 3,829 (149)  
Preferred dividends                 0 0 0  
Net Income available to common shareholders                 3,062 3,829 (149)  
Capital expenditures                 220 354 333  
Total assets 122,242       125,227       122,242 125,227 101,791  
Goodwill 16,882       16,882       16,882 16,882 16,882  
Operating Segments | Financial Holding Company                        
Revenues:                        
Interest income                 3 2 2  
Mortgage fee income                 0 0 0  
Insurance and investment services income                 0 0 0  
Other income                 5,247 4,331 4,357  
Total operating income                 5,250 4,333 4,359  
Expenses:                        
Interest expense                 2,226 2,204 1,703  
Salary and employee benefits                 5,937 4,250 3,658  
Provision for loan losses                 0 0 0  
Other expense                 3,144 2,534 1,970  
Total operating expenses                 11,307 8,988 7,331  
Income from continuing operations, before income taxes                 (6,057) (4,655) (2,972)  
Income tax (benefit) - continuing operations                 (2,072) (1,597) (993)  
Net Income from continuing operations                 (3,985) (3,058) (1,979)  
Income (loss) from discontinued operations, before income taxes                 6,926 0 0  
Income tax expense (benefit) - discontinued operations                 2,629 0 0  
Net Income (loss) from discontinued operations                 4,297 0 0  
Net Income                 312 (3,058) (1,979)  
Preferred dividends                 1,128 575 332  
Net Income available to common shareholders                 (816) (3,633) (2,311)  
Capital expenditures                 303 616 40  
Total assets 180,340       148,509       180,340 148,509 146,137  
Goodwill 0       0       0 0 0  
Operating Segments | Insurance                        
Revenues:                        
Interest income                 0 0 0  
Mortgage fee income                 0 0 0  
Insurance and investment services income                 0 0 0  
Other income                 0 0 0  
Total operating income                 0 0 0  
Expenses:                        
Interest expense                 0 0 0  
Salary and employee benefits                 0 0 0  
Provision for loan losses                 0 0 0  
Other expense                 0 0 0  
Total operating expenses                 0 0 0  
Income from continuing operations, before income taxes                 0 0 0  
Income tax (benefit) - continuing operations                 0 0 0  
Net Income from continuing operations                 0 0 0  
Income (loss) from discontinued operations, before income taxes                 (580) 134 (996)  
Income tax expense (benefit) - discontinued operations                 (218) 53 (372)  
Net Income (loss) from discontinued operations                 (362) 81 (624)  
Net Income                 (362) 81 (624)  
Preferred dividends                 0 0 0  
Net Income available to common shareholders                 (362) 81 (624)  
Capital expenditures                 0 9 353  
Total assets 0       5,017       0 5,017 4,031  
Goodwill 0       0       0 0 0  
Intercompany Eliminations                        
Revenues:                        
Interest income                 (578) (308) 346  
Mortgage fee income                 (1,035) (1,095) (1,198)  
Insurance and investment services income                 0 0 0  
Other income                 (5,294) (4,580) (4,676)  
Total operating income                 (6,907) (5,983) (5,528)  
Expenses:                        
Interest expense                 (1,613) (1,402) (918)  
Salary and employee benefits                 0 0 0  
Provision for loan losses                 0 0 0  
Other expense                 (5,294) (4,362) (4,534)  
Total operating expenses                 (6,907) (5,764) (5,452)  
Income from continuing operations, before income taxes                 0 (219) (76)  
Income tax (benefit) - continuing operations                 0 (87) (28)  
Net Income from continuing operations                 0 (132) (48)  
Income (loss) from discontinued operations, before income taxes                 0 219 76  
Income tax expense (benefit) - discontinued operations                 0 87 28  
Net Income (loss) from discontinued operations                 0 132 48  
Net Income                 0 0 0  
Preferred dividends                 0 0 0  
Net Income available to common shareholders                 0 0 0  
Capital expenditures                 0 0 0  
Total assets (299,513)       (273,265)       (299,513) (273,265) (189,601)  
Goodwill $ 0       $ 0       $ 0 $ 0 $ 0