|
Income Taxes (Details) (USD $)
|
3 Months Ended |
12 Months Ended |
|
Jun. 30, 2012
|
Dec. 31, 2013
|
Dec. 31, 2012
|
Dec. 31, 2011
|
| Current [Abstract] |
|
|
|
|
| Federal |
|
$ 2,842,000 |
$ 4,256,000 |
$ 1,216,000 |
| State |
|
385,000 |
435,000 |
81,000 |
| Current Total |
|
3,227,000 |
4,691,000 |
1,297,000 |
| Deferred [Abstract] |
|
|
|
|
| Federal |
|
3,861,000 |
(12,664,000) |
(590,000) |
| State |
|
1,533,000 |
(4,231,000) |
(145,000) |
| Deferred Total |
|
5,394,000 |
(16,895,000) |
(735,000) |
| Total |
|
8,621,000 |
(12,204,000) |
562,000 |
| Differential income tax provisions computed at the Federal statutory corporate tax rate [Abstract] |
|
|
|
|
| Income (loss) before income tax |
|
23,329,000 |
22,710,000 |
(6,911,000) |
| Tax at Federal statutory rate (35%) |
|
8,165,000 |
7,949,000 |
(2,419,000) |
| Add (deduct) effect of [Abstract] |
|
|
|
|
| State income taxes net of Federal income tax benefit (expense) |
|
1,246,000 |
(2,467,000) |
(41,000) |
| Cash surrender value of life insurance |
|
(376,000) |
(375,000) |
(393,000) |
| Non-deductible ESOP and stock option expense |
|
(62,000) |
103,000 |
119,000 |
| Tax-exempt interest income |
|
(392,000) |
(185,000) |
(254,000) |
| Reversal of federal valuation allowance on deferred taxes |
|
0 |
(17,008,000) |
2,921,000 |
| Intra-period tax allocation between other comprehensive income and loss from operations |
|
0 |
0 |
(591,000) |
| Increase in tax exposure reserve |
|
0 |
(184,000) |
1,216,000 |
| Other |
|
40,000 |
(37,000) |
4,000 |
| Total |
|
8,621,000 |
(12,204,000) |
562,000 |
| Federal statutory rate (in hundredths) |
|
35.00% |
35.00% |
35.00% |
| Effective tax rate (in hundredths) |
|
37.00% |
(53.70%) |
(8.10%) |
| Number of prior periods of cumulative losses included in examples of negative evidence |
|
|
2 years |
|
| Number of most recent periods of cumulative loss used as negative evidence in determining necessity of valuation allowance |
|
|
3 years |
|
| Federal and state income tax benefit |
|
|
|
736,000 |
| Gross deferred tax assets [Abstract] |
|
|
|
|
| Excess book depreciation |
|
46,000 |
653,000 |
|
| Compensation agreements |
|
210,000 |
277,000 |
|
| Restricted stock and stock options |
|
991,000 |
935,000 |
|
| Allowance for loan losses |
|
9,523,000 |
12,316,000 |
|
| Repurchase reserve for loans sold |
|
122,000 |
357,000 |
|
| Real estate owned write-downs |
|
2,401,000 |
4,005,000 |
|
| Interest recognized for tax but not books |
|
1,390,000 |
1,609,000 |
|
| Federal NOL carryforward |
|
467,000 |
0 |
|
| State NOL carryforward |
|
508,000 |
817,000 |
|
| Unrealized loss on impaired securities |
|
598,000 |
0 |
|
| Other |
|
291,000 |
426,000 |
|
| Total gross deferred tax assets |
|
16,547,000 |
21,395,000 |
|
| Gross deferred tax liabilities [Abstract] |
|
|
|
|
| Unrealized gain on securities available for sale, net |
|
0 |
(1,834,000) |
|
| Mortgage Servicing Rights |
|
(1,365,000) |
(1,278,000) |
|
| FHLB stock dividends |
|
(736,000) |
(858,000) |
|
| Deferred loan fees |
|
(622,000) |
(639,000) |
|
| Deferred liabilities |
|
(2,723,000) |
(4,609,000) |
|
| Net deferred tax assets |
|
13,824,000 |
16,786,000 |
|
| Operating Loss Carryforwards [Line Items] |
|
|
|
|
| Retained earnings excluding federal or state taxes |
|
16,700,000 |
|
|
| Reconciliation of the beginning and ending amount of unrecognized tax benefits [Roll Forward] |
|
|
|
|
| Balance at January 1 |
|
71,000 |
2,004,000 |
|
| Increases related to prior year tax positions |
|
0 |
13,000 |
|
| Increases related to current year tax positions |
|
0 |
2,000 |
|
| Decreases related to prior year tax positions |
|
(71,000) |
(1,948,000) |
|
| Balance at December 31 |
|
0 |
71,000 |
2,004,000 |
| Payment towards IRS proposed IRS adjustment |
982,000 |
|
|
|
| Income tax interest or penalties |
|
0 |
0 |
241,000 |
| Income tax interest or penalties accrued |
|
0 |
53,000 |
241,000 |
|
Federal [Member]
|
|
|
|
|
| Operating Loss Carryforwards [Line Items] |
|
|
|
|
| NOL Carryforwards |
|
|
|
|
|
Wisconsin [Member]
|
|
|
|
|
| Operating Loss Carryforwards [Line Items] |
|
|
|
|
| NOL Carryforwards |
|
$ 9,900,000 |
|
|
| Operating loss carryforwards expiration date |
|
2028 |
|
|