Consolidated Statements of Operations (USD $)
In Thousands, except Per Share data, unless otherwise specified
 12 Months Ended
Dec. 31, 2013
Dec. 31, 2012
Dec. 31, 2011
Interest income:      
Loans $ 345,908 $ 346,393 $ 327,219
Mortgage-backed and investment securities 6,330 12,388 30,061
Interest-only strips 5,003 5,804 6,025
Other interest-earning assets 3,384 3,892 4,312
Total interest income 360,625 368,477 367,617
Interest expense:      
Deposits 54,537 63,386 88,286
Securities sold under agreements to repurchase 4,143 10,120 21,119
Advances from Federal Home Loan Bank 34,746 38,202 37,129
Loans payable 6,054 5,888 5,964
Notes payable 34,886 30,356 26,224
Total interest expense 134,366 147,952 178,722
Net interest income 226,259 220,525 188,895
Provision for Loan and Lease Losses 73,630 176,098 67,525
Net interest (loss) income after provision for loan and lease losses 152,629 44,427 121,370
Non-interest income:      
Other-than-temporary impairment losses 0 (6,396) (8,485)
Portion of loss recognized in other comprehensive income (before taxes) 0 0 4,195
Net credit related other-than-temporary impairment losses 0 (6,396) (4,290)
Net gain (loss) on sale of investment securities available for sale 329 5,867 27,467
Net loss on early repayment of debt (2,620) (2,009) (3,068)
Net gain on loans securitized and sold and capitalization of mortgage servicing 28,073 47,438 33,894
Retail banking fees 23,994 25,890 27,211
Insurance agency commissions 13,537 13,414 12,569
Net gain (loss) on trading assets and derivatives (8,949) (2,351) 4,007
Mortgage loan servicing income (net of mark-to-market adjustments) 12,082 696 15,849
Other income (loss) 4,975 1,704 4,478
Total non-interest income 71,421 84,253 118,117
Non-interest expense:      
Compensation and benefits 102,856 80,873 73,431
Professional services 46,931 50,030 37,694
Occupancy expenses 21,226 21,206 18,159
Communication expenses 12,900 13,832 15,145
FDIC insurance expense 20,032 17,478 14,316
Depreciation and amortization 11,589 13,386 13,228
Taxes, other than payroll and income taxes 12,198 10,236 11,645
Electronic data processing expenses 17,515 16,746 12,480
Corporate Insurance 7,269 6,549 5,669
Loan servicing, administrative and general expenses 26,152 27,385 22,783
Other provisions and other real estate owned expenses:      
Foreclosure and other credit related expenses 9,341 11,555 12,788
Other real estate owned expenses 23,765 24,184 11,132
Total non-interest expenses 311,774 293,460 248,470
(Loss) income before income taxes (87,724) (164,780) (8,983)
Income tax (benefit) expense 563 (161,481) 1,707
Net income (loss) (88,287) (3,299) (10,690)
Net income attributable to common shareholders $ (97,948) [1] $ (12,960) $ (20,350)
Net income per common share $ (14.86) [1],[2] $ (1.99) $ (3.20)
[1] For the years ended December 31, 2013, 2012 and 2011, net loss per common share represents basic and diluted loss per common share, respectively, for each of the periods presented. Refer to note 36 for additional information regarding net loss attributable to common shareholders.
[2] Adjusted to reflect the 1-for-20 reverse stock split, which was effective June 28, 2013.