Note 19 - Quarterly Financial Data (unaudited) (Tables)
12 Months Ended
Dec. 31, 2013
Quarterly Financial Information Disclosure [Abstract]  
Schedule of Quarterly Financial Information [Table Text Block]
   

Three Months Ended

 
   

Mar. 31,

2013

   

Jun. 30,

2013

   

Sep. 30,

2013

   

Dec. 31,

2013

 

Interest income

  $ 59,129     $ 68,816     $ 77,024     $ 86,758  

Interest expense

    46,145       54,917       61,532       68,584  

Net interest income

    12,984       13,899       15,492       18,174  

Other Income:

                               

Provision for loan losses

    (283

)

    (384

)

    (238

)

    (357

)

Impairment loss on investment securities

    —       —       (225

)

    —  

Realized gain (loss) on investment securities and related hedges, net

    (3,162

)

    (8,490

)

    3,319       (2,386

)

Realized gain on distressed residential mortgage loans

    136       435       486       543  

Unrealized (loss) gain on investment securities and related hedges, net

    2,456       2,057       (1,498

)

    2,449  

Unrealized gain on multi-family loans and debt held in securitization trusts, net

    7,051       8,981       6,338       9,125  

Other Income (loss)

    268       235       5       2,201  

Total other income

    6,466       2,834       8,187       11,575  

General, administrative and other expenses

    3,936       4,644       5,082       6,255  

Income from operations before income taxes

    15,514       12,089       18,597       23,494  

Income tax expense

    131       189       211       208  

Net income

    15,383       11,900       18,386       23,286  

Preferred Stock Dividends

    —       (662

)

    (1,453

)

    (1,453

)

Net income attributable to common stockholders

  $ 15,383     $ 11,238     $ 16,933     $ 21,833  

Per share basic income

  $ 0.31     $ 0.19     $ 0.27     $ 0.34  

Per share diluted income

  $ 0.31     $ 0.19     $ 0.27     $ 0.34  

Dividends declared per common share

  $ 0.27     $ 0.27     $ 0.27     $ 0.27  

Weighted average shares outstanding-basic

    49,611       58,959       63,755       63,875  

Weighted average shares outstanding-diluted

    49,611       58,959       63,755       63,875  
   

Three Months Ended

 
   

Mar. 31,

2012

   

Jun. 30,

2012

   

Sep. 30,

2012

   

Dec. 31,

2012

 

Interest income

  $ 19,091     $ 24,991     $ 43,837     $ 49,429  

Interest expense

    12,884       19,150       35,748       38,144  

Net interest income

    6,207       5,841       8,089       11,285  

Other Income:

                               

Provision for loan losses

    (230

)

    (59

)

    (247

)

    (230

)

Realized gain (loss) on investment securities and related hedges, net

    1,057       (456

)

    5,037       630  

Realized gain on distressed residential mortgage loans held in securitization trusts

    —       —       —       85  

Unrealized (loss) gain on investment securities and related hedges, net

    (872

)

    171       (1,875

)

    (1,371

)

Unrealized gain on multi-family loans and debt held in securitization trusts, net

    2,023       2,204       762       1,673  

Other Income (loss)

    375       358       (65

)

    135  

Total other income

    2,353       2,218       3,612       922  

General, administrative and other expenses

    2,661       2,645       3,189       2,932  

Income from continuing operations before income taxes

    5,899       5,414       8,512       9,275  

Income tax expense (benefit)

    —       467       598       (133

)

Income from continuing operations

    5,899       4,947       7,914       9,408  

(Loss) income from discontinued operation - net of tax

    (9

)

    42       (1

)

    (18

)

Net income

    5,890       4,989       7,913       9,390  

Net income (loss) attributable to noncontrolling interest

    51       (148

)

    —       —  

Net income attributable to common stockholders

  $ 5,839     $ 5,137     $ 7,913     $ 9,390  

Per share basic income

  $ 0.42     $ 0.34     $ 0.30     $ 0.19  

Per share diluted income

  $ 0.42     $ 0.34     $ 0.30     $ 0.19  

Dividends declared per common share

  $ 0.25     $ 0.27     $ 0.27     $ 0.27  

Weighted average shares outstanding-basic

    13,998       15,262       26,541       48,219  

Weighted average shares outstanding-diluted

    13,998       15,262       26,541       48,219