Note 19 - Quarterly Financial Data (unaudited) (Details) - Unaudited Quarterly Results (USD $)
In Thousands, except Per Share data, unless otherwise specified
 12 Months Ended
Dec. 31, 2013
Dec. 31, 2012
Dec. 31, 2011
Note 19 - Quarterly Financial Data (unaudited) (Details) - Unaudited Quarterly Results [Line Items]      
Interest expense $ 231,178 $ 105,926 $ 4,837
Net interest income 60,549 31,422 19,454
Other Income:      
Provision for loan losses (1,262) (766) (1,693)
Impairment loss on investment securities (225)   (250)
Realized gain (loss) on investment securities and related hedges, net (10,719) 6,268 5,740
Realized gain on distressed residential mortgage loans held in securitization trusts 1,600 85  
Unrealized (loss) gain on investment securities and related hedges, net 5,464 (3,947) (9,657)
Unrealized gain on multi-family loans and debt held in securitization trusts, net 31,495 6,662  
Total other income 29,062 9,105 (3,693)
General, administrative and other expenses 7,916 6,417 5,073
Income tax expense 739 932 433
(Loss) income from discontinued operation - net of tax   14 63
Net income (loss) attributable to noncontrolling interest   (97) 97
Preferred Stock Dividends (3,568)    
Net income attributable to common stockholders 65,387 28,279 4,776
Per share basic income (in Dollars per share) $ 1.11 $ 1.08 $ 0.46
Per share diluted income (in Dollars per share) $ 1.11 $ 1.08 $ 0.46
Weighted average shares outstanding-basic (in Shares) 59,102 26,067 10,495
Weighted average shares outstanding-diluted (in Shares) 59,102 26,067 10,495
First Quarter [Member]
      
Note 19 - Quarterly Financial Data (unaudited) (Details) - Unaudited Quarterly Results [Line Items]      
Interest income 59,129 19,091  
Interest expense 46,145 12,884  
Net interest income 12,984 6,207  
Other Income:      
Provision for loan losses (283) (230)  
Realized gain (loss) on investment securities and related hedges, net (3,162) 1,057  
Realized gain on distressed residential mortgage loans 136    
Unrealized (loss) gain on investment securities and related hedges, net 2,456 (872)  
Unrealized gain on multi-family loans and debt held in securitization trusts, net 7,051 2,023  
Other Income (loss) 268 375  
Total other income 6,466 2,353  
General, administrative and other expenses 3,936 2,661  
Income from continuing operations before incometaxes 15,514 5,899  
Income tax expense 131    
Income from continuing operations   5,899  
(Loss) income from discontinued operation - net of tax   (9)  
Net income 15,383 5,890  
Net income (loss) attributable to noncontrolling interest   51  
Net income attributable to common stockholders 15,383 5,839  
Per share basic income (in Dollars per share) $ 0.31 $ 0.42  
Per share diluted income (in Dollars per share) $ 0.31 $ 0.42  
Dividends declared per common share (in Dollars per share) $ 0.27 $ 0.25  
Weighted average shares outstanding-basic (in Shares) 49,611 13,998  
Weighted average shares outstanding-diluted (in Shares) 49,611 13,998  
Second Quarter [Member]
      
Note 19 - Quarterly Financial Data (unaudited) (Details) - Unaudited Quarterly Results [Line Items]      
Interest income 68,816 24,991  
Interest expense 54,917 19,150  
Net interest income 13,899 5,841  
Other Income:      
Provision for loan losses (384) (59)  
Realized gain (loss) on investment securities and related hedges, net (8,490) (456)  
Realized gain on distressed residential mortgage loans 435    
Unrealized (loss) gain on investment securities and related hedges, net 2,057 171  
Unrealized gain on multi-family loans and debt held in securitization trusts, net 8,981 2,204  
Other Income (loss) 235 358  
Total other income 2,834 2,218  
General, administrative and other expenses 4,644 2,645  
Income from continuing operations before incometaxes 12,089 5,414  
Income tax expense 189 467  
Income from continuing operations   4,947  
(Loss) income from discontinued operation - net of tax   42  
Net income 11,900 4,989  
Net income (loss) attributable to noncontrolling interest   (148)  
Preferred Stock Dividends (662)    
Net income attributable to common stockholders 11,238 5,137  
Per share basic income (in Dollars per share) $ 0.19 $ 0.34  
Per share diluted income (in Dollars per share) $ 0.19 $ 0.34  
Dividends declared per common share (in Dollars per share) $ 0.27 $ 0.27  
Weighted average shares outstanding-basic (in Shares) 58,959 15,262  
Weighted average shares outstanding-diluted (in Shares) 58,959 15,262  
Third Quarter [Member]
      
Note 19 - Quarterly Financial Data (unaudited) (Details) - Unaudited Quarterly Results [Line Items]      
Interest income 77,024 43,837  
Interest expense 61,532 35,748  
Net interest income 15,492 8,089  
Other Income:      
Provision for loan losses (238) (247)  
Impairment loss on investment securities (225)    
Realized gain (loss) on investment securities and related hedges, net 3,319 5,037  
Realized gain on distressed residential mortgage loans 486    
Unrealized (loss) gain on investment securities and related hedges, net (1,498) (1,875)  
Unrealized gain on multi-family loans and debt held in securitization trusts, net 6,338 762  
Other Income (loss) 5 (65)  
Total other income 8,187 3,612  
General, administrative and other expenses 5,082 3,189  
Income from continuing operations before incometaxes 18,597 8,512  
Income tax expense 211 598  
Income from continuing operations   7,914  
(Loss) income from discontinued operation - net of tax   (1)  
Net income 18,386 7,913  
Preferred Stock Dividends (1,453)    
Net income attributable to common stockholders 16,933 7,913  
Per share basic income (in Dollars per share) $ 0.27 $ 0.30  
Per share diluted income (in Dollars per share) $ 0.27 $ 0.30  
Dividends declared per common share (in Dollars per share) $ 0.27 $ 0.27  
Weighted average shares outstanding-basic (in Shares) 63,755 26,541  
Weighted average shares outstanding-diluted (in Shares) 63,755 26,541  
Fourth Quarter [Member]
      
Note 19 - Quarterly Financial Data (unaudited) (Details) - Unaudited Quarterly Results [Line Items]      
Interest income 86,758 49,429  
Interest expense 68,584 38,144  
Net interest income 18,174 11,285  
Other Income:      
Provision for loan losses (357) (230)  
Realized gain (loss) on investment securities and related hedges, net (2,386) 630  
Realized gain on distressed residential mortgage loans held in securitization trusts   85  
Realized gain on distressed residential mortgage loans 543    
Unrealized (loss) gain on investment securities and related hedges, net 2,449 (1,371)  
Unrealized gain on multi-family loans and debt held in securitization trusts, net 9,125 1,673  
Other Income (loss) 2,201 135  
Total other income 11,575 922  
General, administrative and other expenses 6,255 2,932  
Income from continuing operations before incometaxes 23,494 9,275  
Income tax expense 208 (133)  
Income from continuing operations   9,408  
(Loss) income from discontinued operation - net of tax   (18)  
Net income 23,286 9,390  
Preferred Stock Dividends (1,453)    
Net income attributable to common stockholders $ 21,833 $ 9,390  
Per share basic income (in Dollars per share) $ 0.34 $ 0.19  
Per share diluted income (in Dollars per share) $ 0.34 $ 0.19  
Dividends declared per common share (in Dollars per share) $ 0.27 $ 0.27  
Weighted average shares outstanding-basic (in Shares) 63,875 48,219  
Weighted average shares outstanding-diluted (in Shares) 63,875 48,219