Schedule of Mortgage-Backed Securities by Weighted Average Life (Details) - USD ($)
$ in Thousands
Dec. 31, 2015
Dec. 31, 2014
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 1,242,266 $ 1,393,303
Non-Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value 31,401 32,501
Amortized Cost $ 30,395 $ 30,291
Weighted Average Coupon Rate, Percent 2.48% 2.29%
Less than three years [Member] | Non-Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 2,558 $ 2,837
Amortized Cost $ 1,543 $ 1,785
Weighted Average Coupon Rate, Percent 3.21% 3.02%
Greater than three years and less than seven years [Member] | Non-Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 24,736 $ 17,660
Amortized Cost $ 25,478 $ 17,662
Weighted Average Coupon Rate, Percent 2.66% 2.63%
Greater than seven years and less than eleven years [Member] | Non-Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 4,107 $ 12,004
Amortized Cost $ 3,374 $ 10,844
Weighted Average Coupon Rate, Percent 0.55% 1.28%
Greater than eleven years [Member] | Non-Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 0  
Amortized Cost $ 0  
Weighted Average Coupon Rate, Percent 0.00%  
Fixed Rate [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 1,203,107 $ 1,349,558
Amortized Cost $ 1,200,329 $ 1,329,680
Weighted Average Coupon Rate, Percent 4.04% 4.05%
Fixed Rate [Member] | Less than three years [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 30,054 $ 18,428
Amortized Cost $ 30,227 $ 18,418
Weighted Average Coupon Rate, Percent 4.76% 5.13%
Fixed Rate [Member] | Greater than three years and less than seven years [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 273,477 $ 410,759
Amortized Cost $ 273,107 $ 405,739
Weighted Average Coupon Rate, Percent 3.78% 4.12%
Fixed Rate [Member] | Greater than seven years and less than eleven years [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 893,730 $ 920,371
Amortized Cost $ 891,112 $ 905,523
Weighted Average Coupon Rate, Percent 4.10% 4.00%
Fixed Rate [Member] | Greater than eleven years [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 5,846  
Amortized Cost $ 5,883  
Weighted Average Coupon Rate, Percent 3.81%  
Interest-Only [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 7,758 $ 11,244
Amortized Cost $ 8,491 $ 10,780
Weighted Average Coupon Rate, Percent 3.82% 4.04%
Interest-Only [Member] | Less than three years [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 4,974 $ 5,197
Amortized Cost $ 5,701 $ 5,563
Weighted Average Coupon Rate, Percent 3.55% 3.42%
Interest-Only [Member] | Greater than three years and less than seven years [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 2,784 $ 6,047
Amortized Cost $ 2,790 $ 5,217
Weighted Average Coupon Rate, Percent 4.97% 5.19%
Interest-Only [Member] | Greater than seven years and less than eleven years [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 0 $ 0
Amortized Cost $ 0 $ 0
Weighted Average Coupon Rate, Percent 0.00% 0.00%
Interest-Only [Member] | Greater than eleven years [Member] | Agency RMBS [Member]    
Mortgage-Backed Securities [Line Items]    
Mortgage-backed securities, at fair value $ 0  
Amortized Cost $ 0  
Weighted Average Coupon Rate, Percent 0.00%