Fair Value of Financial Instruments (Carrying and Fair Value of Assets and Liabilities on a Recurring Basis) (Details) - USD ($)
$ in Thousands
3 Months Ended
Mar. 31, 2020
Dec. 31, 2019
Assets:    
Investment securities available-for-sale $ 761,539 $ 498,995
Equity securities held-for-trading 2,558 3,581
Derivatives 157,458 60,648
Liabilities:    
Loan level derivatives $ 155,393 59,701
Changes in generic pricing of securities period one, considered for analyzing changes in prices obtained from pricing service (in years) 15 years  
Changes in generic pricing of securities period two, considered for analyzing changes in prices obtained from pricing service (in years) 30 years  
Recurring basis    
Assets:    
Equity securities held-for-trading $ 2,558 3,581
Recurring basis | Investment securities available for sale    
Assets:    
Investment securities available-for-sale 761,539 498,995
Recurring basis | GSE debentures    
Assets:    
Investment securities available-for-sale 237,816 185,803
Recurring basis | GSE CMOs    
Assets:    
Investment securities available-for-sale 63,527 85,932
Recurring basis | GSE MBSs    
Assets:    
Investment securities available-for-sale 328,499 153,343
Recurring basis | SBA commercial loan asset-backed securities    
Assets:    
Investment securities available-for-sale 1 34
Recurring basis | Municipal obligations    
Assets:    
Investment securities available-for-sale 45,618  
Recurring basis | Corporate debt obligations    
Assets:    
Investment securities available-for-sale 25,959 28,986
Recurring basis | U.S. Treasury bonds    
Assets:    
Investment securities available-for-sale 59,634 44,897
Recurring basis | Foreign government obligations    
Assets:    
Investment securities available-for-sale 485  
Recurring basis | Level 1    
Assets:    
Equity securities held-for-trading 1,527 2,569
Recurring basis | Level 1 | Investment securities available for sale    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 1 | GSE debentures    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 1 | GSE CMOs    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 1 | GSE MBSs    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 1 | SBA commercial loan asset-backed securities    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 1 | Municipal obligations    
Assets:    
Investment securities available-for-sale 0  
Recurring basis | Level 1 | Corporate debt obligations    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 1 | U.S. Treasury bonds    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 1 | Foreign government obligations    
Assets:    
Investment securities available-for-sale 0  
Recurring basis | Level 2    
Assets:    
Equity securities held-for-trading 1,031 1,012
Recurring basis | Level 2 | Investment securities available for sale    
Assets:    
Investment securities available-for-sale 761,539 498,995
Recurring basis | Level 2 | GSE debentures    
Assets:    
Investment securities available-for-sale 237,816 185,803
Recurring basis | Level 2 | GSE CMOs    
Assets:    
Investment securities available-for-sale 63,527 85,932
Recurring basis | Level 2 | GSE MBSs    
Assets:    
Investment securities available-for-sale 328,499 153,343
Recurring basis | Level 2 | SBA commercial loan asset-backed securities    
Assets:    
Investment securities available-for-sale 1 34
Recurring basis | Level 2 | Municipal obligations    
Assets:    
Investment securities available-for-sale 45,618  
Recurring basis | Level 2 | Corporate debt obligations    
Assets:    
Investment securities available-for-sale 25,959 28,986
Recurring basis | Level 2 | U.S. Treasury bonds    
Assets:    
Investment securities available-for-sale 59,634 44,897
Recurring basis | Level 2 | Foreign government obligations    
Assets:    
Investment securities available-for-sale 485  
Recurring basis | Level 3    
Assets:    
Equity securities held-for-trading 0 0
Recurring basis | Level 3 | Investment securities available for sale    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 3 | GSE debentures    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 3 | GSE CMOs    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 3 | GSE MBSs    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 3 | SBA commercial loan asset-backed securities    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 3 | Municipal obligations    
Assets:    
Investment securities available-for-sale 0  
Recurring basis | Level 3 | Corporate debt obligations    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 3 | U.S. Treasury bonds    
Assets:    
Investment securities available-for-sale 0 0
Recurring basis | Level 3 | Foreign government obligations    
Assets:    
Investment securities available-for-sale 0  
Loan level derivatives    
Assets:    
Derivatives 154,761 59,365
Liabilities:    
Loan level derivatives 154,761 59,365
Loan level derivatives | Recurring basis    
Assets:    
Derivatives 154,761 59,365
Liabilities:    
Loan level derivatives 154,761 59,365
Loan level derivatives | Recurring basis | Level 1    
Assets:    
Derivatives 0 0
Liabilities:    
Loan level derivatives 0 0
Loan level derivatives | Recurring basis | Level 2    
Assets:    
Derivatives 154,761 59,365
Liabilities:    
Loan level derivatives 154,761 59,365
Loan level derivatives | Recurring basis | Level 3    
Assets:    
Derivatives 0 0
Liabilities:    
Loan level derivatives 0 0
Risk participation-out agreements    
Assets:    
Derivatives 2,473 1,229
Risk participation-out agreements | Recurring basis    
Assets:    
Derivatives 2,473 1,229
Risk participation-out agreements | Recurring basis | Level 1    
Assets:    
Derivatives 0 0
Risk participation-out agreements | Recurring basis | Level 2    
Assets:    
Derivatives 2,473 1,229
Risk participation-out agreements | Recurring basis | Level 3    
Assets:    
Derivatives 0 0
Risk participation-in agreements    
Liabilities:    
Loan level derivatives 432 283
Risk participation-in agreements | Recurring basis    
Liabilities:    
Loan level derivatives 432 283
Risk participation-in agreements | Recurring basis | Level 1    
Liabilities:    
Loan level derivatives 0 0
Risk participation-in agreements | Recurring basis | Level 2    
Liabilities:    
Loan level derivatives 432 283
Risk participation-in agreements | Recurring basis | Level 3    
Liabilities:    
Loan level derivatives 0 0
Foreign exchange contracts    
Assets:    
Derivatives 224 54
Liabilities:    
Loan level derivatives 200 53
Foreign exchange contracts | Recurring basis    
Assets:    
Derivatives 224 54
Liabilities:    
Loan level derivatives 200 53
Foreign exchange contracts | Recurring basis | Level 1    
Assets:    
Derivatives 0 0
Liabilities:    
Loan level derivatives 0 0
Foreign exchange contracts | Recurring basis | Level 2    
Assets:    
Derivatives 224 54
Liabilities:    
Loan level derivatives 200 53
Foreign exchange contracts | Recurring basis | Level 3    
Assets:    
Derivatives 0 0
Liabilities:    
Loan level derivatives $ 0 $ 0