I mean not bIP passphrase
Ok if I understand your post, your passphrase is not part of the 2048 standard words of bip39 mnemonic phrase? You choose your passphrase using custom words?
If that’s so there is still no problem, you can actually choose your own passphrase outside the bip39 words, in fact it’s the best choice for passphrase. If that’s what you did yes ledger and other hardware wallets will perfectly recover that wallet for you as long as the seed phrase is actually a bip-39 standard.
But for verification sake, import it to the new wallet and verify the addresses to see if it’s same wallet that got recovered before you send in funds into.
For the custom word ( passphrase) be cautions of every character including even their cases (uppercase or lowercase) and even space as they are considered different characters too