It looks there's no direct way to do that in Web3 or EthersJS
And I don't prefer to use external service like Moralis or BSCScan.com, to save costs and support more chains without limits
Due to how the ERC-20 token standard behaves it does indeed there is no direct way. If we also look at a popular wallet like Metamask, they only keep a handful of listed token contracts, if the token is not listed by them, the user has to add them manually.
Furthermore, you also might find this thorough explanations relevant, How to get all tokens by wallet address:
ERC-20 (and ERC-20-like such as TRC-20, BEP-20, etc.) token balance of each address is stored in the contract of the token.
Blockchain explorers scan each transaction for Transfer() events and if the emitter is a token contract, they update the token balances in their separate DB. The balance of all tokens per each address (from this separate DB) is then displayed as the token balance on the address detail page.
Etherscan and BSCScan currently don't provide an API that would return the token balances per address.
In order to get all ERC-20 token balances of an address, the easiest solution (apart from finding an API that returns the data) is to loop through all token contracts (or just the tokens that you're interested in), and call their balanceOf(address) function.
So as the Stack Overflow answer above, the likely implementation you might want to use is to loop the contracts. Besides, I recommend you take a reference on how MetaMask implements the functionalities.