If we are comparing bitcoin transaction with banking transaction what about providing loan
Yes. People and/or businesses with bitcoins can loan them to you if they want to.
Absolutely... and if you think about it, it's kind of easy to see this connection and that bitcoin could easily be loaned out to people, from people; rather than people going to the bank.
Bitcoin is meant to be a Peer to Peer cash system. To do business, whether accepting payments, paying your employees, or whatever; bitcoin enables and kind of nudges you to do that sort of business with other peers that would like to provide that certain service. Now, if bitcoin becomes more popular... then loaning services might become more centralized... but that's another story, I guess.