I voted for "I would like 2000$ in bitcoins" in your poll, because I would like $2000 in bitcoins.
How can I make a transaction in New York to buy 2000$ worth of bitcoins
Here in the United States (such as in New York), we typically put the $ before of the amount, not after it.
So, I assume you are looking to buy
$2000 worth of bitcoins?
to my wallet with low interest
Interest is something that you pay on borrowed money. Are you planning on borrowing bitcoins, or do you want to buy them? If you want to buy them then you won't have any interest to pay.
and having cash in n hand?
You can deposit that cash into a bank account and then transfer it to a business like Coinbase.com to buy bitcoins if you like.
If you prefer to exchange cash directly for bitcoins without using a bank account, then I would recommend using localbitcoins.com to find someone nearby that has bitcoins and wants cash.
I'd like to know the quickest and easiest way please and thank you!!
Fast, cheap, easy: generally in life and business you can have two of the three. It is rare to find situations where all three are possible.
Responding to a listing on localbitcoins.com will probably be fast and easy, but it might not be cheap.
Coinbase will be cheap and easy, but it might not be fast.
I'm not currently aware of any methods that are cheap and fast, but difficult.