if your only touching bitcoin. then no.
that casascius guy didn't touch fiat, he didn't even have a bank account. that didn't stop fincen getting heavy with him. maybe their thoughts have been smoothed out now, it was a long time ago, but it's the type of thing someone needs to check up on before they check up on you.
Wasn't he selling physical bitcoins for fiat? I thought that was what got him into trouble.
That case was pretty regrettable.