Contribution from the phone being held should be easy to cancel out for the most part, as high frequency noise. It of course gets much easier if you have acceleration data from two or more devices held by different people.