Rabbits in nature are only grabbed, if they are hunted down. Because of this they all have a strong aversion against grabbing and carrying around.
But if you do it gentle and let your bunny time to became common with it, then it will be a unpleasant but tolerable thing for your rabbit. You could help him when you are calm during the handling and if you give him reward for it. The reward could be little amounts of the favorite food while he sits in your arms, or calm petting at his favorite spots.
(Additional you could train to slow your heart rate. Like the most pray animals rabbits are sensible for the heart rate of other animals nearby. If your heart stays calm, you give the rabbits the information that everything is good and there is no need for fear.)