Question on lavender oil and body butter

hey Bob, do you think if I infused olive oil with lavender then used it in body butter that the fragrance would hold up?