Bosses are desperate to sign him for a second series of the X Factor spin-off show.
But in-demand Olly's music career has taken off since he first agreed to front the ITV2 programme with Caroline Flack.
Now the singer is planning to launch his career across the Pond by hitting the road as a support act to One Direction in the US, just as the X Factor auditions take place.
The band — who were finalists on the show in 2010 — are on their first US tour but have gone down so well there that their management are plotting a string of new dates.
A source said: "Olly wants to crack America — and who can blame him for that? The One Direction lads are going down a storm over there so their management are looking at getting them back out there as soon as possible after their current tour finishes on Friday.
"Olly's team are still working on a US launch date for his album, In Case You Didn't Know.
"The ideal time would coincide with a tour.
"But by attempting that he just will not be around to do the Xtra Factor audition stuff.
"It's quite a crucial show nowadays and can get up to three million people watching, so producers really want him to do it."
TV bosses are so desperate for him to stay that they are considering letting him skip the audition shows and just front the series for the live finals. Executives were in talks with Olly's management last night.
A spokesman for the star told TV Biz: "Olly's album is now starting to break big internationally and this means we have to juggle all his commitments between promoting his own album and also doing the show.
"We are confident that talks will continue to be productive from both sides."
Brought to you by bb Niall