The 72-year-old Welsh crooner had been due to entertain tens of thousands of people at the outdoor concert in Hyde Park on Saturday. He was replaced by British singer Will Young.
Jones tweeted “sorry to all,” adding that doctors had ordered him to cancel gigs scheduled for Saturday and Sunday.
He later added: “Thanks for all the lovely messages, I don’t know if everyone’s understanding and support is making me feel better or worse! You’re the best!”
The concert was part of the BT London Live series that is offering fans without Olympic tickets an opportunity to listen to music and watch sports on big screens.
Blur’s Damon Albarn On The Olympics: ‘It Feels Like You’re Drowning In Commercialism’ Twitter Olympics: Athletes Have To Beware Being Distracted By Social Media How To Block The Olympics On Twitter And Facebook Madonna & Swastikas: Singer Defends Use Of Nazi Iconography In Show Here’s Your First Look at Catherine Zeta-Jones and Sebastian Bach in Rock of Ages