Only one in five believe that the 2012 logo is an effective design.
David Thorp, director of research and information at the CIM, said: "The logo should communicate clearly an appealing identity for the games, yet the UK's marketers are deeply sceptical about its ability to do so.
"With the public and marketing professionals set against it, those involved with the Olympic logo have a lot of work to do over the next four years to win them round."
When the logo, designed by Wolff Olins, was revealed in June last year it sparked an unprecedented public and media backlash with calls for it to be axed.
The controversial logo took Wolff Olins around a year to create at an estimated cost of £400,000. It replaced the previous logo, which featured the words "London 2012" intertwined with ribbons in the shape of the Thames.
Wolff Olins was appointed without London 2012 having seen any design ideas from the agency.
The CIM's online questionnaire was completed

This
is London's 2012 Olympic logo. It is being criticized as being ineffective.