"It is unacceptable that they have a turnover of several billion euros in France without paying tax," he told Le Point magazine, adding that the French government should consider taxing online advertising revenues.
French lawmakers last year rejected plans for a proposed tax on online advertising revenues, fearing the project would hurt small local companies more than global Internet giants like Google, Facebook or Twitter.
A spokesman for Google hit back, arguing that "the internet offers a wonderful opportunity to generate growth and jobs in France".
Google cited a report from management consultant McKinsey, which said internet companies contributed 60 billion euros to the French economy in 2009, or 3.2 percent of output, and could create 450,000 jobs by 2015.
"This positive contribution would have a better chance of coming about in an environment that is supportive of the web in France and of investment in the sector. Public policy should support this," the spokesman argued.
The president's comment come as Twitter co-founder Jack Dorsey is in Paris to meet with French presidential candidates, including Sarkozy.
Sarkozy urged Twitter to follow other internet companies and base their European operations in France, the president's office said.
"Jack Dorsey responded positively to this invitation," it added.
Sarkozy argued that France should not "only be a consumer of digital products, but a creator of digital technology and innovative methods" and pointed out that both Google and Microsoft had recently opened offices in France.
Earlier Dorsey met the front-running Socialist candidate Francois Hollande and the centrist Francois Bayrou.