{"id":13717,"date":"2025-03-31T14:29:32","date_gmt":"2025-03-31T12:29:32","guid":{"rendered":"https:\/\/www.silamir.com\/?p=13717"},"modified":"2025-03-31T14:38:44","modified_gmt":"2025-03-31T12:38:44","slug":"%f0%9d%97%9f%f0%9d%97%b2%f0%9d%98%80-%f0%9d%97%ba%f0%9d%97%bc%f0%9d%97%b1%f0%9d%97%b2%f0%9d%97%b9%f0%9d%97%b2%f0%9d%98%80-%f0%9d%97%b1%f0%9d%97%b2-%f0%9d%97%b9%f0%9d%97%ae%f0%9d%97%bb%f0%9d%97%b4","status":"publish","type":"post","link":"https:\/\/www.silamir.com\/en\/insight\/%f0%9d%97%9f%f0%9d%97%b2%f0%9d%98%80-%f0%9d%97%ba%f0%9d%97%bc%f0%9d%97%b1%f0%9d%97%b2%f0%9d%97%b9%f0%9d%97%b2%f0%9d%98%80-%f0%9d%97%b1%f0%9d%97%b2-%f0%9d%97%b9%f0%9d%97%ae%f0%9d%97%bb%f0%9d%97%b4\/","title":{"rendered":"Diffusion\" language models on the way: revolution in sight?"},"content":{"rendered":"<p><\/p>\n\n\n\n<p id=\"ember79\">You've probably heard of Stable Diffusion for image creation. Now imagine the same method applied to text or code generation.<\/p>\n\n\n\n<p><strong>No more token-by-token generation <\/strong>(autoregressive): the model produces everything en bloc, then \"refines\" the answer in several passes. Result:<\/p>\n\n\n\n<p><strong>- Speed multiplied by 10<\/strong> (over 1,000 tokens\/sec)<\/p>\n\n\n\n<p><strong>- Lower inference costs <\/strong><\/p>\n\n\n\n<p><strong>- More global corrections<\/strong> (the model sees and reviews the whole answer)<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"ember85\">Why is this a major leap?<\/h3>\n\n\n\n<p id=\"ember134\">- AI agents, which link tasks and reasoning, can work <strong>significantly faster<\/strong> and avoid long waits for generation<\/p>\n\n\n\n<p id=\"ember134\">- Developers gain in <strong>productivity <\/strong>thanks to virtually instantaneous code generation, with easy corrections<\/p>\n\n\n\n<p id=\"ember134\">- Companies could deploy these models <strong>on a larger scale, without blowing their budget<\/strong><\/p>\n\n\n\n<p><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">The secret?<\/h3>\n\n\n\n<p>It is inspired by the AI diffusion technique for images: we start with a textual \"draft\" and gradually refine it until we obtain a coherent answer. The model is no longer constrained by a strictly linear progression.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">This could democratize as-yet unexplored use cases <\/h3>\n\n\n\n<p><strong>The challenge<\/strong> The key is to ensure ethical alignment and impeccable quality, especially with such a \"turbo\". Speed shouldn't come at the expense of reliability.<\/p>\n\n\n\n<p><strong>A philosophical note<\/strong> We humans often write word after word, like GPT (autoregressive) models. Recent approaches, where AI takes the time to \"think\" before revealing a more complete answer, are reminiscent of the way we write a draft and then correct it. But diffusion goes even further: it considers the whole text (or code) as a whole, and refines it layer by layer. It's a fascinating mechanism, perhaps opening the way to other ways of structuring thought... and \"thinking\". Worth exploring!<\/p>\n\n\n\n<p id=\"ember1409\">Discover our <a href=\"https:\/\/www.silamir.com\/en\/expertise\/data\/\" data-type=\"link\" data-id=\"https:\/\/www.silamir.com\/expertise\/data\/\">AI expertise <\/a>and <a href=\"https:\/\/www.silamir.com\/en\/contact\/\" data-type=\"page\" data-id=\"342\">contact our experts<\/a> to discuss your specific projects and needs. <\/p>\n\n\n\n<p id=\"ember1409\"><strong>By J\u00e9r\u00e9my BRON, AI Director, Silamir Group<\/strong><br><\/p>\n\n\n\n<p id=\"ember1409\"><\/p>","protected":false},"excerpt":{"rendered":"<p>Vous avez sans doute entendu parler de la diffusion pour la cr\u00e9ation d\u2019images (type Stable Diffusion). Imaginez maintenant la m\u00eame m\u00e9thode appliqu\u00e9e \u00e0 la g\u00e9n\u00e9ration de texte ou de code. Finie la g\u00e9n\u00e9ration token par token (autor\u00e9gressive) : le mod\u00e8le produit tout en bloc, puis \u201caffine\u201d la r\u00e9ponse en plusieurs passes. R\u00e9sultat : \u2022 Vitesse [&hellip;]<\/p>\n","protected":false},"author":10,"featured_media":13689,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_seopress_robots_primary_cat":"none","_seopress_titles_title":"","_seopress_titles_desc":"","_seopress_robots_index":"","footnotes":"","_links_to":"","_links_to_target":""},"categories":[62],"tags":[78],"secteur_categories":[],"expertise_categories":[52],"editeur":[],"offres":[],"model":[],"class_list":["post-13717","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-insight","tag-ia","expertise_categories-ia"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/posts\/13717","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/comments?post=13717"}],"version-history":[{"count":3,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/posts\/13717\/revisions"}],"predecessor-version":[{"id":13723,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/posts\/13717\/revisions\/13723"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/media\/13689"}],"wp:attachment":[{"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/media?parent=13717"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/categories?post=13717"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/tags?post=13717"},{"taxonomy":"secteur_categories","embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/secteur_categories?post=13717"},{"taxonomy":"expertise_categories","embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/expertise_categories?post=13717"},{"taxonomy":"editeur","embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/editeur?post=13717"},{"taxonomy":"offres","embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/offres?post=13717"},{"taxonomy":"model","embeddable":true,"href":"https:\/\/www.silamir.com\/en\/wp-json\/wp\/v2\/model?post=13717"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}