{"id":367,"date":"2026-11-02T17:41:39","date_gmt":"2026-11-02T14:41:39","guid":{"rendered":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/we-pitted-ai-coding-assistants-against-each-other\/"},"modified":"2026-11-02T17:41:39","modified_gmt":"2026-11-02T14:41:39","slug":"we-pitted-ai-coding-assistants-against-each-other","status":"publish","type":"post","link":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/we-pitted-ai-coding-assistants-against-each-other\/","title":{"rendered":"We pitted AI coding assistants against each other on the same project"},"content":{"rendered":"<p class=\"has-drop-cap\">AI coding assistants have become an integral part of developers&#039; daily workflow. In this test, we built a small web app from scratch with each assistant, following the same steps. All of them produced fast and accurate results for simple functions, but clear differences emerged in complex business logic and debugging. Noticing that some suggestions contained insecure code showed that human oversight is still essential. Software developer Ryan Douglas says the healthiest approach is to treat the assistants like an intern and review every line.<\/p>\n<div class=\"wp-block-group m-keybox\">\n<p class=\"m-keybox__title\"><strong>In this article<\/strong><\/p>\n<ul>\n<li>The test project and the rules<\/li>\n<li>Speed and code quality<\/li>\n<li>Watch out for security flaws<\/li>\n<\/ul>\n<\/div>\n<h2>The test project and the rules<\/h2>\n<p>Our test project was a small web app with user login, a task list and a simple reporting screen. We gave every assistant the same written task description and started each one in the same empty folder. We followed a twenty-two-step plan in order, running the code and recording the result at the end of each step. A reference version we wrote by hand served as the yardstick for comparison.<\/p>\n<p>Our rules were simple: we could fix the assistant&#039;s code ourselves only if there was a build error; for logic errors, we had to ask the assistant. We measured the time taken, the number of fixes requested and the number of working features at the end. Software developer Ryan Douglas acted as referee, reviewing the code and scoring it for security and readability. That way, the results didn&#039;t hinge on a single person&#039;s opinion, and the criteria were open to everyone from the start.<\/p>\n<figure class=\"wp-block-image alignwide size-large\"><img decoding=\"async\" src=\"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-content\/uploads\/sites\/79\/2026\/11\/mergen-kod-asistanlarini-ayni-projede-yaristirdik-2-1100x700.webp\" alt=\"The test project and the rules \u2014 We pitted AI coding assistants against each other on the same project\" \/><\/figure>\n<blockquote class=\"wp-block-quote\">\n<p>The assistant writes fast, but the responsibility still lies with the developer.<\/p>\n<p><cite>Sophie Laurent<\/cite><\/p><\/blockquote>\n<h2>Speed and code quality<\/h2>\n<p>For simple functions such as data validation, date formatting or sorting a list, all of the assistants wrote correct code in seconds. The user interface skeleton was similarly quick. The differences emerged as the business logic got more complex: on queries joining multiple tables, two assistants produced the wrong result on the first try. The gap became more pronounced as the project grew.<\/p>\n<p>During debugging, the assistants that took in the full error message together with the relevant code snippet performed best. On code quality, we saw differences in variable naming and comments; one assistant produced needlessly long, repetitive code, while another wrote short but hard-to-follow solutions. On average, the assistants let us finish the project 40 percent faster than the reference version we wrote by hand.<\/p>\n<h2>Watch out for security flaws<\/h2>\n<p>Our most striking finding came on the security side. Two assistants suggested code that inserted user input into a query without validating it, opening the door to a classic database vulnerability. Another suggestion stored passwords in plain text. These are bugs that are hard to spot at first glance because the code appears to work. A careful eye can catch them, but someone in a hurry can easily miss them.<\/p>\n<figure class=\"wp-block-table m-facts\">\n<table>\n<tbody>\n<tr>\n<th>Topic<\/th>\n<td>Software<\/td>\n<\/tr>\n<tr>\n<th>Highlights<\/th>\n<td>AI, comparison, review<\/td>\n<\/tr>\n<tr>\n<th>Reading time<\/th>\n<td>8 minutes<\/td>\n<\/tr>\n<tr>\n<th>Written by<\/th>\n<td>Sophie Laurent<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/figure>\n<h3>Key takeaways<\/h3>\n<ul>\n<li>Different coding assistants were tested with the same task and the same steps.<\/li>\n<li>All are fast at simple tasks; differences are clear in complex logic.<\/li>\n<li>Some suggestions contained security flaws, so human review is essential.<\/li>\n<\/ul>\n<p>Ryan Douglas&#039;s advice is clear: treat the assistant like a capable intern, read every line it produces, run security scans automatically and keep your tests independent of the code the assistant writes. It&#039;s also important not to paste secret keys or customer data into the assistant. In short, the tool saves time, but it doesn&#039;t take over responsibility; the final call and oversight still rest with the developer.<\/p>\n<div class=\"wp-block-group m-readmore\">\n<p class=\"m-readmore__title\"><strong>You may also like<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/?name=password-managers-compared-right-choice-your-digital-security\">Password managers compared: The right choice for your digital security<\/a><\/li>\n<li><a href=\"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/?name=new-operating-system-update-out-12-standout-features\">The new operating system update is out: 12 standout features and known issues<\/a><\/li>\n<li><a href=\"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/?name=open-source-office-software-good-free-alternatives\">Open-source office software: How good are the free alternatives?<\/a><\/li>\n<\/ul>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>We used different AI coding assistants to build a web app from scratch. We share the results for speed, accuracy and security in the video.<\/p>\n","protected":false},"author":11,"featured_media":286,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"video","meta":{"_mergen_verified":"","_mergen_sources":"","_mergen_correction":"","_mergen_correction_date":"","footnotes":""},"categories":[54,50],"tags":[71,60,59],"class_list":["post-367","post","type-post","status-publish","format-video","has-post-thumbnail","hentry","category-ai","category-software","tag-ai","tag-comparison","tag-review","post_format-post-format-video"],"_links":{"self":[{"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/posts\/367","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/comments?post=367"}],"version-history":[{"count":0,"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/posts\/367\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/media\/286"}],"wp:attachment":[{"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/media?parent=367"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/categories?post=367"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mergen.temorya.net\/en\/demo\/gadget-lab\/wp-json\/wp\/v2\/tags?post=367"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}