The AI tool Devin, developed by Cognition Labs and utilizing GPT4 and Search, has come under scrutiny for potentially misleading demonstrations, similar to previous controversies involving other AI products like Google's Gemini. Critics argue that these demos, which showcase the tool's capabilities in software engineering, are cherry-picked and possibly exaggerated. This has led to broader concerns about overpromising in the AI sector, with some labeling the practice as akin to a 'pump and dump' strategy in tech, involving other products like Humane Pin. Skepticism has grown since fall 2022, as more AI tools, like Devin, are accused of being 'vaporware'—products that are over-hyped but under-deliver. Despite these allegations, some defend the legitimacy of Devin, emphasizing the need for proper response to such claims, especially given its status as a closed product.
A group was bashing Devin (an AI tool that programs) as “not real.” This is how companies should respond to such claims. TL;DR: it is real. https://t.co/spgeQDLuKB
so I just started paying attention in fall 2022. have famous VC backed companies always been over inflating expectations like this? Or has there been a step change to a new order since ChatGPT?
Yeah, I'm skeptical of many AI products right now -- because we're repeatedly seeing falsified demos (Gemini, Devin) and exaggerated claims (Humane Pin) This all feels somewhat "pump and dump" but now for apps and physical products. Fool me once... Can't get fooled again.
This combined with the Devin drama creates a worrying pattern.. Yes, founders overpromised to capitalize on the influx of capital in AI. This happens in every booming industry. However, if it keeps happening, we could see a complete shift in the way our industry is perceived… https://t.co/dSnKudMxun
Devin the "AI software engineer" -- really an agent model using GPT4 and Search to solve multistep coding problems -- is being called vaporware by some. Over-hyped seems more fair. The video debunking Devin is by a SWE and a bit slow but good. I'd watch. https://t.co/LdDOv7vAUk https://t.co/McRj734w3I https://t.co/nUyL1lfrGc
Anyone who really believed that outrageous claim that Devin was actually going to replace an SWE is too gullible and not in touch with the state of AI This was clearly a demo that oversold the product. Sadly, Google started this trend, vastly overselling Gemini. The best way to… https://t.co/x6OiZx4ZoG
The Devin critique seems valid but a bit beyond the point: "It did not do things perfectly" And then they present that by instantly jumping to: "AI devs are a scam and we should all just ignore it, your job will not be replaced" (PS I don't know Devin founders, investors etc,… https://t.co/6E5BqHjEbm
Devin by @cognition_labs getting heat for overpromising and there is speculation that their demos are fake. No way to check with a closed product.. @DatabuttonHQ, the first “virtual app developer”, has been operational for a while. Go check it out! https://t.co/JJ3JiAmuXo
Was the Devin demo faked, just like Google's? We all know these AI demos are cherry-picked and only show the best scenarios. https://t.co/ksy2Ryhtw7