Thoughtworks & Groq partner to deliver faster, cheaper AI in Australia
Thoughtworks has entered a strategic partnership with Groq to address the performance and economic challenges facing Australian enterprises seeking to scale artificial intelligence solutions. The collaboration will focus on deploying Groq's Language Processing Unit (LPU) to enable real-time AI inference at lower costs, while leveraging Thoughtworks' expertise in designing and implementing trustworthy AI systems.
AI deployment
The partnership aims to provide Australian organisations with the technology and support needed to implement AI-driven systems in operational settings. Groq's deterministic LPU architecture is positioned to deliver instant and predictable responses in high-demand environments, which are requirements for applications such as large language models and real-time enterprise solutions.
The LPU architecture is built for AI inference at scale, with an emphasis on performance reliability and cost efficiency. This is set to support enterprises dealing with growing demands on AI-powered services, particularly where speed and accuracy are critical for user experience and operational productivity.
Proof-of-concept
To assess the impact of the partnership, Thoughtworks developed a real-time speech-to-text proof of concept on Groq's LPU platform. The test simulated a high-volume call centre environment, utilising realistic datasets provided by Collinear AI. Collinear AI also supplied evaluation tools for real-time performance measurement.
Results of the proof of concept demonstrated significant improvements in both speed and cost. Response times were reported as up to five times faster than traditional GPU-based platforms. The running costs were also up to five times lower, supporting the claim of improved economic viability for large-scale use cases.
"Every enterprise wants AI that works, but compute is scarce," said Jonathan Ross, Founder and CEO, Groq. "Our partnership with Thoughtworks allows us to put Groq's performance directly into production."
Market considerations
The increased interest in AI deployment has amplified scrutiny on infrastructure costs and real-world reliability. Enterprises face budgetary pressures, and the requirement to deliver AI that enhances user experience and delivers measurable business outcomes has grown in importance.
The collaboration between Thoughtworks and Groq is targeted at offering direct value, attempting to eliminate the need for organisations to choose between high performance, quality user experience, and budget constraints. The demonstrated use of curated training data and accelerated architecture is intended to set new performance standards in the Australian market.
"Imagine the competitive advantage organisations could build when not having to choose between improved AI performance, user experience or budgets," said Andy Nolan, Global VP of AI, Thoughtworks. "Our partnership with Groq moves the conversation from 'what if' to 'what's next.' By combining their groundbreaking speed with our deep expertise in AI design, engineering and implementation, we're delivering high-performance, cost-effective, and sovereign AI solutions for Australian businesses."
