Demo Github Devpost Figma

UofTHacks X Submission

Ollie Ai

Introducing Ollie, an ai assistant that detects, translates, and summarizes large amounts of text taken from an image using Cohere's generate API.

What tools it uses

ReactJSViteGoogle Cloud PlatformTranslate APIVision APINetlifyCohere API

How we built it

Ollie was designed and conceptualized on Figma, then coded using HTML/CSS, JavaScript and Cohere as an API. Our tech stack is simply React for the front end and node.js for the back end. To achieve our translation and summarization we are chaining a pipeline of API requests from different providers to get a seamless unique user experience. First, to get the text, we used either Google Cloud’s vision API for image-to-text detection or a textfield for direct text input. Next, we took that text and translated it to the desired language using Google Cloud’s translation API for text language translations. Finally, we utilized the Cohere AI Javascript SDK to request their generated API for text summarizations and then presented that text to the user in various levels of verbosity.