Convo AI

UX Design
UX Research
Assessibility
UI DESIGN
project
Google Cloud Vertex AI Hackathon
role
Product Designer
duration
July 7-10th 2023 (3 day Hackathon)
team
1 Designer, 3 Developer
ABOUT
ConvoAI is a communication solution designed to break down barriers and empower individuals with communication difficulties. Using advanced AI voice recognition, content generation, and real-time assistance, ConvoAI creates a more inclusive and engaging experience for users. Whether for individuals with hearing impairments, ADHD, or those seeking alternative communication methods, ConvoAI ensures every voice is heard and valued.
Presentation Link
project scope

Inspiration

Our inspiration for developing ConvoAI was driven by a deep commitment to improving accessibility to effective communication for diverse user groups. We recognized the pressing need to bridge these communication gaps, promote inclusivity, and empower individuals who are deaf, hearing-impaired, or encounter difficulty in making phone calls. Drawing from the transformative potential of Generative AI, we envisioned a tool that would not only understand spoken language but also generate responses, provide real-time assistance, and tailor the communication experience to individual preferences.

Design Process

We used the Double Diamond process to create ConvoAI. First, we learned about the challenges faced by those with communication difficulties. This empathy-building phase shaped our insights. Then, we transformed these insights into innovative solutions, ensuring our product was not only user-centric but also intuitive and effective.
(Image from: https://www.redspark.io/double-diamond-o-que-e-e-como-usar/)
User Research

Competitive Analysis

In our competitive analysis we closely examined notable communication apps like Ava, RogerVoice, and BeWarned. Ava offers real-time captioning for both phone calls and in-person conversations while RogerVoice specializes in providing voice-to-text captions during calls. BeWarned, on the other hand, excels in transforming speech to text and vice versa, facilitating phone conversations for deaf individuals. User pain points include occasional inaccuracies in transcription, limitations in accurately capturing fast-paced or complex conversations, and challenges in adapting to app interfaces. These pain points have highlighted the need for a more accurate, user-friendly, and comprehensive communication solution, which we aim to address with ConvoAI.

Use cases

1. Deaf and Hearing-Impaired

Pain points:
  • Limited Access to Non-Verbal Cues: Lack of visual cues.
  • Lack of Real-Time Feedback: Immediate feedback is limited.
  • Background Noise Interference: Noise disrupts comprehension.


Needs:
  • Real-Time Feedback: Visual indicators for success.
  • Visual Communication Support: Real-time captioning, sign language interpretation.
  • Clear Communication: Tools to enhance speech clarity.

2. ADHD

Pain points:
  • Attention Difficulties: Maintaining focus during calls can be challenging.
  • Listening Comprehension: Understanding and retaining information can be tough.
  • Organization Challenges: Keeping track of key points and action items is difficult.


Needs:
  • Distraction Management: Tools to reduce interruptions.
  • Active Listening: Features promoting comprehension.
  • Structured Support: Visual aids and prompts for organizing thoughts.

3. Introverts

Pain points:
  • Phone Call Anxiety: Introverts often feel anxious during phone calls.
  • Preparation Stress: Preparing scripts can be stressful.


Needs:
  • Confidence Boosters: Prompts for call confidence.
  • Assistance with Scripting: Features to ease script creation.
Design prototype

App Prototype

Our design prototype revolutionizes communication accessibility. It offers real-time transcription, suggests responses, generates conversation scripts, and provides prompts to ensure effortless conversations. Post-call, a concise summary keeps key points handy. Plus, tailor your experience with voice settings. We're committed to empower individuals, break down barriers, and make conversations inclusive, independent, and engaging.
reflection

Impact

  • Increased accessibility for individuals with hearing impairments.
  • Improved focus, organization, and communication for ADHD individuals.
  • Promotion of inclusivity and equal communication opportunities.
  • Enhanced self-expression and active participation.
  • Reduced anxiety and improved mental well-being during phone interactions.

Learnings

We are thrilled to see and test first-hand that generative AI empowers accessibility design which holds the promise of creating a more inclusive digital world! It can break down communication barriers for diverse user groups. By generating personalized content, real-time support features, and tailored communication experiences, generative AI empowers individuals to engage with confidence and independence. User-centric design with empathy at its core is essential in harnessing the full potential of this technology. What's particularly exciting is that as AI continues to advance, the potential for even more innovative, user-friendly, and empowering accessibility features grows, making technology more welcoming and supportive for everyone! :)

Other projects

Fidelity Investment - FCAT
Triton Mentor
Vanguard Robo-Advisor Dashboard
Convo AI
Made by norry 🧋© 2023
Linkedin