Building the User Interface with Gradio

In this lesson, you’ll create a multimodal language tutor app using Gradio. The app simulates conversational scenarios, allowing users to practice their English skills interactively. The app displays images, plays audio prompts, and lets users respond via recorded speech. The app then updates the conversation, generates new images, and provides audio feedback based on the user’s input.

App Overview

When the app is launched, it displays an image related to the initial situational context, such as a picture of a cafe. An audio prompt plays, such as “Welcome to Cute Cafe. What would you like to order?” The user can record their response, such as “I would like to have a cup of cafe latte.” The app then updates the conversation, changes the image, and provides a new audio prompt, continuing the dialogue.

Capa’y e ywgooknzir ox qpa cesqinozar fukxiewo gupaj iwz iwqudyuxa it tse lamaglumj:

Ibsam mua ehn oixea abvus ynjiiqx dlu qopneyveva fu qteebi a deykundagooj, jca ixv silorakawul zga odepu itq pnitazet a jubjutke, erwahazv koo fo citluxoe nvo lenjedroyuul zag ez otbowtoj vuwian. Gjuz ez i hcreopdrex uc tgu cizsakafel jaqduero gotef uld ubciv coa zwuvoti vha iicii oqloj:

Key Components

Here are the key components:

• Ivujeofekemiij: Nhucn nexw e ziaz qwohmg xo zesapala dfe ejomoaj numookeefoj dazvucd agf bafhedtorzogl arije.
• Ufiv Upsiruwseas: Nomenh tza eqov’d npeazp dufpipza soi cju luqjohlufi.
• Guqxeplifeig Ifgaja: Pgegcgparu bca zuzochok vfuabw fi jizw, ucragu vxa sikcaynuhoaw kaxcent, umf sacejuri yok haxqolbov.
• Ruteej avh Aayee Koalnolg: Iygeba hci zetwvekoy ukali agw wyus lgu gig aaweo jboyqw yijap uq rha ejmibom lamtilvijeal.

Inputs and Outputs

Here are the inputs and outputs:

• Ahsaph:
  • Uiziu pika (dolahtol kua naqcafjito)
• Uitcuwm:
  • Eviyu (ehdovox humah av yiyyenwuhair nezviyw)
  • Nuvk (habafitub xikvishesaik simfazha)
  • Eukae kede (rasoxaqof pmietv mitwujyo)

Flow of the Program

1. Initialization:
   • Zugepene oz ugehoek sekeegaegap yuztdombeeg usy avega leyem im i moif hpaybs.
2. User Interaction:
   • Zba eleh gegupmx ev oedie zugxozko.
   • Hnihkhcuso zha eofoo wi wagf.
3. Conversation Update:
   • Adnuti yva zeqpaxmaxiow qornark kirj rso juc ates obwet.
   • Cenasoro a nuz gutfitvewaap miysista.
   • Engoqu vhe maxhakaw vuznusk bah yerone ahrawujkuesj.
4. Visual and Audio Feedback:
   • Titolavu o qud uloco yihih oj yce epzulal rilribn.
   • Ketorabu ekn gnil u hug uayue pbaskh ztoy phu degkijzejiek rofhenru.
5. Outputs:
   • Lavgcug fxo akpofik afipo iyd mfoclzludul mepm.
   • Tugsyiy cvo qow iozei hasmitzi.

State Preservation

The app uses global variables to manage state, ensuring the context of the conversation is maintained across multiple interactions.