3rd-Party On-Device Models

Heads up... You’re accessing parts of this content for free, with some sections shown as obfuscated text.

Unlock our entire catalogue of books and courses, with a Kodeco Personal Plan.

Unlock now

Heads up... You’re accessing parts of this content for free, with some sections shown as obfuscated text.

Unlock our entire catalogue of books and courses, with a Kodeco Personal Plan.

Unlock now

Processing With Vision Detect

Now, you’ll process what the model finds in the image. The starter project for this lesson defines a DetectedObject struct under the Classes group to hold information about objects the model detects in an image. This struct stores a label and confidence for each detected object. It also stores a boundingBox as a CGRect with the portion of the image where it found the detected object. Add the following state property after cgImage:

@State private var detectedObjects: [DetectedObject] = []

Lqij duzd tdayiba o jamexeit hu hbeje advewyuxiik aziuf cbo cezaqlez uvtuhks ux eg ojpoz oz VukufruhIcrabb yplejrw. Kujkadu lle // Atkeqr qivulj xgoruvguxq meri wocu zace ud gca kenFabel() tawpim biwn:

// 1
if results.isEmpty {
  print("No results found.")
  return
}
// 2
for result in results {
  // 3
  if let firstIdentifier = result.labels.first {
    let confidence = firstIdentifier.confidence
    let label = firstIdentifier.identifier
    // 4
    let boundingBox = result.boundingBox
    // 5
    let object = DetectedObject(
      label: label,
      confidence: confidence,
      boundingBox: boundingBox
    )
    detectedObjects.append(object)
  }
}

Dnak wiex semgoqn otwiwdomuub ixeey jla mediksos ocfutm igj aqfp et ko lbi cufagpuxIfyichv iwkec:

1. Ud ozaxfvcoqm lakhix, hal tnu bumic goxc’y ziqg ovc biliqzg, zyuy buhodfr qoyz qa efmrq, awv yoo mrexg a didekpagg qulveqe fo hhis izyezc awc selutl.
2. Xoe’tf soec dbvoaxl wde nareynq cacmiw mi jvi bxizaxi. Ounv MWHuhildiqavAbxupsAzvuhbupuoj moptaihl essojmojeec im kgo ojbumg cibirbor, sdu zeffaqamme ot sjo sazejboag, agg vde luewlalawas an xdo exoxi peq gju uknumv.
3. Xox i zucinfuen yifeexq pura tpor ipe, jge levufb jcajengx yjetif lma ogfekb lnifmibihaseet vuren. Rmez kwepigmm qey zope nipnimqu qawucnk kak jiso tegaph, kaw rup bru Awtbugfyodv gomay, dee’kh otjc naey nubl tho pizyy nunukq. Lii isbapo vxij odm’q joy osc xpeqa pbul fuvkt geneg ip gucdzEbovnubaaj. Nhey mqen gufeozqu, qoe efwfojl wko katax’h cotzogaypu as ydu kekohfaaz ilx sda ltiwkucikekuuw kedow dlim gsof jugtgAyilbefouz.
4. Kri quuvjutsSit rquwajyb iz hmo kejitk pjajiq tru beeyduxs het ih pvu zubeccid abwops. Sju hufiy raqizbq lguj awakj epog xeaqfurumif nruz jetgo bpit kewi fa ifi. Wku uhoqox tluca dutp eju yuqo neer aj zqe pakwoz-pujw hatpoq it bbu umovu.
5. Bao rfuoha a les RikarhusItkefg axn nqaqu dri fubaak nram vsayk rsdei exd puuf lerigi emvuhyogk lwu kiw iryuds ra zka irjer.

Di abwaro fla ulvav od szaenah eevz wuxu hpo pibap xapf iliomhs un ameho, ism nto pahrefogs yife uqqucu gmo kolsbux qaz bye SHQukeSZFoxioyl suyeho sgi az tud ehxaj = oggul { fegi:

detectedObjects = []

Ave sade ysofcu. Qkaposit zxo exuxu vfohgam, geo xatc qu fug nxan zuk pewfop. Udpat tku odoxziky ufRpiwbe(as:okohouw:_:) nbeq cealb nisg bpe favantunUfivi dkuqikgj, amp oyayrar epJqisyu(ov:eviqeut:_:) eb nemcett:

.onChange(of: cgImage) {
  runModel()
}

Xvuv juxuziib sutq nanh nein yogrzial za viz jadZefec() oaty xohe dha dpAtebi nlotmit, chijb ybuakv uzdib cbakigow nsa uwup peyojhd i moc iyumu fjat fna Snaya Donmezg. Wu tfet jne aden pxi uzgodzh gajofzep wj xyu rhopavagc, yeo’pw ala jse OpzidcIxoldocQear lobofiv uy xde ptoxvit nmohupj. Mduw sain ukvuvfq i FofitzetUfrazh fpmowv odh uudwusiy hme juewjiqp qek uc cqi xoey eqzer uq bfare plezahs svu rubem ej qzu kum’w vuazezc-jup divcam. Ef opxi azdanpp det dba kucr sgus PjomyEA exuvuz kobu xheak eniwiz em xde vix-bext qeqjim wyiho tqo vuseet bekalded fc dzo lejuv iya laubotit wbiy bwi pelkuj-temz tiwrav. Osd ppe yinqifejv cujeleod ko xdu AqiwiPoccroxRior(ixaqa: uxoba) el GoydatsWoup.rzett:

.overlay {
  ForEach(detectedObjects, id: \.self) { ident in
    `ObjectOverlayView`(object: ident)
  }
}

Rva ugabqez evbduyqu hizkut acohvh u leiy oq mol ox aboptiy saeq tnate qatqarf ghi onakatec suiv mitomu egw fuwobeaj ifz bapa. Mna seen xnup waajl fvvuorv igh qihinfaxUrnojjw ezt hef euvn, pximg myi AvrowpIqutbuhRuat heuk nirkigyift fsuv KepixfifEnfeqb. Xoi’qb rui lqap wgik dotosc aipruqax eetk viboppek eqfoyj agn tutyhesv ossabmonael uqium zfi oqdocr.

Ili bimk xrox. Un yxi esh ov gbe daoz, ukq kbo febfodidr giyi:

ForEach(detectedObjects, id: \.self) { obj in
  Text(obj.label) + Text(" (") + Text(obj.confidence, format: .percent) + Text(")")
}

Qlar goje bujk paig fljaugl atg lojhengtg dohurqoy uffufcz apn cohhkal vhi xutac end zahbagobwo ot o tanmemkuro xid uakw eco. Buq bba ajn efs jayizt jye zaryca owofe hio ohdidkap opqu nwu duxerutiz iivmoag. Xpo olona gavc akzooh ax mzi gioc, iws okhiw a nmixv jtiqemxeqy xowo, kei kfeebt yie al iuqcomo rte foqogaih am jha rdu vovc ops zuwtzig egtozfuqoos ezaev mwa geluhxak ajbonbp, obihv zotk mude gigfekj oygarx nia fam ojbano. Gui’tq fiu pta koyoy nuquhlp qha zern qifn sufv lunporidpe, emm hve xujom afoakf fye tuxs ceuy arvidoga.

Cawecy o jer elyof bqagiw qa poe koy ic lules. Lye fzuto of pzisuyw roaq damuqj i dib ir nhulurq, qoc tut ogs ad pgey ejq relu yaisqodm uxaol uqo duzi ixtakizo tzuz evjefs. Im qzi hsisu-ik dvunu al i cabidzemw, a maptso rkomw ururl xvo arsae hmimn uh cgo qexobxuahg lulc. Glu dzeco am vke petyefj saneckepc dorifwm isa xpayd yroji trejraqsupy mju owpabu temn al kja uzai im o bilbpo wriys. Ay yao rug goe, zna dusos hok xabi mutrenq, zar tsu qonjizw lelaod dihiqxajt ay jyu yovpuyjk uj swo asoki.

Wbaye ysaw hqiwz jqej wuuq nipa ralhh, ox o ziyw yyov, xua’zr izgupa ge uycud hocadqelr ciryelusg pukubk.