Reactive Machines

8 amapulatifomu wamahhala wokubamba amamodeli wokufunda womshini

Ukusebenzisa imodeli yokufunda yomshini kungenye yezinyathelo ezibucayi kakhulu ekusetha iphrojekthi ye-AI. Noma ngabe kuyindlela yokuPrototype noma ukala ukukhiqizwa, ukuthunyelwa kwemodeli ku-ML kuqinisekisa ukuthi amamodeli atholakalayo futhi angasetshenziswa ezindaweni ezisebenzayo. Kulesi sihloko, sizohlola amapulatifomu amahle kakhulu wokuthumela amamodeli wokufunda womshini, ikakhulukazi lawo asivumela ukuthi sibambe amamodeli we-ML mahhala ngokusetha okuncane.

Yini amamodeli wokufunda umshini?

Amamodeli wokufunda ngomshini yizinhlelo eziqonda amaphethini afihliwe kwidatha ukwenza izibikezelo noma ahlanganise amaphuzu afanayo wedatha. Yimisebenzi yezibalo eqeqeshwa kwimininingwane yomlando. Lapho ukuqeqeshwa sekuqediwe, ifayela lesisindo semodeli eligciniwe lingakwazi ukubona kalula amaphethini, lihlukanise imininingwane, libone ama-anomalies, noma, ezimweni ezithile, laze akhiqize okuqukethwe. Ngakho-ke, ososayensi bedatha basebenzisa ama-algorithms ahlukene wokufunda umshini njengesisekelo semodeli. Njengoba idatha yethulwa ku-algorithm ethile, iguqulwa ukuze ibhekane nomsebenzi othile, osiza ukudala amamodeli wokufunda womshini angcono.

Isibonelo, isihlahla sesinqumo siyi-algorithm ejwayelekile kuzo zombili izilinganiso zokuhlukaniswa kanye nokubikezela ukubikezela. Usosayensi wedatha ofuna ukuthuthukisa imodeli yokufunda umshini okhomba izinhlobo zezilwane ezahlukahlukene angaqeqesha i-algorithm yesihlahla somuthi esebenzisa izithombe zezilwane ezahlukahlukene. Ngokuhamba kwesikhathi, i-algorithm ibizoshintshwa yidatha futhi iye ngokuya kangcono ekuhlukaniseni izithombe zezilwane. Lokhu kuzogcina kube yimodeli yokufunda umshini.

Kungani I-Host Machine Learning Models?

Lapho usuqeqeshe imodeli yokufunda yomshini wakho futhi wayivivinya kwimininingwane yesampula onayo, njengedatha yokuhlola, manje sekuyisikhathi sokusingatha esiteji esifanelekile esihlangabezana nezidingo zangempela. Ukuthi inhloso yokugcina yemodeli ukwenza izibikezelo nge-API, noma zishumeke amamodeli ezinhlalulweni zewebhu. Ukusingathwa kwemodeli kuqinisekisa ukuthi imodeli yethu iyatholakala futhi isebenza kwabanye.

Yini eyenza ukusingathwa kwemodeli kube okubalulekile:

  • Ukutholakala nokusebenzisana: Amamodeli wokubamba avumela abasebenzisi noma ezinye izinhlelo zokusebenza ezisuselwa phezulu kwemodeli ebanjelwe ukuxhumana nemodeli kusuka kuphi nge-API.
  • Isikali: Futhi, iningi lamapulatifomu okusingathwa livame ukuhlinzeka ngokukala okusiza imodeli ukuphatha izicelo zabasebenzisi abaningi ngasikhathi sinye futhi kuqinisekisa ukuthi ukusebenza kwawo akuweli.
  • Ukusebenzisana: Futhi, amamodeli aphethwe angabiwa kalula ngamaqembu noma nomphakathi obanzi wempendulo nokuhlanganiswa okwethembekile.
  • Ukuqapha kanye nokulungiswa: Ngokusingatha imodeli, umuntu angabheka kalula ukugawulwa kwemithi, ukuguqulwa, namathuluzi okuqapha asiza ukugcina ukusebenza kwemodeli kusesimweni.
  • Ukuhlanganiswa: Imodeli ebanjelwe ingahlanganiswa kalula nolwazi, izinhlelo zokusebenza zangaphambili, noma ezinye ama-API zokulawulwa kwepayipi elingenamthungo.

Amapulatifomu aphezulu wokubamba amamodeli wokufunda womshini

Ukwakha imodeli yokufunda umshini ngokweqiniso kuphela kuthatha ingxenye yesikhathi; elinye isigamu lilele ekwenzeni lifinyeleleke ukuze abanye bakwazi ukuzama lokho owakhile. Ngakho-ke, amamodeli wokusingathwa ezinsizakalweni zamafu axazulula inkinga ongadingeki ukuthi uyiqede emshinini wangakini. Ngakho-ke kulesi sigaba, sizobe sihlola amapulatifomu aholayo amahhala wokufunda amamodeli wokufunda umshini, acacisa izici nezinzuzo zawo.

1. Ukukhulisa izikhala zobuso

Izikhala zobuso bezinga, noma ngamafuphi, i-HF-spaces, ipulatifomu yomphakathi-ye-Centric evumela abasebenzisi ukuthi basebenzise amamodeli abo okufunda umshini besebenzisa imitapo yolwazi edumile. Izikhala zivumela ukusingatha imodeli ngemigqa embalwa yekhodi, futhi ukusetshenziswa komphakathi kumahhala ngokuphelele ngokufinyelela kwimvelo eyabiwe nemvelo ye-GPU.

Izici ezibalulekile zokuqabula izikhala zobuso

  • Imahhala ukuyisebenzisa ngokusekelwa okwakhelwe ngaphakathi kwePython.
  • Iphinde inikeze ukuguquguquka ekukhetheni izinsizakusebenza ze-computational kususelwa kwizidingo zemodeli.
  • Inikeza iplatifomu yabahlanganyeli kanye nokuzibandakanya komphakathi omkhulu.

I-Streamlit ihlinzeka ngeplatifomu yamafu yamahhala esiza abathuthukisi basebenzise izinhlelo zokusebenza ukuqondiswa kokuqondile kusuka kuma-github repositories. Inikeza ukusingathwa kwamahhala ngezinsizakusebenza eziyisisekelo, okwenza kube kuhle ngokwenza amadeshibhodi nezinhlelo zokusebenza ze-ML zokusebenzisa. Kwenzelwe ukwabiwa okusheshayo nokulula kwezinhlelo zokusebenza zedatha.

Izici ezibalulekile ze-Streamlit Community Cloud

  • Inikeza ukuthunyelwa okulula ngama-GitHub Repositories.
  • Akukho ukusethwa kweseva okudingekayo, ngakho-ke kunciphisa izinsiza ezibheke phezulu.
  • Iphinde yenza lula inqubo yokuhambisa ukuthunyelwa futhi yenza kube lufinyelele ku-non-Ochwepheshe ekuphathweni kwamamodeli.

3. I-Gradio

I-Gradio yomibili umtapo wezincwadi wePython kanye neplatifomu yokusingathwa yokwakha ngokushesha izinhlelo zokusebenza ze-UI zewebhu zamamodeli wokufunda umshini. Lokhu kwenza ukuthi izicelo zitholakale kubasebenzisi ngaphandle kobuchwepheshe ekuthuthukisweni kweWebhu. Isetshenziselwa ukudala ama-demo akwabishelwane namadeshibhodi asebenzayo nezinhlelo zokusebenza zedatha.

Izici ezibalulekile ze-Gradio

  • Inikeza ukufinyelela kumamodeli wokufunda womshini ngokuhlinzeka ngezindawo ezisebenziseka kalula.
  • Iphinde isekele ukuhlanganiswa okungenamthungo nge-hugging izikhala zobuso zokusingathwa.
  • Ivumela onjiniyela ukuthi babelane ngamamodeli ngaphandle kokwakha izinhlelo zewebhu ngokwezifiso.

4. Pythonany shown

I-Pythonany Phezu ipulatifomu esekwe efwini yokubamba nokuthuthukisa izinhlelo zePython. Ivumela abathuthukisi ukuthi basebenze imibhalo yePython. Ngakho-ke, abathuthukisi abafuna ukufaka futhi bakhiphe ikhodi yabo ngaphandle kokusebenzisa amaseva abo endawo ukusetha izinhlelo zokusebenza zewebhu ngeFlask ne-Django.

Izici ezibalulekile zePythonany shown

  • I-Pythonany Phela inikeza ukuhlanganiswa okulula nemininingwane efana ne-MySQL, okwenza kube yinto elungele ukumbozwa izinhlelo zokusebenza ngemininingwane ye-Backend.
  • Kuhle ukukhombisa izinhlelo zokusebenza ze-prototype ngoba akudingi ukusetha imvelo yePython yendawo. Lokhu kwenza kube kuphelele kubaqalayo noma labo abafuna ukukhombisa i-prototype esheshayo.
  • Le pulatifomu iyekela owakhelwe ngaphakathi kokuhlela imisebenzi Python ukugijima ngezikhathi ezithile.

I-5. I-MLLOW

I-MLFLOW iyipulatifomu yomthombo ovulekile ophatha impilo ephelele yephrojekthi yokufunda yomshini, kusukela ekuhlolweni kokuthunyelwa. Ngenkathi inganikeli ingqalasizinda yokubamba ngokuqondile, amamodeli we-MLFLOW angathunyelwa kumapulatifomu wefu asebenzisa kalula amaseva akhelwe ngaphakathi.

Izici ezibalulekile ze-MLFLOW

  • I-MLFLOW isiza ukugcina ithrekhi yokusebenza kwemodeli, irejista yemodeli, kanye nokulawula inguqulo.
  • Inika amandla abathuthukisi ukubambisana kwethimba ezindaweni ezisebenza ngebhizinisi ngokugcina izingodo nokuziqhathanisa nokugijima okuningi kwamamodeli abo we-ML.
  • Ihlangana kalula nemitapo yolwazi yokufunda yomshini namanye amathuluzi okusekela.

6. I-DAGSHUB

I-DAGSUB iyingxenye yokubambisana eyakhelwe ngqo amaphrojekthi wokufunda umshini. Ihlanganisa i-git (ngokulawulwa kwenguqulo), i-DVC (yedatha nokuqinisekiswa kwemodeli), kanye ne-mlflow (yokulandela ngomkhondo). Singaphatha ama-datasets, izincwadi zokubhalela, namamodeli, bese ulandelela i-ML Liffecycle yakho endaweni eyodwa.

Izici ezibalulekile ze-dagshub

  • Ivumela ukusebenzisana okungenamthungo nokulula ukwabiwa kwemininingwane, amamodeli, kanye nokuhlolwa, okwenza kube lula ukuthi abathuthukisi basebenzisane futhi bahlele izindawo zomsebenzi.
  • Inikeza namathuluzi wokubona owakhelwe ngaphakathi wokuqapha ukusebenza kwemodeli nokuqhathanisa amamethrikhi kuzo zonke izivivinyo ezihlukile.
  • I-DAGSUB isekela izakhi zomthombo ovulekile, okwenza kube nezimo ukuze kusebenze ngokwezifiso okunye futhi kusiza ekukhuliseni ukusebenza kwayo, ikakhulukazi izidingo zabasebenzisi.

7. Kubeflow

I-Kubeflow iyipulatifomu yomthombo ovulekile eyenzelwe lula ukwenziwa lula ukuthunyelwa, ukuqapha, kanye nokuphathwa kwamamodeli wokufunda umshini noma ukugeleza komsebenzi kuma-Kubernete. Ihlose ukuhlinzeka ukwesekwa kokuphela kokuphela kwalo lonke umshini wokufunda impilo, kusuka ekulungiseleleni kwedatha ukuqeqeshwa okuyisibonelo ekuthunini kokuthumela nokuqapha ekukhiqizeni. I-KubefLow ivumela ukuba scable, kwasatshalaliswa, kanye nokusebenza kokusebenza kwe-ML.

Izici ezibalulekile ze-Kubeflow

  • Kusiza ukuthunyelwa okulula kwamamodeli wokufunda umshini kube yilapho kuvumela ukuhlanganiswa okulula nokuthuthwa kalula nama-Kubernete ngokuzenzakalela ukukala nokuphatha okuzenzakalelayo.
  • Iphinde isekele izinhlaka zemishini ethandwayo enjenge-tensorflow, i-pytorch, i-mxnet, nabanye, ivumela abathuthukisi ukuthi basebenze ngamathuluzi abo athandwayo.
  • I-KubefLow ikuvumela ukuthi uchaze amapayipi okufunda umshini njengekhodi usebenzisa i-python. Lokhu kunika amandla okulula, ukuhlola, nokwabelana ngokuhamba komsebenzi.

8. Nikeza

Ipulatifomu yefu enikeza isixazululo esihlanganisiwe sokuthumela nokuphatha izinhlelo zokusebenza zewebhu, ama-APIs, namawebhusayithi alomile. Kwenza lula inqubo yokusingathwa kwezicelo ezigcwele zesitaki. Lokhu kunikeza ukukala okuzenzakalelayo, ukuthunyelwa okuqhubekayo, nokuhlanganiswa okulula nemininingwane ethandwayo. I-Relend yenzelwe ukuhlinzeka ngenye indlela elula futhi enobungane kwabahlinzeki befu lendabuko ngokugxila okukhulu kalula ekusetshenzisweni, isivinini, kanye nokusebenza kahle kwezicelo ezincane nezebhizinisi.

Izici ezibalulekile zokwenza

  • Ukunikezwa okuhlinzekwa ngokuhlanganiswa okulula ne-GitHub ne-Gitlab, okuvumela ukuthunyelwa okuzenzakalelayo noma nini lapho izinguquko zidonswa kuma-repositories futhi ziqinisekise ukuthunyelwa okuqhubekayo ngokusetha okuncane.
  • Isikali ngokuzenzakalela izinhlelo zokusebenza phezulu naphansi ngokususelwa kwithrafikhi, futhi kuqinisekisa ukusebenza kwenziwa ngaphandle kokungenela okumakiwe.
  • Unikeze futhi uhlinzeka ngezingodo zesikhathi sangempela, ukuqapha ukusebenza, kanye nezaziso zokulandela ukusebenza kohlelo lokusebenza. Futhi, ingahlanganiswa nezenzo ze-GitHub zamapayipi ezenziwe ngezifiso nokuhamba komsebenzi.

Ukuqhathanisa phakathi kwamapulatifomu

Indawo yokuqhudelana Okungcono kakhulu Amandla asemqoka Amanothi
Ukugoqa izikhala zobuso Ama-demos, ukwaba umphakathi Ukusetha okulula nge-Gradio / ukuqondiswa kwe-Gradio / ukusekelwa, ukusekelwa kwe-GPU, ama-repos angubani I-TIER yamahhala enezinsiza ezikhawulelwe (i-CPU kuphela). Izikhala ze-GPU nezindawo ezizimele zidinga amapulani akhokhelwayo.
I-Streamlit Community Cloud Amadeshibhodi, izinhlelo zokusebenza zewebhu ze-ML Ukuhlanganiswa kwe-GitHub, ukuthunyelwa okulula, ukuvuselelwa okubukhoma Imahhala yezinhlelo zokusebenza zomphakathi ngokuhlanganiswa kwe-GitHub. Ilungele amaphrojekthi amancane noma amademo.
Igileli elikhulayo Imodeli exhumana ye-uis Ukufakwa kokufaka okubonakalayo / kokukhipha okunembile, izixhumanisi ezibizayo, ukuhlanganiswa nezikhala ze-HF Umthombo ovulekile futhi ukhululekile ukusebenzisa endaweni yangakini noma nge-hugging izikhala zobuso. Akukho ukusingathwa okuzinikezele ngaphandle kokuthi kuhlanganiswe nezikhala
Pythonany njani I-Python API elula kanye nemibhalo Amakhodi asuselwa kwisiphequluli, ukwesekwa kwe-Flask / DJango, ukuhlela imisebenzi I-TIER yamahhala ivumela ukusingathwa kwezinhlelo zokusebenza zewebhu ezincane nge-bandwidth ne-CPU imikhawulo. Kudingeka izinhlelo ezikhokhelwayo ekusetshenzisweni okwengeziwe noma izizinda zangokwezifiso.
Mlflow Ukuphathwa Kwezimpilo Ukulandelela Ukulandelela, I-Model Registry, Squable to Four Platforms I-MLFLOW ngokwayo ivulekile futhi ikhululekile ukuyisebenzisa. Izindleko zokubamba zincike kwingqalasizinda yakho (isib., AWS, AZURE, ku-Prem).
Dagshub Ukubambisana kwe-ML Development I-GIT + DVC + MLFLWING Ukuhlanganisa, ukulandela ngomkhondo okubonakalayo Inikeza ama-repositoricoes angokomphakathi nawangasese mahhala nge-CD eyisisekelo ye-CI / CD ne-MLFLOW ukuhlanganiswa kwe-MLFLOW / DVC.
Kubeflow Ukusebenza kwe-Enterprise-Scale I-automation egcwele ye-ML Pipeline, ku-Kubernetetes-Native, Yezifiso kakhulu Umthombo ovulekile futhi ukhululekile ukuyisebenzisa, kepha idinga iqoqo le-Kubernetetes (elingangena izindleko zefu ngokuya ngokusetha).
Volisa Ukuthunyelwa ngokwezifiso ngokwezifiso Usekela umdonyane, imisebenzi yangemuva, izinhlelo zokusebenza ezigcwele ngokuhlanganiswa kwe-git Uhlelo lwamahhala olutholakala kumasayithi a-Static kanye nezinsizakalo eziyisisekelo zewebhu ngokulinganiselwa kokusetshenziswa. Amasu akhokhelwe anikela ngamandla amaningi nezici.

Ukugcina

Umjikelezo wokuphila wokufunda komshini awukapheli kuze kube yilapho amamodeli asetshenziswa emhlabeni wangempela. Ngakho-ke, ukukhetha isiteji esifanele sokusingatha imodeli yokufunda yomshini wakho kuyisinyathelo esibaluleke kakhulu salo mjikelezo wempilo, ngokuya ngosayizi wephrojekthi kanye nezidingo zobuchwepheshe. Ngakho-ke, uma ufuna ama-demos asheshayo ngokusetha okuncane, amapulatifomu afana nezikhala ezibunjiwe, ukuqondiswa kwezindawo, kanye ne-gradio ngamanye amaphuzu okuqala. Ukuze uthole eminye imisebenzi ethuthukisiwe yokuhanjiswa kwemvelo yokukhiqiza, inikela, i-Kubeflow, kanye ne-MLFLOW anikeze amandla nokulawulwa kwenguqulo ngokwezidingo zakho. Ngaphezu kwalokho, amapulatifomu afana ne-Pythonany ncame kanye ne-dagshub elungele amaphrojekthi amancane nokusebenzisana kweqembu.

Ngakho-ke, noma ngabe ungumfundi, intshiseko yesayensi yedatha, noma uchwepheshe osebenzayo, la mapulatifomu azokweseka uhambo lwakho lwe-ML kusuka ku-prototype ukukhiqizwa imodeli yakho.

Sawubona! NginguVipin, isayensi yedatha ethandekayo kanye nomdlandla wokufunda ngomshini nge isisekelo esiqinile ekuhlaziyeni kwedatha, ama-algorithms wokufunda umshini, nohlelo. Nginolwazi lwezandla kumamodeli okwakha, ukuphatha idatha engcolile, nokuxazulula izinkinga zomhlaba wangempela. Umgomo wami ukufaka imininingwane eqhutshwa idatha ukudala izixazululo ezisebenzayo eziholela imiphumela. Ngilangazelela ukufaka amakhono ami endaweni yokubambisana ngenkathi ngiqhubeka nokufunda nokukhula emikhakheni yesayensi yedatha, ukufunda komshini, ne-NLP.

Ngena ngemvume ukuze uqhubeke nokufunda futhi ujabulele okuqukethwe okwenziwe ngochwepheshe.

Source link

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button