Isithombe nguMbhali
# Isingeniso
Njengomsebenzi wokufunda umshini, uyazi ukuthi ubunjiniyela besici bunobuhlungu, umsebenzi wezandla. Udinga ukudala amatemu okusebenzelana phakathi kwezici, ufake ikhodi okuguquguqukayo kwezigaba ngendlela efanele, ukhiphe amaphethini esikhashana kusukela kumadethi, ukhiqize ukuhlanganisa, futhi uguqule ukusatshalaliswa. Esicini ngasinye esingaba khona, uyahlola ukuthi ingabe siyathuthukisa ukusebenza kwemodeli, siphindaphinda ukwehluka, futhi ulandelele lokho okuzamile.
Lokhu kuba inselele kakhulu njengoba idathasethi yakho ikhula. Ngenqwaba yezici, uzodinga izindlela ezihlelekile zokukhiqiza izici zekhandidethi, uhlole ukuthi ziwusizo kangakanani, bese ukhetha ezihamba phambili. Ngaphandle kokuzenzakalela, cishe uzophuthelwa yizinhlanganisela zezici ezibalulekile ezingakhuphula kakhulu ukusebenza kwemodeli yakho.
Lesi sihloko sihlanganisa imibhalo emihlanu yePython eklanyelwe ngokuqondile ukwenza imisebenzi yobunjiniyela yesici esinomthelela omkhulu. Le mibhalo ikusiza ukuthi ukhiqize izici zekhwalithi ephezulu ngokuhlelekile, uzihlole ngendlela efanele, futhi wakhe amasethi ezici athuthukisiwe akhulisa ukusebenza kwemodeli.
Ungathola ikhodi ku-GitHub.
# 1. Umbhalo Wekhodi Izici
// I-Pain Point
Okuguquguqukayo kwezigaba kukhona yonke indawo kudatha yomhlaba wangempela. Udinga ukubhala ngekhodi lezi zigaba, nokukhetha indlela efanele yombhalo wekhodi kubalulekile:
- Umbhalo wekhodi oshisayo usebenzela izici ezisezingeni eliphansi kodwa udala izinkinga zobukhulu ngezigaba eziphezulu zekhadinali
- Umbhalo wekhodi welebula usebenzisa inkumbulo kahle kodwa usikisela okujwayelekile
- Umbhalo wekhodi oqondiwe unamandla kodwa ubeka engcupheni ukuvuza kwedatha
Ukusebenzisa lokhu kubhala ngekhodi ngendlela efanele, ukuphatha izigaba ezingabonakali kudatha yokuhlola, nokugcina ukuvumelana kuso sonke isitimela, ukuqinisekiswa, nokuhlukaniswa kokuhlola kudinga ikhodi ecophelelayo, ethambekele kumaphutha.
// Okwenziwa Isikripthi
Iskripthi sikhetha ngokuzenzakalelayo futhi sisebenzise amasu ombhalo wekhodi afanele ngokusekelwe kuzici zesici: i-cardinalality, ukuhlobana okuhlosiwe, kanye nohlobo lwedatha.
Iphatha umbhalo wekhodi oshisayo owodwa wezici ze-low-cardinality, umbhalo wekhodi oqondiwe wezici ezihlobene nokuhlosiwe, ukubhala ngekhodi kwemvamisa yezici ze-high-cardinality, kanye nombhalo wekhodi welebula wokuguquguquka kwe-ordinal. Iphinda iqoqe izigaba ezingavamile ngokuzenzakalelayo, iphathe izigaba ezingabonakali kudatha yokuhlola ngomusa, futhi igcine ukuvumelana kombhalo wekhodi kukho konke ukuhlukaniswa kwedatha.
// Indlela Esebenza Ngayo
Umbhalo uhlaziya isici ngasinye sesigaba ukuze sinqume ubukhazikhazi baso kanye nobudlelwano nokuhluka okuqondiwe.
- Ezicini ezinamavelu ahlukile angaphansi kuka-10, kusetshenziswa ukubhala ngekhodi okukodwa okushisayo
- Ezicini eziphakeme kakhulu ezinamavelu ahlukile angaphezu kuka-50, isebenzisa umbhalo wekhodi wokuvama ukugwema ukuqhuma kobukhulu.
- Ezicini ezibonisa ukuhlobana nokuhlosiwe, kusetshenziswa umbhalo wekhodi oqondiwe onokushelela ukuze ugweme ukugcwala ngokweqile
- Izigaba ezingavamile ezivela ngaphansi kuka-1% wemigqa zihlelwe zaba isigaba “esinye”.
Wonke amamephu wombhalo wekhodi agcinwa futhi angasetshenziswa ngokulinganayo kudatha entsha, ngezigaba ezingabonakali ezisingathwa ngokuzenzakalelayo kumbhalo wekhodi wesigaba esingandile noma incazelo yomhlaba.
⏩ Thola iskripthi sesifaki khodi sesici sesigaba
# 2. Ukuguqula Izici Zezinombolo
// I-Pain Point
Izici zezinombolo ezingahluziwe ngokuvamile zidinga ukuguqulwa ngaphambi kokumodela. Ukusabalalisa okutshekile kufanele kwenziwe kube ngokwejwayelekile, okungaphandle kufanele kuphathwe, izici ezinezikali ezihlukene zidinga ukumiswa, futhi ubudlelwano obungewona umugqa bungadinga ukuguqulwa kwe-polynomial noma i-logarithmic. Ukuhlola mathupha amasu okuguqula ahlukene esici ngasinye sezinombolo kuyakhathaza. Le nqubo idinga ukuphindaphindwa kuwo wonke amakholomu ezinombolo futhi iqinisekiswe ukuze kuqinisekiswe ukuthi empeleni uthuthukisa ukusebenza kwemodeli.
// Okwenziwa Isikripthi
Umbhalo uhlola ngokuzenzakalelayo amasu amaningi okuguqula izici zezinombolo: ukuguqulwa kwelogi, Ukuguqulwa kwe-Box-Coximpande eyisikwele, i-cube root, ukumisa, ukujwayela, ukukala okuqinile, nokuguqulwa kwamandla.
Ihlola umthelela wenguquko ngayinye ekujwayelekeni kokusabalalisa nokusebenza kwemodeli, ikhetha ukuguqulwa okungcono kakhulu kwesici ngasinye, futhi isebenzisa izinguquko ngokungaguquki ekuqeqesheni nasekuhloleni idatha. Iphinde isingathe ama-zero namavelu angalungile ngokufanelekile, igwema amaphutha oguquko.
// Indlela Esebenza Ngayo
Esicini ngasinye sezinombolo, umbhalo uhlola izinguquko eziningi futhi uzihlole kusetshenziswa izivivinyo zokujwayelekile – ezifana I-Shapiro-Wilk futhi U-Anderson-Darling – namamethrikhi okusabalalisa afana nokutsheka kanye ne-kurtosis. Ezicini ezinokwenteka okukhulu kuno-1, ibeka phambili izinguquko zelogi ne-Box-Cox.
Ezicini ezinama-outliers, kusebenza ukukala okuqinile. Umbhalo ugcina amapharamitha oshintsho afakwe kudatha yokuqeqeshwa futhi uwasebenzise ngokungaguquki ekuqinisekiseni nasekuhloleni amasethi. Izici ezinamavelu angalungile noma amaziro aphathwa ngoguquko oluguquliwe noma Yeo-Johnson izinguquko ezisebenza nanoma imaphi amanani angempela.
⏩ Thola umbhalo we-transformer wesici sezinombolo
# 3. Ukukhiqiza Ukusebenzelana Kwesici
// I-Pain Point
Ukusebenzisana phakathi kwezici kuvame ukuqukatha isignali ebalulekile egejwa yizici ngazinye. Imali engenayo ingase ibaluleke ngokuhlukile kuwo wonke amasegimenti wamakhasimende, ukusetshenziswa kokukhangisa kungase kube nemiphumela ehlukile ngesizini, noma inhlanganisela yentengo yomkhiqizo nesigaba kungase kuqagelwe kakhulu kunokukodwa. Kodwa ngezici eziningi, ukuhlola konke ukusebenzelana okungaba kokubili okubili kusho ukuhlola izinkulungwane zabantu.
// Okwenziwa Isikripthi
Lesi script sikhiqiza ukusebenzisana kwesici kusetshenziswa ukusebenza kwezibalo, izici ze-polynomial, izici zesilinganiso, nezinhlanganisela zezigaba. Ihlola amandla okuqagela ekhandidethi ngalinye kusetshenziswa ulwazi olufanayo noma amaphuzu okubaluleka asekelwe kumodeli. Ibuyisela kuphela ukusebenzisana okuphezulu okuphezulu kwe-N, igwema ukuqhuma kwesici kuyilapho ithwebula izinhlanganisela ezinomthelela kakhulu. Futhi isekela imisebenzi yokusebenzisana yangokwezifiso yobunjiniyela besici esicacisiwe sesizinda.
// Indlela Esebenza Ngayo
Iskripthi sidala ukusebenzisana kwekhandidethi phakathi kwazo zonke izici ezimbili:
- Ezicini zezinombolo, kwakha imikhiqizo, izilinganiso, izibalo, nomehluko
- Ezicini zesigaba, idala amakhodi ahlanganyelwe
Ikhandidethi ngalinye linikezwa amaphuzu kusetshenziswa ulwazi olufanayo ngethagethi noma ukubaluleka kwesici esivela ehlathini elingahleliwe. Ukusebenzisana kuphela okudlula umkhawulo wokubaluleka noma izinga eliphezulu ku-N okugciniwe. Umbhalo uphatha amacala afana nokuhlukaniswa ngoziro, amanani angapheli, nokuhlobana phakathi kwezici ezikhiqiziwe nezici zoqobo. Imiphumela ihlanganisa amagama ezici ezicacile ezibonisa ukuthi iziphi izici zangempela ezahlanganiswa nokuthi kanjani.
⏩ Thola iskripthi se-generator yesici sokusebenzisana
# 4. Ukukhipha Izici Zesikhathi Sosuku
// I-Pain Point
Amakholomu esikhathi sedethi aqukethe ulwazi lwesikhashana oluwusizo, kodwa ukuwasebenzisa ngempumelelo kudinga ubunjiniyela besici owenziwe ngesandla. Udinga ukwenza lokhu okulandelayo:
- Khipha izingxenye ezinjengonyaka, inyanga, usuku, nehora
- Dala izici ezitholiwe ezifana nosuku lweviki, ikota, namafulegi empelaviki
- Bala umehluko wesikhathi njengezinsuku kusukela ngedethi yesithenjwa kanye nesikhathi phakathi kwemicimbi
- Bamba amaphethini omjikelezo
Ukubhala le khodi yokukhipha kuwo wonke amakholomu esikhathi sosuku kuyaphindaphinda futhi kudla isikhathi, futhi odokotela bavame ukukhohlwa izici zesikhashana ezibalulekile ezingathuthukisa amamodeli abo.
// Okwenziwa Isikripthi
Umbhalo ukhipha ngokuzenzakalelayo izici eziphelele zesikhathi sedethi kumakholomu ezitembu zesikhathi, okuhlanganisa izingxenye eziyisisekelo, izici zekhalenda, izinkomba ze-boolean, amakhodi omjikelezo kusetshenziswa ukuguqulwa kwe-sine ne-cosine, izinkomba zesizini, nomehluko wesikhathi kusukela kumadethi ereferensi. Iphinde ithole futhi ihlabe umkhosi amaholide, iphathe amakholomu amaningi esikhathi sosuku, futhi ibale umehluko wesikhathi phakathi kokubhanqwa kwedethi.
// Indlela Esebenza Ngayo
Umbhalo uthatha amakholomu esikhathi futhi ukhipha ngokuhlelekile wonke amaphethini esikhashana ahlobene.
Ezicini zomjikelezo njengenyanga noma ihora, idala izinguquko ze-sine ne-cosine:
[
text{month_sin} = sinleft(frac{2pi times text{month}}{12}right)
]
Lokhu kuqinisekisa ukuthi uDisemba noJanuwari kuseduze endaweni yesici. Ibala i-deltas yesikhathi ukusuka endaweni eyireferensi (izinsuku kusukela ngedethi ethile, izinsuku kusukela ngedethi ethile) ukuze ithwebule amathrendi.
Okwamasethi edatha anamakholomu amaningi esikhathi sosuku (isb order_date futhi ship_date), ibala umehluko phakathi kwabo ukuze ithole ubude obunjalo processing_time. Amafulegi aphuphuthekisayo adalelwa izinsuku ezikhethekile, izimpelasonto, nemingcele yenkathi. Zonke izici zisebenzisa izimiso zokuqamba ezicacile ezibonisa umthombo nencazelo yazo.
⏩ Thola iskripthi se-extractor sesikhathi sedethi
# 5. Ukukhetha Izici Ngokuzenzakalelayo
// I-Pain Point
Ngemuva kobunjiniyela besici, uvamise ukuba nezici ezimbalwa, eziningi zazo ezinganalutho, ezingabalulekile, noma ezibangela ukugcwala ngokweqile. Udinga ukukhomba ukuthi yiziphi izici ezisiza imodeli yakho nokuthi yiziphi okufanele zisuswe. Ukukhethwa kwesici okwenziwa mathupha kusho amamodeli okuqeqesha ngokuphindaphindiwe ngezici ezingezansi ezihlukene, ukulandelela imiphumela kumaspredishithi, nokuzama ukuqonda amaphuzu okubaluleka kwezici eziyinkimbinkimbi. Inqubo ihamba kancane futhi izimele, futhi ngeke wazi ukuthi uthole isethi yesici esilungile noma usanda kuba nenhlanhla ngezivivinyo zakho.
// Okwenziwa Isikripthi
Umbhalo ukhetha ngokuzenzakalelayo izici ezibaluleke kakhulu usebenzisa izindlela eziningi zokukhetha:
- Ukuhlunga okusekelwe ekuhlukeni kususa izici ezihlala njalo noma eziseduze
- Ukuhlunga okusekelwe ku-Correlation kususa izici ezingafuneki
- Ukuhlolwa kwezibalo njengokuhlaziywa kokuhluka (ANOVA), i-chi-square, nolwazi oluhlanganyelwe
- Ukubaluleka kwesici esisekelwe esihlahleni
- I-L1 ejwayelekile
- Ukuqedwa kwesici esiphindaphindayo
Ibese ihlanganisa imiphumela esuka ezindleleni eziningi ibe amaphuzu ahlanganisiwe, ilinganisa zonke izici ngokubaluleka, futhi ihlonze isici esincane sesethi ekhulisa ukusebenza kwemodeli kuyilapho sinciphisa ubukhulu.
// Indlela Esebenza Ngayo
Umbhalo usebenzisa ipayipi lokukhetha lezigaba eziningi. Nakhu okwenziwa yisigaba ngasinye:
- Susa izici ezinoziro noma ezicishe zicishe ziro njengoba zinganikezi ulwazi
- Susa amapheya esici ahlobene kakhulu, ugcine leso sihlotshaniswa kakhulu nokuhlosiwe
- Bala ukubaluleka kwesici usebenzisa izindlela eziningi, njengokubaluleka kwehlathi okungahleliwe, izikolo zokwaziswa okuhlanganyelwe, ukuhlolwa kwezibalo, kanye nama-coefficients ajwayelekile we-L1
- Yenza kube ngokwejwayelekile futhi uhlanganise amaphuzu asuka ezindleleni ezihlukene abe yizinga lokuhlanganisa
- Sebenzisa ukuqeda isici esiphindaphindayo noma ukuqinisekiswa okuphambene ukuze unqume inani eliphelele lezici
Umphumela uwuhlu olulinganiselwe lwezici kanye nesethi engaphansi enconyiwe yokuqeqeshwa kwemodeli, kanye nezikolo zokubaluleka ezinemininingwane ezivela endleleni ngayinye.
⏩ Thola umbhalo wesikhethi sesici esizenzakalelayo
# Isiphetho
Le mibhalo emihlanu ibhekana nezinselelo eziyinhloko zobunjiniyela besici obudla isikhathi esiningi kumaphrojekthi wokufunda komshini. Nasi isifinyezo esisheshayo:
- Isifaki khodi sesigaba siphatha ukubhala ngekhodi ngokuhlakanipha okususelwe kukhadinali kanye nokuhlobana okuqondisiwe
- Isiguquli sezinombolo sithola ngokuzenzakalelayo izinguquko ezifanele zesici ngasinye sezinombolo
- Ijeneretha yokusebenzisana ithola izinhlanganisela zezici ezibalulekile ngokuhlelekile
- Isikhiphi sesikhathi sosuku sikhipha amaphethini esikhashana aphelele nezici zomjikelezo
- Isikhethi sesici sihlonza izici ezibikezela kakhulu sisebenzisa izindlela zokuhlanganisa
Umbhalo ngamunye ungasetshenziswa ngokuzimela emisebenzini ethile yobunjiniyela noma uhlanganiswe ube yipayipi eliphelele. Qala ngezishumeki nama-transformer ukuze ulungise izici zakho eziyisisekelo, sebenzisa ijeneretha yokusebenzisana ukuze uthole amaphethini ayinkimbinkimbi, ukhiphe izici zesikhashana kumakholomu esikhathi, futhi uqedele ngokukhetha izici ukuze uthuthukise isethi yakho yesici.
Ubunjiniyela besici obujabulisayo!
Bala Priya C ungunjiniyela kanye nombhali wezobuchwepheshe ovela eNdiya. Uthanda ukusebenza ezimpambanweni zezibalo, izinhlelo, isayensi yedatha, nokudalwa kokuqukethwe. Izindawo zakhe azithandayo nobungcweti zifaka i-DevOps, isayensi yedatha, nokucubungula ulimi lwemvelo. Uyakujabulela ukufunda, ukubhala, ukubhala amakhodi, kanye nekhofi! Okwamanje, usebenzela ukufunda nokwabelana ngolwazi lwakhe nomphakathi wonjiniyela ngokugunyaza izifundo, imihlahlandlela yokuthi kwenziwa kanjani, imibono, nokuningi. I-Bala iphinda idale ukubuka konke kwensiza okubandakanyayo kanye nokufundisa ngekhodi.
