2023 International Conference on Computational Intelligence, Communication Technology and Networking (CICTN)

7H[WWR,PDJH*HQHUDWRUZLWK/DWHQW'LIIXVLRQ
0RGHOV
2023 International Conference on Computational Intelligence, Communication Technology and Networking (CICTN) | 979-8-3503-3802-7/23/$31.00 ©2023 IEEE | DOI: 10.1109/CICTN57981.2023.10140348


$SRRUYD5DXQL\DU $U\DQ5DM $VKLVK.XPDU
Department of Computer Science and Department of Computer Science and Department of Computer Science and
Engineering Engineering Engineering
IMS Engineering College IMS Engineering College IMS Engineering College
*KD]LDEDG,QGLD *KD]LDEDG,QGLD *KD]LDEDG,QGLD
DSRRUYDUDXQL\DU#JPDLOFRP UDMDU\DQE#JPDLOFRP NXPDUDVKLVKLDP#JPDLOFRP

$VKLVK.XPDU.DQGX $VWKD6LQJK $QMDQL*XSWD
Department of Computer Science and Department of Computer Science and Department of Computer Science and
Engineering Engineering Engineering
IMS Engineering College IMS Engineering College IMS Engineering College
*KD]LDEDG,QGLD *KD]LDEDG,QGLD *KD]LDEDG,QGLD
DVKLVKNXPDUNDQGX#JPDLOFRP VLQJKDVWKD#JPDLOFRP DQMDQLDJJDUZDO#JPDLOFRP


Abstract²*HQHUDWLQJ LPDJHV IURP QDWXUDO ODQJXDJH WH[W UREXVWSURSHUWLHVWKH\UHTXLUHGRPDLQVSHFLILFNQRZOHGJHIRU
GHVFULSWLRQV LV DQ LPSUHVVLYH IHDW RI GHHS OHDUQLQJ 'LIIXVLRQ UHWULHYDO 2Q WKH RWKHU KDQG QDWXUDO ODQJXDJH SURYLGHV D
PRGHOV KDYH HQDEOHG VWDWHRIWKHDUW V\QWKHVLV UHVXOWV IRU IOH[LEOHLQWHUIDFHIRUGHVFULELQJREMHFWVLQDQ\YLVXDOFDWHJRU\
YDULRXVW\SHVRIGDWDLQFOXGLQJLPDJHVE\EUHDNLQJGRZQWKH 5HFHQWDGYDQFHPHQWVLQGHHSOHDUQLQJKDYHSURGXFHGKLJKO\
LPDJHJHQHUDWLRQSURFHVVLQWRVXFFHVVLYHGHQRLVLQJDXWRHQFRGHU LGHQWLILDEOH DQG JHQHUDOL]DEOH WH[WXDO UHSUHVHQWDWLRQV
DSSOLFDWLRQV +RZHYHU WKHVH PRGHOV FDQ EH FRPSXWDWLRQDOO\ DXWRPDWLFDOO\ OHDUQHG IURP ZRUGV DQG FKDUDFWHUV
H[SHQVLYH DQG WLPHFRQVXPLQJ WR WUDLQ DQG LQIHU GXH WR WKHLU RXWSHUIRUPLQJSUHYLRXVVWDWHRIWKHDUWPHWKRGVLQ]HURVKRW
UHOLDQFHRQSL[HOVSDFH7KLVSDSHULQWURGXFHVDQRYHODSSURDFK
OHDUQLQJ0RWLYDWHGE\WKHVHDGYDQFHPHQWVRXUUHVHDUFKDLPV
WR WUDLQLQJ GLIIXVLRQ PRGHOV ZLWK OLPLWHG FRPSXWDWLRQDO
WROHDUQDPDSSLQJIURPWKHWH[WGHVFULSWLRQVWRFRQYLQFLQJ
UHVRXUFHV ZKLOH VWLOO PDLQWDLQLQJ TXDOLW\ DQG IOH[LELOLW\ XVLQJ
SUHWUDLQHG DXWRHQFRGHUV :H KDYH GHYHORSHG D PHWKRGRORJ\
LPDJHVZKLFKUHTXLUHVVROYLQJWZRVXESUREOHPVOHDUQLQJD
WKDW VWULNHV D QHDUSHUIHFW HTXLOLEULXP EHWZHHQ VLPSOLI\LQJ WH[W IHDWXUH UHSUHVHQWDWLRQ WKDW FDSWXUHV LPSRUWDQW YLVXDO
FRPSOH[LW\DQGPDLQWDLQLQJLQWULFDWHGHWDLOVHQKDQFLQJYLVXDO GHWDLOV DQG XVLQJ WKRVH IHDWXUHV WR V\QWKHVL]H D FRQYLQFLQJ
DFFXUDF\:HDOVRSURSRVHDFURVVDWWHQWLRQOD\HULQRXUPRGHO LPDJH )RUWXQDWHO\ UHFHQW DGYDQFHPHQWV LQ GHHS OHDUQLQJ
GHVLJQWRHQDEOHKLJKUHVROXWLRQV\QWKHVLVXVLQJDFRQYROXWLRQ KDYHPDGHVLJQLILFDQWSURJUHVVRQERWKVXESUREOHPVZKLFK
EDVHGDSSURDFKIRUFRQGLWLRQHGLQSXWVOLNHWH[WDQGERXQGLQJ ZHEXLOGXSRQLQRXUFXUUHQWZRUN
ER[HV 2XU ODWHQW GLIIXVLRQ PRGHO H[KLELWV H[FHSWLRQDO
SHUIRUPDQFH LQ PXOWLSOH LPDJH V\QWKHVLV WDVNV VXFK DV WH[W
LPDJH V\QWKHVLV VXSHUUHVROXWLRQ DQG XQFRQGLWLRQDO SLFWXUH
JHQHUDWLRQ ZKLOH UHGXFLQJ FRPSXWDWLRQDO UHTXLUHPHQWV
VLJQLILFDQWO\FRPSDUHGWRSL[HOEDVHGPRGHOV

Keywords- GANs, Diffusion, Autoencoders, Decoders, text-to-

image synthesis.

, ,1752'8&7,21
7KH IRFXV RI WKLV UHVHDUFK LV RQ WKH WDVN RI FRQYHUWLQJ
KXPDQZULWWHQ WH[W GHVFULSWLRQV LQWR SL[HODWHG LPDJHV
6SHFLILFDOO\ ZH DLP WR JHQHUDWH LPDJHV IURP PRQRV\OODELF
GHVFULSWLRQVVXFKDV7KLVELUGKDVDEOXHEUHDVWDQGZLQJVRU
7KLV IORZHU KDV UHG SHWDOV $OWKRXJK WKLV SUREOHP KDV
JDLQHG LQFUHDVLQJ DWWHQWLRQ LQ WKH UHVHDUFK FRPPXQLW\ LW
UHPDLQV XQVROYHG &RQYHQWLRQDOO\ WKH FROOHFWLRQ RI
FRPSUHKHQVLYH YLVXDO GDWD SHUWDLQLQJ WR REMHFWV KDV EHHQ 
DFFRPSOLVKHGLQYHFWRUHQFRGHGDWWULEXWHUHSUHVHQWDWLRQVWKDW )LJ 6KRZFDVHVJHQHUDWHGLPDJHVIURPERWKWKHWUDLQLQJVHWDQGXQVHHQ
DUHVSHFLILFWRREMHFWFDWHJRULHVVXFKDVWKRVHXVHGIRUYLVXDO WH[WGHVFULSWLRQV
UHFRJQLWLRQZLWKRXWWULJJHUVDQGFRQGLWLRQDOLPDJLQJ6HYHUDO
VWXGLHVKDYHH[SORUHGWKLVDSSURDFKLQFOXGLQJ)DUKDGL   *HQHUDWLQJ YLVXDO UHSUHVHQWDWLRQV IURP WH[WXDO
.XPDU  DQG/DPSHUW  +RZHYHUWKHFKDOOHQJH GHVFULSWLRQVLVDFRPSOH[WDVNGXHWRWKHPXOWLPRGDOQDWXUHRI
RI JHQHUDWLQJ LPDJHV IURP QDWXUDO ODQJXDJH GHVFULSWLRQV PDSSLQJ ZRUGV WR LPDJHV 'HHS OHDUQLQJ DORQH FDQQRW
FRQWLQXHVWREHDVXEMHFWRIRQJRLQJUHVHDUFK>@ DGHTXDWHO\UHVROYHWKHFKDOOHQJHRIDFFXUDWHO\UHSUHVHQWLQJD
GHVFULSWLRQZLWKWKHQXPHURXVSRVVLEOHSL[HOFRQILJXUDWLRQV
7KH DELOLW\ WR JHQHUDWH LPDJHV IURP WKH WH[W GHVFULSWLRQ 7R WDFNOH WKLV SUREOHP RXU DSSURDFK LQYROYHV WUDLQLQJ D
SUHVHQWVDXQLTXHDQGDSSHDOLQJRSSRUWXQLW\IRUDSSOLFDWLRQV PRGHO WR SUHGLFW WKH QH[W WRNHQ EDVHG RQ WKH LPDJH DQG
LQ YDULRXV GRPDLQV :KLOH DWWULEXWH UHSUHVHQWDWLRQV RIIHU SUHYLRXVO\ JHQHUDWHG WRNHQV 7KLV FRQGLWLRQDO SUHGLFWLRQ

979-8-3503-3802-7/23/$31.00 ©2023 IEEE 144

Authorized licensed use limited to: GURU JAMBHESHWAR UNIVERISTY. Downloaded on February 29,2024 at 06:55:35 UTC from IEEE Xplore. Restrictions apply.
 2023 International Conference on Computational Intelligence, Communication Technology and Networking (CICTN)
SUREOHPRIIHUVDPRUHZHOOGHILQHGVROXWLRQ>@/HYHUDJLQJ
DGYHUVDULDO WUDLQLQJ ZH DGGUHVV WKH LVVXH RI FRQGLWLRQDO
PXOWLPRGDOLW\ E\ HPSOR\LQJ GLVFULPLQDWRUV WUDLQHG LQ DQ
DGYHUVDULDOPDQQHUWRGLVWLQJXLVKV\QWKHWLFLPDJHVIURPUHDO
RQHV 7KH GLVFULPLQDWRU QHWZRUN DFWV DV DQ LQWHOOLJHQW DQG
DGDSWLYH ORVV IXQFWLRQ HQDEOLQJ ERWK WKH GLVFULPLQDWRU DQG
JHQHUDWRUWRLQFRUSRUDWHDGGLWLRQDOLQIRUPDWLRQDVREVHUYHG
LQSUHYLRXVVWXGLHV>@
2XUUHVHDUFKSULPDULO\IRFXVHVRQGHYHORSLQJDVLPSOHDQG
HIILFLHQW DUFKLWHFWXUH IRU *HQHUDWLYH $GYHUVDULDO 1HWZRUNV
*$1V  DQG GHYLVLQJ D WUDLQLQJ WHFKQLTXH IRU V\QWKHVL]LQJ
ELUGDQGIORZHULPDJHVIURPKXPDQZULWWHQGHVFULSWLRQV)RU
HYDOXDWLRQZHXWLOL]HWKH2[IRUGIORZHUGDWDVHWDQGWKH
&DOWHFK8&6'ELUGGDWDVHWERWKRIZKLFKRIIHUILYHWH[WXDO
H[SODQDWLRQVIRUHDFKLPDJH2XUPRGHOXQGHUJRHVWHVWLQJRQ
ERWKWKHWUDLQLQJDQGWHVWVHWFDWHJRULHVKDYLQJEHHQWUDLQHG
RQDVXEVHWRIWKHWUDLQLQJFDWHJRULHV$GGLWLRQDOO\ZHHPSOR\
]HURVKRW FRPSRVLWLQJ IRU V\QWKHVL]LQJ LPDJHV IURP WH[W
HQKDQFLQJWKHYHUVDWLOLW\RIRXUDSSURDFK>@
,QVXPPDU\RXUUHVHDUFKFRQWULEXWHVWRWKHILHOGRIWH[WWR
LPDJHV\QWKHVLVE\FRPELQLQJUHFHQWDGYDQFHPHQWVLQGHHS
OHDUQLQJ WR JHQHUDWH FRQYLQFLQJ LPDJHV IURP WKH WH[W
GHVFULSWLRQ :H SURSRVH D QRYHO *$1 DUFKLWHFWXUH DQG
WUDLQLQJ WHFKQLTXH DQG GHPRQVWUDWH LWV HIIHFWLYHQHVV RQ WZR
SRSXODUGDWDVHWV2XUUHVHDUFKRIIHUVSRWHQWLDODSSOLFDWLRQVLQ
YDULRXV GRPDLQV ZKHUH LPDJH JHQHUDWLRQ IURP WKH WH[W
GHVFULSWLRQVLVGHVLUDEOH
,, /,7(5$785(6859(<
,Q UHFHQW \HDUV WKHUH KDV EHHQ VLJQLILFDQW LQWHUHVW LQ
PXOWLPRGDO OHDUQLQJ ZKLFK LQYROYHV HVWDEOLVKLQJ D VKDUHG
UHSUHVHQWDWLRQIRUGLIIHUHQWPRGDOLWLHVDQGSUHGLFWLQJPLVVLQJ
GDWD LQ RQH PRGDOLW\ EDVHG RQ LQIRUPDWLRQ IURP DQRWKHU
PRGDOLW\ 9DULRXV PHWKRGV KDYH EHHQ SURSRVHG LQ WKH
OLWHUDWXUHWRWDFNOHWKLVFKDOOHQJH
2QH DSSURDFK SUHVHQWHG E\ 1JLDP   XWLOL]HG D
VWDFNHG PXOWLPRGDO DXWRHQFRGHU WR OHDUQ PRGDOLW\LQYDULDQW
UHSUHVHQWDWLRQV E\ OHYHUDJLQJ ERWK DXGLR DQG YLVXDO GDWD
$QRWKHU PHWKRG E\ 6ULYDVWDYD DQG 6DODNKXWGLQRY  
HPSOR\HGDGHHS%ROW]PDQQPDFKLQHWRMRLQWO\PRGHOSLFWXUH
DQGWH[WWDJV,QDGLIIHUHQWVWXG\6RQJ  LQWURGXFHGD
IUDPHZRUNIRUPXOWLPRGDOFRQGLWLRQDOSUHGLFWLRQZKHUHRQH
PRGDOLW\LVUHSUHVHQWHGDVPLPLFNLQJWKHIXQFWLRQVRIDQRWKHU
PRGDOLW\
)XUWKHUPRUHFRQYROXWLRQDOGHFRGLQJV\VWHPVKDYHJDLQHG
SRSXODULW\IRUJHQHUDWLQJKLJKO\UHDOLVWLFLPDJHV'RVRYLWVNL\
 WUDLQHGDGHFRQYROXWLRQQHWZRUNDQGHPSOR\HGDVHWRI
JUDSKLF FRGHV WR UHQGHU ' FKDLUV <DQJ HW DO  
LQWHJUDWHG HQFRGHU QHWZRUNV DQG DFWLRQV GHYHORSLQJ D
UHFXUVLYH FRQYROXWLRQDO HQFRGHU DQG GHFRGHU FDSDEOH RI
URWDWLQJ KXPDQ IDFHV DQG ' FKDLU PRGHOV LQ UHVSRQVH WR
URWDWLRQDODFWLRQVHTXHQFHV5HHG  IRFXVHGRQHQFRGLQJ
WUDQVIRUPVIURPDQDORJ\SDLUVWRDQWLFLSDWHYLVXDOVLPLODULWLHV
RIVKDSHVFKDUDFWHUVIURPYLGHRJDPHVDQG'FDUV
2YHUDOO PXOWLPRGDO OHDUQLQJ KDV EHFRPH D YLEUDQW
UHVHDUFKDUHDDQGUHVHDUFKHUVFRQWLQXHWRH[SORUHLQQRYDWLYH
WHFKQLTXHV DQG DUFKLWHFWXUHV IRU DGGUHVVLQJ LWV DVVRFLDWHG
FKDOOHQJHV
,QUHFHQW\HDUVWKHUHKDYHEHHQQRWDEOHDGYDQFHPHQWVLQ
JHQHUDWLQJ OLIHOLNH LPDJHV XVLQJ FRQYROXWLRQDO GHFRGHUV
ZLWKLQ WKH *HQHUDWLYH $GYHUVDULDO 1HWZRUNV *$1V 
145
Authorized licensed use limited to: GURU JAMBHESHWAR UNIVERISTY. Downloaded on February 29,2024 at 06:55:35 UTC from IEEE Xplore. Restrictions apply.
IUDPHZRUN *RRGIHOORZ   HPSOR\HG D FRQYROXWLRQDO
GHFRGHU LQ WKH *HQHUDWLYH 1HWZRUNV PRGXOH RI *$1V WR
SURGXFHUHDOLVWLFLPDJHV5DGIRUG  IXUWKHUHQKDQFHGWKH
SLFWXUHV\QWKHVLVUHVXOWVE\XWLOL]LQJDVWDQGDUGFRQYROXWLRQDO
GHFRGHU DQG LQWURGXFLQJ DQ HIILFLHQW DQG VWDEOH VWDFN
QRUPDOL]DWLRQDUFKLWHFWXUH
2Q WKH RWKHU KDQG JHQHUDWLQJ WH[WXDO GHVFULSWLRQV IURP
LPDJHV XVLQJ 511 GHFRGHUV KDV DOVR VHHQ VLJQLILFDQW
EUHDNWKURXJKV9LQ\DOV  0DR  'RQDKXH  
DQG.DUSDWK\DQG/L  GHYHORSHGPRGHOVWKDWOHYHUDJHG
ORQJWHUP PHPRULHV WR JHQHUDWH FRQGLWLRQDO FDSWLRQV ;X
  LPSURYHG XSRQ WKHVH DSSURDFKHV E\ LQFRUSRUDWLQJ
YLVXDO DWWHQWLRQ PHFKDQLVPV 5HQ   SURYLGHG LQVLJKWV
LQWR WKH YLVXDO HOHPHQWV RI SKRWRJUDSKV ZKLOH =KX  
SHUIRUPHGDOLJQPHQWEHWZHHQWH[WDQGFLQHPDXVLQJVHTXHQFH
PRGHOV
*UHJRU   VXFFHVVIXOO\ LQWHJUDWHG WH[W DQG LPDJHV
DFKLHYLQJ LPSUHVVLYH UHVXOWV HYHQ ZLWK LPSODXVLEOH WH[WV
+RZHYHUWKHJHQHUDWHGYLVXDOVVWLOOODFNHGUHDOLVPDQGZHUH
HDVLO\GLVWLQJXLVKDEOHIURPDFWXDOSKRWRJUDSKV
,QWKLVSDSHUZHSURSRVHDQRYHOWH[WWRLPDJHJHQHUDWRU
EDVHGRQODWHQWGLIIXVLRQPRGHOV8QOLNHSUHYLRXVDSSURDFKHV
RXUPHWKRGLVIXOO\GLIIHUHQWLDEOHIURPWKHFKDUDFWHUOHYHOWR
WKH SL[HO OHYHO :H LQWURGXFH D 0XOWLSOH ,QWHUSRODWLRQ
5HJXODUL]HUWRWKH*$1JHQHUDWRUVLJQLILFDQWO\LPSURYLQJWKH
TXDOLW\RIWKHJHQHUDWHGVDPSOHV2XUPRGHOLVDQHQGWRHQG
*$1 WKDW HPSOR\V FKDUDFWHUOHYHO WH[W HQFRGHUV DQG *$1
FODVV FRQVWUDLQWV WR JHQHUDWH YLVXDOO\ VWULNLQJ LPDJHV :H
IRFXV RQ ILQHJUDLQHG SLFWXUH GDWDVHWV XWLOL]LQJ UHFHQWO\
FROOHFWHGELUGDQG2[IRUGIORZHUGHVFULSWLRQVIURP8&6'DW
&DOWHFKZKLFKSURYLGHILYHKXPDQJHQHUDWHGODEHOVIRUHDFK
LPDJH
7R VXPPDUL]H RXU PRGHO DGGUHVVHV WKH FKDOOHQJH RI
JHQHUDWLQJ KLJKTXDOLW\ LPDJHV IURP WH[WXDO GHVFULSWLRQV
XVLQJ D XQLTXH DSSURDFK WKDW LV GLIIHUHQWLDEOH DW ERWK WKH
FKDUDFWHUDQGSL[HOOHYHOV:HOHYHUDJH*$1FODVVFRQVWUDLQWV
DQG D 0XOWLSOH ,QWHUSRODWLRQ 5HJXODUL]HU WR HQKDQFH WKH
TXDOLW\ RI WKH JHQHUDWHG LPDJHV 2XU DSSURDFK VXUSDVVHV
SUHYLRXV PRGHOV DQG GHPRQVWUDWHV SURPLVLQJ UHVXOWV LQ
JHQHUDWLQJYLVXDOO\FRQYLQFLQJLPDJHVIURPWH[W

,,, 0(7+2'2/2*<
7KH SURSRVHG DSSURDFK XWLOLVHV D ODWHQW GLIIXVLRQ PRGHO
/'0  WR OHDUQ WKH GDWD GLVWULEXWLRQ S [  E\ GHQRLVLQJ
QRUPDOO\ GLVWULEXWHG YDULDEOHV 7KH /'0 LV WUDLQHG DV D
VHTXHQFH RI GHQRLVLQJ DXWRHQFRGHUV ǻș [WW  ZKHUH [W
UHSUHVHQWVWKHLQSXWDQGWKHDXWRHQFRGHUSUHGLFWVWKHGHQRLVHG
YHUVLRQRI[W7KHREMHFWLYHLVWRJHQHUDWHLPDJHVE\PRGHOOLQJ
WKH GLVWULEXWLRQ RI ORZGLPHQVLRQDO ODWHQW UHSUHVHQWDWLRQV
XVLQJDSHUFHSWXDOFRPSUHVVLRQPRGHOFRPSULVLQJDQHQFRGHU
( DQG D GHFRGHU ' 7KLV ORZGLPHQVLRQDO VSDFH FDSWXUHV
HVVHQWLDO VHPDQWLF LQIRUPDWLRQ DQG LV PRUH FRPSXWDWLRQDOO\
HIILFLHQW WKDQ WKH KLJKGLPHQVLRQDO SL[HO VSDFH PDNLQJ LW
VXLWDEOHIRUJHQHUDWLYHPRGHOVEDVHGRQSUREDELOLW\>@
$ FKDUDFWHUOHYHO K\EULG FRQYROXWLRQDO UHFXUUHQW QHXUDO
QHWZRUN LV HPSOR\HG WR HQFRGH WH[W IHDWXUHV DQG D 'HHS
&RQYROXWLRQDO*HQHUDWLYH$GYHUVDULDO1HWZRUN '&*$1 LV
WUDLQHG7KHGLVFULPLQDWRUQHWZRUNGHQRWHGDV'5A'î5A7
ĺ ^` WDNHV LQSXWV RI SLFWXUH GLPHQVLRQ ' DQG WH[WXDO
HPEHGGLQJ GLPHQVLRQ 7 WR GLVFULPLQDWH EHWZHHQ UHDO DQG
 2023 International Conference on Computational Intelligence, Communication Technology and Networking (CICTN)
JHQHUDWHGLPDJHV7KHJHQHUDWRUQHWZRUNLQGLFDWHGDV*5A=
î5A7î5A'ĺ5WDNHVLQSXWVRIQRLVHGLPHQVLRQ=WH[WXDO
HPEHGGLQJGLPHQVLRQ7DQGSLFWXUHGLPHQVLRQ'WRJHQHUDWH
LPDJHV>@
,QVXPPDU\WKHSURSRVHGPHWKRGOHYHUDJHVWKH/'0WR
OHDUQ WKH GDWD GLVWULEXWLRQ DQG JHQHUDWH LPDJHV IURP D ORZ
GLPHQVLRQDO ODWHQW VSDFH FRQGLWLRQHG RQ WH[WEDVHG IHDWXUHV
HQFRGHG E\ D FKDUDFWHUOHYHO K\EULG FRQYROXWLRQDO UHFXUUHQW
QHXUDO QHWZRUN 7KH '&*$1 LV WUDLQHG ZLWK IHHGIRUZDUG
LQIHUHQFH WKDW LV FRQGLWLRQHG RQ WKH WH[W IHDWXUHV 7KH
GLVFULPLQDWRUDQGJHQHUDWRUQHWZRUNVDUHUHSUHVHQWHGDV'DQG
* UHVSHFWLYHO\ ZLWK VSHFLILF QRWDWLRQ IRU LQSXW DQG RXWSXW
GLPHQVLRQV7KHQHWZRUNDUFKLWHFWXUHGHSLFWHGLQ)LJXUH
LQYROYHV HQFRGLQJ WKH WH[W TXHU\ XVLQJ WKH WH[W FRGHU
VDPSOLQJQRLVHIURP]5=1  DVLQSXWWRWKHJHQHUDWRU
* FRQFDWHQDWLQJ WKH FRPSUHVVHG GHVFULSWLYH HPEHGGLQJ W 
ZLWKWKHQRLVHYHFWRU=DQGSDVVLQJLWWKURXJKDGHFRQYROXWLRQ
QHWZRUNWRJHQHUDWHDFRPSRVLWHLPDJH>@

)LJ 6KRZV *$1 DUFKLWHFWXUH ZLWK WH[W HQFRGLQJ XVHG LQ ERWK
GLVFULPLQDWRUDQGJHQHUDWRU
7KH SURFHVV HPSOR\HG E\ WKH GLVFULPLQDWRU ' LQYROYHV
XWLOL]LQJDPXOWLOHYHO6WULGHFRQYROXWLRQLQFRQMXQFWLRQZLWK
VSDWLDO EDWFK QRUPDOL]DWLRQ DQG D OHDN\ 5H/8 DFWLYDWLRQ
IXQFWLRQLQRUGHUWRHIIHFWLYHO\GHFUHDVHWKHGLPHQVLRQDOLW\RI
WKHGHVFULSWLRQ,IWKHGLVFULPLQDWRU VVSDWLDOGLPHQVLRQLVE\
GHHSFKDLQLQJVKRXOGEHXVHGDORQJZLWKVSDWLDOUHSOLFDWLRQ
RIWKHGHVFULSWLYHHPEHGGLQJ
,9 ,03/(0(17$7,21
,QWKLVVHFWLRQZHGLVFXVVWKHLPSOHPHQWDWLRQGHWDLOVDQG
H[SHULPHQWDOUHVXOWV2XUH[SHULPHQWVZHUHFRQGXFWHGRQWZR
EHQFKPDUNGDWDVHWV2[IRUGDQG&8%ELUGLPDJHV7KH
2[IRUG  GDWDVHW FRQWDLQV  IORZHU SKRWRV IURP 
GLVWLQFW FDWHJRULHV ZKLOH WKH &8% GDWDVHW FRQWDLQV 
ELUGSLFWXUHVIURPGLVWLQFWFDWHJRULHV
)RUERWKGDWDVHWVZHVSOLWWKHGDWDLQWRWKHWUDLQLQJDQG
WHVWLQJVHWVDFFRUGLQJWRWKHSURYLGHGFODVVODEHOV(DFKLPDJH
LQ ERWK GDWDVHWV LV DVVRFLDWHG ZLWK ILYH FDSWLRQV ZKLFK DUH
XVHG WR JXLGH WKH WH[WWRLPDJH JHQHUDWLRQ SURFHVV 'XULQJ
WUDLQLQJZHUDQGRPO\VHOHFWDQLPDJHSHUVSHFWLYHDQGFDSWLRQ
IRUHDFKPLQLEDWFK
7R HPEHG WKH WH[W FDSWLRQV ZH ILUVW XVH D GHHS QHXUDO
UHFXUVLYH PRGHO EDVHG RQ GLPHQVLRQDO *RRJ/H1HW
SLFWXUHHPEHGGLQJV7KHQZHLQWHJUDWHDFKDU&11511WR
HQFRGH WKH FDSWLRQV LQWR D IL[HGOHQJWK YHFWRU 7KLV WH[W
HQFRGHUGRHVQRWUHTXLUHSUHWUDLQLQJDQGFDQEHWUDLQHGHQG
WRHQGZLWKWKHRWKHUFRPSRQHQWVRIWKHV\VWHP
:HXVHWKHVDPH*$1DUFKLWHFWXUHIRUERWKGDWDVHWVZLWK
WKH SUDFWLFH LPDJH V GLPHQVLRQV VHW WR [ 7KH 
GLPHQVLRQDOWH[WHPEHGGLQJVDUHUHGXFHGWRGLPHQVLRQV
E\ WKH JHQHUDWRU  GLVFULPLQDWRU QHWZRUNV DQG WKHQ
146
Authorized licensed use limited to: GURU JAMBHESHWAR UNIVERISTY. Downloaded on February 29,2024 at 06:55:35 UTC from IEEE Xplore. Restrictions apply.
FRQFDWHQDWHG ZLWK FRQYROXWLRQDO IHDWXUH PDSV 7KH
GLVFULPLQDWRU DQG JHQHUDWRU QHWZRUNV DUH XSGDWHG LQ
DOWHUQDWLQJSKDVHVDFFRUGLQJWR$OJRULWKPZLWKDOHDUQLQJ
WKHUDWHRIWKHDQGDPRPHQWXPRIWKHXVLQJWKH
$'$0VROYHU7KHJHQHUDWRUSURGXFHVQRLVHWKDWLVVDPSOHG
IURP D XQLW QRUPDO GLVWULEXWLRQ ZLWK  GLPHQVLRQV 7KH
WUDLQLQJ SURFHVV FRQVLVWV RI  HSRFKV ZLWK HDFK HSRFK
XWLOL]LQJDPLQLEDWFKVL]HRI
2YHUDOORXUSURSRVHGWH[WWRLPDJHJHQHUDWRUXVLQJODWHQW
GLIIXVLRQ PRGHOV GHPRQVWUDWHV SURPLVLQJ UHVXOWV RQ WZR
EHQFKPDUNGDWDVHWVDQGVKRZVSRWHQWLDOIRUJHQHUDWLQJKLJK
TXDOLW\ LPDJHV IURP WKH WH[W GHVFULSWLRQ 2XU DSSURDFK LV
JHQHUDOL]DEOH WR RWKHU GDWDVHWV DQG FDQ EH LPSURYHG ZLWK
IXWXUHUHVHDUFK
7R PHDVXUH WKH GHJUHH RI GLVHQWDQJOHPHQW LQ &8% WKH
UHVHDUFKHUV VHW XS RI WZR SUHGLFWLRQ WDVNV SRVH FKHFN DQG
EDFNJURXQGFRORUFKHFN7KH\XVHGQRLVH]DVLQSXWDQGIHGD
SDLURIVLPLODUDQGGLVVLPLODULPDJHVWRDVW\OHFRGHUWUDLQHG
WR UHYHUVH WKH RXWSXW DQG LQSXW RI WKH JHQHUDWRU 7KH VW\OH
YHFWRU ZDV FDOFXODWHG EDVHG RQ WKH GHJUHH RI VLPLODULW\
EHWZHHQ WKH LPDJHV RI GLIIHUHQW VW\OHV ,I D *$1 XVHV ] WR
GLVHQWDQJOHVW\OHVIURPLPDJHFRQWHQWVXFKDVGLIIHUHQWSRVHV
WKH VLPLODULW\ EHWZHHQ WKH VW\OH YHFWRUV RI LPDJHV ZLWK
GLIIHUHQWSRVHVVKRXOGEHJUHDWHUWKDQWKRVHZLWKVLPLODUSRVHV

)LJ ,PDJHVDUHRUJDQL]HGEDVHGRQNH\SRLQWFRRUGLQDWHVLQFOXGLQJ
WKHEHDNEHOO\FKHVWWDLOIRUHKHDGDQGFURZQ
7RUHFRYHU]WKHUHVHDUFKHUVUHYHUVHGHDFKRIJHQHUDWRU
QHWZRUN DV PHQWLRQHG LQ VXEVHFWLRQ  7KH LPDJHV ZHUH
FDWHJRUL]HG EDVHG RQ WKH W\SLFDO EDFNJURXQG FRORU 5*%
FKDQQHOV  7KH UHVXOWV VKRZHG WKDW WKH GLVHQWDQJOHPHQW
SHUIRUPDQFH RI WKH *$1 PRGHO ZDV DIIHFWHG E\ WKH
FRPSOH[LW\RIWKHVW\OHLQIRUPDWLRQ)RUH[DPSOHWKHPRGHO
KDG GLIILFXOW\ GLVHQWDQJOLQJ EDFNJURXQG FRORUV WKDW ZHUH
VLPLODU LQ KXH EXW GLIIHUHG LQ VDWXUDWLRQ DQG EULJKWQHVV
+RZHYHU LW SHUIRUPHG ZHOO LQ GLVHQWDQJOLQJ SRVH
LQIRUPDWLRQ LQGLFDWLQJ WKDW WKH PRGHO ZDV DEOH WR OHDUQ WR
VHSDUDWHVW\OH FRQWHQWHIIHFWLYHO\


 2023 International Conference on Computational Intelligence, Communication Technology and Networking (CICTN)
)LJ +HUH WKH 52& FXUYHV GHPRQVWUDWH WKH FRVLQH GLVWDQFH GLIIHUHQFH
EHWZHHQ H[SHFWHG VW\OH YHFWRUV RQ LPDJH SDLUV ZLWK VLPLODU DQG GLVWLQFW
VW\OHV 7KH OHIW VLGH GLVSOD\V LPDJH SDLUV ZLWK VLPLODU DQG GLVWLQFW SRVHV
ZKLOH WKH ULJKW VLGH VKRZV LPDJH VHWV ZLWK VLPLODU DQG GLVWLQFW DYHUDJH
EDFNJURXQGFRORUV>@
2YHUDOOWKHH[SHULPHQWVGHPRQVWUDWHGWKDWWKHSURSRVHG
PRGHO ZDV FDSDEOH RI GLVHQWDQJOLQJ VW\OH DQG FRQWHQW
LQIRUPDWLRQ DOORZLQJ IRU JUHDWHU FRQWURO RYHU WKH LPDJH
JHQHUDWHSURFHVV7KLVFDSDELOLW\KDVVLJQLILFDQWLPSOLFDWLRQV
IRU DSSOLFDWLRQV VXFK DV LPDJH HGLWLQJ DQG PDQLSXODWLRQ
ZKHUHWKHDELOLW\WRVHSDUDWHDQGPDQLSXODWHGLIIHUHQWDVSHFWV
RIDQLPDJHFDQEHXVHIXO
9 &21&/86,21
,Q WKLV VWXG\ WKH DXWKRUV KDYH SURSRVHG DQ HIIHFWLYH
PHWKRGIRUJHQHUDWLQJLPDJHVIURPWKHWH[WGHVFULSWLRQXVLQJ
*$1VDQGODWHQWGLIIXVLRQPRGHOV7KH\KDYHGHPRQVWUDWHG
WKHDELOLW\RIWKHLUPRGHOWRJHQHUDWHGLYHUVHDQGFRQYLQFLQJ
YLVXDO LQWHUSUHWDWLRQV RI WKH JLYHQ WH[W ODEHO 7KH SURSRVHG
UHJXODUL]HU IRU PDQLIROG LQWHUSRODWLRQ KDV VKRZQ VLJQLILFDQW
9, )8785(6&23($1'/,0,7$7,216
$V ZH ORRN WR WKH IXWXUH WKHUH DUH VHYHUDO DYHQXHV IRU
IXUWKHUUHVHDUFKWKDWZHOLNHWRH[SORUH$QDVSHFWWKDWZHDUH
FXUUHQWO\IRFXVHGRQLVEURDGHQLQJWKHUDQJHRIWH[WXDOLQSXWV
+RZHYHUWKHUHDUHDOVROLPLWDWLRQVWRRXUFXUUHQWPRGHO
2QH RI WKH PDLQ OLPLWDWLRQV LV WKDW LW UHTXLUHV DQ LQWHUQHW
FRQQHFWLRQ WR IXQFWLRQ LQ RQOLQH PRGH DQG ZLOO QRW ZRUN
RIIOLQH 7R DGGUHVV WKLV ZH SODQ WR LQYHVWLJDWH DOWHUQDWLYH
GDWDVHWV RU GHYHORS RXU RZQ GDWDVHW WR RYHUFRPH WKLV
OLPLWDWLRQ$QRWKHUDUHDIRULPSURYHPHQWLVWRLQYHVWLJDWHWKH
WUDGHRII EHWZHHQ WKH LPDJH TXDOLW\  JHQHUDWLRQ VSHHG DV
RXUPRGHOFDQWDNHDVLJQLILFDQWDPRXQWRIWLPHWRJHQHUDWH
KLJKTXDOLW\ LPDJHV )LQDOO\ ZH ZRXOG OLNH WR H[SORUH WKH
SRWHQWLDOIRULQFRUSRUDWLQJDGGLWLRQDOPRGDOLWLHVVXFKDVDXGLR
RU YLGHR WR HQKDQFH WKH PRGHO V DELOLW\ WR JHQHUDWH PXOWL
PRGDORXWSXWV
5()(5(1&(6
>@ $6LQJK$.XPDU13UDGKDQDQG9.XPDU7H[WWRLPDJHXVLQJ
GHHS OHDUQLQJ ,QWHUQDWLRQDO -RXUQDO RI (QJLQHHULQJ 5HVHDUFK 
7HFKQRORJ\YROQRSS
>@ 0'=+RVVDLQ*0XKDPPDGDQG65R\7H[WWRLPDJHV\QWKHVLV
IRULPSURYHGFDSWLRQLQJLQ,(((,QWHUQDWLRQDO&RQIHUHQFHRQ
&RPSXWHU 9LVLRQ :RUNVKRS ,&&9:   SS 
KWWSVGRLRUJ,&&9:
>@ 0:DQJ5/LX=+HDQG<*DR-RLQWHPEHGGLQJEDVHGWH[WWR
LPDJH V\QWKHVLV LQ  ,((( QG ,QWHUQDWLRQDO &RQIHUHQFH RQ
7RROV ZLWK $UWLILFLDO ,QWHOOLJHQFH ,&7$,   SS 
KWWSVGRLRUJ,&7$,
>@ + =KDQJ ; 0DR < /LX DQG 5 -L '*DWW*$1 &RRSHUDWLYH XS
VDPSOLQJ EDVHG GXDO JHQHUDWRU DWWHQWLRQDO *$1 RQ WH[WWRLPDJH
V\QWKHVLVLQ,(((,QWHUQDWLRQDO&RQIHUHQFHRQ0XOWLPHGLDDQG
([SR ,&0(   SS 
KWWSVGRLRUJ,&0(
>@ 7)URORY$*DIXURYDQG$%H]]XEWVHYD$GYHUVDULDOWH[WWRLPDJH
V\QWKHVLVDU;LYSUHSULQWDU;LY
>@ $'RVRYLWVNL\-76SULQJHQEHUJDQG7%UR[/HDUQLQJWRJHQHUDWH
FKDLUVZLWKFRQYROXWLRQDOQHXUDOQHWZRUNVLQ3URFHHGLQJVRIWKH,(((
&RQIHUHQFH RQ &RPSXWHU 9LVLRQ DQG 3DWWHUQ 5HFRJQLWLRQ &935 
SSKWWSVGRLRUJ&935
>@ $)DUKDGL,(QGUHV'+RLHPDQG')RUV\WK'HVFULELQJREMHFWV
E\ WKHLU DWWULEXWHV LQ 3URFHHGLQJV RI WKH ,((( &RQIHUHQFH RQ
&RPSXWHU 9LVLRQ DQG 3DWWHUQ 5HFRJQLWLRQ &935   SS 
KWWSVGRLRUJ&935
147
Authorized licensed use limited to: GURU JAMBHESHWAR UNIVERISTY. Downloaded on February 29,2024 at 06:55:35 UTC from IEEE Xplore. Restrictions apply.
LPSURYHPHQWLQWKHV\QWKHVLVRIWH[WDQGLPDJHVDW&8%DQG
WKH GHFRXSOLQJ RI GHVLJQ DQG VXEVWDQFH KDV EHHQ DFKLHYHG
HQDEOLQJ WKH WUDQVIHU RI ELUG DWWLWXGH DQG EDFNJURXQG IURP
VHDUFKSKRWRJUDSKVWRWH[WGHVFULSWLRQV7KHDXWKRUVKDYHDOVR
VKRZQ WKH JHQHUDOL]DELOLW\ RI WKHLU DSSURDFK IRU SURGXFLQJ
LPDJHVZLWKGLIIHUHQWW\SHRIREMHFWV PRYDEOHEDFNGURSV
XVLQJWKH06&2&2GDWDVHW
2YHUDOOWKHSURSRVHGPHWKRGFDQEHXWLOL]HGIRUWKHZLGH
UDQJHRIDSSOLFDWLRQVVXFKDVYLUWXDOUHDOLW\JDPLQJDQGH
FRPPHUFH ,W FDQ HQDEOH WKH JHQHUDWLRQ RI UHDOLVWLF SURGXFW
LPDJHV IRU RQOLQH VWRUHV EDVHG RQ WH[WXDO GHVFULSWLRQV
DOORZLQJ FXVWRPHUV WR YLHZ SURGXFWV WKDW GRQ¶W H[LVW
SK\VLFDOO\ ,W FDQ DOVR DVVLVW LQ WKH FUHDWLRQ RI YLUWXDO
HQYLURQPHQWV IRU JDPLQJ DQG VLPXODWLRQV ZKHUH WKH
JHQHUDWLRQ RI UHDOLVWLF LPDJHV IURP WKH WH[W GHVFULSWLRQ LV
FULWLFDO 7KH PRGHO V DELOLW\ WR JHQHUDWH WKH KLJKTXDOLW\
LPDJHV IURP WKH WH[W GHVFULSWLRQ ZLWK WKH GHVLUHG OHYHO RI
FRQWURORYHUWKHYLVXDOVW\OHDQGFRQWHQWRSHQVXSQXPHURXV
SRVVLELOLWLHVIRUIXWXUHUHVHDUFKDQGDSSOLFDWLRQV
WKDWRXUPRGHOFDQSURFHVVZKLOHDOVRLPSURYLQJLWVFDSDFLW\
WR JHQHUDWH KLJKUHVROXWLRQ LPDJHV $GGLWLRQDOO\ ZH ZRXOG
OLNHWRH[SORUHWKHSRVVLELOLW\RIDGGLQJWKHVL]HRIWKHGDWDVHW
E\ LQFOXGLQJ PRUH VSHFLDOL]HG GRPDLQV DQG LPSURYLQJ WKH
XQGHUO\LQJ VFHQH JUDSK PRGDOLW\ WR EHWWHU FDSWXUH WKH
VHPDQWLFVRIWKHLQSXWWH[W
>@ < )X 7 0 +RVSHGDOHV 7 ;LDQJ 6 *RQJ DQG & =KDQJ
7UDQVGXFWLYH PXOWLYLHZ HPEHGGLQJ IRU ]HURVKRW UHFRJQLWLRQ DQG
DQQRWDWLRQ LQ (XURSHDQ &RQIHUHQFH RQ &RPSXWHU 9LVLRQ (&&9 
SS
>@ -*DXWKLHU&RQGLWLRQDOJHQHUDWLYHDGYHUVDULDOQHWVIRUFRQYROXWLRQDO
IDFH JHQHUDWLRQ 7HFKQLFDO UHSRUW  DU;LY SUHSULQW DU;LY

>@ ,*RRGIHOORZ-3RXJHW$EDGLH00LU]D%;X':DUGH)DUOH\
62]DLUHW DO*HQHUDWLYHDGYHUVDULDOQHWVLQ $GYDQFHVLQQHXUDO
LQIRUPDWLRQSURFHVVLQJV\VWHPV 1,36 SS
>@ .*UHJRU,'DQLKHOND$0QLK&%OXQGHOODQG':LHUVWUD³'5$:
$ UHFXUUHQW QHXUDO QHWZRUN IRU LPDJH JHQHUDWLRQ´ LQ 3URFHHGLQJV RI WKH
,QWHUQDWLRQDO &RQIHUHQFH RQ 0DFKLQH /HDUQLQJ ,&0/   SS

>@ 6+RFKUHLWHUDQG-6FKPLGKXEHU³/RQJVKRUWWHUPPHPRU\´1HXUDO
&RPSXWDWLRQ YRO  QR  SS  1RY 
GRLQHFR
>@ 6,RIIHDQG&6]HJHG\³%DWFKQRUPDOL]DWLRQ$FFHOHUDWLQJGHHS
QHWZRUN WUDLQLQJ E\ UHGXFLQJ LQWHUQDO FRYDULDWH VKLIW´ LQ
3URFHHGLQJVRIWKH,QWHUQDWLRQDO&RQIHUHQFHRQ0DFKLQH/HDUQLQJ
,&0/ SSGRL
>@ $ .DUSDWK\ DQG / )HL)HL ³'HHS YLVXDOVHPDQWLF DOLJQPHQWV IRU
JHQHUDWLQJ LPDJH GHVFULSWLRQV´ LQ 3URFHHGLQJV RI WKH ,(((
&RQIHUHQFH RQ &RPSXWHU 9LVLRQ DQG 3DWWHUQ 5HFRJQLWLRQ &935 
SSGRL&935
>@ 5.LURV56DODNKXWGLQRYDQG5=HPHO³8QLI\LQJYLVXDOVHPDQWLF
HPEHGGLQJVZLWKPXOWLPRGDOQHXUDOODQJXDJHPRGHOV´LQ3URFHHGLQJV
RIWKH1HXUDO,QIRUPDWLRQ3URFHVVLQJ6\VWHPV 1,36 SS

>@ 1.XPDU$%HUJ31%HOKXPHXUDQG61D\DU³$WWULEXWHDQGVLPLOH
FODVVLILHUVIRUIDFHYHULILFDWLRQ´LQ3URFHHGLQJVRIWKH,(((,QWHUQDWLRQDO
&RQIHUHQFH RQ &RPSXWHU 9LVLRQ ,&&9   SS 
GRL,&&9
>@ & + /DPSHUW + 1LFNLVFK DQG 6 +DUPHOLQJ ³$WWULEXWHEDVHG
FODVVLILFDWLRQIRU]HURVKRWYLVXDOREMHFWFDWHJRUL]DWLRQ´,(((7UDQVDFWLRQV
RQ 3DWWHUQ$QDO\VLVDQG0DFKLQH,QWHOOLJHQFHYROQRSS
0DUGRL73$0,
>@ 7</LQ00DLUH6%HORQJLH-+D\V33HURQD'5DPDQDQ3
'ROOiU DQG & / =LWQLFN ³0LFURVRIW &2&2 &RPPRQ REMHFWV LQ
FRQWH[W´ LQ 3URFHHGLQJV RI WKH (XURSHDQ &RQIHUHQFH RQ &RPSXWHU
9LVLRQ (&&9   SS  GRL 
B
 2023 International Conference on Computational Intelligence, Communication Technology and Networking (CICTN)

>@ ( 0DQVLPRY ( 3DULVRWWR - %D DQG 5 6DODNKXWGLQRY ³*HQHUDWLQJ
LPDJHVIURPFDSWLRQVZLWKDWWHQWLRQ´LQ3URFHHGLQJVRIWKH,QWHUQDWLRQDO
&RQIHUHQFH RQ /HDUQLQJ 5HSUHVHQWDWLRQV ,&/5  
DU;LY
>@ -0DR:;X<<DQJ-:DQJ==KDDQG-/L'HHSFDSWLRQLQJ
ZLWK PXOWLPRGDO UHFXUUHQW QHXUDO QHWZRUNV PUQQ  LQ 
,QWHUQDWLRQDO&RQIHUHQFHRQ/HDUQLQJ5HSUHVHQWDWLRQV6DQ'LHJR&$
86$SSKWWSVDU[LYRUJDEV
>@ 65HHG=$NDWD;<DQ//RJHVZDUDQ%6FKLHOH+/HH³
*HQHUDWLYH$GYHUVDULDO7H[WWR,PDJH6\QWKHVLV´LQ3URFHHGLQJV
RIWKHUG ,QWHUQDWLRQDO&RQIHUHQFHRQ0DFKLQH/HDUQLQJ1HZ
<RUN 1< 86$  -0/5 : &3 YROXPH 
KWWSVDU[LYRUJSGISGI

148
Authorized licensed use limited to: GURU JAMBHESHWAR UNIVERISTY. Downloaded on February 29,2024 at 06:55:35 UTC from IEEE Xplore. Restrictions apply.