| operations |
| comment | | "parent_author":"",<br>"parent_permlink":"kr",<br>"author":"yoonheeseung",<br>"permlink":"2-restricted-boltzmann-machines-rbms",<br>"title":"[\ub525\ub7ec\ub2dd - 2 \ub525\ub7ec\ub2dd\uc758 \uc2dc\ucd08,<br> Restricted Boltzmann Machines(RBMs)",<br>"body":"\ubc18\uac11\uc2b5\ub2c8\ub2e4. @yoonheeseung \uc785\ub2c8\ub2e4.\n\ub525\ub7ec\ub2dd \uccab \ub9ac\ubdf0\ub97c \uc4f0\uace0 \uaf64 \uc624\ub79c\uc2dc\uac04\uc774 \uc9c0\ub098\uc11c \ub450\ubc88\uc9f8 \ub9ac\ubdf0\ub97c \uc791\uc131\ud569\ub2c8\ub2e4.\n\uc624\ub298 \uc81c\uac00 \uacf5\ubd80\ud55c \ub0b4\uc6a9\uc740 Unsupervised Learning\uc758 \ud55c \ubc29\ubc95\uc778 Restricted Boltzmann Machines(RBMs) \uc785\ub2c8\ub2e4.\n\nRBM\uc740 \ub525\ub7ec\ub2dd\uc758 \uc544\ubc84\uc9c0\ub77c \ubd88\ub9ac\ub294 **Geoff Hinton** \uad50\uc218\uac00 \uc774\uc804 \uc2e0\uacbd\ub9dd\uc758 \uc5ec\ub7ec \ubb38\uc81c\ub4e4,<br> \ud2b9\ud788 Vanishing Gradient \ubb38\uc81c\ub97c \ud574\uacb0\ud558\uae30 \uc704\ud574 \uace0\uc548\ud55c \ubaa8\ub378\uc785\ub2c8\ub2e4.\n\n## RBM\uc758 \uad6c\uc870\ub294?\nRBM\uc740 Markov Random Fields(http:\/\/norman3.github.io\/prml\/docs\/chapter08\/3)\uc758 \ud2b9\ubcc4\ud55c \n\ud0c0\uc785\uc73c\ub85c,<br> visible layer\uc640 hidden layer\uac00 \uc591\ubc29\ud5a5\uc73c\ub85c \uc804\ubd80 \uc5f0\uacb0\ub418\uc5b4 \uc788\ub294(fully-connected) \uc595\uc740 \ub450 \uce35\uc73c\ub85c \uc774\ub8e8\uc5b4\uc9c4 \ud655\ub960\ub860\uc801\uc778 \ubaa8\ub378\uc785\ub2c8\ub2e4. \n\ud558\uc9c0\ub9cc \uac19\uc740 layer\uc758 \ub178\ub4dc\ub07c\ub9ac\ub294 \uc5f0\uacb0\uc774 \uc81c\ud55c\ub418\uc5b4 \uc788\uae30 \ub54c\ubb38\uc5d0 \uc774 \ubaa8\ub378\uc758 \uc774\ub984\uc5d0 Restricted\uac00 \n\ubd99\uc5c8\ub2e4\uace0 \ud558\ub124\uc694.\n\n![RBM.PNG (https:\/\/steemitimages.com\/DQmSFjgHHXYEETbHY5ZYWyMVXNee1cqhLKb8vwznntpTNco\/RBM.PNG)\n\n## \ud6c8\ub828 \uacfc\uc815\uc740?\n\nRBM\uc73c\ub85c \ud6c8\ub828\uc2dc\ud0ac \ub54c\uc5d0\ub294 \ub450 \uac1c \uc774\uc0c1\uc758 \ud655\ub960\ubcc0\uc218\uc758 \uacb0\ud569\ud655\ub960\ubd84\ud3ec\ub85c\ubd80\ud130 \uc77c\ub828\uc758 \ud45c\ubcf8\uc744 \uc0dd\uc131\ud558\ub294 \ud655\ub960\uc801 \uc54c\uace0\ub9ac\uc998\uc778 Gibbs Sampling(https:\/\/ratsgo.github.io\/statistics\/2017\/05\/31\/gibbs\/)\uc744 \ud1b5\ud574 \ud6c8\ub828\uc744 \uc2dc\ud0b5\ub2c8\ub2e4. \n\n3\uac00\uc9c0 \ub2e8\uacc4\ub97c \ubc18\ubcf5\ud568\uc73c\ub85c\uc11c \ud6c8\ub828\uc744 \uc2dc\ud0a4\ub294\ub370\uc694. \ud6c8\ub828 \ubc29\ubc95\uc740 \ub2e4\uc74c\uacfc \uac19\uc2b5\ub2c8\ub2e4.\n1. forward : \uc785\ub825 \uac12\uc744 \ub0b4\ud3ec\ud558\ub294 \uc5b4\ub5a4 \uc22b\uc790 \uac12\uc73c\ub85c \ubcc0\uc5ed\n![trainingrbm.PNG (https:\/\/steemitimages.com\/DQmY6tCGKVpkTEf3R3zjNHpVJd6JA1vNqUPjWGASpYBeNji\/trainingrbm.PNG)\n2. backward : \uc785\ub825\uac12\uc5d0 \ub300\ud574 \uc7ac\uad6c\uc131(reconstruct)\n![trainingrbm2.PNG (https:\/\/steemitimages.com\/DQmS15MDkL79sJDmtBKxtHsfXce9P1Xn4iZMiW3KL6gN4fZ\/trainingrbm2.PNG)\n3. \uc7ac\uad6c\uc131\ub41c \uac12\uacfc \uc6d0\ub798\uc758 \uc785\ub825 \uac12\uc744 \ube44\uad50\ud558\uc5ec \ud3c9\uac00\n\n\uc774\ub807\uac8c 3\ub2e8\uacc4\ub97c \uc785\ub825\uac12\uacfc \uc7ac\uad6c\uc131\ub41c \uac12\uc774 \ucd5c\ub300\ud55c \uac00\uae4c\uc6cc \uc9c8 \ub54c\uae4c\uc9c0 \ubc18\ubcf5\ud569\ub2c8\ub2e4.\n\n\uc774 \ub54c,<br> 3\ubc88\uc9f8 \uc21c\uc11c\uc5d0\uc11c \ube44\uad50\ub97c \ud560 \ub54c \ubcf4\ud1b5 KL Divergence(http:\/\/dongwonshin.net\/kullback-leibler-divergence-%EC%84%A4%EB%AA%85\/)\ub97c \uc0ac\uc6a9\ud558\uc9c0\ub9cc,<br> \uc81c\uac00 \ubcf8 \ub17c\ubb38\uc5d0\uc11c\ub294 gradient-based CD(contrastive divergence) algorithm\uc744 \uc0ac\uc6a9\ud588\uc744 \ub54c \ud6a8\uc728\uc774 \ub354 \uc88b\ub2e4\uace0 \ud569\ub2c8\ub2e4. CD \uc54c\uace0\ub9ac\uc998\uc744 \ub3c4\uc785\ud55c RBM update \uacfc\uc815\uc740 \ub2e4\uc74c\uacfc \uac19\uc2b5\ub2c8\ub2e4.\n\n![CD algorithm.PNG (https:\/\/steemitimages.com\/DQmWdDa7nN7sUQZAdhH4Gs9kSBc74GSwyghgbxA16QQY6Sw\/CD%20algorithm.PNG)\n\n## \uadf8\ub807\ub2e4\uba74 RBM\uc758 \ud2b9\uc9d5\uc740?\nRBM\uc740 Unsupervised Learning\uc774\uae30 \ub54c\ubb38\uc5d0 \uc6b0\uc120 data\uac00 labeled \ub418\uc5b4 \uc788\uc744 \ud544\uc694\uac00 \uc5c6\uc2b5\ub2c8\ub2e4. \ud558\uc9c0\ub9cc \uc0ac\uc2e4 RBM\uc740 \uc5b4\ub5a4 \uc785\ub825 feature\uac00 \uc911\uc694\ud558\uace0,<br> \uc5b4\ub5bb\uac8c \uadf8\ub4e4\uc744 \uc870\ud569\ud574\uc11c \ud328\ud134\uc744 \ub9cc\ub4e4 \uac83\uc778\uc9c0 \uacb0\uc815\ud558\uace0 \uc788\uc2b5\ub2c8\ub2e4. \uadf8\ub798\uc11c RBM\uc744 \ud2b9\uc131(feature)\uc744 \ucd94\ucd9c\ud558\ub294 \uc2e0\uacbd\ub9dd\uc774\ub77c\uace0\ub3c4 \ubd80\ub974\uba70 \uc774\uac83\uc740 Autoencoder\ub77c\uace0\ub3c4 \ud569\ub2c8\ub2e4.\n\n## \ub9c8\ubb34\ub9ac\n\uc9c0\uae08\uae4c\uc9c0 RBM\uc5d0 \ub300\ud574 \uacf5\ubd80\ud55c \ub0b4\uc6a9\uc744 \uc801\uc5b4\ubcf4\uc558\ub294\ub370\uc694. \nRBM\uc5d0 \ub300\ud574 \uc870\uae08 \ub354 \uc790\uc138\ud788 \uc54c\uace0 \uc2f6\uc73c\uc2e0 \ubd84\ub4e4\uc740 (https:\/\/deeplearning4j.org\/kr\/restrictedboltzmannmachine)\uc744 \ucc38\uace0\ud574\uc8fc\uc2dc\uae38 \ubc14\ub78d\ub2c8\ub2e4.\n\ub2e4\uc74c\ubc88\uc5d0\ub294 Deep Belief Network\ub97c \uacf5\ubd80\ud558\uace0 \ucc3e\uc544\ubd59\uaca0\uc2b5\ub2c8\ub2e4.\n\uadf8\ub7fc \uc624\ub298\ub3c4 \uc88b\uc740 \ud558\ub8e8 \ub418\uc138\uc694~!!!",<br>"json_metadata":" \"tags\":[\"kr\",<br>\"deeplearning\",<br>\"masterdegree\",<br>\"study\",<br>\"stochasticmodel\" ,<br>\"users\":[\"yoonheeseung\" ,<br>\"image\":[\"https:\/\/steemitimages.com\/DQmSFjgHHXYEETbHY5ZYWyMVXNee1cqhLKb8vwznntpTNco\/RBM.PNG\",<br>\"https:\/\/steemitimages.com\/DQmY6tCGKVpkTEf3R3zjNHpVJd6JA1vNqUPjWGASpYBeNji\/trainingrbm.PNG\",<br>\"https:\/\/steemitimages.com\/DQmS15MDkL79sJDmtBKxtHsfXce9P1Xn4iZMiW3KL6gN4fZ\/trainingrbm2.PNG\",<br>\"https:\/\/steemitimages.com\/DQmWdDa7nN7sUQZAdhH4Gs9kSBc74GSwyghgbxA16QQY6Sw\/CD%20algorithm.PNG\" ,<br>\"links\":[\"http:\/\/norman3.github.io\/prml\/docs\/chapter08\/3\",<br>\"https:\/\/ratsgo.github.io\/statistics\/2017\/05\/31\/gibbs\/\",<br>\"http:\/\/dongwonshin.net\/kullback-leibler-divergence-%EC%84%A4%EB%AA%85\/\",<br>\"https:\/\/deeplearning4j.org\/kr\/restrictedboltzmannmachine\" ,<br>\"app\":\"steemit\/0.1\",<br>\"format\":\"markdown\" " |
|