官术网_书友最值得收藏!

Getting ready

To understand the impact of varying the optimizer on network accuracy, let's contrast the scenario laid out in previous sections (which was the Adam optimizer) with using a stochastic gradient descent optimizer in this section, while reusing the same MNIST training and test datasets that were scaled (the same data-preprocessing steps as those of step 1 and step 2 in the Scaling the dataset recipe):

model = Sequential()
model.add(Dense(1000, input_dim=784, activation='relu'))
model.add(Dense(10, activation='softmax'))
model.compile(loss='categorical_crossentropy', optimizer='sgd', metrics=['accuracy'])
history = model.fit(X_train, y_train, validation_data=(X_test, y_test), epochs=100, batch_size=32, verbose=1)

Note that when we used the stochastic gradient descent optimizer in the preceding code, the final accuracy after 100 epochs is ~98% (the code to generate the plots in the following diagram remains the same as the code we used in step 8 of the Training a vanilla neural network recipe):

However, we should also note that the model achieved the high accuracy levels much more slowly when compared to the model that used Adam optimization.

主站蜘蛛池模板: 根河市| 苍梧县| 尚义县| 云林县| 南郑县| 庆城县| 佛坪县| 福海县| 木里| 柞水县| 伊宁县| 安乡县| 武陟县| 科技| 南华县| 兴宁市| 嘉兴市| 永宁县| 莒南县| 乐业县| 泊头市| 晋宁县| 乐亭县| 方正县| 贺州市| 高雄县| 陵水| 互助| 巫溪县| 内江市| 九龙坡区| 洛南县| 山丹县| 阜康市| 九龙城区| 富阳市| 行唐县| 辉南县| 衡东县| 平定县| 沂南县|