官术网_书友最值得收藏!

Defining problem and objectives

Before any development begins, the problem to be solved must be defined together with objectives of what good will look like, to set expectations. The way the problem is formulated is very important, as this can mean the difference between intractability and a simple solution. It is also likely to involve a conversation about where the input data for any algorithm will come from.

ML algorithms usually require large amounts of data to perform at their best. Sourcing quality data is the most important consideration when planning a ML project. 

The typical formulation of an ML problem takes the form given X dataset, predict Y. The availability of data or lack of it thereof can affect the formulation of the problem, the solution, and its feasibility. For example, consider the problem given a large labeled set of images of handwritten digits[18], predict the label of a previously unseen image. Deep learning algorithms have demonstrated that it is possible to achieve relatively high accuracy on this particular problem with little work on the part of the engineer, as long as the training dataset is sufficiently large[19]. If the training set is not large, the problem immediately becomes more difficult and requires a careful selection of the algorithm to use. It also affects the accuracy and thus, the set of attainable objectives.

Experiments performed by Michael Nielsen on the MNIST handwritten digit dataset show that the difference between training an ML algorithm with 1 example of labeled input/output pairs per digit and 5 examples was an improvement of accuracy from around 40% to around 65% for most algorithms tested[20]. Using 10 examples per digit usually raised the accuracy a further 5%.

If insufficient data is available to meet the project objectives, it is sometimes possible to boost performance by artificially expanding the dataset by making small changes to existing examples. In the previously mentioned experiments, Nielsen observed that adding slightly rotated or translated images to the dataset improved performance by as much as 15%.

主站蜘蛛池模板: 郎溪县| 辽中县| 确山县| 图片| 天全县| 扎鲁特旗| 恭城| 甘孜| 龙门县| 石阡县| 苍梧县| 仁怀市| 资阳市| 永兴县| 阿巴嘎旗| 息烽县| 五大连池市| 太原市| 昭通市| 鄢陵县| 保德县| 万年县| 文化| 锡林郭勒盟| 嫩江县| 台东县| 枣阳市| 岳普湖县| 桦甸市| 舟山市| 金寨县| 抚顺市| 辽源市| 栖霞市| 东宁县| 珠海市| 蕉岭县| 乳源| 龙井市| 山东省| 平利县|