舉報 
會員
Hands-On Mathematics for Deep Learning
Mostprogrammersanddatascientistsstrugglewithmathematics,havingeitheroverlookedorforgottencoremathematicalconcepts.ThisbookusesPythonlibrariestohelpyouunderstandthemathrequiredtobuilddeeplearning(DL)models.You'llbeginbylearningaboutcoremathematicalandmoderncomputationaltechniquesusedtodesignandimplementDLalgorithms.Thisbookwillcoveressentialtopics,suchaslinearalgebra,eigenvaluesandeigenvectors,thesingularvaluedecompositionconcept,andgradientalgorithms,tohelpyouunderstandhowtotraindeepneuralnetworks.Laterchaptersfocusonimportantneuralnetworks,suchasthelinearneuralnetworkandmultilayerperceptrons,withaprimaryfocusonhelpingyoulearnhoweachmodelworks.Asyouadvance,youwilldelveintothemathusedforregularization,multi-layeredDL,forwardpropagation,optimization,andbackpropagationtechniquestounderstandwhatittakestobuildfull-fledgedDLmodels.Finally,you’llexploreCNN,recurrentneuralnetwork(RNN),andGANmodelsandtheirapplication.Bytheendofthisbook,you'llhavebuiltastrongfoundationinneuralnetworksandDLmathematicalconcepts,whichwillhelpyoutoconfidentlyresearchandbuildcustommodelsinDL.
最新章節
- Leave a review - let other readers know what you think
- Other Books You May Enjoy
- Summary
- Facial recognition in 3D
- Mixture model networks
- Spectral graph CNNs
品牌：中圖公司
上架時間：2021-06-18 18:00:23
出版社：Packt Publishing
本書數字版權由中圖公司提供，并由其授權上海閱文信息技術有限公司制作發行
- Leave a review - let other readers know what you think 更新時間：2021-06-18 18:56:13
- Other Books You May Enjoy
- Summary
- Facial recognition in 3D
- Mixture model networks
- Spectral graph CNNs
- Graph neural networks
- Spectral decomposition
- Discrete manifolds
- Manifolds
- Comparing Euclidean and non-Euclidean data
- Geometric Deep Learning
- Summary
- Model-agnostic meta learning
- Long Short-Term Memory meta learners
- Optimization-based meta learning
- Siamese neural networks
- Prototypical networks
- Metric-based meta learning
- Meta Networks
- Memory-augmented neural networks
- Model-based meta learning
- Approaches to meta learning
- Meta learning
- Transfer learning
- Transfer and Meta Learning
- Summary
- Real-valued non-volume preserving
- Normalizing flows
- Flow-based networks
- Wasserstein GANs
- Generative adversarial networks
- The variational autoencoder
- The denoising autoencoder
- Autoencoders
- Why we need generative models
- Generative Models
- Summary
- Transformers
- Comparing global and local attention
- Comparing hard and soft attention
- Self-attention
- Exploring the types of attention
- Location-based address mechanism
- Content-based addressing mechanism
- Addressing mechanisms
- Writing
- Reading
- Understanding neural Turing machines
- Overview of attention
- Attention Mechanisms
- Section 3: Advanced Deep Learning Concepts Simplified
- Summary
- Clockwork RNNs
- Popular architecture
- Training and optimization
- Deep RNNs
- Gated recurrent units
- Long short-term memory
- Bidirectional RNNs
- Vanilla RNNs
- Understanding RNNs
- The types of data used in RNNs
- The need for RNNs
- Recurrent Neural Networks
- Summary
- Inception-v1
- VGG-16
- Exploring popular ConvNet architectures
- Training and optimization
- Working with the ConvNet architecture
- Convolution and pooling size
- Global average pooling
- Pooling
- Transposed convolutions
- Separable convolutions
- Three-dimensional convolutions
- 1 × 1 convolutions
- One-dimensional convolutions
- Two-dimensional convolutions
- Convolutions and pooling
- Types of data used in ConvNets
- The inspiration behind ConvNets
- Convolutional Neural Networks
- Summary
- Adversarial training
- Dropout
- Dataset augmentation
- Parameter tying and sharing
- Early stopping
- L1 regularization
- L2 regularization
- Norm penalties
- The need for regularization
- Regularization
- Summary
- Deep neural networks
- The data
- Xavier initialization
- Random initialization
- All zeros
- Parameter initialization
- Training neural networks
- Backpropagation
- Jensen-Shannon divergence
- Kullback-Leibler divergence
- Cross entropy
- The Huber loss
- Root mean squared error
- Mean squared error
- Mean absolute error
- The loss function
- Exponential linear unit
- Parametric ReLU
- Leaky ReLU
- Rectified linear unit
- Softmax
- Hyperbolic tangent
- Sigmoid
- Activation functions
- Layers
- MLPs
- Pros and cons of the MP neuron and perceptron
- Perceptron
- The MP neuron
- Comparing the perceptron and the McCulloch-Pitts neuron
- Understanding biological neural networks
- Feedforward Neural Networks
- Summary
- Logistic regression
- Polynomial regression
- Linear regression
- Linear Neural Networks
- Section 2: Essential Neural Networks
- Summary
- Graph Laplacian
- Tree graphs
- Multilayer and dynamic graphs
- Directed acyclic graphs
- Directed graphs
- Weighted graphs
- Types of graphs
- Adjacency matrix
- Understanding the basic concepts and terminology
- Graph Theory
- Summary
- Particle swarm optimization
- Genetic algorithms
- Exploring population methods
- Natural evolution
- Simulated annealing
- Adaptive gradient descent
- The Nesterov's accelerated gradient
- Gradient descent with momentum
- Loss functions
- Stochastic gradient descent
- Gradient descent
- Descent methods
- Game theory
- The quasi-Newton method
- The secant method
- Newton's method
- Lagrange multipliers
- Least squares
- Exploring the various optimization methods
- Non-convex optimization
- Optimization problems
- Convex functions
- Affine sets
- Convex sets
- Convex optimization
- Unconstrained optimization
- Constrained optimization
- Understanding optimization and it's different types
- Optimization
- Summary
- Hypothesis testing
- Linear models
- The multivariate normal theory
- Composite hypothesis
- Simple hypotheses
- Hypothesis testing
- Bayesian estimation
- Confidence intervals
- Likelihood
- Sufficiency
- Mean squared error
- Estimation
- Essential concepts in statistics
- Gamma distribution
- Bivariate normal distribution
- Multivariate normal distribution
- Normal distribution
- More probability distributions
- Joint distributions
- Continuous random variables
- Multiple random variables
- Variance
- Random variables
- Conditional probability
- Discrete distributions
- Independence
- Stirling's formula
- Multinomial coefficient
- Sampling with or without replacement
- Classical probability
- Understanding the concepts in probability
- Probability and Statistics
- Summary
- Inverse functions
- Vector fields
- Derivatives
- Vector calculus
- Integrals
- Chain rule
- Partial derivatives
- Multivariable calculus
- Integration by parts
- Areas between curves
- Substitution rule
- The fundamental theorem of calculus
- Integrals
- Antiderivative
- Chain rule
- Quotient rule
- Product rule
- First and second derivatives
- Trigonometric functions
- Power rule
- Sum rule
- Derivatives
- Single variable calculus
- Vector Calculus
- Summary
- Cholesky decomposition
- Singular value decomposition
- Diagonalization and symmetric matrices
- Orthogonal matrices
- Trace
- Eigenvalues and eigenvectors
- Determinant
- Matrix decompositions
- Inner product space
- Metric space and normed space
- Image and kernel
- Linear maps
- Subspaces
- Spaces
- Vector spaces and subspaces
- Permutations
- Matrix transpose
- Inverse matrices
- Multiplying matrices
- Adding matrices
- Matrix operations
- Solving linear equations using elimination
- Solving linear equations in n-dimensions
- Linear equations
- Comparing scalars and vectors
- Linear Algebra
- Section 1: Essential Mathematics for Deep Learning
- Reviews
- Get in touch
- Conventions used
- Download the color images
- To get the most out of this book
- What this book covers
- Who this book is for
- Preface
- Packt is searching for authors like you
- About the reviewers
- About the author
- Contributors
- Why subscribe?
- About Packt
- 版權信息
- 封面
- 封面
- 版權信息
- About Packt
- Why subscribe?
- Contributors
- About the author
- About the reviewers
- Packt is searching for authors like you
- Preface
- Who this book is for
- What this book covers
- To get the most out of this book
- Download the color images
- Conventions used
- Get in touch
- Reviews
- Section 1: Essential Mathematics for Deep Learning
- Linear Algebra
- Comparing scalars and vectors
- Linear equations
- Solving linear equations in n-dimensions
- Solving linear equations using elimination
- Matrix operations
- Adding matrices
- Multiplying matrices
- Inverse matrices
- Matrix transpose
- Permutations
- Vector spaces and subspaces
- Spaces
- Subspaces
- Linear maps
- Image and kernel
- Metric space and normed space
- Inner product space
- Matrix decompositions
- Determinant
- Eigenvalues and eigenvectors
- Trace
- Orthogonal matrices
- Diagonalization and symmetric matrices
- Singular value decomposition
- Cholesky decomposition
- Summary
- Vector Calculus
- Single variable calculus
- Derivatives
- Sum rule
- Power rule
- Trigonometric functions
- First and second derivatives
- Product rule
- Quotient rule
- Chain rule
- Antiderivative
- Integrals
- The fundamental theorem of calculus
- Substitution rule
- Areas between curves
- Integration by parts
- Multivariable calculus
- Partial derivatives
- Chain rule
- Integrals
- Vector calculus
- Derivatives
- Vector fields
- Inverse functions
- Summary
- Probability and Statistics
- Understanding the concepts in probability
- Classical probability
- Sampling with or without replacement
- Multinomial coefficient
- Stirling's formula
- Independence
- Discrete distributions
- Conditional probability
- Random variables
- Variance
- Multiple random variables
- Continuous random variables
- Joint distributions
- More probability distributions
- Normal distribution
- Multivariate normal distribution
- Bivariate normal distribution
- Gamma distribution
- Essential concepts in statistics
- Estimation
- Mean squared error
- Sufficiency
- Likelihood
- Confidence intervals
- Bayesian estimation
- Hypothesis testing
- Simple hypotheses
- Composite hypothesis
- The multivariate normal theory
- Linear models
- Hypothesis testing
- Summary
- Optimization
- Understanding optimization and it's different types
- Constrained optimization
- Unconstrained optimization
- Convex optimization
- Convex sets
- Affine sets
- Convex functions
- Optimization problems
- Non-convex optimization
- Exploring the various optimization methods
- Least squares
- Lagrange multipliers
- Newton's method
- The secant method
- The quasi-Newton method
- Game theory
- Descent methods
- Gradient descent
- Stochastic gradient descent
- Loss functions
- Gradient descent with momentum
- The Nesterov's accelerated gradient
- Adaptive gradient descent
- Simulated annealing
- Natural evolution
- Exploring population methods
- Genetic algorithms
- Particle swarm optimization
- Summary
- Graph Theory
- Understanding the basic concepts and terminology
- Adjacency matrix
- Types of graphs
- Weighted graphs
- Directed graphs
- Directed acyclic graphs
- Multilayer and dynamic graphs
- Tree graphs
- Graph Laplacian
- Summary
- Section 2: Essential Neural Networks
- Linear Neural Networks
- Linear regression
- Polynomial regression
- Logistic regression
- Summary
- Feedforward Neural Networks
- Understanding biological neural networks
- Comparing the perceptron and the McCulloch-Pitts neuron
- The MP neuron
- Perceptron
- Pros and cons of the MP neuron and perceptron
- MLPs
- Layers
- Activation functions
- Sigmoid
- Hyperbolic tangent
- Softmax
- Rectified linear unit
- Leaky ReLU
- Parametric ReLU
- Exponential linear unit
- The loss function
- Mean absolute error
- Mean squared error
- Root mean squared error
- The Huber loss
- Cross entropy
- Kullback-Leibler divergence
- Jensen-Shannon divergence
- Backpropagation
- Training neural networks
- Parameter initialization
- All zeros
- Random initialization
- Xavier initialization
- The data
- Deep neural networks
- Summary
- Regularization
- The need for regularization
- Norm penalties
- L2 regularization
- L1 regularization
- Early stopping
- Parameter tying and sharing
- Dataset augmentation
- Dropout
- Adversarial training
- Summary
- Convolutional Neural Networks
- The inspiration behind ConvNets
- Types of data used in ConvNets
- Convolutions and pooling
- Two-dimensional convolutions
- One-dimensional convolutions
- 1 × 1 convolutions
- Three-dimensional convolutions
- Separable convolutions
- Transposed convolutions
- Pooling
- Global average pooling
- Convolution and pooling size
- Working with the ConvNet architecture
- Training and optimization
- Exploring popular ConvNet architectures
- VGG-16
- Inception-v1
- Summary
- Recurrent Neural Networks
- The need for RNNs
- The types of data used in RNNs
- Understanding RNNs
- Vanilla RNNs
- Bidirectional RNNs
- Long short-term memory
- Gated recurrent units
- Deep RNNs
- Training and optimization
- Popular architecture
- Clockwork RNNs
- Summary
- Section 3: Advanced Deep Learning Concepts Simplified
- Attention Mechanisms
- Overview of attention
- Understanding neural Turing machines
- Reading
- Writing
- Addressing mechanisms
- Content-based addressing mechanism
- Location-based address mechanism
- Exploring the types of attention
- Self-attention
- Comparing hard and soft attention
- Comparing global and local attention
- Transformers
- Summary
- Generative Models
- Why we need generative models
- Autoencoders
- The denoising autoencoder
- The variational autoencoder
- Generative adversarial networks
- Wasserstein GANs
- Flow-based networks
- Normalizing flows
- Real-valued non-volume preserving
- Summary
- Transfer and Meta Learning
- Transfer learning
- Meta learning
- Approaches to meta learning
- Model-based meta learning
- Memory-augmented neural networks
- Meta Networks
- Metric-based meta learning
- Prototypical networks
- Siamese neural networks
- Optimization-based meta learning
- Long Short-Term Memory meta learners
- Model-agnostic meta learning
- Summary
- Geometric Deep Learning
- Comparing Euclidean and non-Euclidean data
- Manifolds
- Discrete manifolds
- Spectral decomposition
- Graph neural networks
- Spectral graph CNNs
- Mixture model networks
- Facial recognition in 3D
- Summary
- Other Books You May Enjoy
- Leave a review - let other readers know what you think 更新時間：2021-06-18 18:56:13
