Dell PowerEdge C4140 Deep Learning Performance Comparison - Scale-up vs. Scale - Page 7

Introduction

Page 7 highlights

Deep Learning Performance: Scale-up vs Scale-out 2 Introduction Figure 1: Artificial Intelligence, Machine Learning and Deep Learning [Source: MIT] Artificial Intelligence First coined in 1956 by John McCarthy, AI involves machines that can perform tasks that are characteristic of human intelligence. While this is rather general, it includes things like planning, understanding language, recognizing objects and sounds, learning, and problem solving. Machine Learning Arthur Samuel coined the phrase not too long after AI, in 1959, defining it as, "the ability to learn without being explicitly programmed." You see, you can get AI without using machine learning, but this would require building millions of lines of codes with complex rules and decision-trees. So instead of hard coding software routines with specific instructions to accomplish a task, machine learning is a way of "training" an algorithm so that it can learn how. "Training" involves feeding massive amounts of data to the algorithm and allowing the algorithm to adjust itself and improve. Spiking Neural Networks Spiking neural networks (SNNs) are artificial neural network models that more closely mimic natural neural networks. In addition to neuronal and synaptic state, SNNs also incorporate the concept of time into their operating model. The idea is that neurons in the SNN do not fire at each propagation cycle (as it happens with typical multi-layer perceptron networks), but rather fire only when a membrane potential - an intrinsic quality of the neuron related to its membrane Architectures & Technologies Dell EMC | Infrastructure Solutions Group 6

  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30
  • 31
  • 32
  • 33
  • 34
  • 35
  • 36
  • 37
  • 38
  • 39
  • 40
  • 41
  • 42
  • 43
  • 44
  • 45
  • 46
  • 47
  • 48
  • 49
  • 50
  • 51
  • 52
  • 53

Deep Learning Performance: Scale-up vs Scale-out
Architectures & Technologies
Dell
EMC
| Infrastructure Solutions Group
6
2
Introduction
Figure 1: Artificial Intelligence, Machine Learning and Deep Learning [Source: MIT]
Artificial Intelligence
First coined in 1956 by John McCarthy,
AI involves machines that can perform tasks that are
characteristic of human intelligence
. While this is rather general, it includes things like planning,
understanding language, recognizing objects and sounds, learning, and problem solving.
Machine Learning
Arthur Samuel coined the phrase not too long after AI, in 1959, defining it as, “the ability to learn
without being
explicitly programmed.” You see, you can get AI
without
using machine learning,
but this would require building millions of lines of codes with complex rules and decision-trees.
So instead of hard coding software routines with specific instructions to accomplish a task,
machine learning is a way of “training” an algorithm so that it can
learn
how. “Training” involves
feeding massive amounts of data to the algorithm and allowing the algorithm to adjust itself and
improve.
Spiking Neural Networks
Spiking neural networks
(
SNNs
)
are artificial neural network models that more closely mimic
natural neural networks. In addition to neuronal and synaptic state, SNNs also incorporate the
concept of time into their operating model. The idea is that neurons in the SNN do not fire at
each propagation cycle (as it happens with typical multi-layer perceptron networks), but rather
fire only when a membrane potential
an intrinsic quality of the neuron related to its membrane