Pydata2017 11-29
44
2017-09-29@ PyData Tokyo
-
Upload
yuta-kashino -
Category
Software
-
view
2.340 -
download
2
Transcript of Pydata2017 11-29
2017-09-29@ PyData Tokyo
Yuta Kashino ( )
BakFoo, Inc. CEO Astro Physics /Observational Cosmology Zope / Python Realtime Data Platform for Enterprise Prototyping
arXiv
PyCon2015
Python
PyCon2016
PyCon2017 DNN PPL Edward @yutakashino
Yuta Kashino ( )
…
TensorFlow eager
Dynamic: Define By Run
Static: Define AND Run
TensorFlow eager
Dynamic: Define By Run
…
TensorFlow- API : tf.contrib
- : ecosystem(spark, hadoop, kubenates)
- : tfdbg, tensorboard
- : Feature Columns
- : OpenMPI+ , Horovod(uber)
- : Lite, Mobile
- : XLA
- : TPU
- : GCP
: DL-
-
-
-
- AI - Google, NVIDIA, Intel, AMD, Apple, Huwei, Baidu, MS, FB… - Graphcore, Groq, DeePhi, BitMain…
DL-
-
-
- …
-
-
- AI …
DL- TensorFlow
-
-
-
-
PyTorch - Torch 7 Chainer
-
- Adam Paszke - Sam Gross - Soumith Chintala
- NYU FBAIR
- 2017 2 v0.1.6
PyTorch - 2017 2 v0.1.6
Google Trend
PyTorch - TF/Keras …
Google Trend
- GPU(CUDA)
- Define by Run:
- Pythonic + python
http://pytorch.org/tutorials/advanced/numpy_extensions_tutorial.html
autograd.Variable-
- data, grad (, grad_fn) - chainer Variable
- autograd.Variable Chainer fork
- backward()
data gradgrad_fn
autograd.Variable
data gradgrad_fn
x
data gradgrad_fn
y
data gradgrad_fn
z
autograd …- NLP DyNet 10
- Python addmm
- ATen
- v.0.3.0 autograd ATen
https://twitter.com/kchonyc/status/899832376955744257
https://github.com/zdevito/aten
https://goo.gl/Tujudr
https://github.com/ilkarman/DeepLearningFrameworks
NN- torcn.nn
chainer.Chain
chainer.links
chainer.functions
chainer
chainer.ChainList
GPU- CPU → GPU: Variable cuda()
- GPU → CPU: cpu()
chainer
Chainer- Chainer
- GPU Chainer
- Chainer
- torch.optim = chainer.optimizers - …
- pytorch/tnt = chainer.training
- Pythonic …
https://github.com/pytorch/tnt
Chainer
- PyTorch
- PyTorch
- Awesome-Pytorch-list, The Incredible PyTorchhttps://github.com/bharathgs/Awesome-pytorch-list https://github.com/ritchieng/the-incredible-pytorch
-
→
→
- …
→ PyTorch
-
Capsule Nets- Hinton CapculeNets 2017 10 26
- 10 29 TensorFlow/Keras/PyTorchhttps://github.com/timomernick/pytorch-capsule https://github.com/gram-ai/capsule-networks
https://arxiv.org/abs/1710.09829
https://github.com/naturomics/CapsNet-Tensorflow https://github.com/XifengGuo/CapsNet-Keras
/-
- CNN/RNN: torch.nn, torchvision.models - GAN
-
https://github.com/Cadene/pretrained-models.pytorch
https://github.com/szagoruyko/functional-zoo
https://github.com/wiseodd/generative-modelshttps://github.com/znxlwm/pytorch-generative-model-collections
https://github.com/aaron-xichen/pytorch-playground
https://github.com/sdhnshu/pytorch-model-zoo
DAG- PyTorch DAG
- pyro
- gpytorch
- CUDA FFT pytorch_fft
- sequence-to-sequence fairseq-py
https://github.com/uber/pyro
https://github.com/jrg365/gpytorch
https://github.com/locuslab/pytorch_fft
https://github.com/facebookresearch/fairseq-py
-
- StackOverFlowhttp://pytorch.org/tutorials/
https://discuss.pytorch.org/latest
- PyTorchZeroToAll - Practical Deep Learning with PyTorch on Udemy - fast.ai
https://www.udemy.com/practical-deep-learning-with-pytorch
http://www.fast.ai/2017/09/08/introducing-pytorch-for-fastai/
https://goo.gl/kt3uV2
- conda
DL
BakFoo, Inc.NHK NMAPS: +
BakFoo, Inc.PyConJP 2015
Python
BakFoo, Inc.: SNS +
