Algoliterary Bibliography
From Algolit
These are the texts which surrounded us during the work sessions on natural language processing within machine learning.
Contents
Neural networks and language
- CS224n: Natural Language Processing with Deep Learning (Stanford course) - http://web.stanford.edu/class/cs224n/syllabus.html
- GloVe: Global Vectors for Word Representation - https://nlp.stanford.edu/projects/glove/
- The Unreasonable Effectiveness of Recurrent Neural Networks - http://karpathy.github.io/2015/05/21/rnn-effectiveness/
Bias in language
- Caliskan, A., Bryson, J. J. and Narayanan, A., 2017. Semantics derived automatically from language corpora contain human-like biases. Science, 356 (6334), pp. 183-186.
- Bolukbasi, T., Chang, K. W., Zou, J. and Saligrama, V., 2016. Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings. CoRR.
- Rob Speer, How to make a racist AI without really trying - https://gist.github.com/rspeer/ef750e7e407e04894cb3b78a82d66aed#file-how-to-make-a-racist-ai-without-really-trying-ipynb
Free online books on neural networks and deep learning
- Ian Goodfellow, Yoshua Bengio and Aaron Courville, Deep Learning - http://www.deeplearningbook.org/
- Michael Nielsen, Neural Networks and Deep Learning - http://neuralnetworksanddeeplearning.com
Background articles on neural networks
- Neural Networks, Manifolds, and Topology - http://colah.github.io/posts/2014-03-NN-Manifolds-Topology/
- Visualizing Representations: Deep Learning and Human Beings - http://colah.github.io/posts/2015-01-Visualizing-Representations/
Books
- Halpern, O., 2014. Beautiful Data: A History of Vision and Reason since 1945, Duke Press - https://www.dukeupress.edu/beautiful-data, http://www.orithalpern.net/
- Hayles, Katherine N., 2016. Unthought. The Power of Cognitive Nonconscious
Software for Deep Learning and neural networks
- Tensorflow (Google): https://www.tensorflow.org/
Tensorflow has become a major programming framework for neural networks. On the website a range of tutorials can be found to tackle machine learning problems, although for new users it can be useful to read some introductory literature on Tensorflow to grasp better how an algorithm is build up in Tensorflow. Good introductions are:
- Sam Abrahams, Danijar Hafner, Erik Erwitt, Ariel Scarpinelli, TensorFlow for Machine Intelligence. A Hands-On Introduction to Learning Algorithms. Bleeding Edge Press (2016)
- Rodolfo Bonnin, Building Machine Learning Projects with TensorFlow. Packt Publishing (2016)
- Nick McClure, TensorFlow Machine Learning Cookbook. Packt Publishing (2017) (more in-depth but also a bit steeper learning curve)
Simulation tools
- Simulation of NN in browser: http://playground.tensorflow.org
- Nice introduction using this tool: https://cloud.google.com/blog/big-data/2016/07/understanding-neural-networks-with-tensorflow-playground