Actions

Algoliterary Encounters: Difference between revisions

From Algolit

 
(98 intermediate revisions by 4 users not shown)
Line 1: Line 1:
 
__NOTOC__
 
__NOTOC__
 
+
== About ==
Start of the Algoliterary Encounters catalog.
+
* [[An Algoliterary Journey]]
 
+
* [[Program]]
== General Introduction ==
 
 
 
* [[Introduction Algolit]]
 
  
 
==Algoliterary works==
 
==Algoliterary works==
* Oulipo scripts
+
A selection of works by members of Algolit presented in other contexts before.
* i-could-have-written-that interfaces
+
* [[i-could-have-written-that]]
* Obama, model for a politician
+
* [[The Weekly Address, A model for a politician]]
* ClueBotNG, a special Algolit edition
+
* [[In the company of CluebotNG]]
 +
* [[Oulipo recipes]]
  
 
==Algoliterary explorations==
 
==Algoliterary explorations==
===A few outputs to see how it works===
+
This chapter presents part of the research of Algolit over the past year.
* CHARNN text generator
 
* [[talking_about_machine_learning]] - exploring the vocabulary of machine learning textbooks in 7 stages with word2vec
 
  
===Parts of NN process===
+
=== What the Machine Writes: a closer look at the output ===
 +
Two neural networks are presented more closely, what content do they produce?
 +
* [[CHARNN text generator]]
 +
* [[You shall know a word by the company it keeps]]
  
 +
=== How the Machine Reads: Dissecting Neural Networks ===
 
==== Datasets ====
 
==== Datasets ====
* [[the data speaks]]
+
Working with Neural Networks includes collecting big amounts of textual data.
 
+
We compared a 'regular' size with the collection of words of the Library of St-Gilles.
==== From words to numbers ====
+
* [[Many many words]]  
* [[bag-of-words]]
 
* [[one-hot-vector script]] & [[word embeddings]]
 
 
 
==== Different views on the data ====
 
* tensorflow projector visualisation of high dimensional data
 
* [[5 dimensions 32 graphs]]
 
* GloVe dataset sorted alphabetically
 
 
 
==== Creating word embeddings using word2vec ====
 
* [[word2vec applications]] - this can serve as an introduction to word2vec?
 
* [[word2vec_basic.py]] - in piles of paper
 
* [[softmax annotated]]
 
* [[chatbot for word mathematics]]
 
 
 
=== Autonomous machine as inspection ===
 
* AI script showing racist bias using supervised classical ML & NN embeddings
 
 
 
===Algoliterary Toolkit===
 
* cgi interface template
 
* [[text-punctuation-clean-up.py]]
 
 
 
===Bibliography===
 
* [[Algoliterary Bibliography]] - Reading Room texts
 
 
 
  
 +
=====Public datasets=====
 +
Most commonly used public datasets are gathered at [https://aws.amazon.com/public-datasets/ Amazon].
 +
We looked closely at the following two:
 +
* [[Common Crawl]]
 +
* [[WikiHarass]]
  
 +
=====Algoliterary datasets=====
 +
Working with literary texts allows for poetic beauty in the reading/writing of the algorithms.
 +
This is a small collection used for experiments.
 +
* [[The data (e)speaks]]
 +
* [[Frankenstein]]
 +
* [[Learning from Deep Learning]]
 +
* [[nearbySaussure]]
 +
* [[astroBlackness]]
  
 +
==== From words to numbers ====
 +
As machine learning is based on statistics and math, in order to process text, words need to be transformed to numbers. In the following section we present three technologies to do so.
 +
* [[A Bag of Words]]
 +
* [[A One Hot Vector]]
 +
* [[About Word embeddings|Exploring Multidimensional Landscapes: Word Embeddings]]
 +
* [[Crowd Embeddings|Word Embeddings Casestudy: Crowd embeddings]]
  
 +
===== Different vizualisations of word embeddings =====
 +
* [[Word embedding Projector]]
 +
* [[The GloVe Reader]]
  
 +
===== Inspecting the technique behind word embeddings =====
 +
* [[word2vec_basic.py]]
 +
* [[Reverse Algebra]]
  
 +
=== How a Machine Might Speak ===
 +
If a computer model for language comprehension could speak, what would it say?
 +
* [[We Are A Sentiment Thermometer]]
  
===== multidimensionality =====
+
== Sources ==
 +
The scripts we used and a selection of texts that kept us company.
 +
* [[Algoliterary Toolkit]]
 +
* [[Algoliterary Bibliography]]
  
"In most of the cases the meaning will come through multiple dimensions." (Richard Socher, CS224D Lecture 2)
 
  
* digital interactive visualisation & printed visualisation 1 poster for 1 dimension (total could be 30 posters)
+
[[Category:Algoliterary-Encounters]]
   
 
===== output =====
 

Latest revision as of 13:50, 2 November 2017

About

Algoliterary works

A selection of works by members of Algolit presented in other contexts before.

Algoliterary explorations

This chapter presents part of the research of Algolit over the past year.

What the Machine Writes: a closer look at the output

Two neural networks are presented more closely, what content do they produce?

How the Machine Reads: Dissecting Neural Networks

Datasets

Working with Neural Networks includes collecting big amounts of textual data. We compared a 'regular' size with the collection of words of the Library of St-Gilles.

Public datasets

Most commonly used public datasets are gathered at Amazon. We looked closely at the following two:

Algoliterary datasets

Working with literary texts allows for poetic beauty in the reading/writing of the algorithms. This is a small collection used for experiments.

From words to numbers

As machine learning is based on statistics and math, in order to process text, words need to be transformed to numbers. In the following section we present three technologies to do so.

Different vizualisations of word embeddings
Inspecting the technique behind word embeddings

How a Machine Might Speak

If a computer model for language comprehension could speak, what would it say?

Sources

The scripts we used and a selection of texts that kept us company.