Tutorial on distributional semantics (vector space models)

A nice tutorial by Chris Potts :

http://web.stanford.edu/class/linguist236/materials/ling236-handout-05-09-vsm.pdf

Python: encoding/decoding a string starting with \x

If a string starts with \x (e.g., '\xea \xe1\xeb\xe8\xe6\xed\xe5\xec\xf3' for cyrillic) decode it using 'string_escape' :

string=string.decode('string_escape')

Lowercase strings in file

 Lowercase strings in text file using sed(works for cyrillic):
 sed -e 's/\(.*\)/\L\1/' file