Example of entropy and information gain in NLP

Assume we have a task to classify words into Indonesian/Non-Indonesian. Given a list of words each labeled with either “I” or “NI”, we want to learn a model that fits the data and can be used to predict a new unseen word as Indonesian or Non-Indonesian.

Continue reading


Automatic question generation

.. defines me in several ways.

First, “automatic”. It refers to something that is done, or occurring spontaneously; without conscious thought or attention. Like breathing. Like loving someone (LOL). Reflex. Unconscious. I like thing going as it is. I prefer decide for most things spontaneously, at the moment. If people ask me what are you gonna do if.. what are you gonna do when.. I might answer I won’t know until it happens.

Continue reading