Last summer I blogged about using a Deep Neural Network to generate tweets but only used 3200 of my tweets. Since then I've used Twitter's archive mechanism to retrieve ALL my tweets (just over 30,000) to train a network. Not any old network - the GPT-2 model from OpenAI. This 'finetuning' of an existing...
Gaining insights with Natural Language Processing of Reddit Data to Evaluate Dermatology Patient Experiences and Therapeutics. "There is a lack of research studying patient-generated data on Reddit, one of the world’s most popular forums with active users interested in dermatology. Techniques within...
Source: sciencedirect.com
Improving Language Understanding with Unsupervised Learning: We've obtained state-of-the-art results on a suite of diverse language tasks with a scalable, task-agnostic system, which we're also releasing. Our approach is a combination of two existing ideas: transformers and unsupervised pre-training....
Source: openai.com