{"id":985,"date":"2016-03-04T01:05:45","date_gmt":"2016-03-04T01:05:45","guid":{"rendered":"http:\/\/ec2-52-79-86-100.ap-northeast-2.compute.amazonaws.com\/?p=985"},"modified":"2024-05-01T11:54:39","modified_gmt":"2024-05-01T02:54:39","slug":"answering-tasks-for-ai","status":"publish","type":"post","link":"https:\/\/blog.themusio.com\/?p=985","title":{"rendered":"Answering Tasks for AI"},"content":{"rendered":"

Goal<\/strong>
\nThe aim of this short summary is to provide an overview of the tasks an AI system is, should be and will be capable to execute in the near future.<\/p>\n

In particular we focus on classifying tasks with respect to NLP.<\/p>\n

Motivation<\/strong>
\nWhen testing existing algorithms it is of great importance to have a clear interpretation of the results.
\nThis can be achieved by setting up specific learning environments in such a way that the complexity of the task is always under control.
\nMore generally, the state-of-the-art problems determine next development steps for Musio.<\/p>\n

Ingredients<\/strong>
\ncommon sense, coreference, compound, conjunction, deduction, induction, argument relation, counting, negation, indefinite knowledge, time reasoning, positional and size reasoning, path finding, motivational reasoning.<\/p>\n

Steps<\/strong>
\nLet us start by mentioning several AI tests which are out there.
\nThe Allen Institute for AI provides a test on general knowledge, called ARISO, in the form of science exams for 4th, 8th and 12th grade students.
\nThese exams take the form of multiple choice questions and only recently the best algorithms on the 8th grade exam reached a score of 0.60.
\nA test that is more standardized is the Winograd schema challenge, where a sentence with a coreference and two possible word choices has to be completed.
\nBoth these tests require general knowledge about the world which is not provided in the test situation.<\/p>\n

In contrast the follow tests contain the required background knowledge in order to answer distinct questions.
\nThe MCTest provides 660 stories with associated multiple choice questions, which each assume a different reasoning.
\nMore specific is the Children’s book test (CBT) which measures language modeling in a wider linguistic context by the before mentioned sentence completion task.<\/p>\n

Closely related to real-world tasks are the following tests.
\nThe CNN QA tests is based on news articles with abstract bullet point summaries which have been rephrased as questions.
\nFocusing on the topic movies, the Movie dialog data set allows to ask factoid questions and provides recommendations.
\nDespite being limited topic-wise this task is more suited for training and building dialog systems.<\/p>\n

A different approach to overcoming the general scarcity of large datasets is based on simulating the needed data.
\nClearly, this does not allow to capture the complexity of natural language however in this way it is possible to specify certain classes of self-contained tasks.
\nOnly to name a few here, supporting fact questions require to distinguish between given relevant and irrelevant facts, deduction and induction assume a certain logic reasoning and positional and size reasoning allow to recognize objects.
\nAmong the hardest tasks is path finding according to a relative description between to points A and B with respect to a point C.
\nEspecially, tasks that require a kind of long term memory provide hard tasks.<\/p>\n

Appropriated tested algorithms take the form of N-Gram models, structured support vector machines or certain types of recurrent neural networks.<\/p>\n

Very promising are also memory networks with neural components.<\/p>\n

With regard to Musio’s focus on emotional and sentimental reasoning tasks beyond logical reasoning should be considered.<\/p>\n

Resources
\n<\/strong>“TOWARDS AI-COMPLETE QUESTION ANSWERING: A SET OF PREREQUISITE TOY TASKS<\/a>“(PDF). TOWARDS AI-COMPLETE QUESTION ANSWERING: A SET OF PREREQUISITE TOY TASKS.<\/em> December 2015. Retrieved Feburary 23, 2016.
\n<\/em>“Task generation for testing text understanding and reasoning<\/a>“(GIT). Task generation for testing text understanding and reasoning<\/em>. Retrieved Feburary 23, 2016.
\n“Artificial Tasks for Artificial Intelligence<\/a>” (PDF).\u00a0Artificial Tasks for Artificial Intelligence. <\/em>May 2015.\u00a0Retrieved Feburary 23, 2016.
\n“THE GOLDILOCKS PRINCIPLE: READING CHILDREN\u2019S BOOKS WITH EXPLICIT MEMORY REPRESENTATIONS<\/a>“(PDF). THE GOLDILOCKS PRINCIPLE: READING CHILDREN\u2019S BOOKS WITH EXPLICIT MEMORY REPRESENTATIONS<\/em>. January 2016.\u00a0Retrieved Feburary 23, 2016.
\n“Teaching Machines to Read and Comprehend<\/a>” (PDF). Teaching Machines to Read and Comprehend.\u00a0<\/em>November 2015. Retrieved February 23, 2016.
\n“EVALUATING PREREQUISITE QUALITIES FOR LEARN- ING END-TO-END DIALOG SYSTEMS<\/a>” (PDF). EVALUATING PREREQUISITE QUALITIES FOR LEARN- ING END-TO-END DIALOG SYSTEMS<\/em>. Jan 2016.\u00a0Retrieved Feburary 23, 2016.<\/p>\n","protected":false},"excerpt":{"rendered":"

Goal The aim of this short summary is to provide an overview of the tasks an AI system is, should be and will […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[3642,3640],"tags":[3650,3652,4172,4080,3760,3656,3762,3658,3788,3700,3662,4050,4082,4316,4174,3702,3664,3816,4146,3710,4310,3712,4084,4318],"class_list":["post-985","post","type-post","status-publish","format-standard","hentry","category-ai-en","category-all-en","tag-ai-ja-en","tag-aka-ja-en","tag-algorithms-ja-en","tag-answers-en","tag-artificial-intelligence-en","tag-baggage-en","tag-children-book-ja-en","tag-christmas-en","tag-classifier-en","tag-cmos-en","tag-cognitive-behavioral-therapy-en","tag-coherence-of-values-en","tag-communication-robot-en-en","tag-conditional-random-fields-en","tag-connection-en","tag-contents-en","tag-crowd-funding-en","tag-language-en","tag-memory-en","tag-musio-en","tag-n-gram-en","tag-neural-networks-en","tag-questions-ja-en","tag-tasks-en"],"aioseo_notices":[],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/blog.themusio.com\/index.php?rest_route=\/wp\/v2\/posts\/985","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.themusio.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.themusio.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.themusio.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.themusio.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=985"}],"version-history":[{"count":3,"href":"https:\/\/blog.themusio.com\/index.php?rest_route=\/wp\/v2\/posts\/985\/revisions"}],"predecessor-version":[{"id":10903,"href":"https:\/\/blog.themusio.com\/index.php?rest_route=\/wp\/v2\/posts\/985\/revisions\/10903"}],"wp:attachment":[{"href":"https:\/\/blog.themusio.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=985"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.themusio.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=985"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.themusio.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=985"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}