Last week I reported on RE4AI, Requirements Engineering for Artificial Intelligence. Among other things, it dealt with the limitations and challenges of RE4AI. All well and good, but how do we approach the whole thing in practice? One possible approach is Google PAIR, which is presented below.<\/p>\n\n\n\n\n\n\n\n
Here it goes to the first part<\/a> and here is the paper What's up with Requirements Engineering for Artificial Intelligence Systems?<\/a> by Ahmad et. al.<\/p>\n\n\n\n To better understand the challenges of built-in AI, let's take a look at a prominent example: autonomous driving. A sensible requirement could be:<\/p>\n\n\n\n But the devil is in the detail. Is it always clear what a traffic light is? What does \"run over\" mean? How do we deal with accuracy and precision? What about special cases, such as an approaching vehicle with flashing blue lights? In this case, can the vehicle drive through the red light to make way for the ambulance? How can we tackle these new problems when existing technologies are no longer sufficient?<\/p>\n\n\n\n Google has published a new set of guidelines for developing AI applications with a human-centered approach called PAIR. The authors examine Google PAIR in terms of their findings from the literature review (see part 1<\/a>). Based on this, the authors make recommendations for future RE4AI research.<\/p>\n\n\n\n PAIR stands for \"People + AI Research\", as on the corresponding Google project page<\/a> can be read.<\/p>\n\n\n\n The central part of PAIR is the People + AI Guidebook<\/a>which consists of a collection of methods, best practices and examples for RE4AI. The guidebook consists of 6 chapters, which the authors of the research paper have summarized very nicely as an activity diagram (Figure 7).<\/p>\n\n\n\n Recommendation: Figure 7 in the paper is an extremely useful activity diagram that shows the overall process in a compact form. <\/p>\nDownload paper with Figure 7 now<\/a><\/cite><\/blockquote>\n\n\n\n The chapter structure also describes the step-by-step procedure, with the authors of the paper focusing on the following four.<\/p>\n\n\n\n Google PAIR steps not examined by the authors, but nevertheless central to RE4AI:<\/p>\n\n\n\n The authors found many shortcomings in the development of systems that use AI. By combining these shortcomings with the identified \"best practices\", they make six specific recommendations:<\/p>\n\n\n\n Many problems only benefit from AI to a limited extent. The authors recommend planning a checkpoint during development at which the following questions must be answered: What problem does the system solve? Why is it needed? How will it be used? Does AI add value to the previous points? Does the organization have the resources to develop an AI product?<\/p>\n\n\n\n Many AI systems have problems because the specifications simply do not cover the aspects relevant to AI, such as data collection, data protection, etc. The authors recommend developing a reference system for AI systems that brings together all the requirements relevant to AI systems in a matrix. Until we have such a reference system, guidelines such as Google PAIR in RE4AI can serve us well.<\/p>\n\n\n\n The authors found that a suitable modeling language can be very effective for the development of AI systems. Two of the studies examined suggested developing a separate modeling language for AI4RE. Alternatives already exist today, but classic modeling languages such as SysML<\/a> only suitable to a limited extent.<\/p>\n\n\n\n In practice, communication between these three roles does not work well, partly because the responsibilities are not clearly delineated. The authors recommend structuring this accordingly and working with a collaboration platform.<\/p>\n\n\n\n With AI applications, there are rarely yes\/no decisions. Many factors flow into the overall result. We need to take a systematic approach here. This usually boils down to a quantitative evaluation with corresponding weightings, as recommended by PAIR. There are countless criteria. Which is better: a more accurate algorithm or one that explains the results better? Are the disadvantages of false negatives significantly higher than false positives, or are they the same? The trade-off between Precision and recall<\/a> is particularly important for AI applications.<\/p>\n\n\n\n Most AI projects start with existing systems and functioning development processes. Many things work. Therefore, we need to be systematic and only start where RE4KI requires new approaches, for example because we can collect data in new ways. To do this, the authors suggest creating a taxonomy that lists all the different techniques and methods required when building AI systems. Until we have this, we should proceed systematically and ensure that our adaptations to methods and techniques achieve positive results.<\/p>\n\n\n\n Today, we still have many gaps in the development of AI-based products. These will certainly be eliminated in the coming years. To develop such products today, it helps to be aware of these gaps. The authors have also pointed to Google PAIR as a powerful tool for RE4AI. The recommendations will help you to safely cross this minefield in your own environment - and to inspire the market with impressive, AI-based products.<\/p>\n\n\n\n Photo by KOBU Agency<\/a> on Unsplash<\/a><\/p>","protected":false},"excerpt":{"rendered":" Last week I reported on RE4AI, Requirements Engineering for Artificial Intelligence. Among other things, it dealt with the limitations and challenges of RE4AI. All well and good, but how do we approach the whole thing in practice? One possible approach is Google PAIR, which is presented below.<\/p>","protected":false},"author":1,"featured_media":4687,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[110,518],"tags":[100,656,429,654],"class_list":["post-4675","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-anforderungen","category-kuenstliche-intelligenz","tag-anforderungen","tag-google-pair","tag-machine-learning","tag-re4ai"],"_links":{"self":[{"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/posts\/4675","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/comments?post=4675"}],"version-history":[{"count":0,"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/posts\/4675\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/media\/4687"}],"wp:attachment":[{"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/media?parent=4675"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/categories?post=4675"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.se-trends.de\/en\/wp-json\/wp\/v2\/tags?post=4675"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}AI in products: The new challenges<\/h2>\n\n\n\n
Google PAIR<\/h2>\n\n\n\n
\n
\n
\n
Recommendations for RE4AI<\/h2>\n\n\n\n
Conclusion: a lot to do<\/h2>\n\n\n\n