Description
Explore the adoption of chatbots in business by focusing on the design, deployment, and continuous improvement of chatbots in a business, with a single use-case from the banking and insurance sector. This book starts by identifying the business processes in the banking and insurance industry. This involves data collection from sources such as conversations from customer service centers, online chats, emails, and other NLP sources. You’ll then design the solution architecture of the chatbot. Once the architecture is framed, the author goes on to explain natural language understanding (NLU), natural language processing (NLP), and natural language generation (NLG) with examples. In the next sections, you’ll design and implement the backend framework of a typical chatbot from scratch. You will also explore some popular open-source chatbot frameworks such as Dialogflow and LUIS. The authors then explain how you can integrate various third-party services and enterprise databases with the custom chatbot framework. In the final section, you’ll discuss how to deploy the custom chatbot framework on the AWS cloud. By the end of Building an Enterprise Chatbot, you will be able to design and develop an enterprise-ready conversational chatbot using an open source development platform to serve the end user. What You Will Learn Identify business processes where chatbots could be used Focus on building a chatbot for one industry and one use-case rather than building a ubiquitous and generic chatbot Design the solution architecture for a chatbot Integrate chatbots with internal data sources using APIs Discover the differences between natural language understanding (NLU), natural language processing (NLP), and natural language generation (NLG) Work with deployment and continuous improvement through representational learning Who This Book Is For Data scientists and enterprise architects who are currently looking to deploy chatbot solutions to their business. Ssu ti/jidNGNZ3/J08yC1dNv9v8AAAA//8DAFBLAwQUAAYACAAAACEArTA/8cEAAAAyAQAACwAAAF9y ZWxzLy5yZWxzhI/NCsIwEITvgu8Q9m7TehCRpr2I4FX0AdZk2wbbJGTj39ubi6AgeJtl2G9m6vYx jeJGka13CqqiBEFOe2Ndr+B03C3WIDihMzh6RwqexNA281l9oBFTfuLBBhaZ4ljBkFLYSMl6oAm5 8IFcdjofJ0z5jL0MqC/Yk1yW5UrGTwY0X0yxNwri3lQgjs+Qk/+zfddZTVuvrxO59CNCmoj3vCwj MfaUFOjRhrPHaN4Wv0VV5OYgm1p+LW1eAAAA//8DAFBLAwQUAAYACAAAACEAUUzzwMUCAABKBgAA HwAAAGNsaXBib2FyZC9kcmF3aW5ncy9kcmF3aW5nMS54bWysVF1v2yAUfZ+0/4B4b23nY02sulWb tdWkrouS9gfcYGyjYfCAOEl//a6xU3vd1knb/BLIPRzOOVw4v9yXktTcWKFVQqPTkBKumE6FyhP6 9Hh7MqPEOlApSK14Qg/c0suL9+/OIc4NVIVgBBmUjSGhhXNVHASWFbwEe6orrrCWaVOCw6nJg9TA DplLGYzC8ENQglD0oqf6CA7I1oi/oJKafeXpAlQNFikli4f/dBol+3dmiFV9Z6p1tTSNcvZQLw0R aUIxOQUlRkSDrtDBcBq8WpX3BPvMlA1eZxnZJ3Qym82nSHVI6NloPA/Dlo3vHWFYjkbjcXSGdYaA aDoO57Npt1/x5U0GVtz8gQNFtmJwMBBoq0aeqn92PD46XnGGLZJLTsYv5o9wW93j0Vii9KJADL8y Ru8KDqlFAw0ad8MQW7jPqV+JyW52n3WKocLWad8q/yevF68QV8a6O65L0gwSatCL3wjqe+tafUdI E4TVUqS3Qko/MflmIQ2pQSb01n+dpR9gUpEdup2HeLJvc4T++xVHKRw3RIoyobMXEMRNkjcq9S3n QMh2jPak8tHark/dfu3P0e2vdXpoRGzwFwM2Gk1jQ+EbgINCm2dKdnizE2q/bcFwSuQnhWc1jyYT hDk/mUzPRjgxw8pmWAHFkCqhjpJ2uHA4wyXbyoi8wJ0in4TSV3iwmeiCbjU16qR1a3eQ3BvzytEI KcHcexocrPwAZI7vFnPG00m1rphPuGJL5tpziaIpBtZlOkRc8+yIdbbFHmG2Yn31KnOvcVHPiFAP wMy7rLlKl2BghYIltnxCuTp5WuM7+oy2caWXyrMMO61tMbQLTijiDhXPgGG7L0CKjRGNaIg5/K7C 7KDyKEpuyQPfkZUuQXWGezG+HzBKFNp3wdbyddXc37bT2zZBRHPrg1evqF/avfrNUz2cX3wHAAD/ /wMAUEsDBBQABgAIAAAAIQDhUTcfzwYAAOYbAAAaAAAAY2xpcGJvYXJkL3RoZW1lL3RoZW1lMS54 bWzsWc1v3EQUvyPxP4x8b7PfzUbdVNnNbgNt2ijZFvU4a8/a04w91sxs0r2h9oiEhCiIA5W4cUBA pVbiUv6aQBEUqf8Cb2ZsryfrkLSNoILmkLWff/O+35uvy1fuxQwdECEpT3pe/WLNQyTxeUCTsOfd Go8urHpIKpwEmPGE9Lw5kd6V9fffu4zXfEbTCcciGEckJggYJXIN97xIqXRtZUX6QMbyIk9JAt+m XMRYwasIVwKBD0FAzFYatVpnJcY08daBo9KMhgz+JUpqgs/EnmZDUIJjkH5zOqU+Mdhgv64Rci4H TKADzHoe8Az44ZjcUx5iWCr40PNq5s9bWb+8gteyQUydMLY0bmT+snHZgGC/YWSKcFIIrY9a3Uub BX8DYGoZNxwOB8N6wc8AsO+DpVaXMs/WaLXez3mWQPZxmfeg1q61XHyJf3NJ526/3293M10sUwOy j60l/Gqt09poOHgDsvj2Er7V3xgMOg7egCy+s4QfXep2Wi7egCJGk/0ltA7oaJRxLyBTzrYq4asA X61l8AUKsqHILi1iyhN1Uq7F+C4XIwBoIMOKJkjNUzLFPuTkAMcTQbEWgNcILn2xJF8ukbQsJH1B U9XzPkxx4pUgL599//LZE3R0/+nR/Z+OHjw4uv+jZeSM2sJJWB714tvP/nz0MfrjyTcvHn5RjZdl /K8/fPLLz59XA6F8FuY9//Lxb08fP//q09+/e1gB3xB4UoaPaUwkukEO0S6PwTDjFVdzMhGvNmIc YVoesZGEEidYS6ngP1SRg74xxyyLjqNHn7gevC2gfVQBr87uOgrvRWKmaIXka1HsALc5Z30uKr1w TcsquXk8S8Jq4WJWxu1ifFAle4ATJ77DWQp9M09Lx/BBRBw1dxhOFA5JQhTS3/g+IRXW3aHU8es2 9QWXfKrQHYr6mFa6ZEwnTjYtBm3RGOIyr7IZ4u34Zvs26nNWZfUmOXCRUBWYVSg/Jsxx41U8Uziu YjnGMSs7/DpWUZWSe3Phl3FDqSDSIWEcDQMiZdWYmwLsLQX9GoaOVRn2bTaPXaRQdL+K53XMeRm5 yfcHEY7TKuweTaIy9gO5DymK0Q5XVfBt7laIfoc44OTEcN+mxAn36d3gFg0dlRYJor/MhI4ltGqn A8c0+bt2zCj0Y5sD59eOoQE+//pRRWa9rY14A+akqkrYOtZ+T8Idb7oDLgL69vfcTTxLdgik+fLE 867lvmu53n++5Z5Uz2dttIveCm1XrxvsotgskeMTV8hTytiemjNyXZpFsoR5IhgBUY8zO0FS7JjS CB6zvu7gQoHNGCS4+oiqaC/CKSyw655mEsqMdShRyiVs7Ay5krfGwyJd2W1hW28YbD+QWG3zwJKb mpzvCwo2ZrYJzeYzF9TUDM4qrHkpYwpmv46wulbqzNLqRjXT6hxphckQw2XTgFh4ExYgCJYt4OUO 7MW1aNiYYEYC7Xc79+ZhMVE4zxDJCAcki5G2ezlGdROkPFfMSQDkTkWM9CbvFK+VpHU12zeQdpYg lcW1ThCXR+9NopRn8CJKum6PlSNLysXJEnTY87rtRttDPk573hT2tPAYpxB1qdd8mIVwGuQrYdP+ 1GI2Vb6IZjc3zC2COhxTWL8vGez0gVRItYllZFPDfMpSgCVaktW/0Qa3npcBNtNfQ4vmKiTDv6YF +NENLZlOia/KwS5RtO/sa9ZK+UwRsRcFh2jCZmIXQ/h1qoI9AZVwNGE6gn6BczTtbfPJbc5Z0ZVP rwzO0jFLI5y1W12ieSVbuKnjQgfzVlIPbKvU3Rj36qaYkj8nU8pp/D8zRc8ncFLQDHQEfDiUFRjp eu15XKiIQxdKI+qPBCwcTO+AbIGzWPgMSQUnyOZXkAP9a2vO8jBlDRs+tUtDJCjMRyoShOxAWzLZ dwqzejZ3WZYsY2QyqqSuTK3aE3JA2Fj3wI6e2z0UQaqbbpK1AYM7nn/ue1ZBk1Avcsr15vSQYu61 NfBPr3xsMYNRbh82C5rc/4WKFbOqHW+G53Nv2RD9YbHMauVVAcJKU0E3K/vXVOEVp1rbsZYsbrRz 5SCKyxYDsVgQpXDeg/Q/mP+o8Jm9bdAT6pjvQm9FcNGgmUHaQFZfsAsPpBukJU5g4WSJNpk0K+va bOmkvZZP1ue80i3kHnO21uws8X5FZxeLM1ecU4vn6ezMw46vLe1EV0Nkj5cokKb5RsYEpurWaRun aBLWex7c/ECg78ET3B15QGtoWkPT4AkuhGCxZG9xel72kFPgu6UUmGZOaeaYVk5p5ZR2ToHFWXZf klM60Kn0FQdcsekfD+W3GbCCy24/8qbqXM2t/wUAAP//AwBQSwMEFAAGAAgAAAAhAJxmRkG7AAAA JAEAACoAAABjbGlwYm9hcmQvZHJhd2luZ3MvX3JlbHMvZHJhd2luZzEueG1sLnJlbHOEj80KwjAQ hO+C7xD2btJ6EJEmvYjQq9QHCMk2LTY/JFHs2xvoRUHwsjCz7DezTfuyM3liTJN3HGpaA Abhishek Singh is on a mission to profess the de facto language of this millennium, the numbers. He is on a journey to bring machines closer to humans, for a better and more beautiful world by generating opportunities with artificial intelligence and machine learning. He leads a team of data science professionals solving pressing problems in food security, cyber security, natural disasters, healthcare, and many more areas, all with the help of data and technology. Abhishek is in the process of bringing smart IoT devices to smaller cities in India so that people can leverage technology for the betterment of life. He has worked with colleagues from many parts of the United States, Europe, and Asia, and strives to work with more people from various backgrounds. In 7 years at big corporations, he has stress-tested the assets of U.S. banks at Deloitte, solved insurance pricing models at Prudential, and made telecom experiences easier for customers at Celcom, and core SaaS Data products at Probyto. He is now creating data science opportunities with his team of young minds. He actively participates in analytics-related thought leadership, authoring, public speaking, meetups, and training in data science. He is a staunch supporter of responsible use of AI to remove biases and fair use of AI for a better society. Abhishek completed his MBA from IIM Bangalore, a B.Tech. In Mathematics and Computing from IITGuwahati, and a PG Diploma in Cyber Law from NALSAR University, Hyderabad. Karthik Ramasubramanian has over seven years of practice and leading Data Science and Business Analytics in Retail, FMCG, E-Commerce, Information Technology for a multi-national and two unicorn startups. A researcher and problem solver with a diverse set of experience in the data science lifecycle, starting from a data problem discovery to creating a data science prototype/product. On the descriptive side of data science, designed, developed and spearheaded many A/B experiment frameworks for improving product features, conceptualized funnel analysis for understanding user interactions and identifying the friction points within a product, designing statistically robust metrics and visual dashboards. On the predictive side, developed intelligent chatbots which understand human-like interactions, customer segmentation models, recommendation systems, identifying medical specialization from a patient query for telemedicine, and many more. He actively participates in analytics related thought leadership, authoring blogs & books, public speaking, meet-ups, and training & mentoring for Data Science. Karthik completed his M.Sc. in Theoretical Computer Science at PSG College of Technology, India, where he pioneered the application of machine learning, data mining, and fuzzy logic in his research work on the computer and network security. Shrey Shivam extensive experience in leading the design, development, and delivery of solutions in the field of data engineering, stream analytics, machine learning, graph databases, and natural language processing. In his seven years of experience, he has worked with various conglomerates, startups, and big corporations and has gained relevant exposure to digital media, e-commerce, investment banking, insurance, and a suite of transaction-led marketplaces across music, food, lifestyle, news, legal and travel. He is a keen learner and is actively engaged in designing the next generation of systems powered by artificial intelligence-based analytical and predictive models. He has taken up various roles in product management, data analytics, digital growth, system architecture, and full stack engineering. In the era of rapid acceptance and adoption of new and emerging technologies, he believes in strong technical fundamentals and advocates continuous improvement through self-learning. Shrey is currently leading a team of machine learning & big data engineers across the US, Europe, and India to build robust and scalable big data pipelines to implement various statistical and predictive models. Shrey has completed his BTech in Information Technology from Cochin University of Science moreover, Technology, India. Chapter 1: Processes in the Banking and Insurance Industry The chapter will focus on explaining some core process within the banking and insurance industry that is suitable for a chatbot application. No of pages: 30 Chapter 2: Identifying the Sources of Data This chapter will discuss sources of data for conversation and action-based event triggers for a chatbot. Conversation courses would be from customer service centers, online chats, emails and other NLP sources, while action sources are customer account details and more personalize data. No of pages: 30 Chapter 3: Mining Intents from the Data Sources This chapter will discuss how to build a business-specific intent engine for chatbots. No of pages: 30 Chapter 4: Building a Business Use-Case This chapter will focus on how to identify the right business process to introduce chatbots. It will also discuss how to look at some of the metrics of success and RoI given a chatbot is deployed. No of pages: 30 Chapter 5: Natural Language Processing (NLP) Chapter Goal: This chapter focusses on processing and understanding natural language through the computer algorithm. It also introduces how to prepare data for applying the NLP algorithms. We will use Stanford CoreNLP, NLTK, gensim, OpenIE tools to explore and model. No of pages: 80 Sub – topics Introduction: Question & answering, information extraction, sentiment analysis, Machine translation, Text processing: Regex, tokenization, normalization – lower case, lemmatization, stemming (Porters Algorithm), sentence segmentation Converting text to features: Syntactical parsing – dependency grammar, PoS, entity parsing – phrase detection, topic modeling, statistical features – TF-IDF, word embeddings Classification – spam filter using nave Bayes, sentiment analysis using SVM on Lexicon and text feature. NLP Tools – nltk, genism, openIE, CoreNLP Chapter 6: Building Chatbots Using Popular Platforms For general purpose chatbots, publicly available cloud services can be used to deploy chatbots faster and without any DevOps overhead. We shall discuss some of the major chatbot development platforms available in the market. No of pages: 50 Sub-Topics Microsoft Bot framework with LUIS Google’s DialogFlow Amazon Lex with Lambda Bottr, Chatfuel and others Open framework RASA and Botpress Chapter 7: Deployment and Continuous Improvement Framework In this chapter we shall discuss and implement a custom built chatbot . We will discuss designing and implementing state machines and their different state transitions, and how they are critical to maintain the context of user utterance as well as in defining the chat flow using sessions that contains long term and short-term attributes. No of pages: 50 Sub-topics: Public endpoint creation Intent engine development and deployment as API Building state machine Integration with Facebook messenger Deployment of chatbot on AWS Logging Mining conversation log to improve intent engine Recommending similar/next questions, pushing information based on needs prediction
