Skip to content
Satyam Mittal edited this page Mar 8, 2020 · 4 revisions

Project descriptions

Phase 1: Voice Enabled Chatbot

Implementing a voice enabled chatbot which converses with a user via their voice in natural language. The user should be able to interact with the application like a voice assistant and appropriate responses should be returned by the application (also through voice). The number of topics to converse upon will be fixed however the user should be able to converse through natural language.

Objectives

For this project you would

Tasks: Main task is to create open source alternate to Google DialogFlow. Before starting Conversation, bot will fetch the location of the user and other details to give personalized results.

Step 1: Speech-2-Text: Given a speech through Microphone, Store it and Convert it using SpeechRecognition and PyAudio.

Step 2: Topic Modelling: Get Entity and Intent of chat using model with a corpora. To get the trained model, we will use the classifier to categorize it to weather, location and inventory. After that using RASA-NLU with Spacy library, we will get the entities.

Step 3: After Finding Intent and Entity, we will set model in following method: Intent = Weather: Based on entity specified, We will use weather API to get data about location. Intent = Location: Following Conversation flow: Get Stores located or Any Nearby Stores Choose Store Inventory Details about Store

Step 4: Use cache mechanism to give result about recently used query.

Students will be involved in following features: a) Completing chat bot so that it works on multiple domain specified through config. b) Adding classification techniques for intent separation. c) Automated method for Entity creation from sentences. d) Use cache mechanism to give result about recently used query. e) At the end, the deliverable will be to implement user interface for a sample chatbot implemented. f) We will also extend it to create plugin for companies requiring chatbot. They can put their domain in config file and data separately to give personalized result.

Mentors

  • @satyam.mittal
  • @phpduke

Technologies

  • python
  • nlp
  • machine-learning

Phase 2: Chatbot Sharing Dashboard

It provides users to upload their chatbots model file. It also lists down current chatbots available on the platform to download. We have various feature requests built on integrating various chatbots and providing a platform to run chatbots.

Objectives

  1. Common Dashboard where users can sign in and submit their model through a form.
  2. Listing down the chatbot response through user session.
  3. Where users can integrate chatbots and download them.

Mentors

  • @satyam.mittal

Technologies

  • golang
  • angularjs/reactjs

Phase 3: Android Support APK (Frontend)

We are building a jar file to provide plugins for android apps that extend our chatbot support in their applications. It allows app to have built-in built-in voice enabled support for their customers.

Objectives

  1. Build a jar file that support api integration of our backend system.
  2. Jar file support voice recognition and provide response of intent page needed to be open at that session.

Mentors

  • @satyam.mittal
  • @phpduke

Technologies

  • android studio
  • java
  • xml
  • javascript