Search

Historic Voicebot

Made by 8BitsAndAByte

About the project

Have a chat with your favourite person from the past with the Historic Voicebot!

Project info

Difficulty:

Estimated time:

2 months

Published:

17th June 2019

Items used in this project


Hardware components

Google AIY Voice Kit for Raspberry Pi x 1
HDMI 7 800x480 Display Backpack - With Touchscreen x 1
Frame x 1
Vintage Phone x 1

Software app and online services

Google Dialogflow
Amazon Web Services AWS EC2
Node.js

Hand tools and fabrication machines

Soldering iron (generic) x 1
Hand saw x 1
Hot glue gun (generic) x 1

Story


Overview

Below a quick overview of the content.

  • Introduction and showcase video
  • Concept
  • Architecture
  • Step 1: Chatbot
  • Step 2: Touchscreen
  • Step 3: Break
  • Step 4: Vintage Phone & Voice Kit
  • Step 5: Test!

Introduction and showcase video

Have a chat with your favourite person from the past with the Historic Voicebot! With this interactive installation, you can talk to a historical figure through both chat and voice. Made using Dialogflow, Node.js, HTML Canvas, an AIY Voice Kit, a Raspberry Pi and a vintage phone.

Concept

A quick sketch of the concept:

Concept Sketch

The concept consists of two parts:

  • A touchscreen with animations of a historical figure. The touchscreen also displays the dialog and has buttons so people can ask a FAQ.
  • A physical phone that captures speech and give audio output, so it can be used to ask questions and listen to the answer.

Architecture

To bring the concept to life, I’ve outlined the following architecture:

The Historic Voicebot Architecture

The three main parts are:

  • The backend, which includes Dialogflow and a Node.js server
  • The frontend, which consists of a HTML Canvas page
  • The interactive installation, which includes a touchscreen and an AIY Voice Kit integrated into a vintage phone

Step 1: Chatbot

Dialogflow To create the conversational agent in Dialogflow, I tried and tested a number of different approaches to get the most accurate and reliable answers possible. I also set out to automate as much of the dialog creation as possible.

I found that in this case the easiest and most reliable way of adding knowledge to a Dialogflow chatbot was by adding a CSV file with question and answer pairs.

For the Historic Voicebot, I’ve manually created 20 question & answer pairs and added these to Dialogflow. As you can see, Ada Lovelace’s answers are correct, timely and reliable.

You can find more information about Dialogflow right here.

Ada can talk!

Node.js Server As mentioned in the architecture, the Node.js server is the brains of the operation, providing the connection between Dialogflow and the different devices.

For the first versions, the server was running locally on my laptop. For the current version, the server is deployed on an EC2 Amazon Web Services server running Ubuntu.

There are some great tutorials on Node.js and running it on AWS.

Step 2: Touchscreen

Graphics The animations for the Historic Voicebot were created by cutting various elements, like the arms, eyebrows and chin, out of a painting of Ada Lovelace using Adobe Photoshop. Each of these elements were individually placed on the HTML Canvasfrontend. The TweenJSJavaScript library was used to move and animate these cut-outs based on the input from users and the responses from Dialogflow.

HTML Canvas animations

Touchscreen

Frame To complete the picture, an old frame was cut to the size of the touchscreen. As always, measure twice, cut once.

Step 3: Break

Don’t forget to take a relaxing break every once in a while!

Sleeping beauty!

Step 4: Vintage Phone & Voice Kit

For the phone I tried to find one that was used during the Ada Lovelace era. Not only were phones invented long after she died, really old phones are hard to come by. Nevertheless, I was able to purchase an old Ericsson rotary phone produced in the 1960’s.

1960's phone

To create the working voicebot, I aimed to place the AIY kit inside the phone whilst reusing as many of the original features as possible.

The AIY Voice Kit

I was able to reuse the speaker and the two bells inside the phone. The rotary disk was also kept intact, but is currently not functional. I updated the microphone that was inside the handle to a modern one, to be able to accurately capture the audio input. I replaced the old phone cord with a new one to be able to correctly wire the new microphone.

New microphone and original speaker

Step 5: Test!

Does it actually work? Only one way to find out, let’s test it!

The Historic Voicebot

That’s it for the Historic Voicebot project, talk to you later!

Bye!

Credits


8BitsAndAByte

We’re Dane & Nicole, two makers that create tremendously terrible tech, which we happily share with you on our channel! https://www.youtube.com/c/8bitsandabyte


Leave your feedback...