JabberChess by Jackson Chen

JabberChess by Jackson Chen


Hello my name is Jackson Chen
and I would like to introduce
JabberChess, the first ever speech activated mobile
chess app. With JabberChess,
you can use your voice to play a game of chess. Therefore
it is the first ever mobile
chess app that allows visually impaired users to play
chess. Regular users can use
this app to play visualization chess games as
well as blindfold chess games.
Let me show you how it works. First of all, you can use your
voice to start JabberChess. Use
Siri. ‘Open JabberChess.’ As you can see,
JabberChess has started. Now
that JabberChess is launched,
you can talk to the app. First look at the layout. The
top two thirds of the screen is
a chess board, and then the bottom one third
of the screen is a white
notation area, so in order to talk to JabberChess,
you need to activate the speech
recognizer. To do this, you’ll need to swipe in
the bottom notation area which
consists of the bottom one-third of the screen. Here’s how you can do it. Let’s
say we want to tell JabberChess
to start a new game and have me as a white
player and the computer engine
as a black player. ‘New game with white’. ‘Game
Ready’. As you can see, JabberChess
started a new game and notified
me that the game is ready. I’m
the white player and the chess engine is
the black player. Now we can
start to play the game. JabberChess understands chess
algebraic notation, so if I
wanted to play the move e4, I just say ‘e4’. ‘White
moved e4, black moved c6.’ As you can
see, JabberChess played the
move e4 for me, and then the
engine responded with the move c6. In addition te human language. For example, I
can tell JabberChess to move my
knight from the square b1 to the square c3.
‘Move the knight from b1 to
c3.’ ‘White move knight c3,
black move d5.’ I can also ask JabberChess if
there is a piece on a specific
square. For example, ‘Is there a piece
at c3?’ ‘White knight on c3’. Or, if I don’t remember how
many knights I have on the
board, I can just ask
JabberChess, ‘How many nights do I have?’
‘There are two white knight’.
Or, if I wanted to know where
my bishops were on the board, I can ask
JabberChess, Where are my
bishops? ‘White bishop on c1,
f1’. Or, if wanted to know where my
opponent’s knights were, I can
simply ask JabberChess, ‘Where
are their nights?” ‘Black night on b8, g8.’ I can also ask JabberChesss to
tell me the location of both my
pieces and my opponent’s pieces
on the chessboard. For example, ‘Where are the queens?’ ‘Black
queen on g8, white queen on
g1.’ In addition, if I wanted to
know the location of all the
pieces on the chessboard I can
just ask JabberChess, ‘Show Position’. If you have used the Stockfish
app before this chessboard
should look very familiar to you. That’s because
JabberChess is built on top of
the open-source Stockfish engine and app. Stock. I added a speech control module
inside the stock fish app to
make it speech activated. All of the
original functionalities are
still working as is. For example, I can still use
the regular touch screen actions to play a game. My speech control module uses
speech recognition and natural language
understanding technology from
Nuance Mix, a developer platform from
Nuance Communications, a world
leader in voice and natural language understanding
technology. As you can see, the app allows
blind users to be able to play
chess. With the generosity of
Nuance Communications, JabberChess is
free to all visually impaired
users. If you have any questions,
please don’t hesitate to
contact me at
[email protected]

2 thoughts on “JabberChess by Jackson Chen

Leave a Reply

Your email address will not be published. Required fields are marked *