GSoC'20 : Using a Game Controller as a Navigation Aid

Tony Atkins tony at
Tue Mar 17 10:15:51 UTC 2020

Hi, Nakul.

Thanks for posting. I wanted to comment a bit on your ideas about
using/enabling search, especially voice search.  It's an interesting
addition to the core idea, but does add a requirement for both end users
and the implementation.  End users have to have a microphone.  The
implementers have to figure out a cross-platform way to support voice
input.  It's also not clear to me whether there are voice search solutions
within a page (Google's Voice Search searches the whole web).  You'd also
have to put a little thought into how the user's focus might change as they
use a voice search.

Anyway, those are my rough thoughts.  To be clear for you and others,
additions like this that have the potential to complement the core idea are
welcome, but you need to back up the unique parts you're adding with some
details in your proposal.



On Mon, 16 Mar 2020 at 10:37, Nakul Tyagi <nakul1tyagi at> wrote:

> Hi,
>  I am Nakul Tyagi an aspirant of GSOC 2020, currently a 3rd year BTech
> student of Bharati Vidyapeeth's College Of Engineering . I am a Web
> Developer and also loves developing games . I am interested to work on the
> Gamepad Navigation Aid project during Inclusive Design Institute's GSoC'20
> program.
> We face problem of using mouse in between games or videos many times which
> really gets frustrating as it just breaks the rhythm of the player or the
> viewer. Now with increasing gaming and streaming reach this problem needs
> to be solved quickly to provide users a better experience .I would like to
> help solving this problem as it is affecting a large group of community
> members and users.
> My 30 minutes of experience of browsing the web without a mouse can be
> found here:
> Technical Aspects and Solution,
> 1. During my analysis I experienced that navigating on a particular
> application or site with a lot of content is tough , going to the content
> directly really needs some hard work so it is better to use search bar if
> available or using javascript we can add feature to access different
> elements on page at a time.
> 2.Shortcuts for switching applications and tabs must be mapped with the
> gamepad for easy navigation.
> 3.For easy and accurate search search by voice feature can help .
> 4. Voice to text feature can help in filling forms and other fields.
> As far as my exploration goes till now we can use Gamepad API that allows
> us to access the state of connected gamepads using JavaScript,with the help
> of this these games can now be played on the web with the same gamepads
> that are used for consoles.
> The Chrome functionalities can be added using Chrome Extension
> -chrome.tabs API.
> For mapping the keys to a gamepad we can use javascript in frontend to
> handle the mapping and Gamepad.mapping feature of the Gamepad.
> I hope you like my inputs and solutions. I am eagerly waiting for mentors
> reviews and suggestions . I would really like to contribute to this
> projects as it matches my skills set perfectly.
> --
> Regards
> Nakul ;)
> _______________________________________________________
> fluid-work mailing list - fluid-work at
> To unsubscribe, change settings or access archives,
> see
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <>

More information about the fluid-work mailing list