Speech recognition with Web Speech API on Chrome Android browser - google-chrome

I am developing a Vue web app and using Web Speech API for voice recognition.
The recognition on the desktop Chrome browser is alright but the voice recognition on the Android Chrome browser is not up to the mark.
I am not sure if this is an issue of browser setting or the speech recognition API is not enough mature in the Android Chrome Browser.
Using the speech to text APIs like Google Cloud, AVS is an option but it has a cost impact. So wanted to check if good voice recognition is possible without using them. Any pointers to how can I increase the accuracy of voice recognition on Android chrome?
Screenshot from Chrome on my laptop:
Screenshot from Chrome on Android phone:
My code for using Web Speech API:
this.recognition = new webkitSpeechRecognition() || new SpeechRecognition();
this.recognition.interimResults = true;
this.recognition.lang = this.lang();
this.recognition.start()
this.recognition.onresult = (event) => {
for (let i = event.resultIndex; i < event.results.length; ++i) {
self.query = event.results[i][0].transcript
}
}
this.recognition.onend = () => {
this.recognition.stop()
this.micro = false
this.submit(this.query)
}

Related

SpeechRecognization for firefox web extension

As chrome has webkitspeechrecognition api for speech detection , what can we use for firefox webextension(web speech api not working for me).
I'm making an extension which will continuously listen for speech and then process it.
I have already made a chrome extension which is up and running,so wanted to extend it to Firefox, need an alternative to this line(which is for chrome extension)
recognition = new webkitSpeechRecognition();
I haven't used the Speech Recognition API yet, but you should be able to use
recognition = new SpeechRecognition();
In order for this to work, you need to set
media.webspeech.recognition.enable
to true in about:config. Source: https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_API
There are a number of outstanding bugs around the implementation of Web Speech in Firefox, so I'm not sure the above is implemented or working well. The basic implementation was done in Firefox 44 / 49.

Chrome doesn't support web kit speech?

My browser is upto date with Version 44.0.2403.155 m.
but this link says Your browser does not support web kit speech so a standard input box will be shown. why is that? what did I miss?
That link apparently uses some obsolete implementation.
Chrome platform status site lists a different example: http://simpl.info/stt/
Basic usage example by George Ornbo (more):
var recognition = new webkitSpeechRecognition();
recognition.onresult = function(event) {
console.log(event)
}
recognition.start();

How to implement Chrome Metro mode?

I want implement like Chrome Metro mode in my desktop app.
Please help me.
class WRLAppViewSource : public mswr::RuntimeClass<winapp::Core::IFrameworkViewSource> {
...
};
mswrw::RoInitializeWrapper roinit(RO_INIT_MULTITHREADED);
HRESULT hr;
mswr::ComPtr<winapp::Core::ICoreApplication> core_app;
hr = CreateActivationFactory(
RuntimeClass_Windows_ApplicationModel_Core_CoreApplication,
core_app.GetAddressOf());
HSTRING id;
hr = core_app->get_Id(&id);
auto viewSource = mswr::Make<WRLAppViewSource>();
hr = core_app->Run(viewSource.Get());
"hr = core_app->Run(viewSource.Get()); " return "hr = 0x80004015 : The class is configured to run as a security id different from the caller".
The "Metro mode" environment (typically used by Windows Store apps) that Chrome, IE, and FireFox use is not available to general purpose desktop apps.
Chrome can do this because it is a "New experience enabled desktop browser" and is selected by the user as the default browser. If you change your default browser to IE then Chrome will lose this ability and IE will gain it.
If you are writing a browser then take a look at the Developing a new experience enabled Desktop Browser white paper.
If you are not writing a browser and are trying to add a Windows Store UI to an existing desktop enterprise app then take a look at Brokered Windows Runtime Components (BWRC). BWRCs allow a side-loaded .Net Windows Store app to interop with a desktop component so the Windows Store app can provide a modern UI which connects to an existing back-end.

Capturing images in web application on Windows 8.1 tablets

I am about to develop an application that is to run on Windows 8.1 tablets. An important feature is to be able to click on a button to access the camera to take some pictures. Ideally I would like to create it as a Web application rather than a native application due to a number of reasons (licences, cross-platform, development time: have no experience in native apps, etc.).
I have looked at the options for capturing images from HTML 5 and have found HTML Media Capture which allows me to write:
<input type="file" accept="image/*" capture="camera" />
To get access to the camera. This works great on iPads and on Android tablets, but I can't get it to work on Windows 8 tablets. I have tried using Chrome on the Windows 8 tablet, but still no effect. All it does is that it opens a file dialog in which I can choose a file to upload. What I want to do is to be able to capture a new image. This standard is not supported by IE (an apparently the other browsers cannot access the device's camera either).
I have also stumbled across Media Capture and Streams which seems to be mostly related to showing streams from e.g. the web cam, but probably could be used to capture images and is supported by Chrome and Firefox among other browsers, but still not by Internet Explorer (even IE11). None of the three browsers' implementations seem to work on my Windows 8.1 test machine though. If someone has gotten getUserMedia to work on Windows 8 tablets in any browser I'm interested in hearing about it.
Anyway, my main question is: Is there any way to access the camera on a Windows 8 tablet using HTML5 from a web application? The only working examples I have seen have relied on a prototype implementation for IE using Active X or solutions that use flash.
EDIT: I would very much prefer to keep it in HTML5/javascript as it has to work offline (using HTML5 Application Cache)
I struggled very much for this solution, at the end I find good a solution. But only can use in windows store apps like chrome windows 8 mode (chrome settings -> relaunch chrome in windows 8 mode) then you can use the normal file input tag in html. when you hit "choose file" u see the image below. Then u can choose camera to add take image from camera.
if you can not see camera in the list, u can install app below.
https://www.microsoft.com/en-US/store/apps/Camera-File-Open-Picker/9WZDNCRFJQVN
So I was running into the exactly same issue. My web app is similar, except I have to do some bar code scanning with the tablet's camera.
I'm using the HTML 5 media api as you commented. In order to make it work in chrome in a Windows 8 Surface Pro, I had to do this:
To enable getUserMedia in Chrome type ‘chrome://flags/’ in URL bar and enable “Enable screen capture support in getUserMedia(). Mac, Windows, Linux, Chrome OS” option.
It was working in my laptop but not in the tablet, after making that change and restarting chrome it worked. Good luck.
Here is the code I ended up using to get around this situation... It appears to work in chrome very well however still no support for Internet Explorer which is known not support getUserMedia. Again I wish this wasn't necessary and windows just supported the take picture feature like iOS and android but it works for now.
Credit:
http://davidwalsh.name/browser-camera
// Put event listeners into place
window.addEventListener("DOMContentLoaded", function() {
// Grab elements, create settings, etc.
var canvas = document.getElementById("canvas"),
context = canvas.getContext("2d"),
video = document.getElementById("video"),
videoObj = { "video": true },
errBack = function(error) {
console.log("Video capture error: ", error.code);
};
// Put video listeners into place
if(navigator.getUserMedia) { // Standard
navigator.getUserMedia(videoObj, function(stream) {
video.src = stream;
video.play();
}, errBack);
} else if(navigator.webkitGetUserMedia) { // WebKit-prefixed
navigator.webkitGetUserMedia(videoObj, function(stream){
video.src = window.webkitURL.createObjectURL(stream);
video.play();
}, errBack);
}
else if(navigator.mozGetUserMedia) { // Firefox-prefixed
navigator.mozGetUserMedia(videoObj, function(stream){
video.src = window.URL.createObjectURL(stream);
video.play();
}, errBack);
}
document.getElementById("snap").addEventListener("click", function() {
context.drawImage(video, 0, 0, 640, 480);
});
}, false);
getUserMedia interface works in Chrome on my Surface 2, prove:
I've implemented solution described here:
http://www.html5rocks.com/en/tutorials/getusermedia/intro/
Btw, there is a working example on their site as well:
getUserMedia doesn't work in IE
getUserMedia probably works in FF, but I didn't test
access to the camera from [Browse] button doesn't work in any browser on my Surface 2
EDIT: Just realized, my approach doesn't work on Surface any more. Same story for the html5rocks page, the example given doesn't work on Surface. I guess, new Chrome version stopped to support something. BUT I've found the example which works on Surface for Chrome and Firefox, here you are:
http://www.ceng.metu.edu.tr/~e1559848/demos/qrdecode/index.html

navigator.online can't detect 3G network in blackberry html5 app

I am new to blackberry development. I am creating a html5 app for blackberry.
I need to check the internet connection in every page.So i did this as below in every page.
In javascript
var a=navigator.online
if(a)
{
// nothing
}
else
{
alert("check for internet connection");
}
It is working in Blackberry OS 6 & 7 properly.
But when the mobile is having blackberry OS5 it is showing the else statement.(which should not happen ideally)
Please help me out regarding this.
Thanks