Google API OCR Language Hint - ocr

I am using the Googel Vision API to detect English.
However, Korean cannot be detected.
I am using bitmap image for recognition. It is source.
TextRecognizer textRecognizer = new TextRecognizer.Builder (this) .build ();
Frame imageFrame = new Frame.Builder ()
.setBitmap (bitmap)
.build ();
SparseArray textBlocks = textRecognizer.detect (imageFrame);
In the case of Google Vision API, if use Language Hint, need to communicate (json) with Google Cloud ???

Related

Google Vision API not detecting any languages

Summary
We are processing a document through Google Vision API to generate OCR from the document. However, the Cloud Vision API's text recognition feature is intermittently not recognizing any languages in a document -- even in documents that are 100% a single language.
What have we tried
While the OCR Language Support documentation, recommends not supplying language hints while using DOCUMENT_TEXT_DETECTION in order to gain full, auto-detected language detection, we have tried supplying the language hint of the known language but still no languages are detected.
Additionally, if we take the OCR output that was generating via Cloud Vision and pass that to Google Translate, Cloud Translation, or Amazon Comprehend, they all return the desired language.
Example
Using this document as an example and with the following code (some code removed for brevity/security), Google Cloud Vision does not detect any languages.
const vision = require('#google-cloud/vision').v1;
const client = new vision.ImageAnnotatorClient(authOptions());
const inputConfig = {
mimeType: 'application/pdf',
gcsSource: {
uri: 'our-gcsSource',
},
};
const features = [{ type: 'DOCUMENT_TEXT_DETECTION' }];
const request = {
requests: [
{
inputConfig,
features,
},
],
};
const [operation] = await client.asyncBatchAnnotateFiles(request);
// Additional code removed for brevity

Is it possible to load new Cloud (BIM 360) links in a Revit model either through the Revit API or FORGE API?

I have a two-part WPF App and Revit Addin that runs a series of routines to create and activate a new BIM 360 project via the FORGE BIM 360 API, launches Revit and creates and sets up a collection of Revit models from a "seed" Revit model. The primary requirement is to have zero user interaction in this process: to be fully automated.
Given that background, I am having trouble linking the newly saved BIM 360 models to one-another. I have the option to do this either in the Revit Addin with Revit API hooks (preferred) or through the manager WPF App with FORGE API REST calls after the models are created.
Is either one possible?
I have successfully linked with the cached local models as described here and here. However, this does not meet the requirement fully, since when any other user (besides the automation machine user) opens the model the links are Not Found.
Screenshot of links Not Found.
Current "sort-of-working" code:
var wId = GetWorksetId(doc, w);
if (wId != null)
{
string localPath = settings.CloudModels.Where(x => x.ModelName == _linkModelNames[i]).Select(x => x.LocalFilePath).First();
ModelPath path = ModelPathUtils.ConvertUserVisiblePathToModelPath(localPath);
using (var options = new RevitLinkOptions(true))
{
using (var t = new Transaction(doc, w))
{
t.Start();
doc.GetWorksetTable().SetActiveWorksetId(wId);
using (var result = RevitLinkType.Create(doc, path, options))
{
_ = RevitLinkInstance.Create(doc, result.ElementId);
}
t.Commit();
linkPlaced++;
}
}
}
I was able to get the correct ModelPath via the Revit API thanks to this helpful tip. I can save this value in my Addin, close the model, and access the property later after opening a different model (saved in the CloudModels class referenced in the linq statement in the code snippet above). Unfortunately for me RevitLinkType.Create() that takes a ModelPath does not accept the cloud path, so I may have hit another dead end. Unless it is possible with an ExternalResourceReference. Has anyone tried this option? If so, how do you assemble a Revit ExternalResourceReference? I am not familiar with this process, and looking over this course from AU 2017, I don't see that it necessarily applies to BIM 360 cloud models. A BIM 360 cloud example would be very helpful if this is possible.
Alternate strategy: I do not see any reference to loading links in the FORGE Data Management API or other FORGE APIs. If I have somehow missed it, please share a link.
Any help would be very much appreciated!!
EDIT: I have since found these two (1) (2) similar questions that, at least for my purposes, were not answered satisfactorily. Any updates I should be aware of?
As of now (Jan 2020), unfortunately, we do not have a Link API for cloud models. It is on the roadmap.
Revit API 2022 docs mention that
The methods:
RevitLinkType.Create(Document, ModelPath, RevitLinkOptions)
RevitLinkType.LoadFrom(ModelPath, WorksetConfiguration)
have been enhanced to support creation of new cloud model Revit links.
You may use ModelPathUtils.ConvertCloudGUIDsToCloudPath() to
create a cloud path to use as an argument to these methods.
Additional Resource:
This Youtube Video showcases an example and its respective Github repo.
For Revit 2021 and below, you can use ExternalResourceReference() as a workaround, but I've noticed that this is not always reliable.
Its also mentioned in the documentation of InSessionPath property to not rely on this property:
Do not rely on this path (InSessionPath ) to look up an ExternalResourceReference, as the path is neither unique nor stable. It isn't unique because multiple servers might use the same server name and display name format. It isn't stable because some servers allow renaming, and because a server might change its name at some point.
Below is the code to do that:
var linkCloudPath = doc.GetCloudModelPath(); // the cloudpath of a BIM360 model
Guid linkedmodelguid = linkCloudPath.GetModelGUID();
Guid linkedprojectguid = linkCloudPath.GetProjectGUID();
Dictionary<string, string> Dictionary_ExternalResource = new Dictionary<string, string>(){
{"LinkedModelModelId", modelGuid.ToString()},
{"LinkedModelProjectId", projGuid.ToString()}
};
Dictionary<string, Guid> servers = new Dictionary<string, Guid>();
foreach (var service in ExternalServiceRegistry.GetServices())
{
if (service.Name == "External Resource Service")
{
IList<Guid> server_ids = service.GetRegisteredServerIds();
foreach (var server_id in server_ids)
{
servers.Add(service.GetServer(server_id).GetName(), server_id);
}
}
}
Guid BIM360ServerID = servers["BIM 360"];
ExternalResourceReference ERS = new ExternalResourceReference(BIM360ServerID, Dictionary_ExternalResource, "", "");
RevitLinkOptions options = new RevitLinkOptions(false);
LinkLoadResult result = RevitLinkType.Create(gcdoc, ERS, options);
RevitLinkInstance.Create(gcdoc, result.ElementId);
Please note that this seems to be working fine in Revit 2020, but not in Revit 2021.
I believe it is possible to create links to the Cloud Models in Revit 2019 or higher (with ModelPathUtils.ConvertCloudGUIDsToCloudPath()). You'll need the ProjectGUID and ModelGUID to make the cloud model path.
Regarding the ExternalResource approach, that also works - but it's super messy - you can read the properties associated with existing BIM360 links and you'll see how an ExternalResource is defined for BIM360 links.
Finally - as of today, the Forge Design Automation for Revit approach would not work for you at all:
1. Not possible to open a live cloud workshared model (only published/uploaded models).
2. No network access while you're running in a Design Automation for Revit session.
Good luck...
-Matt

Customizing Drawing tool in Autodesk Forge Viewer throws error

I am using the Autodesk Forge Viewer API to render the AutoCAD drawing files on the web page. It is working perfectly.
Then I followed the below tutorial to provide markup/annotation support on the viewer.
https://developer.api.autodesk.com/viewingservice/v1/viewers/docs/tutorial-feature_markup.html
Though I am able to get different drawing tools to work as expected, the customizing the color of the markup is throwing an error.
vm.onColorChange = function (e) {
var styleAttributes = ['stroke-color'];
var nsu = Autodesk.Viewing.Extensions.Markups.Core.Utils;
var styleObject = nsu.createStyle(styleAttributes, vm.markupsExtension.viewer);
var selectedColor = $('#sel-colors').val();
styleObject['stroke-color'] = selectedColor;
vm.markupsExtension.setStyle(styleObject);
};
When I debugged the code on the developer tool, the below line in the 'Markups.js' is throwing the error 'getStrokeWidth' is undefined.
I am using the Forge viewer version 6. Is there anything changed for customizing the drawing tool with the latest version of the viewer or is the tutorial still relevant for the current version.
The second argument to pass in to Markups.Core.Utils.createStyle should be the current active Markup tool object, not the Viewer itself:
var markupExt = Viewer.getExtension("Autodesk.Viewing.Markups ore");
var styleObj = Autodesk.Viewing.Extensions.Markups.Core.Utils.createStyle([...], markupExt)
That bit of the tutorial is incorrect and will be rectified soon.

Trying to get Google Drive to work with PCL Xamarin Forms application

I’m using Xamarin Forms to do some cross platform applications and I’d like to offer DropBox and GoogleDrive as places where users can do backups, cross platform data sharing and the like. I was able to get DropBox working without doing platform specific shenanagins just fine, but Google Drive is really giving me fits. I have my app setup properly with Google and have tested it with a regular CLI .NET application using their examples that read the JSON file off the drive and create a temporary credentials file – all fine and well but getting that to fly without access to the file system is proving elusive and I can’t find any examples on how to go about it.
I’m currently just using Auth0 as a gateway to allow users to provide creds/access to my app for their account which works dandy, the proper scope items are requested (I’m just using read only file access for testing) – I get an bearer token and refresh token from them – however when trying to actually use that data and just do a simple file listing, I get a 400 bad request error.
I’m sure this must be possible but I can’t find any examples anywhere that deviate from the slightest of using the JSON file downloaded from Google and creating a credentials file – surely you can create an instance of the DriveService object armed with only the bearer token...
Anyway – here’s a chunk of test code I’m trying to get the driveService object configured – if anyone has done this or has suggestions as to what to try here I’d very much appreciate your thoughts.
public bool AuthenticationTest(string pBearerToken)
{
try
{
var oInit = new BaseClientService.Initializer
{
ApplicationName = "MyApp",
ApiKey = pBearerToken,
};
_googleDrive = new DriveService(oInit);
FilesResource.ListRequest listRequest = _googleDrive.Files.List();
listRequest.PageSize = 10;
listRequest.Fields = "nextPageToken, files(id, name)";
//All is well till this call to list the files…
IList<Google.Apis.Drive.v3.Data.File> files = listRequest.Execute().Files;
foreach (var file in files)
{
Debug. WriteLine(file.Name);
}
}
catch (Exception ex)
{
RaiseError(ex);
}
}

Add new voices for Windows Phone (WinRT) speech synthesizer

Using the speech-to-text WinRT API:
private async Task SynthesizeSpeech(string text)
{
var synthesizer = new SpeechSynthesizer();
var media = new MediaElement();
var stream = await m_Synthesizer.SynthesizeTextToStreamAsync(text);
m_Media.SetSource(stream, stream.ContentType);
m_Media.Play();
}
You can set the synthesizer's voice by choosing from the available ones on the device:
var voice = SpeechSynthesizer.AllVoices
.FirstOrDefault(voice => voice.Language.StartsWith("es"));
My Windows Phone (8.1) includes a voices: an English, Japanese, and Chinese, male and female.
My question is: is there any way to install new voices onto the device (or better yet, include them with my app)?
Settings -> Speech lets you install new speech voices onto the phone. (I still don't know how to install it from a resource in my app, or at least provide a link to the user of my app to install it.)