I want to load the Hortonworks sandbox VirtualBox/VMware image in Google Compute Engine. Is it possible? If yes, how?
I am able to load the image locally in the laptop, but that eats up all the resources and slows down everything.
An easier approach to trying out HDP on Google Compute Engine would be to use bdutil to deploy a Hadoop cluster which you can configure to install any subset of HDP components, rather than converting a VM image from one format to another.
There are two possible approaches:
Using bdutil, modify ambari_env.sh and add ZEPPELIN to the list of services in AMBARI_SERVICES variable to get it installed at the same time as other services.
Alternatively, use Ambari UI after your cluster is deployed to add the Zeppelin service.
Related
I currently have two project stage and prod all my docker images are managed using container repository.
I would like to be able to deploy my images from prod to staging to app engine.
It looks like the best practices for this would be to create a service account that has access to google storage on prod.
I have done that but I'm not sure how to integrate that into my CI pipeline when I'm already logged into gcloud using a staging account. Also, how do I get app engine to pull from that repo?
All images are indeed stored on a bucket called artifacts.[PROJECT-ID].appspot.com. When using CI, make sure that you either added project-wide Storage Object Viewer or defined this role for the service account directly on the bucket (or separately on files).
When using AppEngine, there is also a Service Account called [PROJECT-ID]#appspot.gserviceaccount.com. Try to give access to the bucket to this SA as well so it can pull images into AE.
We are trying to create a horizontaly Scalable web service via Google Compute Engine.
In order to do so, we have created an Instance Template and a Group of Instances based on this new template. The group of instances create a new virtual machine (we chose Debian) in which we can install our NodeJs application and other stuff.
We unlucky found out that when the VM is turned off everything inside the VM is erased. We would like to create a Snapshot or a Disk Image in order to avoid completely rebuild an instance from sketch, but we encountered two problems:
You can't create a Disk Image while the VM is running but if we turn it off we would lose all data in it.
It is possible to create a Snapshot of a VM while it is running but when you create a new instance from the Snapshot we can't link/join the new instance to the Group of Instances.
How can we get to the solution with those tools?
Thanks
Although it is recommended to shutdown your VM instance before creating an image, it is possible to create an image of a running system.
Connect to your instance (SSH, RDP, etc.)
Shutdown the applications that you can such as databases, etc. This purpose is to minimize disk activity and changes to the file system.
Sync the file system to disk. Linux sudo sync. Windows: Sysinternals wrote Sync which will help. Sysinternals's Sync
Go to the Google Console -> Compute Engine ->Disks.
Select your the disk drive for the VM instance.
At the top of the screen will be a button CREATE IMAGE.
Click the button and complete the dialog.
Make sure that you click the button Keep instance running (not recommended).
Once the image completes, I would launch a new instance and verify that you have everything and that everything is working as expected.
Note: You can also create a disk snapshot.
Can we upload and add our applications to already existing sample Images available on AWS Appstream2.0?
It gives the option of creating a new Image through Image Builder and then gives the steps ahead. But is it not possible that we upload our application to Images available by AWS?
You can deploy your application on the app stream using an interactive method or by uploading the application on s3.
The wizard that you use depends on your browser and application installer.
The 10 step process to deploy custom application on the App stream is detailed here.
Is there a way to create a VM instance on Google Cloud using a VHD? It looks pretty straight forward and well documented on the Azure cloud but there is no information I can find on G-Cloud.
Seems like I'm wasting my time recreating my servers on the Google Cloud and I'm quickly losing site of the value of the Google Cloud.
You can bring your own image to GCE. You can follow the instruction on the public documentation on GCE. There's also this video that explains the process.
VHD and VHDX virtual disk files can be converted to GCE compatible disks using steps here. For more sophisticated workflows the image import workflows in the compute-image-tools repository can be useful.
I am working on an HTML5 web application, which I need to host in Google cloud platform.
How can I deploy the web application, which is based on HTML5/CSS3, jQuery to Google Cloud platform/App Engine?
Clarification:
My web application is build using HTML5/CSS3 with javascript to process data. I am using Visual Studio IDE for development of the same. As per my understanding, apart from the supported languages like java, Python, etc, we can deploy html5 web application to Google cloud platform. How can I package my HTML5 application, which is not using any specific language and deploy to App Engine?
Thanks
Ambily
You can deploy to a bucket directly:
The Website Configuration feature enables you to configure a Google
Cloud Storage bucket to simulate the behavior of a static website. You
can define main pages or directory indices (for example, index.html)
for buckets and "directories". Also, you can define a custom error
page in case a requested resource does not exist.
No programming language at all required :)
Google Cloud Storage
You need a account with Google Cloud Platform to start with. Assuming you have that.
Go to cloud console where you find all the admin menus for creating instances.
You need to create a compute engine instance, if you want to create full fledged website.
Steps to follow:
Create a instance (linux, 10GB disk, 1.7GB memmory) and configure it for all required components.
After this you can move your files to your website folder usually "htdocs"
You will be assigned with an empirical IP address.
Using zone management tools you can add a new domain. All that using the admin panel, no complexity involved.
You may required to configure proxy, if you need access to other machines.