I'm using the JUnit runner in IntelliJ to run all tests in a package. When I run my tests in isolation they pass, when I run the entire package some fail, suggesting interplay between the tests. I'd like to force the tests to be run in serial rather than parallel to prove this - can anyone tell me how I can configure this to happen?
Thanks
Tests don't run in parallel, at least not in IDEA 9.x. Unless you are using IDEA 10 EAP, your problem is different and you need to provide more details to get a good answer.
Related
We need to use the Github action self-hosted runner because we need to have an access to the on-premises resource.
I understand that we can run the self-hosted runner on VM or the docker container.
Can we run the self-hosted runner on-demand? Like the Github-hosted runner that always use the clean isolated VM and is destroyed at the end of job execution. Or like the job agents on Azure DevOps/Github that created the clean job agent container to run the pipeline and gets deleted at the end.
Can we do something similar with Gihub-action self-hosted runner? E.g. Allow us to register a VM with the Docker engine or Kubernetes cluster as a self-hosted runner. When I run the Github workflow, it should start a container and run the workflow inside that container. After that, it should delete the container.
Is it possible to do that now? I am not sure if there is a roadmap document somewhere for Github action.
If you use AWS, you can try ec2-github-runner. It does exactly what you're looking for.
I believe the same approach can also be implemented for the other cloud providers.
GitHub itself doesn't provide such capabilities at the moment.
I think the question is a little bit misleading but, if I understand properly, what you are trying to achieve is to have stateless GitHub Actions workflow run execution in your self-hosted runner. Unfortunately, this is currently impossible. Only GitHub-hosted runners work the way you describe. According to the documentation:
GitHub-hosted runner is always a clean isolated virtual machine, and it is destroyed at the end of the job execution.
You can read more about the differences between each runner type here.
What is the best way to run an API test that was created via the IBM API Connect Test and Monitor ?
I published a test and I would like my CI sever (jenkins or azure devops) to run it?
Many thanks,
Assaf
Great question Assaf. It is currently not possible in the product, however, is on the roadmap and is coming soon.
We will have APIs and Webhooks to help execute tests as part of your CI/CD processes. Meaning, the same tests you generated using the test composer and run in production can be recycled to ensure your deployments are error free.
As well, Jenkins is an industry standard so we will be providing a plugin to help facilitate the API testing processes via GUI. More details to come, will update this space when it does.
Alternatively keep your eye out here: http://ibm.biz/apitest
I've built my container multiple times successfully, as noted by the image below. Each time it remains on 99% for > 20+ mins AFTER saying 'Finished: SUCCESS' in the logs. It never makes it past this. I cant kick off the deploy phase until the build registers completion. Is there a way to get past this hang?
I've got no notable errors in the console. The build is based on the registry.ng.bluemix.net/ibmnode:latest image, runs an apache2 server with some Node.js processes that run during the build phase. And lastly, it kicks off a bash script to run apache2 in the foreground.
I just checked my toolchain and wasn't able to reproduce this problem. Please try again, it might have been a transient issue with the toolchains.
If the problem persists, it might have to do with how you have your build script setup. If you are spawning processes and leaving them running, that could be stopping the build from finishing.
How can I check if a build is running for more than X minutes? Does Hudson have some XML API for it? I want the API to be independent of the job, so I can call a URL from my remote machine to check if Hudson is executing any build or any job for more than x minutes.
It may be the case that the job that Hudson is executing is stuck or hanged. How can I identify that?
My idea is if a build is taking too long I will just restart the system or kill all its processes
I will call a URL, say http://myhudsonserver/something, and I should get some XML by which I can make out.
You could use the build timeout plugin.
You may find the Hudson Remote Access API of use.
I'm drowning in the Selenium documentation. What I've got so far is the ability to record a script in FireFox, export it to the new WebDriver format (JUnit4), open and tweak the test in Eclipse, then run it as a JUnit test in Eclipse.
What I'm wanting next:
to run the same test on multiple browsers
to have a suite of tests run on a remote server at a set interval
receive notification if a test fails
Is this possible using the path I've started down above? It's hard to tell, but I'm not sure that WebDriver is compatible with the RC server. Or, should I just take my suite of JUnit tests and integrate them with something like Cruise Control?
Thank you...
to run the same test on multiple browsers
See: How to run Google Chrome with Selenium RC?
to have a suite of tests run on a remote server at a set interval
This is hard, especially when you are running on headless (terminal only) machine. See this article. But not impossible, read further.
receive notification if a test fails
The typical configuration is to use CI server like Bamboo, take advantage of cargo-maven-plugin to deploy your application and run Selenium tests during integration-test phase. Easier said than done. Since CI server is typically headless, you will need freaks of nature like xvfb, taking a lot of screenshots since you have no idea what is happening during the build when it fails, and so on... But it is possible, we managed to setup such a process in our company and are very happy for it.
Bromine helps you to run on several browsers. Regarding "Scheduling" as already said, maven would help. Try to gather infos about Hudson. It helps a lot in scheduling. It supports selenium too. It helps to send notification also.